Search

The purpose of face super-resolution (FSR) is to reconstruct high-resolution (HR) face images from low-resolution (LR) inputs. With the continuous advancement of deep learning technologies, contemporary prior-guided FSR methods initially estimate facial priors and then use this information to assist in the super-resolution reconstruction process. However, ensuring the accuracy of prior estimation remains challenging, and straightforward cascading and convolutional operations often fail to fully leverage prior knowledge. Inaccurate or insufficiently utilized prior information inevitably degrades FSR performance. To address this issue, we propose a prior knowledge distillation network (PKDN) for FSR, which involves transferring prior information from the teacher network to the student network. This approach enables the network to learn priors during the training stage while relying solely on low-resolution facial images during the testing stage, thus mitigating the adverse effects of prior estimation inaccuracies. Additionally, we incorporate robust attention mechanisms to design a parsing map fusion block that effectively utilizes prior information. To prevent feature loss, we retain multi-scale features during the feature extraction stage and employ them in the subsequent super-resolution reconstruction process. Experimental results on benchmark datasets demonstrate that our PKDN approach surpasses existing FSR methods in generating high-quality face images.

Replica exchange stochastic gradient Langevin dynamics (reSGLD) is an effective sampler for non-convex learning in large-scale datasets. However, the simulation may encounter stagnation issues when the high-temperature chain delves too deeply into the distribution tails. To tackle this issue, we propose reflected reSGLD (r2SGLD): an algorithm tailored for constrained non-convex exploration by utilizing reflection steps within a bounded domain. Theoretically, we observe that reducing the diameter of the domain enhances mixing rates, exhibiting a $\textit{quadratic}$ behavior. Empirically, we test its performance through extensive experiments, including identifying dynamical systems with physical constraints, simulations of constrained multi-modal distributions, and image classification tasks. The theoretical and empirical findings highlight the crucial role of constrained exploration in improving the simulation efficiency., Comment: 28 pages, 13 figures

Based on the factorization framework of nonrelativistic quantum chromodynamics, we study the associated $J/\psi+c+\bar{c}$ photoproduction process at next-to-leading order in $\alpha_s$ and leading order in the velocity expansion. The total cross section and differential cross section in $p_T^2$, $W$ and $z$ are presented. The results indicate that the next-to-leading order corrections are substantial, and testable in experiment., Comment: 15 pages, 3 figures

We provide a Lyapunov convergence analysis for time-inhomogeneous variable coefficient stochastic differential equations (SDEs). Three typical examples include overdamped, irreversible drift, and underdamped Langevin dynamics. We first formula the probability transition equation of Langevin dynamics as a modified gradient flow of the Kullback-Leibler divergence in the probability space with respect to time-dependent optimal transport metrics. This formulation contains both gradient and non-gradient directions depending on a class of time-dependent target distribution. We then select a time-dependent relative Fisher information functional as a Lyapunov functional. We develop a time-dependent Hessian matrix condition, which guarantees the convergence of the probability density function of the SDE. We verify the proposed conditions for several time-inhomogeneous Langevin dynamics. For the overdamped Langevin dynamics, we prove the $O(t^{-1/2})$ convergence in $L^1$ distance for the simulated annealing dynamics with a strongly convex potential function. For the irreversible drift Langevin dynamics, we prove an improved convergence towards the target distribution in an asymptotic regime. We also verify the convergence condition for the underdamped Langevin dynamics. Numerical examples demonstrate the convergence results for the time-dependent Langevin dynamics., Comment: 9 figures, 36 pages

In this paper, on the one hand, we prove that for $n \geq 2$ any subbundle of $T^* \mathbb T^n$ with bounded fibers symplectically embeds into a trivial subbundle of $T^* \mathbb T^n$ where the fiber is an irrational cylinder. This not only resolves an open problem in Gong-Xue's recent work (which was stated for the 4-dimension case, that is, $n =2$) and also generalizes to any higher-dimensional situation. The proof is based on some version of Dirichlet's approximation theorem. On the other hand, we generalize a main result in Gong-Xue's work mentioned above, showing that any topologically trivial Liouville diffeomorphism on $T^*M$ (for instance, a diffeomorphism induced by an isometry on $M$) does not change the full marked length spectrum of a Finsler metric $F$ on $M$, up to a lifting of the Finsler metric $F$ to the unit codisk bundle $D^*_FM$. The proof is based on persistence module theory., Comment: 17 pages, 1 figure

In this paper, we prove that the ${\rm Ham}$-orbit space from a fiber of a large family of cotangent bundles, as a metric space with respect to the Floer-theoretic spectral metric, contains a quasi-isometric embedding of an infinite-dimensional normed vector space. The same conclusion holds for the group of compactly supported Hamiltonian diffeomorphisms of some cotangent bundles. To prove this, we generalize a result, relating boundary depth and spectral norm for closed symplectic manifolds in Kislev-Shelukhin's recent work, to Liouville domains. Then we modify Usher's constructions (which were used to obtain Hofer-large scale geometric properties) to achieve our desired conclusions., Comment: 35 pages, 5 figures

Conventional active array radars often jointly design the transmit and receive beamforming for effectively suppressing interferences. To further promote the interference suppression performance, this paper introduces a reconfigurable intelligent surface (RIS) to assist the radar receiver because the RIS has the ability to bring plentiful additional degrees-of-freedom. To maximize the output signal-to-interference-plus-noise ratio (SINR) of receive array, we formulate the codesign of transmit beamforming and RIS-assisted receive beamforming into a nonconvex constrained fractional programming problem, and then propose an alternating minimization-based algorithm to jointly optimize the transmitor beamfmer, receive beamformer and RIS reflection coefficients. Concretely, we translate the RIS reflection coefficients design into a series of unimodular quadratic programming (UQP) subproblems by employing the Dinkelbach transform, and offer the closed-form optimal solutions of transmit and receive beamformers according to the minimum variance distortionless response principle. To tackle the UQP subproblems efficiently, we propose a second-order Riemannian Newton method (RNM) with improved Riemannian Newton direction, which avoids the line search and has better convergence speed than typical first-order Riemannian manifold optimization methods. Moreover, we derive the convergence of the proposed codesign algorithm by deducing the explicit convergence condition of RNM. We also analyze the computational complexity. Numerical results demonstrate that the proposed RIS-assisted array radar has superior performance of interference suppression to the RIS-free one, and the SINR improvement is proportional to the number of RIS elements., Comment: 29 pages, 9 figures

Diffusion models have become the go-to method for large-scale generative models in real-world applications. These applications often involve data distributions confined within bounded domains, typically requiring ad-hoc thresholding techniques for boundary enforcement. Reflected diffusion models (Lou23) aim to enhance generalizability by generating the data distribution through a backward process governed by reflected Brownian motion. However, reflected diffusion models may not easily adapt to diverse domains without the derivation of proper diffeomorphic mappings and do not guarantee optimal transport properties. To overcome these limitations, we introduce the Reflected Schrodinger Bridge algorithm: an entropy-regularized optimal transport approach tailored for generating data within diverse bounded domains. We derive elegant reflected forward-backward stochastic differential equations with Neumann and Robin boundary conditions, extend divergence-based likelihood training to bounded domains, and explore natural connections to entropic optimal transport for the study of approximate linear convergence - a valuable insight for practical training. Our algorithm yields robust generative modeling in diverse domains, and its scalability is demonstrated in real-world constrained generative modeling through standard image benchmarks.

Neural radiance field (NeRF) has achieved great success in novel view synthesis and 3D representation for static scenarios. Existing dynamic NeRFs usually exploit a locally dense grid to fit the deformation field; however, they fail to capture the global dynamics and concomitantly yield models of heavy parameters. We observe that the 4D space is inherently sparse. Firstly, the deformation field is sparse in spatial but dense in temporal due to the continuity of of motion. Secondly, the radiance field is only valid on the surface of the underlying scene, usually occupying a small fraction of the whole space. We thus propose to represent the 4D scene using a learnable sparse latent space, a.k.a. SLS4D. Specifically, SLS4D first uses dense learnable time slot features to depict the temporal space, from which the deformation field is fitted with linear multi-layer perceptions (MLP) to predict the displacement of a 3D position at any time. It then learns the spatial features of a 3D position using another sparse latent space. This is achieved by learning the adaptive weights of each latent code with the attention mechanism. Extensive experiments demonstrate the effectiveness of our SLS4D: it achieves the best 4D novel view synthesis using only about $6\%$ parameters of the most recent work., Comment: 10 pages, 6 figures

The detection of gravitational waves from a binary neutron star merger by Advanced LIGO and Advanced Virgo (GW170817), along with the discovery of the electromagnetic counterparts of this gravitational wave event, ushered in a new era of multimessenger astronomy, providing the first direct evidence that BNS mergers are progenitors of short gamma-ray bursts (GRBs). Such events may also produce very-high-energy (VHE, > 100GeV) photons which have yet to be detected in coincidence with a gravitational wave signal. The Cherenkov Telescope Array (CTA) is a next-generation VHE observatory which aims to be indispensable in this search, with an unparalleled sensitivity and ability to slew anywhere on the sky within a few tens of seconds. New observing modes and follow-up strategies are being developed for CTA to rapidly cover localization areas of gravitational wave events that are typically larger than the CTA field of view. This work will evaluate and provide estimations on the expected number of of gravitational wave events that will be observable with CTA, considering both on- and off-axis emission. In addition, we will present and discuss the prospects of potential follow-up strategies with CTA., Comment: Presented at the 38th International Cosmic Ray Conference (ICRC 2023), 2023 (arXiv:2309.08219)

Language learners should regularly engage in reading challenging materials as part of their study routine. Nevertheless, constantly referring to dictionaries is time-consuming and distracting. This paper presents a novel gaze-driven sentence simplification system designed to enhance reading comprehension while maintaining their focus on the content. Our system incorporates machine learning models tailored to individual learners, combining eye gaze features and linguistic features to assess sentence comprehension. When the system identifies comprehension difficulties, it provides simplified versions by replacing complex vocabulary and grammar with simpler alternatives via GPT-3.5. We conducted an experiment with 19 English learners, collecting data on their eye movements while reading English text. The results demonstrated that our system is capable of accurately estimating sentence-level comprehension. Additionally, we found that GPT-3.5 simplification improved readability in terms of traditional readability metrics and individual word difficulty, paraphrasing across different linguistic levels., Comment: Accepted by ACM ICMI 2023 workshops (Multimodal, Interactive Interfaces for Education)

Effective communication between humans and intelligent agents has promising applications for solving complex problems. One such approach is visual dialogue, which leverages multimodal context to assist humans. However, real-world scenarios occasionally involve human mistakes, which can cause intelligent agents to fail. While most prior research assumes perfect answers from human interlocutors, we focus on a setting where the agent points out unintentional mistakes for the interlocutor to review, better reflecting real-world situations. In this paper, we show that human answer mistakes depend on question type and QA turn in the visual dialogue by analyzing a previously unused data collection of human mistakes. We demonstrate the effectiveness of those factors for the model's accuracy in a pointing-human-mistake task through experiments using a simple MLP model and a Visual Language Model., Comment: Accepted at ICCVW 2023

Pre-captured immersive environments using omnidirectional cameras provide a wide range of virtual reality applications. Previous research has shown that manipulating the eye height in egocentric virtual environments can significantly affect distance perception and immersion. However, the influence of eye height in pre-captured real environments has received less attention due to the difficulty of altering the perspective after finishing the capture process. To explore this influence, we first propose a pilot study that captures real environments with multiple eye heights and asks participants to judge the egocentric distances and immersion. If a significant influence is confirmed, an effective image-based approach to adapt pre-captured real-world environments to the user's eye height would be desirable. Motivated by the study, we propose a learning-based approach for synthesizing novel views for omnidirectional images with altered eye heights. This approach employs a multitask architecture that learns depth and semantic segmentation in two formats, and generates high-quality depth and semantic segmentation to facilitate the inpainting stage. With the improved omnidirectional-aware layered depth image, our approach synthesizes natural and realistic visuals for eye height adaptation. Quantitative and qualitative evaluation shows favorable results against state-of-the-art methods, and an extensive user study verifies improved perception and immersion for pre-captured real-world environments., Comment: 10 pages, 13 figures, 3 tables, submitted to ISMAR 2023

The Breakthrough Listen Initiative is conducting a program using multiple telescopes around the world to search for "technosignatures": artificial transmitters of extraterrestrial origin from beyond our solar system. The VERITAS Collaboration joined this program in 2018, and provides the capability to search for one particular technosignature: optical pulses of a few nanoseconds duration detectable over interstellar distances. We report here on the analysis and results of dedicated VERITAS observations of Breakthrough Listen targets conducted in 2019 and 2020 and of archival VERITAS data collected since 2012. Thirty hours of dedicated observations of 136 targets and 249 archival observations of 140 targets were analyzed and did not reveal any signals consistent with a technosignature. The results are used to place limits on the fraction of stars hosting transmitting civilizations. We also discuss the minimum-pulse sensitivity of our observations and present VERITAS observations of CALIOP: a space-based pulsed laser onboard the CALIPSO satellite. The detection of these pulses with VERITAS, using the analysis techniques developed for our technosignature search, allows a test of our analysis efficiency and serves as an important proof-of-principle., Comment: 15 pages, 7 figures