Search

The diffusion model is widely leveraged for either video generation or video editing. As each field has its task-specific problems, it is difficult to merely develop a single diffusion for completing both tasks simultaneously. Video diffusion sorely relying on the text prompt can be adapted to unify the two tasks. However, it lacks a high capability of aligning heterogeneous modalities between text and image, leading to various misalignment problems. In this work, we are the first to propose a unified Multi-alignment Diffusion, dubbed as MagDiff, for both tasks of high-fidelity video generation and editing. The proposed MagDiff introduces three types of alignments, including subject-driven alignment, adaptive prompts alignment, and high-fidelity alignment. Particularly, the subject-driven alignment is put forward to trade off the image and text prompts, serving as a unified foundation generative model for both tasks. The adaptive prompts alignment is introduced to emphasize different strengths of homogeneous and heterogeneous alignments by assigning different values of weights to the image and the text prompts. The high-fidelity alignment is developed to further enhance the fidelity of both video generation and editing by taking the subject image as an additional model input. Experimental results on four benchmarks suggest that our method outperforms the previous method on each task.

Latent Diffusion Models (LDMs) are renowned for their powerful capabilities in image and video synthesis. Yet, compared to text-to-image (T2I) editing, text-to-video (T2V) editing suffers from a lack of decent temporal consistency and structure, due to insufficient pre-training data, limited model editability, or extensive tuning costs. To address this gap, we propose FLDM (Fused Latent Diffusion Model), a training-free framework that achieves high-quality T2V editing by integrating various T2I and T2V LDMs. Specifically, FLDM utilizes a hyper-parameter with an update schedule to effectively fuse image and video latents during the denoising process. This paper is the first to reveal that T2I and T2V LDMs can complement each other in terms of structure and temporal consistency, ultimately generating high-quality videos. It is worth noting that FLDM can serve as a versatile plugin, applicable to off-the-shelf image and video LDMs, to significantly enhance the quality of video editing. Extensive quantitative and qualitative experiments on popular T2I and T2V LDMs demonstrate FLDM's superior editing quality than state-of-the-art T2V editing methods. Our project code is available at https://github.com/lutianyi0603/fuse_your_latents.

Understanding the excitation spectrum in two-dimensional quantum many-body systems has long been a challenging task. We present an approach by introducing an excitation ansatz based on an infinite matrix product state (MPS) on a helix structure. With the canonical form of MPS states, we can accurately extract key properties such as energy, degeneracy, spectrum weight, and scaling behavior of low-energy excited states simultaneously. To validate the effectiveness of this method, we begin by applying it to the critical point of the transverse-field Ising model. The extracted scaling exponent of the energy gap closely aligns with the conformal bootstrap results. Subsequently, we apply this approach to the $J_1$-$J_2$ Heisenberg model on a square lattice. We discover that the degeneracy of lowest-energy excitations serves as a reliable metric for distinguishing different phases. The phase boundary identified by our method is consistent with some of the previous findings. The present method provides a promising avenue for studying the excitation spectrum of two-dimensional quantum many-body systems.

The experimental evidence for the $\alpha$ Boson gas state in the $^{11}$C+$^{12}$C$\rightarrow$$^{23}$Mg$^{\ast}$ fusion evaporation reaction is presented. By measuring the $\alpha$ emission spectrum with multiplicity 2 and 3, we provide insight into the existence of a three-body force among $\alpha$ particles. The observed spectrum exhibited distinct tails corresponding to $\alpha$ particles emitted in pairs and triplets consistent well with the model-calculations of AV18-UX and chiral effective field theory of NV2-3-la*, indicating the formation of $\alpha$ clusters with three-body force in the Boson gas state., Comment: 7 pages, 6 figures

The correlation of $\alpha\alpha$ was probed via measuring the transverse momentum $p_{T}$ and width $\delta p_{T}$ of one $\alpha$, for the first time, which represents the spatial and dynamical essentialities of the initial coupling state in $^{8}$Be nucleus. The weighted interaction vertex of 3$\alpha$ reflected by the magnitudes of their relative momentums and relative emission angles proves the isosceles triangle configuration for 3$\alpha$ at the high excited energy analogous Hoyle states., Comment: 8 pages, 9 figures

The enhancement of $J^{\pi}(T)$=3$^{+}$(0) state with isospin $T=0$ excited by the tensor force in the free $^{6}$Li nucleus has been observed, for the first time, relative to a shrinkable excitation in the $^{6}$Li cluster component inside its host nucleus. Comparatively, the excitation of $J^{\pi}(T)$=0$^{+}$(1) state with isospin $T=1$ for these two $^{6}$Li formations take on an approximately equal excitation strength. The mechanism of such tensor force effect was proposed due to the intensive nuclear medium role on isospin $T$=0 state., Comment: 6 pages, 4 figures

Inspired by the remarkable success of Latent Diffusion Models (LDMs) for image synthesis, we study LDM for text-to-video generation, which is a formidable challenge due to the computational and memory constraints during both model training and inference. A single LDM is usually only capable of generating a very limited number of video frames. Some existing works focus on separate prediction models for generating more video frames, which suffer from additional training cost and frame-level jittering, however. In this paper, we propose a framework called "Reuse and Diffuse" dubbed $\textit{VidRD}$ to produce more frames following the frames already generated by an LDM. Conditioned on an initial video clip with a small number of frames, additional frames are iteratively generated by reusing the original latent features and following the previous diffusion process. Besides, for the autoencoder used for translation between pixel space and latent space, we inject temporal layers into its decoder and fine-tune these layers for higher temporal consistency. We also propose a set of strategies for composing video-text data that involve diverse content from multiple existing datasets including video datasets for action recognition and image-text datasets. Extensive experiments show that our method achieves good results in both quantitative and qualitative evaluations. Our project page is available $\href{https://anonymous0x233.github.io/ReuseAndDiffuse/}{here}$.

Using a systematic ab initio quantum many-body approach that goes beyond low-energy models, we directly compute the superconducting pairing order of several doped cuprate materials and structures. We find that we can correctly capture two well-known trends: the pressure effect, where pairing order increases with intra-layer pressure, and the layer effect, where the pairing order varies with the number of copper-oxygen layers. From these calculations, we observe that the strength of superexchange and the covalency at optimal doping are the best descriptors of the maximal pairing order. Our microscopic analysis further identifies short-range copper spin fluctuations, together with multi-orbital charge fluctuations, as central to the pairing trends. Our work illustrates the possibility of a quantitative computational understanding of unconventional high-temperature superconducting materials., Comment: 10 pages, 5 figures, with supplementary materials

We study the holographic s+p model in both four dimensional (4D) and five dimensional (5D) Einstein-Gauss-Bonnet (EGB) gravity. We first show a phase diagram with the Gauss-Bonnet parameter fixed to a small value $\alpha=10^{-7}$ to choose propitiate values of $q_p/q_s$. Then we fix the value of $q_p/q_s$ and plot $\alpha-\mu$ phase diagrams to show the influence of Gauss-Bonnet term on the phase transitions in both 4D and 5D bulk, respectively. The phase diagrams in 4D and 5D present the same qualitative features, indicating similarity of 4D Einstein-Gauss-Bonnet gravity with the 5D case in holography. We also study the influences of Gauss-Bonnet parameter on the special values of the fourth order nonlinear term parameters $\lambda_s$ and $\lambda_p$, below which the condensate grows to a different direction near the critical point, that is important in realizing 1st order superfluid phase transitions. Especially, we notice that these special values are different in the canonical and grand canonical ensembles, which is closely related to the study of the spinodal region, where the phase separations occurs with the linear instability at finite wave vector., Comment: 8 pages, 6 figures

Fermionic reduced density matrices summarize the key observables in fermionic systems. In electronic systems, the two-particle reduced density matrix (2-RDM) is sufficient to determine the energy and most physical observables of interest. Here, we consider the possibility of using matrix completion to reconstruct the two-particle reduced density matrix to chemical accuracy from partial information. We consider the case of noiseless matrix completion, where the partial information corresponds to a subset of the 2-RDM elements, as well as noisy completion, where the partial information corresponds to both a subset of elements, as well as statistical noise in their values. Through experiments on a set of 24 molecular systems, we find that the 2-RDM can be efficiently reconstructed from a reduced amount of information. In the case of noisy completion, this results in multiple orders of magnitude reduction in the number of measurements needed to determine the 2-RDM to chemical accuracy. These techniques can be readily applied to both classical and quantum algorithms for quantum simulations.