Search

Recent research on fine-tuning vision-language models has demonstrated impressive performance in various downstream tasks. However, the challenge of obtaining accurately labeled data in real-world applications poses a significant obstacle during the fine-tuning process. To address this challenge, this paper presents a Denoising Fine-Tuning framework, called DeFT, for adapting vision-language models. DeFT utilizes the robust alignment of textual and visual features pre-trained on millions of auxiliary image-text pairs to sieve out noisy labels. The proposed framework establishes a noisy label detector by learning positive and negative textual prompts for each class. The positive prompt seeks to reveal distinctive features of the class, while the negative prompt serves as a learnable threshold for separating clean and noisy samples. We employ parameter-efficient fine-tuning for the adaptation of a pre-trained visual encoder to promote its alignment with the learned textual prompts. As a general framework, DeFT can seamlessly fine-tune many pre-trained models to downstream tasks by utilizing carefully selected clean samples. Experimental results on seven synthetic and real-world noisy datasets validate the effectiveness of DeFT in both noisy label detection and image classification., Comment: Accepted at NeurIPS 2024

Microwave-optics entanglement plays a crucial role in building hybrid quantum networks with quantum nodes working in the microwave and optical frequency bands. However, there are limited efficient ways to produce such entanglement due to the large frequency mismatch between the two regimes. Here, we present a new mechanism to prepare microwave-optics entanglement based on a hybrid system of two coupled opto- and magnomechanical microspheres, i.e., a YIG sphere and a silica sphere. The YIG sphere holds a magnon mode and a vibration mode induced by magnetostriction, while the silica sphere supports an optical whispering-gallery mode and a mechanical mode coupled via an optomechanical interaction. The two mechanical modes are close in frequency and directly coupled via physical contact of the two microspheres. We show that by simultaneously activating the magnomechanical (optomechanical) Stokes (anti-Stokes) scattering, stationary entanglement can be established between the magnon and optical modes via mechanics-mechanics coupling. This leads to stationary microwave-optics entanglement by further coupling the YIG sphere to a microwave cavity and utilizing the magnon-microwave state swapping. Our protocol is within reach of current technology and may become a promising new approach for preparing microwave-optics entanglement, which finds unique applications in hybrid quantum networks and quantum information processing with hybrid quantum systems.

We show how to prepare magnonic squeezed states in an optomagnomechanical system, in which magnetostriction induced mechanical displacement couples to an optical cavity via radiation pressure. We discuss two scenarios depending on whether the magnomechanical coupling is linear or dispersive. We show that in both cases the strong mechanical squeezing obtained via two-tone driving of the optical cavity can be efficiently transferred to the magnon mode. In the linear coupling case, stationary magnon squeezing is achieved; while in the dispersive coupling case, a transient magnonic squeezed state is prepared in a two-step protocol. The proposed magnonic squeezed states find promising applications in quantum information processing and quantum sensing using magnons., Comment: Special Topic on "Brillouin Scattering and Optomechanics" in APL Photonics

We show how to achieve nonreciprocal quantum entanglement in a cavity magnomechanical system by exploiting the chiral cavity-magnon coupling. The system consists of a magnon mode, a mechanical vibration mode, and two degenerate counter-propagating microwave cavity modes in a torus-shaped cavity. We show that nonreciprocal stationary microwave-magnon and -phonon bipartite entanglements and photon-magnon-phonon tripartite entanglement can be achieved by respectively driving different circulating cavity modes that hold a chiral coupling to the magnon mode. The nonreciprocal entanglements are shown to be robust against various experimental imperfections. We specifically show how such nonreciprocal entanglement can realize the channel multiplexing quantum teleportation. The work may find promising applications of the cavity magnomechanical systems in noise-tolerant quantum processing, channel multiplexing quantum teleportation, and chiral magnonic quantum networks.