Search

This report introduces FunAudioLLM, a model family designed to enhance natural voice interactions between humans and large language models (LLMs). At its core are two innovative models: SenseVoice, which handles multilingual speech recognition, emotion recognition, and audio event detection; and CosyVoice, which facilitates natural speech generation with control over multiple languages, timbre, speaking style, and speaker identity. SenseVoice-Small delivers exceptionally low-latency ASR for 5 languages, and SenseVoice-Large supports high-precision ASR for over 50 languages, while CosyVoice excels in multi-lingual voice generation, zero-shot in-context learning, cross-lingual voice cloning, and instruction-following capabilities. The models related to SenseVoice and CosyVoice have been open-sourced on Modelscope and Huggingface, along with the corresponding training, inference, and fine-tuning codes released on GitHub. By integrating these models with LLMs, FunAudioLLM enables applications such as speech-to-speech translation, emotional voice chat, interactive podcasts, and expressive audiobook narration, thereby pushing the boundaries of voice interaction technology. Demos are available at https://fun-audio-llm.github.io, and the code can be accessed at https://github.com/FunAudioLLM., Comment: Work in progress. Authors are listed in alphabetical order by family name

We propose two improvements to target-speaker voice activity detection (TS-VAD), the core component in our proposed speaker diarization system that was submitted to the 2022 Multi-Channel Multi-Party Meeting Transcription (M2MeT) challenge. These techniques are designed to handle multi-speaker conversations in real-world meeting scenarios with high speaker-overlap ratios and under heavy reverberant and noisy condition. First, for data preparation and augmentation in training TS-VAD models, speech data containing both real meetings and simulated indoor conversations are used. Second, in refining results obtained after TS-VAD based decoding, we perform a series of post-processing steps to improve the VAD results needed to reduce diarization error rates (DERs). Tested on the ALIMEETING corpus, the newly released Mandarin meeting dataset used in M2MeT, we demonstrate that our proposed system can decrease the DER by up to 66.55/60.59% relatively when compared with classical clustering based diarization on the Eval/Test set.

In sharp contrast to its classical counterpart, quantum measurement plays a fundamental role in quantum mechanics and blurs the essential distinction between the measurement apparatus and the objects under investigation. An appealing phenomenon in quantum measurements, termed as quantum Zeno effect, can be observed in particular subspaces selected by measurement Hamiltonian. Here we apply the top-down Zeno mechanism to the particle physics. We indeed develop an alternative insight into the properties of fundamental particles, but not intend to challenge the Standard Model (SM). In a unified and simple manner, our effective model allows to merge the origin of neutrino's small mass and oscillations, the hierarchy pattern for masses of electric charged fermions, the color confinement, and the discretization of quantum numbers, using a perturbative theory for the dynamical quantum Zeno effect. Under various conditions for vanishing transition amplitudes among particle eigenstates in the effective model, it is remarkable to probe results that are somewhat reminiscent of SM, including: (i) neutrino oscillations with big-angle mixing and small masses emerge from the energy-momentum conservation, (ii) electrically-charged fermions hold masses in a hierarchy pattern due to the electric-charge conservation, (iii) color confinement and the associated asymptotic freedom can be deduced from the color-charge conservation. We make several anticipations about the basic properties for fundamental particles: (i) the total mass of neutrinos and the existence of a nearly massless neutrino (of any generation), (ii) the discretization in quantum numbers for the new-discovered electrically-charged fermions, (iii) the confinement and the associated asymptotic freedom for any particle containing more than two conserved charges., Comment: 16 pages, 0 figures

As one category of vector boson fusion, photo-production is one important production mechanism at $e$-$p$ colliders. A future $e$-$p$ collider -- Large Hadron-electron Collider (LHeC) has been discussed as a "Higgs factory" candidate where the Higgs boson produced via weak boson fusion (WBF) at the LHeC plays an important role in precision measurement of Yukawa couplings. On the other hand, a measurement of photo-production of the Higgs boson, if possible, might be complementary to the measurement of Higgs to di-photon partial decay width $\Gamma({h\to\gamma\gamma})$. In this paper, we study the possibility of measuring this production process at the LHeC with the help of the photon PDFs published in recent years. This process has a clean final state without additional colored particles in the detectable region other than the decay products of the Higgs. We compute the cross sections of all related processes and find that the production rate is at the same order as the neutral current WBF production of Higgs boson with missing forward jets. However, a detailed phenomenological study of various Higgs decay channels shows that even in the most promising semi-leptonic $WW$ channel, the feasibility of identifying such photo-production is negative due to an irreducible photo-production of $W^{+}W^{-}$., Comment: 19pages, 6figures

Now there are many different methods to do the PV-reduction for the one loop amplitudes. Two of them are unitarity cut method and generalized unitarity cut method. In this short paper, we present an explicit connection of these two methods, especially how the extractions of triangle and bubble coefficients are equivalent to each other., Comment: 18 pages, 1 figures