Search

Multimodal Sentiment Analysis (MSA) integrates diverse modalities(text, audio, and video) to comprehensively analyze and understand individuals' emotional states. However, the real-world prevalence of incomplete data poses significant challenges to MSA, mainly due to the randomness of modality missing. Moreover, the heterogeneity issue in multimodal data has yet to be effectively addressed. To tackle these challenges, we introduce the Modality-Invariant Bidirectional Temporal Representation Distillation Network (MITR-DNet) for Missing Multimodal Sentiment Analysis. MITR-DNet employs a distillation approach, wherein a complete modality teacher model guides a missing modality student model, ensuring robustness in the presence of modality missing. Simultaneously, we developed the Modality-Invariant Bidirectional Temporal Representation Learning Module (MIB-TRL) to mitigate heterogeneity., Comment: Accepted for publication by 2025 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2025)

In human-computer interaction (HCI), Speech Emotion Recognition (SER) is a key technology for understanding human intentions and emotions. Traditional SER methods struggle to effectively capture the long-term temporal correla-tions and dynamic variations in complex emotional expressions. To overcome these limitations, we introduce the PCQ method, a pioneering approach for SER via \textbf{P}rogressive \textbf{C}hannel \textbf{Q}uerying. This method can drill down layer by layer in the channel dimension through the channel query technique to achieve dynamic modeling of long-term contextual information of emotions. This mul-ti-level analysis gives the PCQ method an edge in capturing the nuances of hu-man emotions. Experimental results show that our model improves the weighted average (WA) accuracy by 3.98\% and 3.45\% and the unweighted av-erage (UA) accuracy by 5.67\% and 5.83\% on the IEMOCAP and EMODB emotion recognition datasets, respectively, significantly exceeding the baseline levels., Comment: Accepted for publication by International Conference On Intelligent Computing 2024. For data and code, see this https URL

Large Language Models (LLMs) from the GPT family have become extremely popular, leading to a race towards reducing their inference costs to allow for efficient local computation. Yet, the vast majority of existing work focuses on weight-only quantization, which can reduce runtime costs in the memory-bound one-token-at-a-time generative setting, but does not address them in compute-bound scenarios, such as batched inference or prompt processing. In this paper, we address the general quantization problem, where both weights and activations should be quantized. We show, for the first time, that the majority of inference computations for large generative models such as LLaMA, OPT, and Falcon can be performed with both weights and activations being cast to 4 bits, in a way that leads to practical speedups, while at the same time maintaining good accuracy. We achieve this via a hybrid quantization strategy called QUIK, which compresses most of the weights and activations to 4-bit, while keeping some outlier weights and activations in higher-precision. The key feature of our scheme is that it is designed with computational efficiency in mind: we provide GPU kernels matching the QUIK format with highly-efficient layer-wise runtimes, which lead to practical end-to-end throughput improvements of up to 3.4x relative to FP16 execution. We provide detailed studies for models from the OPT, LLaMA-2 and Falcon families, as well as a first instance of accurate inference using quantization plus 2:4 sparsity. Code is available at: https://github.com/IST-DASLab/QUIK., Comment: 16 pages

We developed a magneto-optical trap reaction microscope (MOTREMI) for strontium atoms by combining the multi-particle coincident detection with laser cooling technique. Present compact injection system can provide cold Sr atoms in three modes of 2D MOT, molasses and 3D MOT, delivering targets with adjustable densities and ratios of the ground state $5s^2$ ($^1S_{0}$) and the excited states $5s5p$ ($^{1}P_{1}$ and $^{3}P_{J}$ etc). The target profiles for the temperature, the density and the size of 3D MOT as well as cold atomic flux in 2D MOT model were characterized in details. With present state-of-the-art setup, we demonstrated the single photoionization of Sr atoms with molasses by absorption of few 800-nm photons, where Sr$^+$ and $e$ were detected in coincidence and most of ionization channels were identified taking into account photoelectron energy, laser-intensity dependence, and target dependence. The best momentum resolution of coincident Sr$^+$ and $e$ along time-of-flight are achieved up to 0.12 a.u. and 0.02 a.u., respectively. Present photoelectron momentum distributions ionized from the ground state and a few excited states illuminate unprecedentedly rich landscapes manifesting prominent features for multi-photon absorption. The full vector momenta of electrons and recoil ion in coincidence paves the way to further studying two-electron correlation dynamics and multi-electron effects in the multiple ionization of alkaline-earth atoms in the ultraviolet region., Comment: 7 figures

Photoionization of the rubidium (Rb) atoms cooled in a magneto-optical trap, characterized by the coexistence of the ground 5$S_{1/2}$ and the excited 5$P_{3/2}$ states, is investigated experimentally and theoretically with the 400 nm femtosecond laser pulses at intensities of $I=3\times10^9$ W/cm$^2$ - $4.5\times10^{12}$ W/cm$^2$. Recoil-ion momentum distribution (RIMD) of Rb$^+$ exhibits rich ring-like structures and their energies correspond to one-photon ionization of the 5$P_{3/2}$ state, two-photon and three-photon ionizations of the 5$S_{1/2}$ state, respectively. With the increasing of $I$, we find that experimental signals near zero-momentum (NZM) in RIMDs resulted from the 5$P_{3/2}$ state enhance dramatically and its peaked Rb$^+$ momenta dwindle obviously while that from the 5$S_{1/2}$ state is maintained. Meanwhile, the ion-yield ratio of the 5$S_{1/2}$ over the 5$P_{3/2}$ states varies from $I$ to $I^{1.5}$ as $I$ increases. These features indicate a transition from perturbative ionization to strong-perturbative ionization for the 5$P_{3/2}$ state. Numerical simulations by solving the time-dependent Schr\"odinger equation (TDSE) can qualitatively explain the measurements of RIMD, photoion angular distributions, as well as ion-yield ratio. However, some discrepancies still exist, especially for the NZM dip, which could stem from the electron-electron correlation that is neglected in the present TDSE simulations since we have adopted the single-active-electron approximation.

We perform high-resolution measurements of momentum distribution on Rb$^{n+}$ recoil ions up to charge state $n=4$, where laser-cooled rubidium atoms are ionized by femtosecond elliptically polarized lasers with the pulse duration of 35 fs and the intensity of 3.3$\times$10$^{15}$ W/cm$^2$ in the over-barrier ionization (OBI) regime. The momentum distributions of the recoil ions are found to exhibit multi-band structures as the ellipticity varies from the linear to circular polarizations. The origin of these band structures can be explained quantitatively by the classical OBI model and dedicated classical trajectory Monte Carlo simulations with Heisenberg potential. Specifically, with back analysis of the classical trajectories, we reveal the ionization time and the OBI geometry of the sequentially released electrons, disentangling the mechanisms behind the tilted angle of the band structures. These results indicate that the classical treatment can describe the strong-field multiple ionization processes of alkali atoms.

Employing recent developed magneto-optical trap recoil ion momentum spectroscopy (MOTRIMS) combining cold atom, strong laser pulse, and ultrafast technologies, we study momentum distributions of the multiply ionized cold rubidium (Rb) induced by the elliptically polarized laser pulses (35 fs, $1.3 \times 10^{15}$ W/cm$^2$). The complete vector momenta of Rbn+ ions up to charge state n = 4 are recorded with extremely high resolution (0.12 a.u. for Rb$^+$). Variations of characteristic multi-bands displayed in momentum distributions, as the ellipticity varies from the linear to circular polarization, are interpreted qualitatively with the classical over-barrier ionization model. Present momentum spectroscopy of cold heavy alkali atoms presents novel strong-field phenomena beyond the noble gases.

A low-energy, compact and superconducting electron beam ion trap (the Shanghai-Wuhan EBIT or SW-EBIT) for extraction of highly charged ions is presented. The magnetic field in the central drift tube of the SW-EBIT is approximately 0.21 T produced by a pair of high-temperature superconducting coils. The electron-beam energy of the SW-EBIT is in the range of 30-4000 eV, and the maximum electron-beam current is up to 9 mA. Acting as a source of highly charged ions, the ion-beam optics for extraction is integrated, including an ion extractor and an einzel lens. A Wien filter is then used to measure the charge-state distribution of the extracted ions. In this work, the tungsten ions below the charge state of 15 have been produced, extracted, and analyzed. The charge-state distributions and spectra in the range of 530-580 nm of tungsten ions have been measured simultaneously with the electron-beam energy of 279 eV and 300 eV, which preliminarily indicates that the 549.9 nm line comes from $W^{14+}$., Comment: This article has been published on Review of Scientific Instruments. Available at https://doi.org/10.1063/1.5112154