Search

In this study, we investigated Rydberg atom-based microwave electrometry using polarization spectroscopy in a room-temperature vapor cell. By measuring Autler-Townes splitting in the electromagnetically induced transparency (EIT) spectrum, we determined that the minimum measurable microwave electric field is approximately five times lower than conventional EIT techniques. The results are well reproduced by a full optical Bloch equation model, which takes into account all the hyperfine levels involved. Subsequently, the EIT setup was used to characterize a custom microwave cylindrical lens, which increases the field at the focus by a factor of three, decreasing the minimum measurable microwave electric field by the same amount. Our results indicate that the combination of polarization spectroscopy and a microwave lens may enhance microwave electrometry.

In this paper, we study different approaches for classifying emotions from speech using acoustic and text-based features. We propose to obtain contextualized word embeddings with BERT to represent the information contained in speech transcriptions and show that this results in better performance than using Glove embeddings. We also propose and compare different strategies to combine the audio and text modalities, evaluating them on IEMOCAP and MSP-PODCAST datasets. We find that fusing acoustic and text-based systems is beneficial on both datasets, though only subtle differences are observed across the evaluated fusion approaches. Finally, for IEMOCAP, we show the large effect that the criteria used to define the cross-validation folds have on results. In particular, the standard way of creating folds for this dataset results in a highly optimistic estimation of performance for the text-based system, suggesting that some previous works may overestimate the advantage of incorporating transcriptions., Comment: 5 pages. Accepted in ICASSP 2020

We present PECMAE, an interpretable model for music audio classification based on prototype learning. Our model is based on a previous method, APNet, which jointly learns an autoencoder and a prototypical network. Instead, we propose to decouple both training processes. This enables us to leverage existing self-supervised autoencoders pre-trained on much larger data (EnCodecMAE), providing representations with better generalization. APNet allows prototypes' reconstruction to waveforms for interpretability relying on the nearest training data samples. In contrast, we explore using a diffusion decoder that allows reconstruction without such dependency. We evaluate our method on datasets for music instrument classification (Medley-Solos-DB) and genre recognition (GTZAN and a larger in-house dataset), the latter being a more challenging task not addressed with prototypical networks before. We find that the prototype-based models preserve most of the performance achieved with the autoencoder embeddings, while the sonification of prototypes benefits understanding the behavior of the classifier.

This paper describes the joint effort of Brno University of Technology (BUT), AGH University of Krakow and University of Buenos Aires on the development of Automatic Speech Recognition systems for the CHiME-7 Challenge. We train and evaluate various end-to-end models with several toolkits. We heavily relied on Guided Source Separation (GSS) to convert multi-channel audio to single channel. The ASR is leveraging speech representations from models pre-trained by self-supervised learning, and we do a fusion of several ASR systems. In addition, we modified external data from the LibriSpeech corpus to become a close domain and added it to the training. Our efforts were focused on the far-field acoustic robustness sub-track of Task 1 - Distant Automatic Speech Recognition (DASR), our systems use oracle segmentation., Comment: 6 pages, Chime-7 challenge 2023

The goal of universal audio representation learning is to obtain foundational models that can be used for a variety of downstream tasks involving speech, music and environmental sounds. To approach this problem, methods inspired by works on self-supervised learning for NLP, like BERT, or computer vision, like masked autoencoders (MAE), are often adapted to the audio domain. In this work, we propose masking representations of the audio signal, and training a MAE to reconstruct the masked segments. The reconstruction is done by predicting the discrete units generated by EnCodec, a neural audio codec, from the unmasked inputs. We evaluate this approach, which we call EnCodecMAE, on a wide range of tasks involving speech, music and environmental sounds. Our best model outperforms various state-of-the-art audio representation models in terms of global performance. Additionally, we evaluate the resulting representations in the challenging task of automatic speech recognition (ASR), obtaining decent results and paving the way for a universal audio representation.

Self-supervised representations of speech are currently being widely used for a large number of applications. Recently, some efforts have been made in trying to analyze the type of information present in each of these representations. Most such work uses downstream models to test whether the representations can be successfully used for a specific task. The downstream models, though, typically perform nonlinear operations on the representation extracting information that may not have been readily available in the original representation. In this work, we analyze the spatial organization of phone and speaker information in several state-of-the-art speech representations using methods that do not require a downstream model. We measure how different layers encode basic acoustic parameters such as formants and pitch using representation similarity analysis. Further, we study the extent to which each representation clusters the speech samples by phone or speaker classes using non-parametric statistical testing. Our results indicate that models represent these speech attributes differently depending on the target task used during pretraining.

Transformers have revolutionized the world of deep learning, specially in the field of natural language processing. Recently, the Audio Spectrogram Transformer (AST) was proposed for audio classification, leading to state of the art results in several datasets. However, in order for ASTs to outperform CNNs, pretraining with ImageNet is needed. In this paper, we study one component of the AST, the positional encoding, and propose several variants to improve the performance of ASTs trained from scratch, without ImageNet pretraining. Our best model, which incorporates conditional positional encodings, significantly improves performance on Audioset and ESC-50 compared to the original AST., Comment: Submitted to ICASSP 2022. 5 pages, 3 figures

Ultra-thin metallic anodic and cathodic wires are frequently employed in low-mass gaseous detectors for precision experiments, where the amount of material crossed by charged particles must be minimised. We present here the results of an analysis of the mechanical stress and chemical corrosion effects observed in $40$ and $50~{\rm{\mu m}}$ diameter silver plated aluminum wires mounted within the volume of the MEG\,II drift chamber, which caused the breaking of about one hundred wires (over a total of $\approx 12000$). This analysis is based on the accurate inspection of the broken wires by means of optical and electronic microscopes and on a detailed recording of all breaking accidents. We present a simple empirical model which relates the number of broken wires to their exposure time to atmospheric humidity and to their mechanical tension, which is necessary for mechanical stability in the presence of electrostatic fields of several kV/cm. Finally we discuss how wire breakings can be avoided or at least strongly reduced by operating in controlled atmosphere during the mounting stages of the wires within the drift chamber and by choosing a $25\,\%$ thicker wire diameter, which has very small effects on the detector resolution and efficiency and can be obtained by using a safer fabrication technique., Comment: 14 pages, 9 figures

Atomtronics is a relatively new subfield of atomic physics that aims to realize the device behavior of electronic components in ultracold atom-optical systems. The fact that these systems are coherent makes them particularly interesting since, in addition to current, one can impart quantum states onto the current carriers themselves or perhaps perform quantum computational operations on them. After reviewing the fundamental ideas of this subfield, we report on the theoretical and experimental progress made towards developing externally-driven and closed loop devices. The functionality and potential applications for these atom analogs to electronic and spintronic systems is also discussed., Comment: Accepted for publication in Entropy

Emotion recognition datasets are relatively small, making the use of the more sophisticated deep learning approaches challenging. In this work, we propose a transfer learning method for speech emotion recognition where features extracted from pre-trained wav2vec 2.0 models are modeled using simple neural networks. We propose to combine the output of several layers from the pre-trained model using trainable weights which are learned jointly with the downstream model. Further, we compare performance using two different wav2vec 2.0 models, with and without finetuning for speech recognition. We evaluate our proposed approaches on two standard emotion databases IEMOCAP and RAVDESS, showing superior performance compared to results in the literature., Comment: 5 pages, 2 figures. Submitted to Interspeech 2021

Research has shown that trust is an essential aspect of human-computer interaction directly determining the degree to which the person is willing to use a system. An automatic prediction of the level of trust that a user has on a certain system could be used to attempt to correct potential distrust by having the system take relevant actions like, for example, apologizing or explaining its decisions. In this work, we explore the feasibility of automatically detecting the level of trust that a user has on a virtual assistant (VA) based on their speech. We developed a novel protocol for collecting speech data from subjects induced to have different degrees of trust in the skills of a VA. The protocol consists of an interactive session where the subject is asked to respond to a series of factual questions with the help of a virtual assistant. In order to induce subjects to either trust or distrust the VA's skills, they are first informed that the VA was previously rated by other users as being either good or bad; subsequently, the VA answers the subjects' questions consistently to its alleged abilities. All interactions are speech-based, with subjects and VAs communicating verbally, which allows the recording of speech produced under different trust conditions. Using this protocol, we collected a speech corpus in Argentine Spanish. We show clear evidence that the protocol effectively succeeded in influencing subjects into the desired mental state of either trusting or distrusting the agent's skills, and present results of a perceptual study of the degree of trust performed by expert listeners. Finally, we found that the subject's speech can be used to detect which type of VA they were using, which could be considered a proxy for the user's trust toward the VA's abilities, with an accuracy up to 76%, compared to a random baseline of 50%., Comment: arXiv admin note: text overlap with arXiv:2007.15711, arXiv:2006.05977

Research has shown that trust is an essential aspect of human-computer interaction directly determining the degree to which the person is willing to use the system. An automatic prediction of the level of trust that a user has on a certain system could be used to attempt to correct potential distrust by having the system take relevant actions like, for example, explaining its actions more thoroughly. In this work, we explore the feasibility of automatically detecting the level of trust that a user has on a virtual assistant (VA) based on their speech. We use a dataset collected for this purpose, containing human-computer speech interactions where subjects were asked to answer various factual questions with the help of a virtual assistant, which they were led to believe was either very reliable or unreliable. We find that the subject's speech can be used to detect which type of VA they were using, which could be considered a proxy for the user's trust toward the VA's abilities, with an accuracy up to 76\%, compared to a random baseline of 50\%. These results are obtained using features that have been previously found useful for detecting speech directed to infants and non-native speakers.

This paper describes a novel protocol for collecting speech data from subjects induced to have different degrees of trust in the skills of a conversational agent. The protocol consists of an interactive session where the subject is asked to respond to a series of factual questions with the help of a virtual assistant. In order to induce subjects to either trust or distrust the agent's skills, they are first informed that it was previously rated by other users as being either good or bad; subsequently, the agent answers the subjects' questions consistently to its alleged abilities. All interactions are speech-based, with subjects and agents communicating verbally, which allows the recording of speech produced under different trust conditions. We collected a speech corpus in Argentine Spanish using this protocol, which we are currently using to study the feasibility of predicting the degree of trust from speech. We find clear evidence that the protocol effectively succeeded in influencing subjects into the desired mental state of either trusting or distrusting the agent's skills, and present preliminary results of a perceptual study of the degree of trust performed by expert listeners. The collected speech dataset will be made publicly available once ready.

Many professional physicists do not fully understand the implications of the Einstein equivalence principle of general relativity. Consequently, many are unaware of the fact that special relativity is fully capable of handling accelerated reference frames. We present results from our nationwide survey that confirm this is the case. We discuss possible origins of this misconception, then suggest new materials for educators to use while discussing the classic twin paradox example. Afterwards, we review typical introductions to general relativity, clarify the equivalence principle, then suggest additional material to be used when the Einstein equivalence principle is covered in an introductory course. All of our suggestions are straightforward enough to be administered to a sophomore-level modern physics class., Comment: 6 pages, 3 figures

The reconstruction of the positron trajectory in the MEG-II experiment searching for the $\mu^+ \to e^+ \gamma$ decay uses a cylindrical drift chamber operated with a helium-isobutane gas mixture. A stable performance of the detector in terms of its electron drift properties, avalanche multiplication, and with a gas mixture of controlled composition and purity has to be provided and continuously monitored. In this paper we describe the strategies adopted to meet the requirements imposed by the target sensitivity of MEG-II, including the construction and commissioning of a small chamber for an online monitoring of the gas quality., Comment: 12 pages, 6 figures, submitted to Journal of Instrumentation