Search

Speech Enhancement (SE) is essential for improving productivity in remote collaborative environments. Although deep learning models are highly effective at SE, their computational demands make them impractical for embedded systems. Furthermore, acoustic conditions can change significantly in terms of difficulty, whereas neural networks are usually static with regard to the amount of computation performed. To this end, we introduce Dynamic Channel Pruning to the audio domain for the first time and apply it to a custom convolutional architecture for SE. Our approach works by identifying unnecessary convolutional channels at runtime and saving computational resources by not computing the activations for these channels and retrieving their filters. When trained to only use 25% of channels, we save 29.6% of MACs while only causing a 0.75% drop in PESQ. Thus, DynCP offers a promising path toward deploying larger and more powerful SE solutions on resource-constrained devices., Comment: Accepted for publication at the 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Lifting during manual material handling is a major cause of low-back pain (LBP). As an important risk factor that directly influences the risk of LBP, the Load vertical location (LVL) during lifting needs to be measured and controlled. However, existing solutions for LVL measurement are inefficient, inaccurate, and impractical for real-world workplace environments. To address these problems, an unobtrusive wearable system, including smart insoles and smart wristbands, was proposed to measure LVL accurately in workplace environments. Different from traditional methods which rely on Inertial Measurement Unit (IMU) and suffer from integral drifting errors over time, a novel barometer-based LVL measurement method was proposed in this study. To correct the environment-induced LVL measurement errors in the barometer-based method, a novel Known Vertical Location Update (KVLU) method was proposed. This method calibrates the measured LVL using a known wrist vertical location at known postures during frequently used daily activities such as standing and walking. The proposed wearable system achieved a mean absolute error (MAE) of 5.71 cm in LVL measurement. This result indicates that the proposed system has the potential to reliably measure LVL and assess the risk of LBP in manual lifting tasks.

Biomaterial surface engineering and integrating cell-adhesive ligands are crucial in biological research and biotechnological applications. The interplay between cells and their microenvironment, influenced by chemical and physical cues, impacts cellular behavior. Surface modification of biomaterials profoundly affects cellular responses, especially at the cell-surface interface. This work focuses on enhancing cellular activities through material manipulation, emphasizing silanization for further functionalization with bioactive molecules like RGD peptides to improve cell adhesion. The grafting of three distinct silanes onto silicon wafers using both spin coating and immersion methods was investigated. This study sheds light on the effects of different alkyl chain lengths and protecting groups on cellular behavior, providing valuable insights into optimizing silane-based self-assembled monolayers (SAMs) before peptide or protein grafting for the first time. Specifically, it challenges the common use of APTES molecules in this context. These findings advance our understanding of surface modification strategies, paving the way for tailoring biomaterial surfaces to modulate cellular behavior for diverse biotechnological applications.

One-dimensional Coulomb drag has been an essential tool to probe the physics of interacting Tomonaga-Luttinger liquids. To date, most experimental work has focused on the linear regime while the predictions for Luttinger liquids beyond the linear response theory remain largely untested. In this letter, we report measurements of momentum transfer induced Coulomb drag between vertically-coupled quasi-one-dimensional quantum wires in the nonlinear regime. Measurements were performed at ultra-low temperatures between wires only 15 nm apart. Our results reveal a nonlinear dependence of the drag voltage as a function of the drive current superimposed with an oscillatory contribution, in agreement with theoretical predictions for Coulomb drag between Tomonaga-Luttinger liquids. Additionally, the observed current-voltage ($I$-$V$) characteristics exhibit a nonmonotonic temperature dependence, further corroborating the presence of non-Fermi-liquid behavior in our system. These findings are observed both in the single and in the multiple subband regimes and in the presence of disorder, extending the onset of this behavior beyond the clean single channel Tomonaga-Luttinger regime where the predictions were originally formulated., Comment: 5 pages, 4 figures

Coulomb drag is a powerful tool to study interactions in coupled low-dimensional systems. Historically, Coulomb drag has been attributed to a frictional force arising from momentum transfer whose direction is dictated by the current flow. However recent findings in one-dimensional systems have also identified a rectified contribution that is independent of the current flow direction. In this work, we present Coulomb drag measurements between vertically coupled GaAs/AlGaAs quantum wires separated vertically by a hard barrier only 15 nm wide where both momentum transfer and rectified Coulomb drag signals are observed simultaneously, and whose relative magnitude are temperature and gate tunable. Our study opens up the possibility of studying the physical mechanisms behind the onset of both momentum transfer and charge rectification drag simultaneously in a single device, ultimately leading to a better understanding of Luttinger liquids in multi-channel wires and paving the way for the creation of energy harvesting devices., Comment: 9 pages, 5 figures

As speech processing systems in mobile and edge devices become more commonplace, the demand for unintrusive speech quality monitoring increases. Deep learning methods provide high-quality estimates of objective and subjective speech quality metrics. However, their significant computational requirements are often prohibitive on resource-constrained devices. To address this issue, we investigated binary activation maps (BAMs) for speech quality prediction on a convolutional architecture based on DNSMOS. We show that the binary activation model with quantization aware training matches the predictive performance of the baseline model. It further allows using other compression techniques. Combined with 8-bit weight quantization, our approach results in a 25-fold memory reduction during inference, while replacing almost all dot products with summations. Our findings show a path toward substantial resource savings by supporting mixed-precision binary multiplication in hard- and software., Comment: Accepted for Interspeech 2024

Data-driven models for stellar spectra which depend on stellar labels suffer from label systematics which decrease model performance: the "stellar labels gap". To close the stellar labels gap, we present a stellar label independent model for $\textit{Gaia}$ BP/RP (XP) spectra. We develop a novel implementation of a variational auto-encoder; a $\textit{scatter}$ VAE, which learns to generate an XP spectrum and intrinsic scatter without relying on stellar labels. We demonstrate that our model achieves competitive XP spectra reconstructions in comparison to stellar label dependent models. We find that our model learns stellar properties directly from the data itself. We then apply our model to XP/APOGEE giant stars to study the [$\alpha$/M] information in $\textit{Gaia}$ XP. We provide strong evidence that the XP spectra contain meaningful [$\alpha$/M] information by demonstrating that our model learns the $\alpha$-bimodality $\textit{without relying on stellar label correlations}$, for stars with $T_{\rm eff} <$ 5000 K. We publicly release our trained model, codebase and data. Importantly, our stellar label independent model can be implemented for any/all XP spectra because our model performance scales with training object density, not training label density., Comment: 18 pages, 14 figures, submitted to ApJ, data available at DOI: https://zenodo.org/doi/10.5281/zenodo.10951129, v2. Note: significant text overlap with arXiv:2307.06378. Comments welcome!

Despite the recent advances in model compression techniques for deep neural networks, deploying such models on ultra-low-power embedded devices still proves challenging. In particular, quantization schemes for Gated Recurrent Units (GRU) are difficult to tune due to their dependence on an internal state, preventing them from fully benefiting from sub-8bit quantization. In this work, we propose a modular integer quantization scheme for GRUs where the bit width of each operator can be selected independently. We then employ Genetic Algorithms (GA) to explore the vast search space of possible bit widths, simultaneously optimising for model size and accuracy. We evaluate our methods on four different sequential tasks and demonstrate that mixed-precision solutions exceed homogeneous-precision ones in terms of Pareto efficiency. In our results, we achieve a model size reduction between 25% and 55% while maintaining an accuracy comparable with the 8-bit homogeneous equivalent., Comment: Accepted as a full paper by the tinyML Research Symposium 2024

Union County Public Schools (UCPS) received a U.S. Department of Education Teacher and School Leader Incentive Program grant in 2017, supporting the EPIC program aimed at transforming education in 13 low-performing, high-poverty schools. The EPIC initiative had two primary goals: redesigning the Human Capital Management System and Performance-Based Compensation System to attract, retain, and sustain effective educators, and enhancing teacher and school leader effectiveness to positively impact student academic achievement. UCPS implemented a Performance-Based Compensation System (PBCS) that provided monetary incentives to individual teachers and school leaders based on attendance, growth targets, and evaluations. The EPIC impact study evaluated the program's effects on student outcomes using a short-interrupted time series design with comparison (SIT-C), comparing standardized achievement scores in math and reading for Grades 5 and 8, and high school levels, with matched comparison schools. The study spanned five years, tracking proficiency scores before and after EPIC implementation. Results at the elementary level showed that neither the treatment nor comparison groups achieved the projected mean percent proficient in post-intervention years for math. However, the treatment group exceeded the mean in reading, unlike the comparison group. In middle schools, the treatment group surpassed the projected mean percent proficient in both math and reading, while the comparison group did not. At the high school level, neither group achieved the projected mean percent proficient in math post-intervention, but the treatment group exceeded it in English compared to the comparison group. Teacher outcomes indicated improvements in retention and diversity across EPIC schools. Seven of the 13 schools saw a substantial increase in teacher retention, and the percentage of teachers of color increased by 10 points over five years. Teacher attendance showed improvement, with a decrease in average days absent. UCPS's EPIC program demonstrated positive outcomes in teacher retention, diversity, and attendance, with varying impacts on student proficiency across grade levels. The study emphasized the need for cautious interpretation of data due to external factors like the COVID pandemic. [The report was submitted to Union County Public Schools.]

While bisimulation-based approaches hold promise for learning robust state representations for Reinforcement Learning (RL) tasks, their efficacy in offline RL tasks has not been up to par. In some instances, their performance has even significantly underperformed alternative methods. We aim to understand why bisimulation methods succeed in online settings, but falter in offline tasks. Our analysis reveals that missing transitions in the dataset are particularly harmful to the bisimulation principle, leading to ineffective estimation. We also shed light on the critical role of reward scaling in bounding the scale of bisimulation measurements and of the value error they induce. Based on these findings, we propose to apply the expectile operator for representation learning to our offline RL setting, which helps to prevent overfitting to incomplete data. Meanwhile, by introducing an appropriate reward scaling strategy, we avoid the risk of feature collapse in representation space. We implement these recommendations on two state-of-the-art bisimulation-based algorithms, MICo and SimSR, and demonstrate performance gains on two benchmark suites: D4RL and Visual D4RL. Codes are provided at \url{https://github.com/zanghyu/Offline_Bisimulation}., Comment: NeurIPS 2023

Coulomb drag experiments have been an essential tool to study strongly interacting low-dimensional systems. Historically, this effect has been explained in terms of momentum transfer between electrons in the active and the passive layer. Here, we report Coulomb drag measurements between laterally coupled GaAs/AlGaAs quantum wires in the multiple 1D sub-band regime that break Onsager's reciprocity upon both layer and current direction reversal, in contrast to prior 1D Coulomb drag results. The drag signal shows nonlinear I-V characteristics, which are well characterized by a third-order polynomial fit. These findings are qualitatively consistent with a rectified drag signal induced by charge fluctuations. However, the nonmonotonic temperature dependence of this drag signal suggests that strong electron-electron interactions, expected within the Tomonaga-Luttinger liquid framework, remain important and standard interaction models are insufficient to capture the qualitative nature of rectified 1D Coulomb drag., Comment: 8 pages, 7 figures

The Ribbit system is a compact Scheme implementation running on the Ribbit Virtual Machine (RVM) that has been ported to a dozen host languages. It supports a simple Foreign Function Interface (FFI) allowing extensions to the RVM directly from the program's source code. We have extended the system to offer conformance to the R4RS standard while staying as compact as possible. This leads to a R4RS compliant REPL that fits in an 7 KB Linux executable. This paper explains the various issues encountered and our solutions to make, arguably, the smallest R4RS conformant Scheme implementation of all time., Comment: Presented at The 2023 Scheme and Functional Programming Workshop (arXiv:cs/0101200)

Offline policy learning is aimed at learning decision-making policies using existing datasets of trajectories without collecting additional data. The primary motivation for using reinforcement learning (RL) instead of supervised learning techniques such as behavior cloning is to find a policy that achieves a higher average return than the trajectories constituting the dataset. However, we empirically find that when a dataset is dominated by suboptimal trajectories, state-of-the-art offline RL algorithms do not substantially improve over the average return of trajectories in the dataset. We argue this is due to an assumption made by current offline RL algorithms of staying close to the trajectories in the dataset. If the dataset primarily consists of sub-optimal trajectories, this assumption forces the policy to mimic the suboptimal actions. We overcome this issue by proposing a sampling strategy that enables the policy to only be constrained to ``good data" rather than all actions in the dataset (i.e., uniform sampling). We present a realization of the sampling strategy and an algorithm that can be used as a plug-and-play module in standard offline RL algorithms. Our evaluation demonstrates significant performance gains in 72 imbalanced datasets, D4RL dataset, and across three different offline RL algorithms. Code is available at https://github.com/Improbable-AI/dw-offline-rl., Comment: Accepted NeurIPS 2023

Inspired by human conscious planning, we propose Skipper, a model-based reinforcement learning framework utilizing spatio-temporal abstractions to generalize better in novel situations. It automatically decomposes the given task into smaller, more manageable subtasks, and thus enables sparse decision-making and focused computation on the relevant parts of the environment. The decomposition relies on the extraction of an abstracted proxy problem represented as a directed graph, in which vertices and edges are learned end-to-end from hindsight. Our theoretical analyses provide performance guarantees under appropriate assumptions and establish where our approach is expected to be helpful. Generalization-focused experiments validate Skipper's significant advantage in zero-shot generalization, compared to some existing state-of-the-art hierarchical planning methods., Comment: ICLR 2024 Camera-Ready

Using diffusion models to solve inverse problems is a growing field of research. Current methods assume the degradation to be known and provide impressive results in terms of restoration quality and diversity. In this work, we leverage the efficiency of those models to jointly estimate the restored image and unknown parameters of the degradation model such as blur kernel. In particular, we designed an algorithm based on the well-known Expectation-Minimization (EM) estimation method and diffusion models. Our method alternates between approximating the expected log-likelihood of the inverse problem using samples drawn from a diffusion model and a maximization step to estimate unknown model parameters. For the maximization step, we also introduce a novel blur kernel regularization based on a Plug \& Play denoiser. Diffusion models are long to run, thus we provide a fast version of our algorithm. Extensive experiments on blind image deblurring demonstrate the effectiveness of our method when compared to other state-of-the-art approaches.

Although deep learning has made strides in the field of deep noise suppression, leveraging deep architectures on resource-constrained devices still proved challenging. Therefore, we present an early-exiting model based on nsNet2 that provides several levels of accuracy and resource savings by halting computations at different stages. Moreover, we adapt the original architecture by splitting the information flow to take into account the injected dynamism. We show the trade-offs between performance and computational complexity based on established metrics., Comment: Accepted at the MLSP 2023

The recent release of 220+ million BP/RP spectra in $\textit{Gaia}$ DR3 presents an opportunity to apply deep learning models to an unprecedented number of stellar spectra, at extremely low-resolution. The BP/RP dataset is so massive that no previous spectroscopic survey can provide enough stellar labels to cover the BP/RP parameter space. We present an unsupervised, deep, generative model for BP/RP spectra: a $\textit{scatter}$ variational auto-encoder. We design a non-traditional variational auto-encoder which is capable of modeling both $(i)$ BP/RP coefficients and $(ii)$ intrinsic scatter. Our model learns a latent space from which to generate BP/RP spectra (scatter) directly from the data itself without requiring any stellar labels. We demonstrate that our model accurately reproduces BP/RP spectra in regions of parameter space where supervised learning fails or cannot be implemented., Comment: Accepted at the ICML 2023 Workshop on Machine Learning for Astrophysics. 6 pages, 3 figures

Most offline reinforcement learning (RL) algorithms return a target policy maximizing a trade-off between (1) the expected performance gain over the behavior policy that collected the dataset, and (2) the risk stemming from the out-of-distribution-ness of the induced state-action occupancy. It follows that the performance of the target policy is strongly related to the performance of the behavior policy and, thus, the trajectory return distribution of the dataset. We show that in mixed datasets consisting of mostly low-return trajectories and minor high-return trajectories, state-of-the-art offline RL algorithms are overly restrained by low-return trajectories and fail to exploit high-performing trajectories to the fullest. To overcome this issue, we show that, in deterministic MDPs with stochastic initial states, the dataset sampling can be re-weighted to induce an artificial dataset whose behavior policy has a higher return. This re-weighted sampling strategy may be combined with any offline RL algorithm. We further analyze that the opportunity for performance improvement over the behavior policy correlates with the positive-sided variance of the returns of the trajectories in the dataset. We empirically show that while CQL, IQL, and TD3+BC achieve only a part of this potential policy improvement, these same algorithms combined with our reweighted sampling strategy fully exploit the dataset. Furthermore, we empirically demonstrate that, despite its theoretical limitation, the approach may still be efficient in stochastic environments. The code is available at https://github.com/Improbable-AI/harness-offline-rl.

The adoption of self-driving cars will certainly revolutionize our lives, even though they may take more time to become fully autonomous than initially predicted. The first vehicles are already present in certain cities of the world, as part of experimental robot-taxi services. However, most existing studies focus on the navigation part of such vehicles. We currently miss methods, datasets, and studies to assess the in-cabin human component of the adoption of such technology in real-world conditions. This paper proposes an experimental framework to study the activities of occupants of self-driving cars using a multidisciplinary approach (computer vision associated with human and social sciences), particularly non-driving related activities. The framework is composed of an experimentation scenario, and a data acquisition module. We seek firstly to capture real-world data about the usage of the vehicle in the nearest possible, real-world conditions, and secondly to create a dataset containing in-cabin human activities to foster the development and evaluation of computer vision algorithms. The acquisition module records multiple views of the front seats of the vehicle (Intel RGB-D and GoPro cameras); in addition to survey data about the internal states and attitudes of participants towards this type of vehicle before, during, and after the experimentation. We evaluated the proposed framework with the realization of real-world experimentation with 30 participants (1 hour each) to study the acceptance of SDCs of SAE level 4., Comment: This paper is currently under review by the 26th IEEE International Conference on Intelligent Transportation Systems (ITSC 2023)

Speech enhancement techniques improve the quality or the intelligibility of an audio signal by removing unwanted noise. It is used as preprocessing in numerous applications such as speech recognition, hearing aids, broadcasting and telephony. The evaluation of such algorithms often relies on reference-based objective metrics that are shown to correlate poorly with human perception. In order to evaluate audio quality as perceived by human observers it is thus fundamental to resort to subjective quality assessment. In this paper, a user evaluation based on crowdsourcing (subjective) and the Comparison Category Rating (CCR) method is compared against the DNSMOS, ViSQOL and 3QUEST (objective) metrics. The overall quality scores of three speech enhancement algorithms from real time communications (RTC) are used in the comparison using the P.808 toolkit. Results indicate that while the CCR scale allows participants to identify differences between processed and unprocessed audio samples, two groups of preferences emerge: some users rate positively by focusing on noise suppression processing, while others rate negatively by focusing mainly on speech quality. We further present results on the parameters, size considerations and speaker variations that are critical and should be considered when designing the CCR-based crowdsourcing evaluation., Comment: Published at ICASSP 2023

Decision Transformer-based decision-making agents have shown the ability to generalize across multiple tasks. However, their performance relies on massive data and computation. We argue that this inefficiency stems from the forgetting phenomenon, in which a model memorizes its behaviors in parameters throughout training. As a result, training on a new task may deteriorate the model's performance on previous tasks. In contrast to LLMs' implicit memory mechanism, the human brain utilizes distributed memory storage, which helps manage and organize multiple skills efficiently, mitigating the forgetting phenomenon. Inspired by this, we propose a working memory module to store, blend, and retrieve information for different downstream tasks. Evaluation results show that the proposed method improves training efficiency and generalization in Atari games and Meta-World object manipulation tasks. Moreover, we demonstrate that memory fine-tuning further enhances the adaptability of the proposed architecture., Comment: Accepted at ICML 2024

Monitoring pesticide concentration is very important for public authorities given the major concerns for environmental safety and the likelihood for increased public health risks. An important aspect of this process consists in locating abnormal signals, from a large amount of collected data. This kind of data is usually complex since it suffers from limits of quantification leading to left censored observations, and from the sampling procedure which is irregular in time and space across measuring stations. The present manuscript tackles precisely the issue of detecting spatio-temporal collective anomalies in pesticide concentration levels, and introduces a novel methodology for dealing with spatio-temporal heterogeneity. The latter combines a change-point detection procedure applied to the series of maximum daily values across all stations, and a clustering step aimed at a spatial segmentation of the stations. Limits of quantification are handled in the change-point procedure, by supposing an underlying left-censored parametric model, piece-wise stationary. Spatial segmentation takes into account the geographical conditions, and may be based on river network, wind directions, etc. Conditionally to the temporal segment and the spatial cluster, one may eventually analyse the data and identify contextual anomalies. The proposed procedure is illustrated in detail on a data set containing the prosulfocarb concentration levels in surface waters in Centre-Val de Loire region., Comment: Environmetrics, In press