Search

Measurements of the EMC effect in the tritium and helium-3 mirror nuclei are reported. The data were obtained by the MARATHON Jefferson Lab experiment, which performed deep inelastic electron scattering from deuterium and the three-body nuclei, using a cryogenic gas target system and the High Resolution Spectrometers of the Hall A Facility of the Lab. The data cover the Bjorken $x$ range from 0.20 to 0.83, corresponding to a squared four-momentum transfer $Q^2$ range from 2.7 to $11.9\gevsq$, and to an invariant mass $W$ of the final hadronic state greater than 1.84 GeV/${\it c}^2$. The tritium EMC effect measurement is the first of its kind. The MARATHON experimental results are compared to results from previous measurements by DESY-HERMES and JLab-Hall C experiments, as well as with few-body theoretical predictions., Comment: arXiv admin note: text overlap with arXiv:2104.05850

A measurement of the double-spin asymmetry from electron-$^{3}$He scattering in the threshold region of two- and three-body breakup of $^{3}$He was performed at Jefferson Lab, for Q$^{2}$ values of 0.1 and 0.2 (GeV/$c$)$^{2}$. The results of this measurement serve as a stringent test of our understanding of few-body systems. When compared with calculations from plane wave impulse approximation and Faddeev theory, we found that the Faddeev calculations, which use modern nuclear potentials and prescriptions for meson-exchange currents, demonstrate an overall good agreement with data.

We present a sensor-agnostic spectral transformer as the basis for spectral foundation models. To that end, we introduce a Universal Spectral Representation (USR) that leverages sensor meta-data, such as sensing kernel specifications and sensing wavelengths, to encode spectra obtained from any spectral instrument into a common representation, such that a single model can ingest data from any sensor. Furthermore, we develop a methodology for pre-training such models in a self-supervised manner using a novel random sensor-augmentation and reconstruction pipeline to learn spectral features independent of the sensing paradigm. We demonstrate that our architecture can learn sensor independent spectral features that generalize effectively to sensors not seen during training. This work sets the stage for training foundation models that can both leverage and be effective for the growing diversity of spectral data.

Rare-earth ions are characterised by transitions with very narrow linewidths even in solid state crystals. Exceedingly long coherence times have been shown on both spin and optical transitions of rare-earth-ion doped crystals. A key factor, and generally the limitation, for such coherence times, is the effects of electronic and nuclear spins in the host crystal. Despite the attractive prospect, a low-strain, spin-free host crystal for rare-earth-ion dopants has not yet been demonstrated. The dopants experience the lowest strain when they substitute for another rare earth (including yttrium). However every stable isotope of the trivalent rare earth ions has either an electron spin, an nuclear spin, or both. The long optical coherence times reported here with erbium dopants in antiferromagnetically ordered gadolinium vanandate suggest an alternative method to achieve the quiet magnetic environment needed for long coherence times: use a magnetic host fully concentrated in electron spins and operate at temperatures low enough for these spins to be ordered. We also observe avoided crossings in the optical spectra, caused by strong coupling between the erbium ions and gadolinium magnons in the host crystal. This suggests the exciting prospect of microwave to optical quantum transduction using the rare-earth ions in these materials mediated by magnons of the host spins.

We discuss modular domain walls and gravitational waves in a class of supersymmetric models where quark and lepton flavour symmetry emerges from modular symmetry. In such models a single modulus field $\tau$ is often assumed to be stabilised at or near certain fixed point values such as $\tau = {\rm i}$ and $\tau = \omega$ (the cube root of unity), in its fundamental domain. We show that, in the global supersymmetry limit of certain classes of potentials, the vacua at these fixed points may be degenerate, leading to the formation of modular domain walls in the early Universe. Taking supergravity effects into account, in the background of a fixed dilaton field $S$, the degeneracy may be lifted, leading to a bias term in the potential allowing the domain walls to collapse. We study the resulting gravitational wave spectra arising from the dynamics of such modular domain walls, and assess their observability by current and future experiments, as a window into modular flavour symmetry., Comment: 23 pages, 6 figures

Run-time steering strategies like Medprompt are valuable for guiding large language models (LLMs) to top performance on challenging tasks. Medprompt demonstrates that a general LLM can be focused to deliver state-of-the-art performance on specialized domains like medicine by using a prompt to elicit a run-time strategy involving chain of thought reasoning and ensembling. OpenAI's o1-preview model represents a new paradigm, where a model is designed to do run-time reasoning before generating final responses. We seek to understand the behavior of o1-preview on a diverse set of medical challenge problem benchmarks. Following on the Medprompt study with GPT-4, we systematically evaluate the o1-preview model across various medical benchmarks. Notably, even without prompting techniques, o1-preview largely outperforms the GPT-4 series with Medprompt. We further systematically study the efficacy of classic prompt engineering strategies, as represented by Medprompt, within the new paradigm of reasoning models. We found that few-shot prompting hinders o1's performance, suggesting that in-context learning may no longer be an effective steering approach for reasoning-native models. While ensembling remains viable, it is resource-intensive and requires careful cost-performance optimization. Our cost and accuracy analysis across run-time strategies reveals a Pareto frontier, with GPT-4o representing a more affordable option and o1-preview achieving state-of-the-art performance at higher cost. Although o1-preview offers top performance, GPT-4o with steering strategies like Medprompt retains value in specific contexts. Moreover, we note that the o1-preview model has reached near-saturation on many existing medical benchmarks, underscoring the need for new, challenging benchmarks. We close with reflections on general directions for inference-time computation with LLMs., Comment: 25 pages

Topological data analysis (TDA) aims to extract noise-robust features from a data set by examining the number and persistence of holes in its topology. We show that a computational problem closely related to a core task in TDA -- determining whether a given hole persists across different length scales -- is $\mathsf{BQP}_1$-hard and contained in $\mathsf{BQP}$. This result implies an exponential quantum speedup for this problem under standard complexity-theoretic assumptions. Our approach relies on encoding the persistence of a hole in a variant of the guided sparse Hamiltonian problem, where the guiding state is constructed from a harmonic representative of the hole., Comment: 21 pages

Microkinetic models are key for evaluating industrial processes' efficiency and chemicals' environmental impact. Manual construction of these models is difficult and time-consuming, prompting a shift to automated methods. This study introduces SiMBA (Simplest Mechanism Builder Algorithm), a novel approach for generating microkinetic models from kinetic data. SiMBA operates through four phases: mechanism generation, mechanism translation, parameter estimation, and model comparison. Our approach systematically proposes reaction mechanisms, using matrix representations and a parallelized backtracking algorithm to manage complexity. These mechanisms are then translated into microkinetic models represented by ordinary differential equations, and optimized to fit available data. Models are compared using information criteria to balance accuracy and complexity, iterating until convergence to an optimal model is reached. Case studies on an aldol condensation reaction, and the dehydration of fructose demonstrate SiMBA's effectiveness in distilling complex kinetic behaviors into simple yet accurate models. While SiMBA predicts intermediates correctly for all case studies, it does not chemically identify intermediates, requiring expert input for complex systems. Despite this, SiMBA significantly enhances mechanistic exploration, offering a robust initial mechanism that accelerates the development and modeling of chemical processes.

Discrete representations of speech, obtained from Self-Supervised Learning (SSL) foundation models, are widely used, especially where there are limited data for the downstream task, such as for a low-resource language. Typically, discretization of speech into a sequence of symbols is achieved by unsupervised clustering of the latents from an SSL model. Our study evaluates whether discrete symbols - found using k-means - adequately capture tone in two example languages, Mandarin and Yoruba. We compare latent vectors with discrete symbols, obtained from HuBERT base, MandarinHuBERT, or XLS-R, for vowel and tone classification. We find that using discrete symbols leads to a substantial loss of tone information, even for language-specialised SSL models. We suggest that discretization needs to be task-aware, particularly for tone-dependent downstream tasks., Comment: Submitted to ICASSP 2025

Fine-tuning Large Language Models (LLMs) has become a crucial technique for adapting pre-trained models to downstream tasks. However, the enormous size of LLMs poses significant challenges in terms of computational complexity and resource requirements. Low-Rank Adaptation (LoRA) has emerged as a promising solution. However, there exists a gap between the practical performance of low-rank adaptations and its theoretical optimum. In this work, we propose eXtreme Gradient Boosting LoRA (XGBLoRA), a novel framework that bridges this gap by leveraging the power of ensemble learning. Inspired by gradient boosting, XGBLoRA iteratively learns and merges a sequence of LoRA adaptations to refine model predictions. It achieves better performance than the standard LoRA, while enjoying the computational efficiency of rank-1 adaptations. We provide theoretical analysis to show the convergence and optimality of our approach, and conduct extensive experiments on a range of natural language processing tasks. The results demonstrate that XGBLoRA consistently outperforms standard LoRA and achieves performance comparable to full fine-tuning with significantly fewer trainable parameters. This work advances parameter-efficient fine-tuning for LLMs, and offers a promising solution for adapting LLMs to downstream tasks while optimizing performance and efficiency., Comment: 19 pages

Inductive knowledge graph completion (KGC) aims to predict missing triples with unseen entities. Recent works focus on modeling reasoning paths between the head and tail entity as direct supporting evidence. However, these methods depend heavily on the existence and quality of reasoning paths, which limits their general applicability in different scenarios. In addition, we observe that latent type constraints and neighboring facts inherent in KGs are also vital in inferring missing triples. To effectively utilize all useful information in KGs, we introduce CATS, a novel context-aware inductive KGC solution. With sufficient guidance from proper prompts and supervised fine-tuning, CATS activates the strong semantic understanding and reasoning capabilities of large language models to assess the existence of query triples, which consist of two modules. First, the type-aware reasoning module evaluates whether the candidate entity matches the latent entity type as required by the query relation. Then, the subgraph reasoning module selects relevant reasoning paths and neighboring facts, and evaluates their correlation to the query triple. Experiment results on three widely used datasets demonstrate that CATS significantly outperforms state-of-the-art methods in 16 out of 18 transductive, inductive, and few-shot settings with an average absolute MRR improvement of 7.2%.

A recent paper (King, 2024) suggested that emission from the central supermassive black holes in high-redshift galaxies must be tightly collimated by the effects of partly expelling a super-Eddington mass supply. I show here that this idea predicts that these galaxies should produce very little detectable rest-frame X-ray emission, appear Compton thick, and show no easily detectable sign of outflows. All of these properties agree with current observations. To produce these effects, the mass supply to the black holes should exceed the Eddington rate by factors 50 - 100, which appears in line with conditions during the early growth of the holes. I note that theoretical derivations of the ratio of black hole mass to host galaxy stellar mass already predict that this should increase significantly at high redshift, in line with recent observations., Comment: 3 pages, accepted for MNRAS

This paper introduces Moonshine, a family of speech recognition models optimized for live transcription and voice command processing. Moonshine is based on an encoder-decoder transformer architecture and employs Rotary Position Embedding (RoPE) instead of traditional absolute position embeddings. The model is trained on speech segments of various lengths, but without using zero-padding, leading to greater efficiency for the encoder during inference time. When benchmarked against OpenAI's Whisper tiny-en, Moonshine Tiny demonstrates a 5x reduction in compute requirements for transcribing a 10-second speech segment while incurring no increase in word error rates across standard evaluation datasets. These results highlight Moonshine's potential for real-time and resource-constrained applications., Comment: 7 pages, 6 figures, 3 tables

Monitoring of Diffuse Intrinsic Pontine Glioma (DIPG) and Diffuse Midline Glioma (DMG) brain tumors in pediatric patients is key for assessment of treatment response. Response Assessment in Pediatric Neuro-Oncology (RAPNO) guidelines recommend the volumetric measurement of these tumors using MRI. Segmentation challenges, such as the Brain Tumor Segmentation (BraTS) Challenge, promote development of automated approaches which are replicable, generalizable and accurate, to aid in these tasks. The current study presents a novel adaptation of existing nnU-Net approaches for pediatric brain tumor segmentation, submitted to the BraTS-PEDs 2024 challenge. We apply an adapted nnU-Net with hierarchical cascades to the segmentation task of the BraTS-PEDs 2024 challenge. The residual encoder variant of nnU-Net, used as our baseline model, already provides high quality segmentations. We incorporate multiple changes to the implementation of nnU-Net and devise a novel two-stage cascaded nnU-Net to segment the substructures of brain tumors from coarse to fine. Using outputs from the nnU-Net Residual Encoder (trained to segment CC, ED, ET and NET tumor labels from T1w, T1w-CE, T2w and T2-FLAIR MRI), these are passed to two additional models one classifying ET versus NET and a second classifying CC vs ED using cascade learning. We use radiological guidelines to steer which multi parametric MRI (mpMRI) to use in these cascading models. Compared to a default nnU-Net and an ensembled nnU-net as baseline approaches, our novel method provides robust segmentations for the BraTS-PEDs 2024 challenge, achieving mean Dice scores of 0.657, 0.904, 0.703, and 0.967, and HD95 of 76.2, 10.1, 111.0, and 12.3 for the ET, NET, CC and ED, respectively.

We consider the spreading dynamics of the Fisher-KPP equation in a shifting environment, by analyzing the limit of the rate function of the solutions. For environments with a weak monotone condition, it was demonstrated in a previous paper that the rate function converges to the unique Ishii solution of the underlying Hamilton-Jacobi equations. In case the environment does not satisfy the weak monotone condition, we show that the rate function is then characterized by the Hamilton-Jacobi equation with a dynamic junction condition, which depends additionally on the generalized eigenvalue derived from the environmental function. Our results applies to the case when the environment has multiple shifting speeds, and clarify the connection with previous results on nonlocally pulled fronts and forced traveling waves.

To many Chomsky's debates with Quine and Skinner are an updated version of the Rationalist Empiricist debates of the 17th century. The consensus being that Chomsky's Rationalism was victorious. This dispute has reemerged with the advent of Large Language Models. With some arguing that LLMs vindicate rationalism because of the necessity of building in innate biases to make them work. The necessity of building in innate biases is taken to prove that empiricism hasn't got the conceptual resources to explain linguistic competence. Such claims depend on the nature of the empiricism one is endorsing. Externalized Empiricism has no difficulties with innate apparatus once they are determined empirically (Quine 1969). Thus, externalized empiricism is not refuted because of the need to build in innate biases in LLMs. Furthermore, the relevance of LLMs to the rationalist empiricist debate in relation to humans is dubious. For any claim about whether LLMs learn in an empiricist manner to be relevant to humans it needs to be shown that LLMs and humans learn in the same way. Two key features distinguish humans and LLMs. Humans learn despite a poverty of stimulus and LLMs learn because of an incredibly rich stimulus. Human linguistic outputs are grounded in sensory experience and LLMs are not. These differences in how the two learn indicates that they both use different underlying competencies to produce their output. Therefore, any claims about whether LLMs learn in an empiricist manner are not relevant to whether humans learn in an empiricist manner.

We carried out a comprehensive crystal structure characterization of Ti-doped lithium ruthenate (Li$_2$Ti$_x$Ru$_{1-x}$O$_3$), to investigate the effect of Ti-doping on the structural phase transition. Experimental tools sensitive to the average structure (X-ray diffraction), as well as those sensitive to local structure (Extended X-ray Absorption Fine Structure, EXAFS; pair distribution function, PDF) are used. We observed non-monotonic dependence of the structural transition temperature on the Ti-doping level. At low doping, the transition temperature slightly increases with doping, while at high doping, the temperature decreases significantly with doping. We note two important observations from our studies. First, Ti K-edge EXAFS data shows persistent Ti-Ru dimerization even with substantial Ti doping. Second, we were able to use the PDF data to estimate the dimer correlation length above the transition temperature, which would correspond to the size of the proposed local `dimer clusters' formed by Ru-Ru and Ti-Ru neighbours. The dimer correlation length is found to be around 10~\AA, which remains robust regardless of doping. Our study therefore suggests that Ti$^{4+}$ with its $d^0$ electronic configuration is a special type of dopant when replacing Ru., Comment: 12 pages, 11 figures

Efficiently retrieving and synthesizing information from large-scale multimodal collections has become a critical challenge. However, existing video retrieval datasets suffer from scope limitations, primarily focusing on matching descriptive but vague queries with small collections of professionally edited, English-centric videos. To address this gap, we introduce $\textbf{MultiVENT 2.0}$, a large-scale, multilingual event-centric video retrieval benchmark featuring a collection of more than 218,000 news videos and 3,906 queries targeting specific world events. These queries specifically target information found in the visual content, audio, embedded text, and text metadata of the videos, requiring systems leverage all these sources to succeed at the task. Preliminary results show that state-of-the-art vision-language models struggle significantly with this task, and while alternative approaches show promise, they are still insufficient to adequately address this problem. These findings underscore the need for more robust multimodal retrieval systems, as effective video retrieval is a crucial step towards multimodal content understanding and generation tasks.

Machine learning has revolutionized the modeling of clinical timeseries data. Using machine learning, a Deep Neural Network (DNN) can be automatically trained to learn a complex mapping of its input features for a desired task. This is particularly valuable in Electronic Health Record (EHR) databases, where patients often spend extended periods in intensive care units (ICUs). Machine learning serves as an efficient method for extract meaningful information. However, many state-of-the-art (SOTA) methods for training DNNs demand substantial volumes of labeled data, posing significant challenges for clinics in terms of cost and time. Self-supervised learning offers an alternative by allowing practitioners to extract valuable insights from data without the need for costly labels. Yet, current SOTA methods often necessitate large data batches to achieve optimal performance, increasing computational demands. This presents a challenge when working with long clinical timeseries data. To address this, we propose an efficient method of contrastive pretraining tailored for long clinical timeseries data. Our approach utilizes an estimator for negative pair comparison, enabling effective feature extraction. We assess the efficacy of our pretraining using standard self-supervised tasks such as linear evaluation and semi-supervised learning. Additionally, our model demonstrates the ability to impute missing measurements, providing clinicians with deeper insights into patient conditions. We demonstrate that our pretraining is capable of achieving better performance as both the size of the model and the size of the measurement vocabulary scale. Finally, we externally validate our model, trained on the MIMIC-III dataset, using the eICU dataset. We demonstrate that our model is capable of learning robust clinical information that is transferable to other clinics.

Panel data arise when time series measurements are collected from multiple, dynamically independent but structurally related systems. In such cases, each system's time series can be modeled as a partially observed Markov process (POMP), and the ensemble of these models is called a PanelPOMP. If the time series are relatively short, statistical inference for each time series must draw information from across the entire panel. Every time series has a name, called its unit label, which may correspond to an object on which that time series was collected. Differences between units may be of direct inferential interest or may be a nuisance for studying the commonalities. The R package panelPomp supports analysis of panel data via a general class of PanelPOMP models. This includes a suite of tools for manipulation of models and data that take advantage of the panel structure. The panelPomp package currently emphasizes recent advances enabling likelihood-based inference via simulation-based algorithms. However, the general framework provided by panelPomp supports development of additional, new inference methodology for panel data.

While traditional earphones primarily offer private audio spaces, so-called "earables" emerged to offer a variety of sensing capabilities. Pioneering platforms like OpenEarable have introduced novel sensing platforms targeted at the ears, incorporating various sensors. The proximity of the ears to the eyes, brain, and facial muscles has also sparked investigation into sensing biopotentials. However, currently there is no platform available that is targeted at the ears to sense biopotentials. To address this gap, we introduce OpenEarable ExG - an open-source hardware platform designed to measure biopotentials in and around the ears. OpenEarable ExG can be freely configured and has up to 7 sensing channels. We initially validate OpenEarable ExG in a study with a left-right in-ear dual-electrode montage setup with 3 participants. Our results demonstrate the successful detection of smooth pursuit eye movements via Electrooculography (EOG), alpha brain activity via Electroencephalography (EEG), and jaw clenching via Electromyography (EMG). OpenEarable ExG is part of the OpenEarable initiative and is fully open-source under MIT license., Comment: 5 pages, 3 figures

Nano-patterned magnetic materials have opened new venues on the investigation of strongly correlated phenomena including artificial spin-ice systems, geometric frustration, magnetic monopoles, for technologically important applications such as reconfigurable ferromagnetism. With the advent of atomically thin two-dimensional (2D) van der Waals (vdW) magnets a pertinent question is whether such compounds could make their way into this realm where interactions can be tailored so that unconventional states of matter could be assessed. Here we show that square islands of CrGeTe3 vdW ferromagnets distributed in a grid manifest antiferromagnetic correlations, essential to enable frustration resulting in an artificial spin-ice. By using a combination of SQUID-on-tip microscopy, focused ion beam lithography, and atomistic spin dynamic simulations, we show that pristine, isolated CGT flakes as small as 150*150*60 nm3 have tunable dipole-dipole interactions, which can be precisely controlled by their lateral spacing. There is a crossover between non-interacting islands and significant inter-island anticorrelation depending how they are spatially distributed allowing the creation of complex magnetic patterns not observable at the isolated flakes. Our findings suggest that the cross-talk between the nano-patterned magnets can be explored in the generation of even more complex spin configurations where exotic interactions may be manipulated in an unprecedent way., Comment: Main text: 12 pages, 5 figures. Supplementary information: 11 pages, 5 figures

FAMU is an INFN-led muonic atom physics experiment based at the RIKEN-RAL muon facility at the ISIS Neutron and Muon Source (United Kingdom). The aim of FAMU is to measure the hyperfine splitting in muonic hydrogen to determine the value of the proton Zemach radius with accuracy better than 1%.The experiment has a scintillating-fibre hodoscope for beam monitoring and data normalisation. In order to carry out muon flux estimation, low-rate measurements were performed to extract the single-muon average deposited charge. Then, detector simulation in Geant4 and FLUKA allowed a thorough understanding of the single-muon response function, crucial for determining the muon flux. This work presents the design features of the FAMU beam monitor, along with the simulation and absolute calibration measurements in order to enable flux determination and enable data normalisation.

Continual learning (CL) aims to empower machine learning models to learn continually from new data, while building upon previously acquired knowledge without forgetting. As machine learning models have evolved from small to large pre-trained architectures, and from supporting unimodal to multimodal data, multimodal continual learning (MMCL) methods have recently emerged. The primary challenge of MMCL is that it goes beyond a simple stacking of unimodal CL methods, as such straightforward approaches often yield unsatisfactory performance. In this work, we present the first comprehensive survey on MMCL. We provide essential background knowledge and MMCL settings, as well as a structured taxonomy of MMCL methods. We categorize existing MMCL methods into four categories, i.e., regularization-based, architecture-based, replay-based, and prompt-based methods, explaining their methodologies and highlighting their key innovations. Additionally, to prompt further research in this field, we summarize open MMCL datasets and benchmarks, and discuss several promising future directions for investigation and development. We have also created a GitHub repository for indexing relevant MMCL papers and open resources available at https://github.com/LucyDYu/Awesome-Multimodal-Continual-Learning.

For nearly a century and a half the Stokes phenomenon had been perceived as a discontinuous change in the asymptotic representation of a function. In 1989 Berry demonstrated how it is possible to smooth out this discontinuity in broad classes of problems with the prefactor for the exponentially small contribution that is being switched on/off taking the universal form of an error function. Following pioneering work of Berk {\it et al.} \cite{BNR82} and the Japanese school of formally exact asymptotics \cite{Aokietal1994,AKT01}, the concept of the higher-order Stokes phenomenon was introduced in \cite{HLO04} and \cite{CM05}, whereby the ability for the exponentially small terms to cause a Stokes phenomenon may change, depending on the values of parameters in the problem, corresponding to the associated singularities in the Borel plane transitioning between different Riemann sheets. Until now, the higher-order Stokes phenomenon has also been treated as a discontinuous event. In this paper we show how the higher-order Stokes phenomenon is, in fact, also smooth and occurs universally with a prefactor that takes the form of a new special function, based on a Gaussian convolution of an error function that gives rise to a rich structure. We provide a rigorous derivation of the result, with examples spanning the gamma function, a second-order nonlinear ODE and the telegraph equation, giving rise to a ghost-like smooth contribution that is present in the vicinity of a Stokes line, but which rapidly tends to zero on either side. We also include a rigorous derivation and example of the effect of the smoothed higher-order Stokes phenomenon on the individual terms in the asymptotic series, where the additional contributions appear prefactored by an error function., Comment: 49 pages, 15 figures

We present projected walk on spheres (PWoS), a novel pointwise and discretization-free Monte Carlo solver for surface PDEs with Dirichlet boundaries, as a generalization of the walk on spheres method (WoS) [Muller 1956; Sawhney and Crane 2020]. We adapt the recursive relationship of WoS designed for PDEs in volumetric domains to a volumetric neighborhood around the surface, and at the end of each recursion step, we project the sample point on the sphere back to the surface. We motivate this simple modification to WoS with the theory of the closest point extension used in the closest point method. To define the valid volumetric neighborhood domain for PWoS, we develop strategies to estimate the local feature size of the surface and to compute the distance to the Dirichlet boundaries on the surface extended in their normal directions. We also design a mean value filtering method for PWoS to improve the method's efficiency when the surface is represented as a polygonal mesh or a point cloud. Finally, we study the convergence of PWoS and demonstrate its application to graphics tasks, including diffusion curves, geodesic distance computation, and wave propagation animation. We show that our method works with various types of surfaces, including a surface of mixed codimension., Comment: Accepted to SIGGRAPH Asia 2024 (Conference Papers). See https://rsugimoto.net/ProjectedWalkOnSpheres/ for updates

Large language models (LLMs) have demonstrated remarkable performance on various tasks. However, it remains an open question whether the default Euclidean space is the most suitable choice for embedding tokens in LLMs. In this study, we first investigate the non-Euclidean characteristics of LLMs. Our findings reveal that token frequency follows a power-law distribution, with high-frequency tokens clustering near the origin and low-frequency tokens positioned farther away. Additionally, token embeddings exhibit a high degree of hyperbolicity, indicating a latent tree-like structure in the embedding space. Building on the observation, we propose to efficiently fine-tune LLMs in hyperbolic space to better exploit the underlying complex structures. However, we found that this fine-tuning in hyperbolic space cannot be achieved with naive application of exponential and logarithmic maps, when the embedding and weight matrices both reside in Euclidean space. To address this technique issue, we introduce a new method called hyperbolic low-rank efficient fine-tuning, HypLoRA, that performs low-rank adaptation directly on the hyperbolic manifold, avoiding the cancellation effect caused by the exponential and logarithmic maps, thus preserving the hyperbolic modeling capabilities. Through extensive experiments, we demonstrate that HypLoRA significantly enhances the performance of LLMs on reasoning tasks, particularly for complex reasoning problems. In particular, HypLoRA improves the performance in the complex AQuA dataset by up to 13.0%, showcasing its effectiveness in handling complex reasoning challenges, Comment: The preliminary work was accepted for the ICML 2024 LLM Cognition Workshop, and this version includes new investigations, analyses, experiments, and results

A high-power laser pulse at normal incidence onto a plane solid target will generate odd harmonics of its frequency. However, the spacing of the harmonic lines in this configuration is fixed. Here, we study harmonic generation using two laser beams incident on a plane target at small, opposite angles to the target normal, via particle-in-cell simulations. When looking at the harmonic radiation in a specific direction via a narrow slit or pinhole, we select an angle-dependent subset of the harmonic spectrum. This way, we obtain a harmonic frequency comb that we control via the observation angle and the input laser frequency. The divergence of the harmonic radiation will be reduced by using wider laser spots, thus increasing the efficacy of the scheme. We will discuss extensions to this scheme, such as using beams with unequal frequencies, a slight tilt of the target, or employing more than two beams., Comment: 10 pages, 5 figures. This version provides a more detailed description of the laser pulses used in the simulations

Jupiter's Great Red Spot (GRS) was mapped by the James Webb Space Telescope (JWST)/Mid-Infrared Instrument (4.9-27.9 micron) in July and August 2022. These observations took place alongside a suite of visual and infrared observations from; Hubble, JWST/NIRCam, Very Large Telescope/VISIR and amateur observers which provided both spatial and temporal context across the jovian disc. The stratospheric temperature structure retrieved using the NEMESIS software revealed a series of hot-spots above the GRS. These could be the consequence of GRS-induced wave activity. In the troposphere, the temperature structure was used to derive the thermal wind structure of the GRS vortex. These winds were only consistent with the independently determined wind field by JWST/NIRCam at 240 mbar if the altitude of the Hubble-derived winds were located around 1,200 mbar, considerably deeper than previously assumed. No enhancement in ammonia was found within the GRS but a link between elevated aerosol and phosphine abundances was observed within this region. North-south asymmetries were observed in the retrieved temperature, ammonia, phosphine and aerosol structure, consistent with the GRS tilting in the north-south direction. Finally, a small storm was captured north-west of the GRS that displayed a considerable excess in retrieved phosphine abundance, suggestive of vigorous convection. Despite this, no ammonia ice was detected in this region. The novelty of JWST required us to develop custom-made software to resolve challenges in calibration of the data. This involved the derivation of the "FLT-5" wavelength calibration solution that has subsequently been integrated into the standard calibration pipeline., Comment: 53 pages, 19 figures, 4 tables

We present an adaptation of the exoplanet transit model code batman, in order to permit the generation of X-ray transits. Our underlying extended coronal model assumes an isothermal plasma that is radially symmetric. While this ignores the effect of bright, active regions, observations of transits in X-rays will require averaging across multiple epochs of data for the foreseeable future, significantly reducing the importance of more complex modelling. Our publicly available code successfully generates the predicted W-shaped transit profile in X-rays due to the optically thin nature of the emission, which concentrates the expected observational emission around the limb of the photospheric stellar disc. We provide some examples based on the best known X-ray transit target, HD 189733b, and examine the effect of varying the planet size, coronal temperature, and impact parameter on the resulting transit profile. We also derived scaling relationships for how the overall transit detectability is affected by changing these parameters. Over most of the parameter space, we find that the detectability scales linearly with the cross-sectional area of the planet in X-rays. The relationship with increasing coronal temperature is less fixed, but averages out to a power law with slope $-1/4$ except when the impact parameter is high. Indeed, varying impact parameter has little effect on detectability at all until it approaches unity., Comment: 16 pages, 8 figures, 2 tables. Accepted for publication in the Astronomical Journal. Code available at https://github.com/georgewking/batmanX-rays

Large Language Models (LLMs) have recently garnered significant attention, primarily for their capabilities in text-based interactions. However, natural human interaction often relies on speech, necessitating a shift towards voice-based models. A straightforward approach to achieve this involves a pipeline of ``Automatic Speech Recognition (ASR) + LLM + Text-to-Speech (TTS)", where input speech is transcribed to text, processed by an LLM, and then converted back to speech. Despite being straightforward, this method suffers from inherent limitations, such as information loss during modality conversion and error accumulation across the three stages. To address these issues, Speech Language Models (SpeechLMs) -- end-to-end models that generate speech without converting from text -- have emerged as a promising alternative. This survey paper provides the first comprehensive overview of recent methodologies for constructing SpeechLMs, detailing the key components of their architecture and the various training recipes integral to their development. Additionally, we systematically survey the various capabilities of SpeechLMs, categorize the evaluation metrics for SpeechLMs, and discuss the challenges and future research directions in this rapidly evolving field., Comment: Work in progress

Tin oxide aerogels were synthesized using an epoxide-assisted technique and characterized with Fourier transform infrared, X-ray diffraction, and UV-Vis to study the effects of post-synthesis annealing and peroxide treatment. While bulk tin oxide exhibits an optical bandgap of $3.6$ eV, its aerogel form often displays a larger apparent bandgap around $4.6$ eV due to defects. Our study reveals that annealing induces a partial phase change from SnO$_2$ to SnO, but is ineffective in removing defects. Conversely, peroxide passivation effectively lowers the bandgap and disorder levels, suggesting that dangling bonds are the primary cause of the increased bandgap in tin oxide aerogels. These findings offer insights for optimizing the optical properties of tin oxide aerogels for applications like solar cells.

Conversational search offers an easier and faster alternative to conventional web search, while having downsides like lack of source verification. Research has examined performance disparities between these two systems in different settings. However, little work has considered the effects of variations within a given search task. We hypothesize that psychological distance - one''s perceived closeness to a target event - affects information needs in search tasks, and investigate the corresponding effects on user preferences between web and conversational search systems. We find that with greater psychological distances, users perceive conversational search as more credible, useful, enjoyable, and easy to use, and demonstrate increased preference for this system. We reveal qualitative reasons for these differences and provide design implications for search system designers., Comment: 28 pages

Non-maximum suppression (NMS) is an indispensable post-processing step in object detection. With the continuous optimization of network models, NMS has become the ``last mile'' to enhance the efficiency of object detection. This paper systematically analyzes NMS from a graph theory perspective for the first time, revealing its intrinsic structure. Consequently, we propose two optimization methods, namely QSI-NMS and BOE-NMS. The former is a fast recursive divide-and-conquer algorithm with negligible mAP loss, and its extended version (eQSI-NMS) achieves optimal complexity of $\mathcal{O}(n\log n)$. The latter, concentrating on the locality of NMS, achieves an optimization at a constant level without an mAP loss penalty. Moreover, to facilitate rapid evaluation of NMS methods for researchers, we introduce NMS-Bench, the first benchmark designed to comprehensively assess various NMS methods. Taking the YOLOv8-N model on MS COCO 2017 as the benchmark setup, our method QSI-NMS provides $6.2\times$ speed of original NMS on the benchmark, with a $0.1\%$ decrease in mAP. The optimal eQSI-NMS, with only a $0.3\%$ mAP decrease, achieves $10.7\times$ speed. Meanwhile, BOE-NMS exhibits $5.1\times$ speed with no compromise in mAP.

This paper introduces the hypothetical track-length fitting algorithm, a novel method for measuring the kinetic energies of ionizing particles in liquid argon time projection chambers (LArTPCs). The algorithm finds the most probable offset in track length for a track-like object by comparing the measured ionization density as a function of position with a theoretical prediction of the energy loss as a function of the energy, including models of electron recombination and detector response. The algorithm can be used to measure the energies of particles that interact before they stop, such as charged pions that are absorbed by argon nuclei. The algorithm's energy measurement resolutions and fractional biases are presented as functions of particle kinetic energy and number of track hits using samples of stopping secondary charged pions in data collected by the ProtoDUNE-SP detector, and also in a detailed simulation. Additional studies describe impact of the dE/dx model on energy measurement performance. The method described in this paper to characterize the energy measurement performance can be repeated in any LArTPC experiment using stopping secondary charged pions.

This study aims to investigate whether GPT-4 can effectively grade assignments for design university students and provide useful feedback. In design education, assignments do not have a single correct answer and often involve solving an open-ended design problem. This subjective nature of design projects often leads to grading problems,as grades can vary between different raters,for instance instructor from engineering background or architecture background. This study employs an iterative research approach in developing a Custom GPT with the aim of achieving more reliable results and testing whether it can provide design students with constructive feedback. The findings include: First,through several rounds of iterations the inter-reliability between GPT and human raters reached a level that is generally accepted by educators. This indicates that by providing accurate prompts to GPT,and continuously iterating to build a Custom GPT, it can be used to effectively grade students' design assignments, serving as a reliable complement to human raters. Second, the intra-reliability of GPT's scoring at different times is between 0.65 and 0.78. This indicates that, with adequate instructions, a Custom GPT gives consistent results which is a precondition for grading students. As consistency and comparability are the two main rules to ensure the reliability of educational assessment, this study has looked at whether a Custom GPT can be developed that adheres to these two rules. We finish the paper by testing whether Custom GPT can provide students with useful feedback and reflecting on how educators can develop and iterate a Custom GPT to serve as a complementary rater., Comment: 25 pages, 5 figures

In this paper, we introduce MIO, a novel foundation model built on multimodal tokens, capable of understanding and generating speech, text, images, and videos in an end-to-end, autoregressive manner. While the emergence of large language models (LLMs) and multimodal large language models (MM-LLMs) propels advancements in artificial general intelligence through their versatile capabilities, they still lack true any-to-any understanding and generation. Recently, the release of GPT-4o has showcased the remarkable potential of any-to-any LLMs for complex real-world tasks, enabling omnidirectional input and output across images, speech, and text. However, it is closed-source and does not support the generation of multimodal interleaved sequences. To address this gap, we present MIO, which is trained on a mixture of discrete tokens across four modalities using causal multimodal modeling. MIO undergoes a four-stage training process: (1) alignment pre-training, (2) interleaved pre-training, (3) speech-enhanced pre-training, and (4) comprehensive supervised fine-tuning on diverse textual, visual, and speech tasks. Our experimental results indicate that MIO exhibits competitive, and in some cases superior, performance compared to previous dual-modal baselines, any-to-any model baselines, and even modality-specific baselines. Moreover, MIO demonstrates advanced capabilities inherent to its any-to-any feature, such as interleaved video-text generation, chain-of-visual-thought reasoning, visual guideline generation, instructional image editing, etc., Comment: Technical Report. Codes and models are available in https://github.com/MIO-Team/MIO

The BICEP3 and BICEP Array polarimeters are small-aperture refracting telescopes located at the South Pole designed to measure primordial gravitational wave signatures in the Cosmic Microwave Background (CMB) polarization, predicted by inflation. Constraining the inflationary signal requires not only excellent sensitivity, but also careful control of instrumental systematics. Both instruments use antenna-coupled orthogonally polarized detector pairs, and the polarized sky signal is reconstructed by taking the difference in each detector pair. As a result, the differential response between detectors within a pair becomes an important systematic effect we must control. Additionally, mapping the intensity and polarization response in regions away from the main beam can inform how sidelobe levels affect CMB measurements. Extensive calibration measurements are taken in situ every austral summer for control of instrumental systematics and instrument characterisation. In this work, we detail the set of beam calibration measurements that we conduct on the BICEP receivers, from deep measurements of main beam response to polarized beam response and sidelobe mapping. We discuss the impact of these measurements for instrumental systematics studies and design choices for future CMB receivers., Comment: 13 pages, 7 figures, 1 table, Proceedings paper SPIE 2024

We investigate the properties of domain walls arising from non-Abelian discrete symmetries, which we refer to as non-Abelian domain walls. We focus on $S_4$, one of the most commonly used groups in lepton flavour mixing models. The spontaneous breaking of $S_4$ leads to distinct vacua preserving a residual $Z_2$ or $Z_3$ symmetry. Five types of domain walls are found, labelled as SI, SII, TI, TII, and TIII, respectively, the former two separating $Z_2$ vacua and the latter three separating $Z_3$ vacua. We highlight that SI, TI and TIII may be unstable for some regions of the parameter space and decay to stable domain walls. Stable domain walls can collapse and release gravitational radiation for a suitable size of explicit symmetry breaking. A symmetry-breaking scale of order 100 TeV may explain the recent discovery of nanohertz gravitational waves by PTA experiments. For the first time, we investigate the properties of these domain walls, which we obtain numerically with semi-analytical formulas applied to compute the tension and thickness across a wide range of parameter space. We estimate the resulting gravitational wave spectrum and find that, thanks to their rich vacuum structure, non-Abelian domain walls manifest in a very interesting and complex phenomenology., Comment: 29 pages, 15 figures

Nucleon structure functions, as measured in lepton-nucleon scattering, have historically provided a critical observable in the study of partonic dynamics within the nucleon. However, at very large parton momenta it is both experimentally and theoretically challenging to extract parton distributions due to the probable onset of non-perturbative contributions and the unavailability of high precision data at critical kinematics. Extraction of the neutron structure and the d-quark distribution have been further challenging due to the necessity of applying nuclear corrections when utilizing scattering data from a deuteron target to extract free neutron structure. However, a program of experiments has been carried out recently at the energy-upgraded Jefferson Lab electron accelerator aimed at significantly reducing the nuclear correction uncertainties on the d-quark distribution function at large partonic momentum. This allows leveraging the vast body of deuterium data covering a large kinematic range to be utilized for d-quark parton distribution function extraction. We present new data from experiment E12-10-002 carried out in Jefferson Lab Hall C on the deuteron to proton cross-section ratio at large BJorken-x. These results significantly improve the precision of existing data, and provide a first look at the expected impact on quark distributions extracted from global parton distribution function fits.

Privacy-preserving voice conversion aims to remove only the attributes of speech audio that convey identity information, keeping other speech characteristics intact. This paper presents a mechanism for privacy-preserving voice conversion that allows controlling the leakage of identity-bearing information using adversarial information hiding. This enables a deliberate trade-off between maintaining source-speech characteristics and modification of speaker identity. As such, the approach improves on voice-conversion techniques like CycleGAN and StarGAN, which were not designed for privacy, meaning that converted speech may leak personal information in unpredictable ways. Our approach is also more flexible than ASR-TTS voice conversion pipelines, which by design discard all prosodic information linked to textual content. Evaluations show that the proposed system successfully modifies perceived speaker identity whilst well maintaining source lexical content., Comment: Accepted for publication in proceedings of 4th symposium on security and privacy in speech communication

We report microwave to optical upconversion in isotopically purified erbium-doped yttrium orthosilicate in a Fabry-P\'erot resonator at millikelvin temperatures. This follows on from investigations made at higher temperatures and with natural isotopic ratios for the erbium dopants. In these previous investigations the highest efficiency was seen only for moderately strong microwave powers. The removal of the unwanted erbium-167 which has hyperfine structure and provides unwanted background optical absorption, and the lower temperatures has removed this problem. We now see efficiencies still increasing as the microwave power is decreased when we reach the smallest input powers for which we could measure an output. Efficiencies of $2\times10^{-6}$ were observed and we discuss potential improvements, including better optical cavity frequency stability and better thermalisation of the erbium spins., Comment: 8 Pages, 7 Figures

A liquid jet plunging into a quiescent bath of the same liquid is a fundamental fluid mechanical problem underpinning a range of processes in industry and the natural world. Significant attention has been given to the study of plunging laminar Newtonian jets and the associated air entrainment that can occur. However, there have been very few (if any) studies devoted to the equivalent case for non-Newtonian viscoelastic liquids. Here we consider the laminar plunging and associated air entrainment of a shear thinning viscoelastic jet into a still bath of the same liquid. We describe a previously unreported phenomenon, that we call ``bubbles-on-a-string'' (BUoaS), consisting of multiple stable toroidal bubbles rising co-axially around the submerged jet. In a qualitative sense, this new observation is akin to an inverse version of the well-known rheological phenomenon ``beads-on-a-string''. The BUoaS phenomenon is stable and repeatable and can be reproduced to a lesser extent in Newtonian surfactant solutions, indicating that low surface tension is key, but non-Newtonian rheology seems likely to provide the most favourable conditions for the onset of the phenomenon. A full characterisation and detailed study of this behaviour with accompanying numerical simulation is to follow in an upcoming publication., Comment: 5 pages, 7 figs, 2 ancillary movies. Content presented at AERC April 2024

Stereotypes are generalised assumptions about societal groups, and even state-of-the-art LLMs using in-context learning struggle to identify them accurately. Due to the subjective nature of stereotypes, where what constitutes a stereotype can vary widely depending on cultural, social, and individual perspectives, robust explainability is crucial. Explainable models ensure that these nuanced judgments can be understood and validated by human users, promoting trust and accountability. We address these challenges by introducing HEARTS (Holistic Framework for Explainable, Sustainable, and Robust Text Stereotype Detection), a framework that enhances model performance, minimises carbon footprint, and provides transparent, interpretable explanations. We establish the Expanded Multi-Grain Stereotype Dataset (EMGSD), comprising 57,201 labeled texts across six groups, including under-represented demographics like LGBTQ+ and regional stereotypes. Ablation studies confirm that BERT models fine-tuned on EMGSD outperform those trained on individual components. We then analyse a fine-tuned, carbon-efficient ALBERT-V2 model using SHAP to generate token-level importance values, ensuring alignment with human understanding, and calculate explainability confidence scores by comparing SHAP and LIME outputs. Finally, HEARTS is applied to assess stereotypical bias in 12 LLM outputs, revealing a gradual reduction in bias over time within model families., Comment: Submitted to NeurIPS 2024 SoLaR Workshop

Graph anomaly detection (GAD), which aims to identify unusual graph instances (nodes, edges, subgraphs, or graphs), has attracted increasing attention in recent years due to its significance in a wide range of applications. Deep learning approaches, graph neural networks (GNNs) in particular, have been emerging as a promising paradigm for GAD, owing to its strong capability in capturing complex structure and/or node attributes in graph data. Considering the large number of methods proposed for GNN-based GAD, it is of paramount importance to summarize the methodologies and findings in the existing GAD studies, so that we can pinpoint effective model designs for tackling open GAD problems. To this end, in this work we aim to present a comprehensive review of deep learning approaches for GAD. Existing GAD surveys are focused on task-specific discussions, making it difficult to understand the technical insights of existing methods and their limitations in addressing some unique challenges in GAD. To fill this gap, we first discuss the problem complexities and their resulting challenges in GAD, and then provide a systematic review of current deep GAD methods from three novel perspectives of methodology, including GNN backbone design, proxy task design for GAD, and graph anomaly measures. To deepen the discussions, we further propose a taxonomy of 13 fine-grained method categories under these three perspectives to provide more in-depth insights into the model designs and their capabilities. To facilitate the experiments and validation, we also summarize a collection of widely-used GAD datasets and empirical comparison. We further discuss multiple open problems to inspire more future high-quality research. A continuously updated repository for datasets, links to the codes of algorithms, and empirical comparison is available at https://github.com/mala-lab/Awesome-Deep-Graph-Anomaly-Detection., Comment: 24 pages, 6 figures, and 7 tables

Multimodal Large Language Models (MLLMs) are evaluated on various benchmarks, such as image captioning, visual question answering, and reasoning. However, many of these benchmarks include overly simple or uninformative samples, complicating the effective distinction of different MLLMs' performance. Furthermore, evaluating models across numerous benchmarks incurs a significant computational burden. To address these issues, we propose LIME (Less Is More for MLLM Evaluation), a refined and efficient benchmark curated through a semi-automated pipeline. This pipeline filters out uninformative samples and eliminates answer leakage by focusing on tasks that necessitate image-based understanding. Our experiments indicate that LIME reduces the number of samples by 76% and evaluation time by 77%, while also providing a more effective means of distinguishing the capabilities of different models. Notably, we find that traditional automatic metrics, such as CIDEr, are inadequate for assessing MLLMs' captioning performance; excluding the caption task score yields a more accurate reflection of overall model performance. All code and data are available at https://github.com/kangreen0210/LIME.

Watermarking algorithms for large language models (LLMs) have attained high accuracy in detecting LLM-generated text. However, existing methods primarily focus on distinguishing fully watermarked text from non-watermarked text, overlooking real-world scenarios where LLMs generate only small sections within large documents. In this scenario, balancing time complexity and detection performance poses significant challenges. This paper presents WaterSeeker, a novel approach to efficiently detect and locate watermarked segments amid extensive natural text. It first applies an efficient anomaly extraction method to preliminarily locate suspicious watermarked regions. Following this, it conducts a local traversal and performs full-text detection for more precise verification. Theoretical analysis and experimental results demonstrate that WaterSeeker achieves a superior balance between detection accuracy and computational efficiency. Moreover, WaterSeeker's localization ability supports the development of interpretable AI detection systems. This work pioneers a new direction in watermarked segment detection, facilitating more reliable AI-generated content identification.Our code is available at https://github.com/THU-BPM/WaterSeeker., Comment: 20 pages, 7 figures, 8 tables

The R package panelPomp supports analysis of panel data via a general class of partially observed Markov process models (PanelPOMP). This package tutorial describes how the mathematical concept of a PanelPOMP is represented in the software and demonstrates typical use-cases of panelPomp. Monte Carlo methods used for POMP models require adaptation for PanelPOMP models due to the higher dimensionality of panel data. The package takes advantage of recent advances for PanelPOMP, including an iterated filtering algorithm, Monte Carlo adjusted profile methodology and block optimization methodology to assist with the large parameter spaces that can arise with panel models. In addition, tools for manipulation of models and data are provided that take advantage of the panel structure.

Wireless electromagnetic sensing is a passive, non-destructive technique for measuring physical and chemical changes through permittivity or conductivity changes. However, the readout is limited by the sensitivity of the materials, often requiring complex sampling, particularly in the GHz range. We report capacitive dielectric temperature sensors based on polydimethylsiloxne (PDMS) loaded with 10 vol% of inexpensive, commercially available conductive fillers including copper powder (Cu), graphite powder (GP) and milled carbon fibre powder (CF). The sensors are tested in the range of 20{\deg}C to 110{\deg}C, with enhanced sensitivity from 20 to 60{\deg}C, and relative response of up to 85.5% at 200 MHz for CF loaded capacitors. Additionally, we demonstrate that operating frequency influences the relative sensing response by as much as 15.0% in loaded composite capacitors. Finally, we demonstrate the suitability of PDMS-CF capacitors as a sensing element in wirelessly coupled chipless resonant coils tuned to 6.78 MHz with a readout response, in the resonant frequency of the sensor. The wireless readout of the PDMS-CF chipless system exhibited an average sensitivity of 0.38 %{\deg}C-1 which is a 40x improvement over a pristine PDMS-based capacitive sensor and outperforms state of the art frequency-domain radio frequency (RF) temperature sensors including carbon-based composites at higher loadings. Exploiting the high sensitivity, we interrogate the sensor wirelessly using a low-cost and portable open-source NanoVNA demonstrating a relative response in the resonant frequency of the reader coil of 48.5%, with the response in good agreement with the instrumentation-grade vector network analyzers (VNAs), demonstrating that the sensors could be integrated into an inexpensive and portable measurement setup that does not rely on specialty equipment or highly trained operators., Comment: Main body 24 pages, 8 figures, one table. Supplemental information 10 pages, 11 figures, two tables

Progress in gravitational-wave astronomy depends upon having sensitive detectors with good data quality. Since the end of the LIGO-Virgo-KAGRA third Observing run in March 2020, detector-characterization efforts have lead to increased sensitivity of the detectors, swifter validation of gravitational-wave candidates and improved tools used for data-quality products. In this article, we discuss these efforts in detail and their impact on our ability to detect and study gravitational-waves. These include the multiple instrumental investigations that led to reduction in transient noise, along with the work to improve software tools used to examine the detectors data-quality. We end with a brief discussion on the role and requirements of detector characterization as the sensitivity of our detectors further improves in the future Observing runs., Comment: 35 pages, 18 figures