Search

We address the challenge of utilizing large language models (LLMs) for complex embodied tasks, in the environment where decision-making systems operate timely on capacity-limited, off-the-shelf devices. We present DeDer, a framework for decomposing and distilling the embodied reasoning capabilities from LLMs to efficient, small language model (sLM)-based policies. In DeDer, the decision-making process of LLM-based strategies is restructured into a hierarchy with a reasoning-policy and planning-policy. The reasoning-policy is distilled from the data that is generated through the embodied in-context learning and self-verification of an LLM, so it can produce effective rationales. The planning-policy, guided by the rationales, can render optimized plans efficiently. In turn, DeDer allows for adopting sLMs for both policies, deployed on off-the-shelf devices. Furthermore, to enhance the quality of intermediate rationales, specific to embodied tasks, we devise the embodied knowledge graph, and to generate multiple rationales timely through a single inference, we also use the contrastively prompted attention model. Our experiments with the ALFRED benchmark demonstrate that DeDer surpasses leading language planning and distillation approaches, indicating the applicability and efficiency of sLM-based embodied policies derived through DeDer., Comment: Accepted at ICML 2024

For embodied reinforcement learning (RL) agents interacting with the environment, it is desirable to have rapid policy adaptation to unseen visual observations, but achieving zero-shot adaptation capability is considered as a challenging problem in the RL context. To address the problem, we present a novel contrastive prompt ensemble (ConPE) framework which utilizes a pretrained vision-language model and a set of visual prompts, thus enabling efficient policy learning and adaptation upon a wide range of environmental and physical changes encountered by embodied agents. Specifically, we devise a guided-attention-based ensemble approach with multiple visual prompts on the vision-language model to construct robust state representations. Each prompt is contrastively learned in terms of an individual domain factor that significantly affects the agent's egocentric perception and observation. For a given task, the attention-based ensemble and policy are jointly learned so that the resulting state representations not only generalize to various domains but are also optimized for learning the task. Through experiments, we show that ConPE outperforms other state-of-the-art algorithms for several embodied agent tasks including navigation in AI2THOR, manipulation in egocentric-Metaworld, and autonomous driving in CARLA, while also improving the sample efficiency of policy learning and adaptation., Comment: Accepted at NeurIPS 2023

This study introduces a modified score matching method aimed at generating molecular structures with high energy accuracy. The denoising process of score matching or diffusion models mirrors molecular structure optimization, where scores act like physical force fields that guide particles toward equilibrium states. To achieve energetically accurate structures, it can be advantageous to have the score closely approximate the gradient of the actual potential energy surface. Unlike conventional methods that simply design the target score based on structural differences in Euclidean space, we propose a Riemannian score matching approach. This method represents molecular structures on a manifold defined by physics-informed internal coordinates to efficiently mimic the energy landscape, and performs noising and denoising within this space. Our method has been evaluated by refining several types of starting structures on the QM9 and GEOM datasets, demonstrating that the proposed Riemannian score matching method significantly improves the accuracy of the generated molecular structures, attaining chemical accuracy. The implications of this study extend to various applications in computational chemistry, offering a robust tool for accurate molecular structure prediction.

Assuming Galactic cosmic rays originate in supernovae and the winds of massive stars, starburst galaxies should produce very-high-energy (VHE; E$>$100 GeV) gamma-ray emission via the interaction of their copious quantities of cosmic rays with the large reservoirs of dense gas within the galaxies. Such VHE emission was detected by VERITAS from the starburst galaxy M 82 in 2008-09. An extensive, multi-year campaign followed these initial observations, yielding a total of 254 h of good quality VERITAS data on M 82. Leveraging modern analysis techniques and the larger exposure, these VERITAS data show a more statistically significant VHE signal ($\sim$6.5 standard deviations ($\sigma$)). The corresponding photon spectrum is well fit by a power law ($\Gamma = 2.3 \pm 0.3_{stat} \pm0.2_{sys}$) and the observed integral flux is F($>$450 GeV) = $(3.2 \pm0.6_{stat} \pm 0.6_{sys}) \times 10^{-13}~\mathrm{cm^{-2}~s}^{-1}$, or $\sim$0.4\% of the Crab Nebula flux above the same energy threshold. The improved VERITAS measurements, when combined with various multi-wavelength data, enable modeling of the underlying emission and transport processes. A purely leptonic scenario is found to be a poor representation of the gamma-ray spectral energy distribution (SED). A lepto-hadronic scenario with cosmic rays following a power-law spectrum in momentum (index $s\simeq 2.25$), and with significant bremsstrahlung below $1$~GeV, provides a good match to the observed SED. The synchrotron emission from the secondary electrons indicates that efficient non-radiative losses of cosmic-ray electrons may be related to advective escape from the starburst core., Comment: 15 pages, 7 figures; Accepted for the publication in The Astrophysical Journal (ApJ)

We propose GOTLoc, a robust localization method capable of operating even in outdoor environments where GPS signals are unavailable. The method achieves this robust localization by leveraging comparisons between scene graphs generated from text descriptions and maps. Existing text-based localization studies typically represent maps as point clouds and identify the most similar scenes by comparing embeddings of text and point cloud data. However, point cloud maps have limited scalability as it is impractical to pre-generate maps for all outdoor spaces. Furthermore, their large data size makes it challenging to store and utilize them directly on actual robots. To address these issues, GOTLoc leverages compact data structures, such as scene graphs, to store spatial information, enabling individual robots to carry and utilize large amounts of map data. Additionally, by utilizing publicly available map data, such as OpenStreetMap, which provides global information on outdoor spaces, we eliminate the need for additional effort to create custom map data. For performance evaluation, we utilized the KITTI360Pose dataset in conjunction with corresponding OpenStreetMap data to compare the proposed method with existing approaches. Our results demonstrate that the proposed method achieves accuracy comparable to algorithms relying on point cloud maps. Moreover, in city-scale tests, GOTLoc required significantly less storage compared to point cloud-based methods and completed overall processing within a few seconds, validating its applicability to real-world robotics. Our code is available at https://github.com/donghwijung/GOTLoc.

CTA 102 is a $\gamma$-ray bright blazar that exhibited multiple flares in observations by the Large Area Telescope on board the Fermi Gamma-Ray Space Telescope during the period of 2016-2018. We present results from the analysis of multi-wavelength light curves aiming at revealing the nature of $\gamma$-ray flares from the relativistic jet in the blazar. We analyse radio, optical, X-ray, and $\gamma$-ray data obtained in a period from 2012 September 29 to 2018 October 8. We identify six flares in the $\gamma$-ray light curve, showing a harder-when-brighter-trend in the $\gamma$-ray spectra. We perform a cross-correlation analysis of the multi-wavelength light curves. We find nearly zero time lags between the $\gamma$-ray and optical and X-ray light curves, implying a common spatial origin for the emission in these bands. We find significant correlations between the $\gamma$-ray and radio light curves as well as negative/positive time lags with the $\gamma$-ray emission lagging/leading the radio during different flaring periods. The time lags between $\gamma$-ray and radio emission propose the presence of multiple $\gamma$-ray emission sites in the source. As seen in 43 GHz images from the Very Long Baseline Array, two moving disturbances (or shocks) were newly ejected from the radio core. The $\gamma$-ray flares from 2016 to 2017 are temporally coincident with the interaction between a traveling shock and a quasi-stationary one at $\sim$0.1 mas from the core. The other shock is found to emerge from the core nearly simultaneous with the $\gamma$-ray flare in 2018. Our results suggest that the $\gamma$-ray flares originated from shock-shock interactions., Comment: 14 pages, 15 figures, 4 tables, accepted for publication in A&A

Graph Neural Networks (GNNs) have been widely adopted for their ability to compute expressive node representations in graph datasets. However, serving GNNs on large graphs is challenging due to the high communication, computation, and memory overheads of constructing and executing computation graphs, which represent information flow across large neighborhoods. Existing approximation techniques in training can mitigate the overheads but, in serving, still lead to high latency and/or accuracy loss. To this end, we propose OMEGA, a system that enables low-latency GNN serving for large graphs with minimal accuracy loss through two key ideas. First, OMEGA employs selective recomputation of precomputed embeddings, which allows for reusing precomputed computation subgraphs while selectively recomputing a small fraction to minimize accuracy loss. Second, we develop computation graph parallelism, which reduces communication overhead by parallelizing the creation and execution of computation graphs across machines. Our evaluation with large graph datasets and GNN models shows that OMEGA significantly outperforms state-of-the-art techniques.

Cluster magnetic multipoles are order parameters that describe the symmetry of spin arrangements in magnetic materials. High-order multipoles are particularly important in non-collinear antiferromagnets, where they determine key physical properties such as the anomalous Hall effect and the magneto-optical Kerr effect. Although non-uniform multipole states have been observed at the micrometer scale, their mesoscopic properties remain largely unexplored. In this work, we develop a general micromagnetic formalism for cluster magnetic multipoles, enabling the study of the spin dynamics in non-uniform multipole systems. As an example, we apply this formalism to investigate magnetic-octupole domain-wall dynamics in the non-collinear antiferromagnet Mn3Sn. Our results capture key features of domain-wall motion, including deformation and the emergence of effective inertial mass. This study provides a general framework for studying the dynamics of high-order cluster magnetic multipoles, which is essential for determining the mesoscopic physical properties of non-collinear magnetic materials., Comment: 8 pages, 5 figures

In this paper, we consider the spatially homogeneous Landau equation, which is a variation of the Boltzmann equation in the grazing collision limit. For the Landau equation for hard potentials in the style of Desvillettes-Villani (Comm. Partial Differential Equations, 2000), we provide the proof of the existence of axisymmetric measure-valued solution for any axisymmetric $\mathcal{P}_p(\mathbb{R}^3)$ initial profile for any $p\ge 2$. Moreover, we prove that if the initial data is not a single Dirac mass, then the solution instantaneously becomes analytic for any time $t>0$ in the hard potential case. In the soft potential and the Maxwellian molecule cases, we show that there are no solutions whose support is contained in a fixed line even for any given line-concentrated data., Comment: 21 pages

The development of vision-language models (VLMs) is driven by large-scale and diverse multimodal datasets. However, progress toward generalist biomedical VLMs is limited by the lack of annotated, publicly accessible datasets across biology and medicine. Existing efforts are restricted to narrow domains, missing the full diversity of biomedical knowledge encoded in scientific literature. To address this gap, we introduce BIOMEDICA, a scalable, open-source framework to extract, annotate, and serialize the entirety of the PubMed Central Open Access subset into an easy-to-use, publicly accessible dataset. Our framework produces a comprehensive archive with over 24 million unique image-text pairs from over 6 million articles. Metadata and expert-guided annotations are also provided. We demonstrate the utility and accessibility of our resource by releasing BMCA-CLIP, a suite of CLIP-style models continuously pre-trained on the BIOMEDICA dataset via streaming, eliminating the need to download 27 TB of data locally. On average, our models achieve state-of-the-art performance across 40 tasks - spanning pathology, radiology, ophthalmology, dermatology, surgery, molecular biology, parasitology, and cell biology - excelling in zero-shot classification with a 6.56% average improvement (as high as 29.8% and 17.5% in dermatology and ophthalmology, respectively), and stronger image-text retrieval, all while using 10x less compute. To foster reproducibility and collaboration, we release our codebase and dataset for the broader research community.

Recent successes of artificial intelligence and deep learning often depend on the well-collected training dataset which is assumed to have an identical distribution with the test dataset. However, this assumption, which is called closed-set learning, is hard to meet in realistic scenarios for deploying deep learning models. As one of the solutions to mitigate this assumption, research on out-of-distribution (OOD) detection has been actively explored in various domains. In OOD detection, we assume that we are given the data of a new class that was not seen in the training phase, i.e., outlier, at the evaluation phase. The ultimate goal of OOD detection is to detect and classify such unseen outlier data as a novel "unknown" class. Among various research branches for OOD detection, generating a virtual outlier during the training phase has been proposed. However, conventional generation-based methodologies utilize in-distribution training dataset to imitate outlier instances, which limits the quality of the synthesized virtual outlier instance itself. In this paper, we propose a novel methodology for OOD detection named Auxiliary Range Expansion for Outlier Synthesis, or ARES. ARES models the region for generating out-of-distribution instances by escaping from the given in-distribution region; instead of remaining near the boundary of in-distribution region. Various stages consists ARES to ultimately generate valuable OOD-like virtual instances. The energy score-based discriminator is then trained to effectively separate in-distribution data and outlier data. Quantitative experiments on broad settings show the improvement of performance by our method, and qualitative results provide logical explanations of the mechanism behind it.

How the environment of the host galaxy affects the formation of multiple populations (MPs) in globular clusters (GCs) is one of the outstanding questions in the near-field cosmology. To understand the true nature of the old GC MPs in the Large Magellanic Cloud (LMC), we study the Ca--CN--CH photometry of the old metal-poor LMC GC NGC 2257. We find the predominantly FG-dominated populational number ratio of $n$(FG):$n$(SG) = 61:39($\pm$4), where the FG and SG denote the first and second generations. Both the FG and SG have similar cumulative radial distributions, consistent with the idea that NGC 2257 is dynamically old. We obtain [Fe/H] = $-$1.78$\pm$0.00 dex($\sigma$=0.05 dex) and our metallicity is $\sim$0.2 dex larger than that from the high-resolution spectroscopy by other, due to their significantly lower temperatures by $\sim$ $-$200 K. The NGC 2257 FG shows a somewhat larger metallicity variation than the SG, the first detection of such phenomenon in an old LMC GC, similar to Galactic GCs with MPs, strongly suggesting that it is a general characteristic of GCs with MPs. Interestingly, the NGC 2257 SG does not show a helium enhancement compared to the FG. Our results for the Galactic normal GCs exhibit that the degree of carbon and nitrogen variations are tightly correlated with the GC mass, while NGC 2257 exhibits slightly smaller variations for its mass. We show that old LMC GCs follow the same trends as the Galactic normal GCs in the $\Delta$W$_{\rm CF336W,F438W,F814W}$, $N_{\rm FG}/N_{\rm tot}$, and $\log M/M_{\rm \odot}$ domains. Our result indicates that the environment of the host galaxy did not play a major role in the formation and evolution of GC MPs., Comment: Accepted for publication in The Astronomical Journal; 19 figures and 1 table

Urban traffic systems are characterized by dynamic interactions between congestion and free-flow states, influenced by human activity and road topology. This study employs percolation theory to analyze traffic dynamics in Seoul, focusing on the transition point $q_c$ and Fisher exponent $\tau$. The transition point $q_c$ quantifies the robustness of the free-flow clusters, while the exponent $\tau$ captures the spatial fragmentation of the traffic networks. Our analysis reveals temporal variations in these metrics, with lower $q_c$ and lower $\tau$ values during rush hours representing low-dimensional behavior. Weight-weight correlations are found to significantly impact cluster formation, driving the early onset of dominant traffic states. Comparisons with uncorrelated models highlight the role of real-world correlations. This approach provides a comprehensive framework for evaluating traffic resilience and informs strategies to optimize urban transportation systems., Comment: 7 pages, 5 figures

Early detection of neurocognitive disorders (NCDs) is crucial for timely intervention and disease management. Speech analysis offers a non-intrusive and scalable screening method, particularly through narrative tasks in neuropsychological assessment tools. Traditional narrative analysis often focuses on local indicators in microstructure, such as word usage and syntax. While these features provide insights into language production abilities, they often fail to capture global narrative patterns, or microstructures. Macrostructures include coherence, thematic organization, and logical progressions, reflecting essential cognitive skills potentially critical for recognizing NCDs. Addressing this gap, we propose to investigate specific cognitive and linguistic challenges by analyzing topical shifts, temporal dynamics, and the coherence of narratives over time, aiming to reveal cognitive deficits by identifying narrative impairments, and exploring their impact on communication and cognition. The investigation is based on the CU-MARVEL Rabbit Story corpus, which comprises recordings of a story-telling task from 758 older adults. We developed two approaches: the Dynamic Topic Models (DTM)-based temporal analysis to examine the evolution of topics over time, and the Text-Image Temporal Alignment Network (TITAN) to evaluate the coherence between spoken narratives and visual stimuli. DTM-based approach validated the effectiveness of dynamic topic consistency as a macrostructural metric (F1=0.61, AUC=0.78). The TITAN approach achieved the highest performance (F1=0.72, AUC=0.81), surpassing established microstructural and macrostructural feature sets. Cross-comparison and regression tasks further demonstrated the effectiveness of proposed dynamic macrostructural modeling approaches for NCD detection., Comment: 12 pages, 8 figures

Magnetization switching by charge current without a magnetic field is essential for device applications and information technology. It generally requires a current-induced out-of-plane spin polarization beyond the capability of conventional ferromagnet/heavy-metal systems, where the current-induced spin polarization aligns in-plane orthogonal to the in-plane charge current and out-of-plane spin current. Here, we demonstrate a new approach for magnetic-field-free switching by fabricating a van-der-Waals magnet and oxide Fe3GeTe2/SrTiO3 heterostructure. This new magnetic-field-free switching is possible because the current-driven accumulated spins at the Rashba interface precess around an emergent interface magnetism, eventually producing an ultimate out-of-plane spin polarization. This interpretation is further confirmed by the switching polarity change controlled by the in-plane initialization magnetic fields with clear hysteresis. We successfully combined van-der-Waals magnet and oxide for the first time, especially taking advantage of spin-orbit torque on the SrTiO3 oxide. This allows us to establish a new way of magnetic field-free switching. Our work demonstrates an unusual perpendicular switching application of large spin Hall angle materials and precession of accumulated spins, and in doing so, opens up a new field and opportunities for van-der-Waals magnets and oxide spintronics., Comment: Accepted by Advanced Materials (2025); 47 pages, 4 main figures, 16 supporting figures

Photonic temporal crystals host a variety of intriguing phenomena, from wave amplification and mixing to exotic band structures, all stemming from the time-periodic modulation of optical properties. While these features have been well described classically, their quantum manifestation has remained elusive. Here, we introduce a quantum electrodynamical model of PTCs that reveals a deeper connection between classical and quantum pictures: the classical momentum gap arises from a localization-delocalization quantum phase transition in a Floquet-photonic synthetic lattice. Leveraging an effective Hamiltonian perspective, we pinpoint the critical momenta and highlight how classical exponential field growth manifests itself as wave-packet acceleration in the quantum synthetic space. Remarkably, when a two-level atom is embedded in such a cavity, its Rabi oscillations undergo irreversible decay to a half-and-half mixed state-a previously unobserved phenomenon driven by photonic delocalization within the momentum gap, even with just a single frequency mode. Our findings establish photonic temporal crystals as versatile platforms for studying nonequilibrium quantum photonics and suggest new avenues for controlling light matter interactions through time domain engineering., Comment: 22 pages, 14 figures

Despite several theoretical predictions regarding the physics and application of quantum wells (QWs) of topological crystalline insulators (TCI), no quantized charge transport via helical or chiral edge states has been experimentally demonstrated for such a class of systems. In this study, we report here on a successful growth by molecular beam epitaxy of high crystalline quality Pb$_{1-x}$Sn$_{x}$Se:Bi/Pb$_{1-y}$Eu$_{y}$Se QWs with $x = 0.25$ and $y = 0.1$, and on their magnetotransport characterization as a function of the QW thickness between 10 and 50 nm, temperatures down to 300 mK, perpendicular and tilted magnetic fields up to 36 T. The character of weak antilocalization magnetoresistance and universal conductance fluctuations points to a notably long phase coherence length. It is argued that a relatively large magnitude of the dielectric constant of IV-VI compounds suppresses the decoherence by electron-electron scattering. The observation of Shubnikov-de-Haas oscillations and the quantum Hall effect, together with multiband $k\cdot p$ modelling, have enabled us to assess valley degeneracies, the magnitude of strain, subbands effective masses, the Berry phases, and the topological phase diagram as a function of the QW thickness. Our results demonstrate that further progress in controlling Sn content, carrier densities, and magnetism in Pb$_{1-x}$Sn$_{x}$Se/Pb$_{1-y}$Eu$_{y}$Se QWs will allow for the exploration of the topologically protected quantized edge transport even in the absence of an external magnetic field. Furthermore, a reduced strength of electron-electron interactions will result in the absence of unpaired localized spins in the topological gap and, thus, in a substantially longer topological protection length compared to the quantum spin Hall materials explored so far., Comment: 19 pages, 20 figures in the main text and appendices; comments are welcome; data is available at https://doi.org/10.5281/zenodo.14593670

Atomic and trapped-ion systems are the backbone of a new generation of quantum-based positioning, navigation, and timing (PNT) technologies. The miniaturization of such quantum systems offers tremendous technological advantages, especially the reduction of system size, weight, and power consumption. Yet, this has been limited by the absence of compact, standalone photonic integrated circuits (PICs) at the wavelengths suitable for these instruments. Mobilizing such photonic systems requires development of fully integrated, on-chip, active components at sub-micrometer wavelengths. We demonstrate heterogeneous photonic integrated circuits operating at 980 nm based on wafer-scale bonding of InGaAs quantum well active regions to tantalum pentoxide passive components. This high-yield process provides > 95 % surface area yield and enables integration of > 1300 active components on a 76.2 mm (3 inch) silicon wafer. We present a diverse set of functions, including semiconductor optical amplifiers, Fabry-Perot lasers, and distributed feedback lasers with 43 dB side-mode suppression ratio and > 250 GHz single-mode tuning range. We test the precise wavelength control and system level functionality of the on-chip lasers by pumping optical parametric oscillation processes in microring resonators fabricated on the same platform, generating short-wavelength signals at 778 nm and 752 nm. These results provide a pathway to realize fully functional integrated photonic engines for operation of compact quantum sensors based on atomic and trapped-ion systems., Comment: 12 pages, 5 figures

We explore, through a combination of x-ray diffraction and elastoresistivity measurements, the effect of disorder on the strain-tuned charge density wave and associated multicriticality in Pd$_x$ErTe$_3$ (x = 0, 0.01, 0.02 and 0.026). We focus particularly on the behavior near the strain-tuned bicritical point that occurs in pristine ErTe$_3$ (x=0). Our study reveals that while Pd intercalation somewhat broadens the signatures of the CDW phase transitions, the line of first-order transitions at which the CDW reorients as a function of applied strain persists in the presence of disorder and still seemingly terminates at a critical point. The critical point occurs at a lower temperature and a lower strain compared to pristine ErTe$_3$. Similarly, the nematic elastoresistance of Pd$_x$ErTe$_3$, though suppressed in magnitude and broadened relative to that of ErTe$_3$, has a markedly more symmetric response around the critical point. These observations point to disorder driving a reduction in the system's electronic orthorhombicity even while the material remains irrevocably orthorhombic due to the presence of a glide plane in the crystal structure. Disorder, it would appear, reinforces the emergence of a "pseudo-tetragonal" electronic response in this fundamentally orthorhombic material.

Recent lightweight image captioning models using retrieved data mainly focus on text prompts. However, previous works only utilize the retrieved text as text prompts, and the visual information relies only on the CLIP visual embedding. Because of this issue, there is a limitation that the image descriptions inherent in the prompt are not sufficiently reflected in the visual embedding space. To tackle this issue, we propose ViPCap, a novel retrieval text-based visual prompt for lightweight image captioning. ViPCap leverages the retrieved text with image information as visual prompts to enhance the ability of the model to capture relevant visual information. By mapping text prompts into the CLIP space and generating multiple randomized Gaussian distributions, our method leverages sampling to explore randomly augmented distributions and effectively retrieves the semantic features that contain image information. These retrieved features are integrated into the image and designated as the visual prompt, leading to performance improvements on the datasets such as COCO, Flickr30k, and NoCaps. Experimental results demonstrate that ViPCap significantly outperforms prior lightweight captioning models in efficiency and effectiveness, demonstrating the potential for a plug-and-play solution., Comment: Accepted to AAAI 2025

Variational quantum algorithms (VQAs) have attracted remarkable interest over the past few years because of their potential computational advantages on near-term quantum devices. They leverage a hybrid approach that integrates classical and quantum computing resources to solve high-dimensional problems that are challenging for classical approaches alone. In the training process of variational circuits, constructing an accurate probability distribution for each epoch is not always necessary, creating opportunities to reduce computational costs through shot reduction. However, existing shot-allocation methods that capitalize on this potential often lack adaptive feedback or are tied to specific classical optimizers, which limits their applicability to common VQAs and broader optimization techniques. Our observations indicate that the information entropy of a quantum circuit's output distribution exhibits an approximately exponential relationship with the number of shots needed to achieve a target Hellinger distance. In this work, we propose a distribution-adaptive dynamic shot (DDS) framework that efficiently adjusts the number of shots per iteration in VQAs using the entropy distribution from the prior training epoch. Our results demonstrate that the DDS framework sustains inference accuracy while achieving a ~50% reduction in average shot count compared to fixed-shot training, and ~60% higher accuracy than recently proposed tiered shot allocation methods. Furthermore, in noisy simulations that reflect the error rates of actual IBM quantum systems, DDS achieves approximately a ~30% reduction in the total number of shots compared to the fixed-shot method with minimal degradation in accuracy, and offers about ~70% higher computational accuracy than tiered shot allocation methods., Comment: 18 pages, 24 figures

In this study, we develop an artificial neural network to estimate the infrared (IR) luminosity and star formation rates (SFR) of galaxies. Our network is trained using 'true' IR luminosity values derived from modeling the IR spectral energy distributions (SEDs) of FIR-detected galaxies. We explore five different sets of input features, each incorporating optical, mid-infrared (MIR), near-infrared (NIR), ultraviolet (UV), and emission line data, along with spectroscopic redshifts and uncertainties. All feature sets yield similar IR luminosity predictions, but including all photometric data leads to slightly improved performance. This suggests that comprehensive photometric information enhances the accuracy of our predictions. Our network is applied to a sample of SDSS galaxies defined as unseen data, and the results are compared with three published catalogs of SFRs. Overall, our network demonstrates excellent performance for star-forming galaxies while we observe discrepancies in composite and AGN samples. These inconsistencies may stem from uncertainties inherent in the compared catalogs or potential limitations in the performance of our network., Comment: 13 pages, 7 figures, and 2 tables. Accepted for publication in ApJ

Building a universal multilingual automatic speech recognition (ASR) model that performs equitably across languages has long been a challenge due to its inherent difficulties. To address this task we introduce a Language-Agnostic Multilingual ASR pipeline through orthography Unification and language-specific Transliteration (LAMA-UT). LAMA-UT operates without any language-specific modules while matching the performance of state-of-the-art models trained on a minimal amount of data. Our pipeline consists of two key steps. First, we utilize a universal transcription generator to unify orthographic features into Romanized form and capture common phonetic characteristics across diverse languages. Second, we utilize a universal converter to transform these universal transcriptions into language-specific ones. In experiments, we demonstrate the effectiveness of our proposed method leveraging universal transcriptions for massively multilingual ASR. Our pipeline achieves a relative error reduction rate of 45% when compared to Whisper and performs comparably to MMS, despite being trained on only 0.1% of Whisper's training data. Furthermore, our pipeline does not rely on any language-specific modules. However, it performs on par with zero-shot ASR approaches which utilize additional language-specific lexicons and language models. We expect this framework to serve as a cornerstone for flexible multilingual ASR systems that are generalizable even to unseen languages.

A remarkable characteristic of quantum computing is the potential for reliable computation despite faulty qubits. This can be achieved through quantum error correction, which is typically implemented by repeatedly applying static syndrome checks, permitting correction of logical information. Recently, the development of time-dynamic approaches to error correction has uncovered new codes and new code implementations. In this work, we experimentally demonstrate three time-dynamic implementations of the surface code, each offering a unique solution to hardware design challenges and introducing flexibility in surface code realization. First, we embed the surface code on a hexagonal lattice, reducing the necessary couplings per qubit from four to three. Second, we walk a surface code, swapping the role of data and measure qubits each round, achieving error correction with built-in removal of accumulated non-computational errors. Finally, we realize the surface code using iSWAP gates instead of the traditional CNOT, extending the set of viable gates for error correction without additional overhead. We measure the error suppression factor when scaling from distance-3 to distance-5 codes of $\Lambda_{35,\text{hex}} = 2.15(2)$, $\Lambda_{35,\text{walk}} = 1.69(6)$, and $\Lambda_{35,\text{iSWAP}} = 1.56(2)$, achieving state-of-the-art error suppression for each. With detailed error budgeting, we explore their performance trade-offs and implications for hardware design. This work demonstrates that dynamic circuit approaches satisfy the demands for fault-tolerance and opens new alternative avenues for scalable hardware design., Comment: 11 pages, 5 figures, Supplementary Information

Quantum error correction is essential for bridging the gap between the error rates of physical devices and the extremely low logical error rates required for quantum algorithms. Recent error-correction demonstrations on superconducting processors have focused primarily on the surface code, which offers a high error threshold but poses limitations for logical operations. In contrast, the color code enables much more efficient logic, although it requires more complex stabilizer measurements and decoding techniques. Measuring these stabilizers in planar architectures such as superconducting qubits is challenging, and so far, realizations of color codes have not addressed performance scaling with code size on any platform. Here, we present a comprehensive demonstration of the color code on a superconducting processor, achieving logical error suppression and performing logical operations. Scaling the code distance from three to five suppresses logical errors by a factor of $\Lambda_{3/5}$ = 1.56(4). Simulations indicate this performance is below the threshold of the color code, and furthermore that the color code may be more efficient than the surface code with modest device improvements. Using logical randomized benchmarking, we find that transversal Clifford gates add an error of only 0.0027(3), which is substantially less than the error of an idling error correction cycle. We inject magic states, a key resource for universal computation, achieving fidelities exceeding 99% with post-selection (retaining about 75% of the data). Finally, we successfully teleport logical states between distance-three color codes using lattice surgery, with teleported state fidelities between 86.5(1)% and 90.7(1)%. This work establishes the color code as a compelling research direction to realize fault-tolerant quantum computation on superconducting processors in the near future.

Gallium oxide is a novel advanced material gaining increasing attention for its unique combination of functional properties. It forms in several phases or polymorphs - {\alpha}, {\beta}, {\gamma}, and {\kappa} - having variable properties because of different lattice symmetries. Optical properties are of particular importance as they determine specific device applications and can also be used for phase identification. However, a direct comparison of optical polymorph signatures, including such critical parameters as bandgaps, is challenging due to the scattered, limited, or even absent data for certain phases in the literature. To address this issue, in the present work we systematically cross-correlate optical emission and absorption features of {\alpha}, {\beta}, {\gamma}, and {\kappa} thin films, as well as differently oriented {\beta}-phase bulk crystals and {\gamma}/{\beta} double polymorph structures. We demonstrate that the optical bandgap and emission features scale consistently across these polymorphs upon minimization of the methodological uncertainties. As a result, this work provides a comparative library of near- and far-field optical signatures of the polymorphs for use by the multidisciplinary research community working with gallium oxide., Comment: 17 pages, 14 figures, 4 tables

Recent medical vision-language models (VLMs) have shown promise in 2D medical image interpretation. However extending them to 3D medical imaging has been challenging due to computational complexities and data scarcity. Although a few recent VLMs specified for 3D medical imaging have emerged, all are limited to learning volumetric representation of a 3D medical image as a set of sub-volumetric features. Such process introduces overly correlated representations along the z-axis that neglect slice-specific clinical details, particularly for 3D medical images where adjacent slices have low redundancy. To address this limitation, we introduce MS-VLM that mimic radiologists' workflow in 3D medical image interpretation. Specifically, radiologists analyze 3D medical images by examining individual slices sequentially and synthesizing information across slices and views. Likewise, MS-VLM leverages self-supervised 2D transformer encoders to learn a volumetric representation that capture inter-slice dependencies from a sequence of slice-specific features. Unbound by sub-volumetric patchification, MS-VLM is capable of obtaining useful volumetric representations from 3D medical images with any slice length and from multiple images acquired from different planes and phases. We evaluate MS-VLM on publicly available chest CT dataset CT-RATE and in-house rectal MRI dataset. In both scenarios, MS-VLM surpasses existing methods in radiology report generation, producing more coherent and clinically relevant reports. These findings highlight the potential of MS-VLM to advance 3D medical image interpretation and improve the robustness of medical VLMs.

This paper studies a hybrid language model (HLM) architecture that integrates a small language model (SLM) operating on a mobile device with a large language model (LLM) hosted at the base station (BS) of a wireless network. The HLM token generation process follows the speculative inference principle: the SLM's vocabulary distribution is uploaded to the LLM, which either accepts or rejects it, with rejected tokens being resampled by the LLM. While this approach ensures alignment between the vocabulary distributions of the SLM and LLM, it suffers from low token throughput due to uplink transmission and the computation costs of running both language models. To address this, we propose a novel HLM structure coined Uncertainty-aware opportunistic HLM (U-HLM), wherein the SLM locally measures its output uncertainty and skips both uplink transmissions and LLM operations for tokens that are likely to be accepted. This opportunistic skipping is enabled by our empirical finding of a linear correlation between the SLM's uncertainty and the LLM's rejection probability. We analytically derive the uncertainty threshold and evaluate its expected risk of rejection. Simulations show that U-HLM reduces uplink transmissions and LLM computations by 45.93%, while achieving up to 97.54% of the LLM's inference accuracy and 2.54$\times$ faster token throughput than HLM without skipping., Comment: 6 pages, 6 figures; This work has been submitted to the IEEE for possible publication

As Generative AI continues to become more accessible, the case for robust detection of generated images in order to combat misinformation is stronger than ever. Invisible watermarking methods act as identifiers of generated content, embedding image- and latent-space messages that are robust to many forms of perturbations. The majority of current research investigates full-image attacks against images with a single watermarking method applied. We introduce novel improvements to watermarking robustness as well as minimizing degradation on image quality during attack. Firstly, we examine the application of both image-space and latent-space watermarking methods on a single image, where we propose a custom watermark remover network which preserves one of the watermarking modalities while completely removing the other during decoding. Then, we investigate localized blurring attacks (LBA) on watermarked images based on the GradCAM heatmap acquired from the watermark decoder in order to reduce the amount of degradation to the target image. Our evaluation suggests that 1) implementing the watermark remover model to preserve one of the watermark modalities when decoding the other modality slightly improves on the baseline performance, and that 2) LBA degrades the image significantly less compared to uniform blurring of the entire image. Code is available at: https://github.com/tomputer-g/IDL_WAR, Comment: YouTube link for the presentation: https://www.youtube.com/watch?v=0vwFG1HSrUE

We report on the fault-tolerant operation of logical qubits on a neutral atom quantum computer, with logical performance surpassing physical performance for multiple circuits including Bell states (12x error reduction), random circuits (15x), and a prototype Anderson Impurity Model ground state solver for materials science applications (up to 6x, non-fault-tolerantly). The logical qubits are implemented via the [[4, 2, 2]] code (C4). Our work constitutes the first complete realization of the benchmarking protocol proposed by Gottesman 2016 [1] demonstrating results consistent with fault-tolerance. In light of recent advances on applying concatenated C4/C6 detection codes to achieve error correction with high code rates and thresholds, our work can be regarded as a building block towards a practical scheme for fault tolerant quantum computation. Our demonstration of a materials science application with logical qubits particularly demonstrates the immediate value of these techniques on current experiments.

We introduce a new class of attacks on commercial-scale (human-aligned) language models that induce jailbreaking through targeted bitwise corruptions in model parameters. Our adversary can jailbreak billion-parameter language models with fewer than 25 bit-flips in all cases$-$and as few as 5 in some$-$using up to 40$\times$ less bit-flips than existing attacks on computer vision models at least 100$\times$ smaller. Unlike prompt-based jailbreaks, our attack renders these models in memory 'uncensored' at runtime, allowing them to generate harmful responses without any input modifications. Our attack algorithm efficiently identifies target bits to flip, offering up to 20$\times$ more computational efficiency than previous methods. This makes it practical for language models with billions of parameters. We show an end-to-end exploitation of our attack using software-induced fault injection, Rowhammer (RH). Our work examines 56 DRAM RH profiles from DDR4 and LPDDR4X devices with different RH vulnerabilities. We show that our attack can reliably induce jailbreaking in systems similar to those affected by prior bit-flip attacks. Moreover, our approach remains effective even against highly RH-secure systems (e.g., 46$\times$ more secure than previously tested systems). Our analyses further reveal that: (1) models with less post-training alignment require fewer bit flips to jailbreak; (2) certain model components, such as value projection layers, are substantially more vulnerable than others; and (3) our method is mechanistically different than existing jailbreaks. Our findings highlight a pressing, practical threat to the language model ecosystem and underscore the need for research to protect these models from bit-flip attacks.

We envision future technologies through science fiction, strategic planning, or academic research. Yet, our expectations do not always match with what actually unfolds, much like navigating a story where some events align with expectations while others surprise us. This gap indicates the inherent uncertainty of innovation-how technologies emerge and evolve in unpredictable ways. Here, we elaborate on this inherent uncertainty of innovation in the way technologies emerge and evolve. We define suspense captures accumulated uncertainty and describing events anticipated before their realization, while surprise represents a dramatic shift in understanding when an event occurs unexpectedly. We identify those connections in U.S. patents and show that suspenseful innovations tend to integrate more smoothly into society, achieving higher citations and market value. In contrast, surprising innovations, though often disruptive and groundbreaking, face challenges in adoption due to their extreme novelty. We further show that these categories allow us to identify distinct stages of technology life cycles, suggesting a way to identify the systematic trajectory of technologies and anticipate their future paths., Comment: 15 pages, 4 figures, 4 supplementary figures

Sulfide solid state electrolytes are promising candidates to realize all solid state batteries due to their superior ionic conductivity and excellent ductility. However, their hypersensitivity to moisture requires processing environments that are not compatible with todays lithium ion battery manufacturing infrastructure. Herein, we present a reversible surface modification strategy that enables the processability of sulfide SSEs under humid ambient air. We demonstrate that a long chain alkyl thiol, undecanethiol, is chemically compatible with the electrolyte with negligible impact on its ion conductivity. Importantly, the thiol modification extends the amount of time that the sulfide SSE can be exposed to air with 33 percent relative humidity with limited degradation of its structure while retaining a conductivity of above 1 mS per cm for up to 2 days, a more than 100 fold improvement in protection time over competing approaches. Experimental and computational results reveal that the thiol group anchors to the SSE surface, while the hydrophobic hydrocarbon tail provides protection by repelling water. The modified Li6PS5Cl SSE maintains its function after exposure to ambient humidity when implemented in a Li0.5In LiNi0.8Co0.1Mn0.1O2 ASSB. The proposed protection strategy based on surface molecular interactions represents a major step forward towards cost competitive and energy efficient sulfide SSE manufacturing for ASSB applications., Comment: 38 pages, 6 figures

We present the development of a decay energy spectroscopy (DES) method for the analysis of radioactive impurities using magnetic microcalorimeters (MMCs). The DES system was designed to analyze radionuclides, such as Ra-226, Th-228, and their daughter nuclides, in materials like copper, commonly used in rare-event search experiments. We tested the DES system with a gold foil absorber measuring 20x20x0.05 mm^3, large enough to accommodate a significant drop of source solution. Using this large absorber and an MMC sensor, we conducted a long-term measurement over ten days of live time, requiring 11 ADR cooling cycles. The combined spectrum achieved an energy resolution of 45 keV FWHM, sufficient to identify most alpha and DES peaks of interest. Specific decay events from radionuclide contaminants in the absorber were identified. This experiment confirms the capability of the DES system to measure alpha decay chains of Ra-226 and Th-228, offering a promising method for radio-impurity evaluation in ultra-low background experiments., Comment: 5 pages, 5 figures

Relying on the representation power of neural networks, most recent works have often neglected several factors involved in haze degradation, such as transmission (the amount of light reaching an observer from a scene over distance) and atmospheric light. These factors are generally unknown, making dehazing problems ill-posed and creating inherent uncertainties. To account for such uncertainties and factors involved in haze degradation, we introduce a variational Bayesian framework for single image dehazing. We propose to take not only a clean image and but also transmission map as latent variables, the posterior distributions of which are parameterized by corresponding neural networks: dehazing and transmission networks, respectively. Based on a physical model for haze degradation, our variational Bayesian framework leads to a new objective function that encourages the cooperation between them, facilitating the joint training of and thereby boosting the performance of each other. In our framework, a dehazing network can estimate a clean image independently of a transmission map estimation during inference, introducing no overhead. Furthermore, our model-agnostic framework can be seamlessly incorporated with other existing dehazing networks, greatly enhancing the performance consistently across datasets and models., Comment: Published in CIKM 2023, 10 pages, 9 figures

Multimodal large language models (MLLMs) have recently shown significant advancements in video understanding, excelling in content reasoning and instruction-following tasks. However, the problem of hallucination, where models generate inaccurate or misleading content, remains underexplored in the video domain. Building on the observation that the visual encoder of MLLMs often struggles to differentiate between video pairs that are visually distinct but semantically similar, we introduce VidHalluc, the largest benchmark designed to examine hallucinations in MLLMs for video understanding tasks. VidHalluc assesses hallucinations across three critical dimensions: (1) action, (2) temporal sequence, and (3) scene transition. VidHalluc consists of 5,002 videos, paired based on semantic similarity and visual differences, focusing on cases where hallucinations are most likely to occur. Through comprehensive testing, our experiments show that most MLLMs are vulnerable to hallucinations across these dimensions. Furthermore, we propose DINO-HEAL, a training-free method that reduces hallucinations by incorporating spatial saliency information from DINOv2 to reweight visual features during inference. Our results demonstrate that DINO-HEAL consistently improves performance on VidHalluc, achieving an average improvement of 3.02% in mitigating hallucinations among all tasks. Both the VidHalluc benchmark and DINO-HEAL code can be accessed via $\href{https://vid-halluc.github.io/}{\text{this link}}$.

The topological properties of gapped graphene have been explored for valleytronics applications. Prior transport experiments indicated their topological nature through large nonlocal resistance in Hall-bar devices, but the origin of this resistance was unclear. This study focused on dual-gate bilayer graphene (BLG) devices with naturally cleaved edges, examining how edge-etching with an oxygen plasma process affects electron transport. Before etching, local resistance at the charge neutral point increased exponentially with the displacement field and nonlocal resistance was well explained by ohmic contribution, which is typical of gapped BLG. After-etching, however, local resistance saturated with increasing displacement field, and nonlocal resistance deviated by three orders of magnitude from ohmic contribution. We suggest that these significant changes in local and nonlocal resistance arise from the formation of edge conducting pathways after the edge-etching, rather than from a topological property of gapped BLG that has been claimed in previous literatures., Comment: 22 pages, 6 figures

Employing large language models (LLMs) to enable embodied agents has become popular, yet it presents several limitations in practice. In this work, rather than using LLMs directly as agents, we explore their use as tools for embodied agent learning. Specifically, to train separate agents via offline reinforcement learning (RL), an LLM is used to provide dense reward feedback on individual actions in training datasets. In doing so, we present a consistency-guided reward ensemble framework (CoREN), designed for tackling difficulties in grounding LLM-generated estimates to the target environment domain. The framework employs an adaptive ensemble of spatio-temporally consistent rewards to derive domain-grounded rewards in the training datasets, thus enabling effective offline learning of embodied agents in different environment domains. Experiments with the VirtualHome benchmark demonstrate that CoREN significantly outperforms other offline RL agents, and it also achieves comparable performance to state-of-the-art LLM-based agents with 8B parameters, despite CoREN having only 117M parameters for the agent policy network and using LLMs only for training., Comment: Findings of EMNLP-2024 Camera Ready Version

Recent advances in data-driven research have shown great potential in understanding the intricate relationships between materials and their performances. Herein, we introduce a novel multi modal data-driven approach employing an Automatic Battery data Collector (ABC) that integrates a large language model (LLM) with an automatic graph mining tool, Material Graph Digitizer (MatGD). This platform enables state-of-the-art accurate extraction of battery material data and cyclability performance metrics from diverse textual and graphical data sources. From the database derived through the ABC platform, we developed machine learning models that can accurately predict the capacity and stability of lithium metal batteries, which is the first-ever model developed to achieve such predictions. Our models were also experimentally validated, confirming practical applicability and reliability of our data-driven approach., Comment: 30 pages, 7 figures

This paper investigates the geometry of regular Hessenberg varieties associated with the minimal indecomposable Hessenberg space in the flag variety of a complex reductive group. These varieties form a flat family of irreducible subvarieties of the flag variety, encompassing notable examples such as the Peterson variety and toric varieties linked to Weyl chambers. Our first main result computes the closures of affine cells that pave these varieties explicitly, establishing a correspondence between Hessenberg--Schubert varieties and regular Hessenberg varieties in smaller dimensional flag varieties. We also analyze the singular locus of these varieties, proving that all regular Hessenberg varieties are singular outside of the toric case. Specifically, we extend previous results on the singular locus of the Peterson variety to all Lie types. Additionally, we provide detailed descriptions of Hessenberg--Schubert variety inclusion relations, a combinatorial characterization of smooth Hessenberg--Schubert varieties, and simple formulas for their $K$-theory and cohomology classes. The paper also includes a classification of all singular permutation flags in each regular Hessenberg variety in type A, linking them to combinatorial patterns, and generalizes these findings using root-theoretic data to all Lie types.

Graphene's exceptional electronic mobility, gate-tunability, and contact transparency with superconducting materials make it ideal for exploring the superconducting proximity effect. However, the work function difference between graphene and superconductors causes unavoidable doping of graphene near contacts, forming a p-n junction in the hole-doped regime and reducing contact transparency. This challenges the device implementation that exploits graphene's bipolarity. To address this limitation, we developed a new fabrication scheme for two-dimensional superconducting contacts that allows independent control over charge concentration and polarity for both the graphene in contact with superconductors and the graphene channel. Contact transparency, conductance enhancement, and Josephson coupling were measured to confirm transparent contacts to both polarities of graphene. Moreover, we demonstrated the Andreev process in the quantum Hall edge state at a negative filling factor of {\nu} = -2. This scheme will open avenues for realizing various theoretical propositions utilizing the bipolarity of graphene combined with superconductivity., Comment: 20 pages, 10 figures

This paper explores the potential of leveraging language priors learned by text-to-image diffusion models to address ambiguity and visual nuisance in monocular depth estimation. Particularly, traditional monocular depth estimation suffers from inherent ambiguity due to the absence of stereo or multi-view depth cues, and nuisance due to lack of robustness of vision. We argue that language prior in diffusion models can enhance monocular depth estimation by leveraging the geometric prior aligned with the language description, which is learned during text-to-image pre-training. To generate images that reflect the text properly, the model must comprehend the size and shape of specified objects, their spatial relationship, and the scale of the scene. Thus, we propose PriorDiffusion, using a pre-trained text-to-image diffusion model that takes both image and text description that aligned with the scene to infer affine-invariant depth through a denoising process. We also show that language priors can guide the model's attention to specific regions and help it perceive the 3D scene in alignment with user intent. Simultaneously, it acts as a constraint to accelerate the convergence of the diffusion trajectory, since learning 3D properties from a condensed, low-dimensional language feature is more efficient compared with learning from a redundant, high-dimensional image feature. By training on HyperSim and Virtual KITTI, we achieve state-of-the-art zero-shot performance and a faster convergence speed, compared with other diffusion-based depth estimators, across NYUv2, KITTI, ETH3D, and ScanNet.

Despite the growing interest in Mamba architecture as a potential replacement for Transformer architecture, parameter-efficient fine-tuning (PEFT) approaches for Mamba remain largely unexplored. In our study, we introduce two key insights-driven strategies for PEFT in Mamba architecture: (1) While state-space models (SSMs) have been regarded as the cornerstone of Mamba architecture, then expected to play a primary role in transfer learning, our findings reveal that Projectors -- not SSMs -- are the predominant contributors to transfer learning, and (2) Based on our observation that adapting pretrained Projectors to new tasks can be effectively approximated through a near-diagonal linear transformation, we propose a novel PEFT method specialized to Mamba architecture: Projector-targeted Diagonal-centric Linear Transformation (ProDiaL). ProDiaL focuses on optimizing only diagonal-centric linear transformation matrices, without directly fine-tuning the pretrained Projector weights. This targeted approach allows efficient task adaptation, utilizing less than 1% of the total parameters, and exhibits strong performance across both vision and language Mamba models, highlighting its versatility and effectiveness.

In this paper we formulate the almost invariant subspaces theorems of backward shift operators in terms of the ranges or kernels of product of Toeplitz and Hankel operators. This approach simplifies and gives more explicit forms of these almost invariant subspaces which are derived from related nearly backward shift invariant subspaces with finite defect. Furthermore, this approach also leads to the surprising result that the almost invariant subspaces of backward shift operators are the same as the almost invariant subspaces of forward shift operators which were treated only briefly in literature., Comment: 21 pages

Domain generalizable person re-identification (DG re-ID) aims to learn discriminative representations that are robust to distributional shifts. While data augmentation is a straightforward solution to improve generalization, certain augmentations exhibit a polarized effect in this task, enhancing in-distribution performance while deteriorating out-of-distribution performance. In this paper, we investigate this phenomenon and reveal that it leads to sparse representation spaces with reduced uniformity. To address this issue, we propose a novel framework, Balancing Alignment and Uniformity (BAU), which effectively mitigates this effect by maintaining a balance between alignment and uniformity. Specifically, BAU incorporates alignment and uniformity losses applied to both original and augmented images and integrates a weighting strategy to assess the reliability of augmented samples, further improving the alignment loss. Additionally, we introduce a domain-specific uniformity loss that promotes uniformity within each source domain, thereby enhancing the learning of domain-invariant features. Extensive experimental results demonstrate that BAU effectively exploits the advantages of data augmentation, which previous studies could not fully utilize, and achieves state-of-the-art performance without requiring complex training procedures. The code is available at \url{https://github.com/yoonkicho/BAU}., Comment: NeurIPS 2024

In this paper, we propose a conceptual framework for personalized brain-computer interface (BCI) applications, which can offer an enhanced user experience by customizing services to individual preferences and needs, based on endogenous electroencephalography (EEG) paradigms including motor imagery (MI), speech imagery (SI), and visual imagery. The framework includes two essential components: user identification and intention classification, which enable personalized services by identifying individual users and recognizing their intended actions through EEG signals. We validate the feasibility of our framework using a private EEG dataset collected from eight subjects, employing the ShallowConvNet architecture to decode EEG features. The experimental results demonstrate that user identification achieved an average classification accuracy of 0.995, while intention classification achieved 0.47 accuracy across all paradigms, with MI demonstrating the best performance. These findings indicate that EEG signals can effectively support personalized BCI applications, offering robust identification and reliable intention decoding, especially for MI and SI., Comment: Submissoion version for IEEE International BCI Winter Conference 2025

Magnons carriers of spin information can be controlled by electric fields in the multiferroic BiFeO$_3$ (BFO), a milestone that brings magnons closer to application in future devices. The origin of magnon-spin currents in BFO, however, is not fully understood due to BFO's complicated magnetic texture. In this letter, we present a phenomenological model to elucidate the existence of magnon spin currents in generalized multiferroics by examining the symmetries inherent to their magnetic and polar structures. This model is grounded in experimental data obtained from BFO and its derivatives, which informs the symmetry operations and resultant magnon behavior. By doing so, we address the issue of symmetry-allowed, switchable magnon spin transport in multiferroics, thereby establishing a critical framework for comprehending magnon transport within complex magnetic textures., Comment: 6 Pages, 3 Figures

Vibrometry-based side channels pose a significant privacy risk, exploiting sensors like mmWave radars, light sensors, and accelerometers to detect vibrations from sound sources or proximate objects, enabling speech eavesdropping. Despite various proposed defenses, these involve costly hardware solutions with inherent physical limitations. This paper presents EveGuard, a software-driven defense framework that creates adversarial audio, protecting voice privacy from side channels without compromising human perception. We leverage the distinct sensing capabilities of side channels and traditional microphones where side channels capture vibrations and microphones record changes in air pressure, resulting in different frequency responses. EveGuard first proposes a perturbation generator model (PGM) that effectively suppresses sensor-based eavesdropping while maintaining high audio quality. Second, to enable end-to-end training of PGM, we introduce a new domain translation task called Eve-GAN for inferring an eavesdropped signal from a given audio. We further apply few-shot learning to mitigate the data collection overhead for Eve-GAN training. Our extensive experiments show that EveGuard achieves a protection rate of more than 97 percent from audio classifiers and significantly hinders eavesdropped audio reconstruction. We further validate the performance of EveGuard across three adaptive attack mechanisms. We have conducted a user study to verify the perceptual quality of our perturbed audio.

Many state-of-the-art computer vision architectures leverage U-Net for its adaptability and efficient feature extraction. However, the multi-resolution convolutional design often leads to significant computational demands, limiting deployment on edge devices. We present a streamlined alternative: a 1D convolutional encoder that retains accuracy while enhancing its suitability for edge applications. Our novel encoder architecture achieves semantic segmentation through channel-wise 1D convolutions combined with pixel-unshuffle operations. By incorporating PixelShuffle, known for improving accuracy in super-resolution tasks while reducing computational load, OneNet captures spatial relationships without requiring 2D convolutions, reducing parameters by up to 47%. Additionally, we explore a fully 1D encoder-decoder that achieves a 71% reduction in size, albeit with some accuracy loss. We benchmark our approach against U-Net variants across diverse mask-generation tasks, demonstrating that it preserves accuracy effectively. Although focused on image segmentation, this architecture is adaptable to other convolutional applications. Code for the project is available at https://github.com/shbyun080/OneNet .