Search

In semiconducting monolayer transition metal dichalcogenides (ML-TMDs), broken inversion symmetry and strong spin-orbit coupling result in spin-valley lock-in effects so that the valley degeneracy may be lifted by external magnetic fields, potentially leading to real-space structural transformation. Here, we report magnetic field (B)-induced giant electric hysteretic responses to back-gate voltages in ML-MoS2 field-effect transistors (FETs) on SiO2/Si at temperatures < 20 K. The observed hysteresis increases with |B| up to 12 T and is tunable by varying the temperature. Raman spectroscopic and scanning tunneling microscopic studies reveal significant lattice expansion with increasing |B| at 4.2 K, and this lattice expansion becomes asymmetric in ML-MoS2 FETs on rigid SiO2/Si substrates, leading to out-of-plane mirror symmetry breaking and the emergence of a tunable out-of-plane ferroelectric-like polar order. This broken symmetry-induced polarization in ML-MoS2 shows typical ferroelectric butterfly hysteresis in piezo-response force microscopy, adding ML-MoS2 to the single-layer material family that exhibit out-of-plane polar order-induced ferroelectricity, which is promising for such technological applications as cryo-temperature ultracompact non-volatile memories, memtransistors, and ultrasensitive magnetic field sensors. Moreover, the polar effect induced by asymmetric lattice expansion may be further generalized to other ML-TMDs and achieved by nanoscale strain engineering of the substrate without magnetic fields.

Sparse Mixture-of-Experts (SMoE) models represent a significant breakthrough in large language model development. These models enable performance improvements without a proportional increase in inference costs. By selectively activating a small set of parameters during task execution, SMoEs enhance model capacity. However, their deployment remains challenging due to the substantial memory footprint required to accommodate the growing number of experts. This constraint renders them less feasible in environments with limited hardware resources. To address this challenge, we propose Hierarchical Clustering for Sparsely activated Mixture of Experts (HC-SMoE), a task-agnostic expert merging framework that reduces SMoE model parameters without retraining. Unlike previous methods, HC-SMoE employs hierarchical clustering based on expert outputs. This approach ensures that the merging process remains unaffected by routing decisions. The output-based clustering strategy captures functional similarities between experts, offering an adaptable solution for models with numerous experts. We validate our approach through extensive experiments on eight zero-shot language tasks and demonstrate its effectiveness in large-scale SMoE models such as Qwen and Mixtral. Our comprehensive results demonstrate that HC-SMoE consistently achieves strong performance, which highlights its potential for real-world deployment., Comment: Code: https://github.com/wazenmai/HC-SMoE

Learning from observation (LfO) aims to imitate experts by learning from state-only demonstrations without requiring action labels. Existing adversarial imitation learning approaches learn a generator agent policy to produce state transitions that are indistinguishable to a discriminator that learns to classify agent and expert state transitions. Despite its simplicity in formulation, these methods are often sensitive to hyperparameters and brittle to train. Motivated by the recent success of diffusion models in generative modeling, we propose to integrate a diffusion model into the adversarial imitation learning from observation framework. Specifically, we employ a diffusion model to capture expert and agent transitions by generating the next state, given the current state. Then, we reformulate the learning objective to train the diffusion model as a binary classifier and use it to provide "realness" rewards for policy learning. Our proposed framework, Diffusion Imitation from Observation (DIFO), demonstrates superior performance in various continuous control domains, including navigation, locomotion, manipulation, and games. Project page: https://nturobotlearninglab.github.io/DIFO, Comment: NeurIPS 2024. Project page: https://nturobotlearninglab.github.io/DIFO

Scene coordinate regression (SCR) methods have emerged as a promising area of research due to their potential for accurate visual localization. However, many existing SCR approaches train on samples from all image regions, including dynamic objects and texture-less areas. Utilizing these areas for optimization during training can potentially hamper the overall performance and efficiency of the model. In this study, we first perform an in-depth analysis to validate the adverse impacts of these areas. Drawing inspiration from our analysis, we then introduce an error-guided feature selection (EGFS) mechanism, in tandem with the use of the Segment Anything Model (SAM). This mechanism seeds low reprojection areas as prompts and expands them into error-guided masks, and then utilizes these masks to sample points and filter out problematic areas in an iterative manner. The experiments demonstrate that our method outperforms existing SCR approaches that do not rely on 3D information on the Cambridge Landmarks and Indoor6 datasets., Comment: ECCV2024

Propagation of interplanetary (IP) shocks, particularly those driven by coronal mass ejections (CMEs), is still an outstanding question in heliophysics and space weather forecasting. Here we address effects of the ambient solar wind on the propagation of two similar CME-driven shocks from the Sun to Earth. The two shock events (CME03: April 3, 2010 and CME12: July 12, 2012) have the following properties: Both events (1) were driven by a halo CME (i.e., source location is near the Sun-Earth line), (2) had a CME source in the southern hemisphere, (3) had a similar transit time (~2 days) to Earth, (4) occurred in a non-quiet solar period, and (5) led to a severe geomagnetic storm. The initial (near the Sun) propagation speed, as measured by coronagraph images, was slower (by ~300 km/s) for CME03 than CME12, but it took about the same amount of traveling time for both events to reach Earth. According to the in-situ solar wind observations from the Wind spacecraft, the CME03-driven shock was associated with a faster solar wind upstream of the shock than the CME12-driven shock. This is also demonstrated in our global MHD simulations. Analysis of our simulation result indicates that the drag force indirectly plays an important role in the shock propagation. The present study suggests that in addition to the initial CME propagation speed near the Sun the shock speed (in the inertial frame) and the ambient solar wind condition, in particular the solar wind speed, are the key to timing the arrival of CME-driven-shock events., Comment: in press

Understanding node representations in graph-based models is crucial for uncovering biases ,diagnosing errors, and building trust in model decisions. However, previous work on explainable AI for node representations has primarily emphasized explanations (reasons for model predictions) rather than interpretations (mapping representations to understandable concepts). Furthermore, the limited research that focuses on interpretation lacks validation, and thus the reliability of such methods is unclear. We address this gap by proposing a novel interpretation method-Node Coherence Rate for Representation Interpretation (NCI)-which quantifies how well different node relations are captured in node representations. We also propose a novel method (IME) to evaluate the accuracy of different interpretation methods. Our experimental results demonstrate that NCI reduces the error of the previous best approach by an average of 39%. We then apply NCI to derive insights about the node representations produced by several graph-based methods and assess their quality in unsupervised settings.

The recent segmentation foundation model, Segment Anything Model (SAM), exhibits strong zero-shot segmentation capabilities, but it falls short in generating fine-grained precise masks. To address this limitation, we propose a novel zero-shot image matting model, called ZIM, with two key contributions: First, we develop a label converter that transforms segmentation labels into detailed matte labels, constructing the new SA1B-Matte dataset without costly manual annotations. Training SAM with this dataset enables it to generate precise matte masks while maintaining its zero-shot capability. Second, we design the zero-shot matting model equipped with a hierarchical pixel decoder to enhance mask representation, along with a prompt-aware masked attention mechanism to improve performance by enabling the model to focus on regions specified by visual prompts. We evaluate ZIM using the newly introduced MicroMat-3K test set, which contains high-quality micro-level matte labels. Experimental results show that ZIM outperforms existing methods in fine-grained mask generation and zero-shot generalization. Furthermore, we demonstrate the versatility of ZIM in various downstream tasks requiring precise masks, such as image inpainting and 3D NeRF. Our contributions provide a robust foundation for advancing zero-shot matting and its downstream applications across a wide range of computer vision tasks. The code is available at \url{https://github.com/naver-ai/ZIM}., Comment: preprint (21 pages, 16 figures, and 8 tables)

This paper presents the first steps toward a soft dolphin robot using a bio-inspired approach to mimic dolphin flexibility. The current dolphin robot uses a minimalist approach, with only two actuated cable-driven degrees of freedom actuated by a pair of motors. The actuated tail moves up and down in a swimming motion, but this first proof of concept does not permit controlled turns of the robot. While existing robotic dolphins typically use revolute joints to articulate rigid bodies, our design -- which will be made opensource -- incorporates a flexible tail with tunable silicone skin and actuation flexibility via a cable-driven system, which mimics muscle dynamics and design flexibility with a tunable skeleton structure. The design is also tunable since the backbone can be easily printed in various geometries. The paper provides insights into how a few such variations affect robot motion and efficiency, measured by speed and cost of transport (COT). This approach demonstrates the potential of achieving dolphin-like motion through enhanced flexibility in bio-inspired robotics., Comment: 7 pages, 13 figures

Recent large language models (LLMs) have demonstrated promising capabilities in modeling real-world knowledge and enhancing knowledge-based generation tasks. In this paper, we further explore the potential of using LLMs to aid in the design of soft modular robots, taking into account both user instructions and physical laws, to reduce the reliance on extensive trial-and-error experiments typically needed to achieve robot designs that meet specific structural or task requirements. Specifically, we formulate the robot design process as a sequence generation task and find that LLMs are able to capture key requirements expressed in natural language and reflect them in the construction sequences of robots. To simplify, rather than conducting real-world experiments to assess design quality, we utilize a simulation tool to provide feedback to the generative model, allowing for iterative improvements without requiring extensive human annotations. Furthermore, we introduce five evaluation metrics to assess the quality of robot designs from multiple angles including task completion and adherence to instructions, supporting an automatic evaluation process. Our model performs well in evaluations for designing soft modular robots with uni- and bi-directional locomotion and stair-descending capabilities, highlighting the potential of using natural language and LLMs for robot design. However, we also observe certain limitations that suggest areas for further improvement., Comment: 8 pages, 7 figures

The orbital Hall effect (OHE) is attracting recent interest due to its fundamental science implications and potential applications in orbitronics and spintronics. Unlike the spin Hall effect, the connection between the OHE and band topology is not well understood. Here we present a novel approach for understanding the OHE based on analyzing the projected orbital angular momentum (POAM) spectrum. By considering monolayers of group IV elements, we demonstrate that the Wannier charge centers of the POAM spectrum display topologically nontrivial windings. The orbital Hall conductivity is found to form a plateau within the band gap as a direct consequence of the Chern number carried by the POAM spectrum. The topological orbital Hall phase is shown to yield a new form of bulk-boundary correspondence, which features gapless states in the POAM spectrum and induces nonzero orbital textures at the boundaries that should be amenable to experimental verification through ARPES measurements. Our study presents a systematic method for investigating the topological OHE and provides a pathway for its broader exploration in two-dimensional materials.

Softmax Loss (SL) is widely applied in recommender systems (RS) and has demonstrated effectiveness. This work analyzes SL from a pairwise perspective, revealing two significant limitations: 1) the relationship between SL and conventional ranking metrics like DCG is not sufficiently tight; 2) SL is highly sensitive to false negative instances. Our analysis indicates that these limitations are primarily due to the use of the exponential function. To address these issues, this work extends SL to a new family of loss functions, termed Pairwise Softmax Loss (PSL), which replaces the exponential function in SL with other appropriate activation functions. While the revision is minimal, we highlight three merits of PSL: 1) it serves as a tighter surrogate for DCG with suitable activation functions; 2) it better balances data contributions; and 3) it acts as a specific BPR loss enhanced by Distributionally Robust Optimization (DRO). We further validate the effectiveness and robustness of PSL through empirical experiments. The code is available at https://github.com/Tiny-Snow/IR-Benchmark.

3D Gaussian Splatting (3DGS) has become a crucial method for acquiring 3D assets. To protect the copyright of these assets, digital watermarking techniques can be applied to embed ownership information discreetly within 3DGS models. However, existing watermarking methods for meshes, point clouds, and implicit radiance fields cannot be directly applied to 3DGS models, as 3DGS models use explicit 3D Gaussians with distinct structures and do not rely on neural networks. Naively embedding the watermark on a pre-trained 3DGS can cause obvious distortion in rendered images. In our work, we propose an uncertainty-based method that constrains the perturbation of model parameters to achieve invisible watermarking for 3DGS. At the message decoding stage, the copyright messages can be reliably extracted from both 3D Gaussians and 2D rendered images even under various forms of 3D and 2D distortions. We conduct extensive experiments on the Blender, LLFF and MipNeRF-360 datasets to validate the effectiveness of our proposed method, demonstrating state-of-the-art performance on both message decoding accuracy and view synthesis quality.

Precise phase measurements by interferometers are crucial in science for detecting subtle changes, such as gravitational waves. However, phase sensitivity is typically limited by the standard quantum limit (SQL) with uncorrelated particles N. This limit can be surpassed using quantum correlations, but achieving high-quality correlations in large systems is challenging. Here, we propose and demonstrate an atom-light hybrid quantum interferometry whose sensitivity is enhanced beyond the SQL with atom-light quantum correlation and newly developed phase comb superposition via atomic-memory-assisted multiple quantum amplification. Finally, a phase sensitivity beyond the SQL of up to $8.3\pm 0.2$ dB is achieved, especially at $N=4 \times10^{13}/s$, resulting in both atomic and optical phase sensitivities of $6\times10^{-8} rad/\sqrt{Hz}$. This technique can advance sensitive quantum measurements in various fields., Comment: 11 pages, 3 figures

Simulating strongly-correlated quantum systems in continuous space belongs to the most challenging and long-concerned issues in quantum physics. This work investigates the quantum entanglement and criticality of the ground-state wave-functions of infinitely-many coupled quantum oscillators (iCQOs). The essential task involves solving a set of partial differential equations (Schr\"odinger equations in the canonical quantization picture) with infinitely-many variables, which currently lacks valid methods. By extending the imaginary-time evolution algorithm with translationally-invariant functional tensor network, we simulate the ground state of iCQOs with the presence of two- and three-body couplings. We determine the range of coupling strengths where there exists a real ground-state energy (dubbed as physical region). With two-body couplings, we reveal the logarithmic scaling law of entanglement entropy (EE) and the polynomial scaling law of correlation length against the virtual bond dimension $\chi$ at the dividing point of physical and non-physical regions. These two scaling behaviors are signatures of criticality, according to the previous results in quantum lattice models, but were not reported in continuous-space quantum systems. The scaling coefficients result in a central charge $c=1$, indicating the presence of free boson conformal field theory (CFT). With three-body couplings where there exist no analytical nor numerical results, we show the breakdown of CFT at the dividing point even with an extremely small strength of three-body terms. Our work uncovers the scaling behaviors of EE in the continuous-space quantum many-body systems, providing numerical evidences for the efficiency of tensor networks in representing the continuous-space quantum many-body ground states in the thermodynamic limit., Comment: 5 pages, 5 figures

This paper introduces a novel approach to financial risk analysis that does not rely on traditional price and market data, instead using market news to model assets as distributions over a metric space of risk factors. By representing asset returns as integrals over the scalar field of these risk factors, we derive the covariance structure between asset returns. Utilizing encoder-only language models to embed this news data, we explore the relationships between asset return distributions through the concept of Energy Distance, establishing connections between distributional differences and excess returns co-movements. This data-agnostic approach provides new insights into portfolio diversification, risk management, and the construction of hedging strategies. Our findings have significant implications for both theoretical finance and practical risk management, offering a more robust framework for modelling complex financial systems without depending on conventional market data.

Multimode fibers provide a promising platform for realizing high-power laser amplifiers with suppressed nonlinearities and instabilities. The potential degradation of optical beam quality has been a major concern for highly multimode fiber amplifiers. We show numerically that the beam propagation factor M2 of a single-frequency multimode fiber amplifier can be reduced to nearly unity by shaping the input or output beam profile with spatial phase-masks. Our method works for narrowband multimode fiber amplifiers with strong gain saturation, pump depletion, random mode coupling and polarization mixing. The numerical results validate our approach of utilizing highly multimode excitation to mitigate nonlinear effects in high-power fiber amplifiers and performing input wavefront shaping to control output beam profile and polarization state.

Global magnetohydrodynamic (MHD) models play an important role in the infrastructure of space weather forecasting. Validating such models commonly utilizes in situ solar wind measurements made near the orbit of the Earth. The purpose of this study is to test the performance of G3DMHD (a data driven, time-dependent, 3-D MHD model of the solar wind) with Parker Solar Probe (PSP) measurements. Since its launch in August 2018, PSP has traversed the inner heliosphere at different radial distances sunward of the Earth (the closest approach ~13.3 solar radii), thus providing a good opportunity to study evolution of the solar wind and to validate heliospheric models of the solar wind. The G3DMHD model simulation is driven by a sequence of maps of photospheric field extrapolated to the assumed source surface (2.5 Rs) using the potential field model from 2018 to 2022, which covers the first 15 PSP orbits. The Pearson correlation coefficient (cc) and the mean absolute squared error (MASE) are used as the metrics to evaluate the model performance. It is found that the model performs better for both magnetic intensity (cc = 0.75; MASE = 0.60) and the solar wind density (cc = 0.73; MASE = 0.50) than for the solar wind speed (cc = 0.15; MASE = 1.29) and temperature (cc = 0.28; MASE = 1.14). This is due primarily to lack of accurate boundary conditions. The well-known underestimate of the magnetic field in solar minimum years is also present. Assuming that the radial magnetic field becomes uniformly distributed with latitude at or below 18 Rs (the inner boundary of the computation do-main), the agreement in the magnetic intensity significantly improves (cc = 0.83; MASE = 0.49)., Comment: in press

Recent experiments suggest a new paradigm towards novel colossal magnetoresistance (CMR) in a family of materials EuM$_2$X$_2$(M=Cd, In, Zn; X=P, As), distinct from the traditional avenues involving Kondo-RKKY crossovers, magnetic phase transitions with structural distortions, or topological phase transitions. Here, we use angle-resolved photoemission spectroscopy (ARPES) and density functional theory (DFT) calculations to explore their origin, particularly focusing on EuCd$_2$P$_2$. While the low-energy spectral weight royally tracks that of the resistivity anomaly near the temperature with maximum magnetoresistance (T$_{MR}$) as expected from transport-spectroscopy correspondence, the spectra are completely incoherent and strongly suppressed with no hint of a Landau quasiparticle. Using systematic material and temperature dependence investigation complemented by theory, we attribute this non-quasiparticle caricature to the strong presence of entangled magnetic and lattice interactions, a characteristic enabled by the $p$-$f$ mixing. Given the known presence of ferromagnetic clusters, this naturally points to the origin of CMR being the scattering of spin-polarized polarons at the boundaries of ferromagnetic clusters. These results are not only illuminating to investigate the strong correlations and topology in EuCd$_2$X$_2$ family, but, in a broader view, exemplify how multiple cooperative interactions can give rise to extraordinary behaviors in condensed matter systems.

Single-view 3D reconstruction methods like Triplane Gaussian Splatting (TGS) have enabled high-quality 3D model generation from just a single image input within seconds. However, this capability raises concerns about potential misuse, where malicious users could exploit TGS to create unauthorized 3D models from copyrighted images. To prevent such infringement, we propose a novel image protection approach that embeds invisible geometry perturbations, termed "geometry cloaks", into images before supplying them to TGS. These carefully crafted perturbations encode a customized message that is revealed when TGS attempts 3D reconstructions of the cloaked image. Unlike conventional adversarial attacks that simply degrade output quality, our method forces TGS to fail the 3D reconstruction in a specific way - by generating an identifiable customized pattern that acts as a watermark. This watermark allows copyright holders to assert ownership over any attempted 3D reconstructions made from their protected images. Extensive experiments have verified the effectiveness of our geometry cloak. Our project is available at https://qsong2001.github.io/geometry_cloak., Comment: Accepted by NeurIPS 2024

Single photon detectors (SPDs) are essential technology in quantum science, quantum network, biology, and advanced imaging. To detect the small quantum of energy carried in a photon, conventional SPDs rely on energy excitation across either a semiconductor bandgap or superconducting gap. While the energy gap suppresses the false-positive error, it also sets an energy scale that can limit the detection efficiency of lower energy photons and spectral bandwidth of the SPD. Here, we demonstrate an orthogonal approach to detect single near-infrared photons using graphene calorimeters. By exploiting the extremely low heat capacity of the pseudo-relativistic electrons in graphene near its charge neutrality point, we observe an electron temperature rise up to ~2 K using a hybrid Josephson junction. In this proof-of-principle experiment, we achieve an intrinsic quantum efficiency of 87% (75%) with dark count < 1 per second (per hour) at operation temperatures as high as 1.2 K. Our results highlight the potential of electron calorimetric SPDs for detecting lower-energy photons from the mid-IR to microwave regimes, opening pathways to study space science in far-infrared regime, to search for dark matter axions, and to advance quantum technologies across a broader electromagnetic spectrum.

We develop a generative model for the nuclear matter equation of state at zero net baryon density using the Gaussian Process Regression method. We impose first-principles theoretical constraints from lattice QCD and hadron resonance gas at high- and low-temperature regions, respectively. By allowing the trained Gaussian Process Regression model to vary freely near the phase transition region, we generate random smooth cross-over equations of state with different speeds of sound that do not rely on specific parameterizations. We explore a collection of experimental observable dependencies on the generated equations of state, which paves the groundwork for future Bayesian inference studies to use experimental measurements from relativistic heavy-ion collisions to constrain the nuclear matter equation of state., Comment: 12 pages, 6 figures

In recent years, quantum computation has been rapidly advancing, driving a technological revolution with significant potential across various sectors, particularly in finance. Despite this, the insurance industry, an essential tool for mitigating unforeseen risks and losses, has received limited attention. This paper provides an initial exploration into the realm of quantum computational insurance and actuarial science. After introducing key insurance models and challenges, we examine quantum algorithms designed to address complex insurance issues. Our study includes experimental and numerical demonstrations of quantum applications in non-life insurance, life insurance, and reinsurance. Additionally, we explore the timeline for quantum insurance, the development of quantum-enhanced insurance products, and the challenges posed by quantum computational advancements., Comment: 10 pages, 5 figures

Dissipationless localized bound states of open quantum systems are significantly robust to decoherence and have potential applications in quantum technologies. In this work, the decoherence dynamics and dissipationless localized bound states of a two-mode open quantum system are investigated. The conditions for the emergence of dissipationless localized bound states are analytically solved, and the corresponding critical system-environment couplings under different values of the inter-mode coupling and the detuning are determined. The decoherence dynamics of the system under such conditions are analyzed and dissipationless coherence between the different localized bound states against decoherence is clearly shown. This may provide a new avenue to develop dissipationless quantum technology for quantum operations., Comment: 10 pages, 6 figures

In this paper, we prove an optimal systolic inequality and the corresponding rigidity in the equality case on closed manifolds with positive bi-Ricci curvature, which generalizes the work of Bray-Brendle-Neves. The proof is given in all dimensions based on the method of minimal surfaces under the Generic Regularity Hypothesis, which is known to be true up to dimension ten., Comment: 23 pages, no figure

Context. With the increasing number of discoveries of globular clusters in the inner Milky Way, the need for spectroscopic confirmation and further investigation of their stellar populations and chemodynamical properties has become crucial. Aims. Gran 5 is a newly reported low-mass globular cluster located close to the Galactic center, and it is thought to be an accreted object associated with the Gaia-Enceladus structure. This study aims to investigate the stellar populations of Gran 5 and their detailed chemical properties. Methods. We performed high-resolution near-infrared spectroscopy on seven stars in the field of Gran 5 using IGRINS on the Gemini-South telescope. Results. We identified six stars as cluster members and reveal that they are divided into two stellar populations with different metallicities, with mean [Fe/H] values of -0.76 dex and -0.55 dex, respectively. In addition, the chemodynamical properties of Gran 5 agree with those of in situ globular clusters. Conclusions. Our findings represent the first detection of two stellar populations with different metallicities in a low-mass globular cluster. This suggests that the metallicity variation in Gran 5 may have arisen from processes different from those in other globular clusters with metallicity variation, or that it may have lost a substantial amount of its initial mass during its evolution., Comment: 12 pages, 9 figures, accepted for publication in A&A

Stochastic differential equations are commonly used to describe the evolution of stochastic processes. The uncertainty of such processes is best represented by the probability density function (PDF), whose evolution is governed by the Fokker-Planck partial differential equation (FP-PDE). However, it is generally infeasible to solve the FP-PDE in closed form. In this work, we show that physics-informed neural networks (PINNs) can be trained to approximate the solution PDF using existing methods. The main contribution is the analysis of the approximation error: we develop a theory to construct an arbitrary tight error bound with PINNs. In addition, we derive a practical error bound that can be efficiently constructed with existing training methods. Finally, we explain that this error-bound theory generalizes to approximate solutions of other linear PDEs. Several numerical experiments are conducted to demonstrate and validate the proposed methods., Comment: pre-print under review

Optics-guided Thermal UAV image Super-Resolution (OTUAV-SR) has attracted significant research interest due to its potential applications in security inspection, agricultural measurement, and object detection. Existing methods often employ single guidance model to generate the guidance features from optical images to assist thermal UAV images super-resolution. However, single guidance models make it difficult to generate effective guidance features under favorable and adverse conditions in UAV scenarios, thus limiting the performance of OTUAV-SR. To address this issue, we propose a novel Guidance Disentanglement network (GDNet), which disentangles the optical image representation according to typical UAV scenario attributes to form guidance features under both favorable and adverse conditions, for robust OTUAV-SR. Moreover, we design an attribute-aware fusion module to combine all attribute-based optical guidance features, which could form a more discriminative representation and fit the attribute-agnostic guidance process. To facilitate OTUAV-SR research in complex UAV scenarios, we introduce VGTSR2.0, a large-scale benchmark dataset containing 3,500 aligned optical-thermal image pairs captured under diverse conditions and scenes. Extensive experiments on VGTSR2.0 demonstrate that GDNet significantly improves OTUAV-SR performance over state-of-the-art methods, especially in the challenging low-light and foggy environments commonly encountered in UAV scenarios. The dataset and code will be publicly available at https://github.com/Jocelyney/GDNet., Comment: 18 pages, 19 figures, 8 tables

This paper explores the structure of graphs defined by an excluded minor or an excluded odd minor through the lens of graph products and tree-decompositions. We prove that every graph excluding a fixed odd minor is contained in the strong product of two graphs each with bounded treewidth. For graphs excluding a fixed minor, we strengthen the result by showing that every such graph is contained in the strong product of two digraphs with bounded indegree and with bounded treewidth. This result has the advantage that the product now has bounded degeneracy. In the setting of 3-term products, we show that every $K_t$-minor-free graph is contained in $H_1\boxtimes H_2 \boxtimes K_{c(t)}$ where $\text{tw}(H_i)\leq t-2$. This treewidth bound is close to tight: in any such result with $\text{tw}(H_i)$ bounded, both $H_1$ and $H_2$ can be forced to contain any graph of treewidth $t-5$, implying $\text{tw}(H_1)\geq t-5$ and $\text{tw}(H_2)\geq t-5$. Analogous lower and upper bounds are shown for any excluded minor, where the minimum possible bound on $\text{tw}(H_i)$ is tied to the treedepth of the excluded minor. Subgraphs of the product of two graphs with bounded treewidth have two tree-decompositions where any bag from the first decomposition intersects any bag from the second decomposition in a bounded number, $k$, of vertices, so called $k$-orthogonal tree-decompositions. We show that graphs excluding a fixed odd-minor have a tree-decomposition and a path-decomposition that are $O(1)$-orthogonal. This implies that such graphs have a tree-decomposition in which each bag has bounded pathwidth. This result is best possible in that `pathwidth' cannot be replaced by `bandwidth' or `treedepth'. Moreover, we characterize the minor-closed classes that have a tree-decomposition in which each bag has bounded bandwidth, or each bag has bounded treedepth.

The direct detection of gravitational waves by LIGO has confirmed general relativity (GR) and sparked rapid growth in gravitational wave (GW) astronomy. However, subtle post-Newtonian (PN) deviations observed during the analysis of high signal-to-noise ratio events from the observational runs suggest that standard waveform templates, which assume strict adherence to GR, might overlook signals from alternative theories of gravity. Incorporating these exotic signals into traditional search algorithms is computationally infeasible due to the vast template space required. This paper introduces a deep learning framework for detecting exotic GW signals, leveraging neural networks trained on GR-based templates. Through their generalization ability, neural networks learn intricate features from the data, enabling the detection of signals that deviate from GR. We present the first study evaluating the capability of deep learning to detect beyond-GR signals, including a variety of PN orders. Our model achieves rapid and accurate identification of exotic GW signals across different luminosity distances, with performance comparable to GR-based detections. Applying the model to the GW150914 event demonstrates excellent performance, highlighting the potential of AI-driven methods for detecting previously overlooked signals beyond GR. This work paves the way for new discoveries in gravitational wave astronomy, enabling the detection of signals that might escape traditional search pipelines., Comment: 10 pages, 7 figures

Soft robots offer adaptability and safe interaction with complex environments. Rapid prototyping kits that allow soft robots to be assembled easily will allow different geometries to be explored quickly to suit different environments or to mimic the motion of biological organisms. We introduce SoftSnap modules: snap-together components that enable the rapid assembly of a class of untethered soft robots. Each SoftSnap module includes embedded computation, motor-driven string actuation, and a flexible thermoplastic polyurethane (TPU) printed structure capable of deforming into various shapes based on the string configuration. These modules can be easily connected with other SoftSnap modules or customizable connectors. We demonstrate the versatility of the SoftSnap system through four configurations: a starfish-like robot, a brittle star robot, a snake robot, a 3D gripper, and a ring-shaped robot. These configurations highlight the ease of assembly, adaptability, and functional diversity of the SoftSnap modules. The SoftSnap modular system offers a scalable, snap-together approach to simplifying soft robot prototyping, making it easier for researchers to explore untethered soft robotic systems rapidly., Comment: 22 pages, 9 figures

Thermally driven transitions between ferromagnetic and paramagnetic phases are characterized by critical behavior with divergent susceptibilities, long-range correlations, and spin dynamics that can span kHz to GHz scales as the material approaches the critical temperature $\mathrm{T_c}$, but it has proven technically challenging to probe the relevant length and time scales with most conventional measurement techniques. In this study, we employ scanning nitrogen-vacancy center based magnetometry and relaxometry to reveal the critical behavior of a high-$\mathrm{T_c}$ ferromagnetic oxide near its Curie temperature. Cluster analysis of the measured temperature-dependent nanoscale magnetic textures points to a 3D universality class with a correlation length that diverges near $\mathrm{T_c}$. Meanwhile, the temperature-dependent spin dynamics, measured through all optical relaxometry suggest that the phase transition is in the XY universality class. Our results capture both static and dynamic aspects of critical behavior, providing insights into universal properties that govern phase transitions in magnetic materials.

Vision-language models (VLMs) embed aligned image-text pairs into a joint space but often rely on deterministic embeddings, assuming a one-to-one correspondence between images and texts. This oversimplifies real-world relationships, which are inherently many-to-many, with multiple captions describing a single image and vice versa. We introduce Probabilistic Language-Image Pre-training (ProLIP), the first probabilistic VLM pre-trained on a billion-scale image-text dataset using only probabilistic objectives, achieving a strong zero-shot capability (e.g., 74.6% ImageNet zero-shot accuracy with ViT-B/16). ProLIP efficiently estimates uncertainty by an "uncertainty token" without extra parameters. We also introduce a novel inclusion loss that enforces distributional inclusion relationships between image-text pairs and between original and masked inputs. Experiments demonstrate that, by leveraging uncertainty estimates, ProLIP benefits downstream tasks and aligns with intuitive notions of uncertainty, e.g., shorter texts being more uncertain and more general inputs including specific ones. Utilizing text uncertainties, we further improve ImageNet accuracy from 74.6% to 75.8% (under a few-shot setting), supporting the practical advantages of our probabilistic approach. The code is available at https://github.com/naver-ai/prolip, Comment: Code: https://github.com/naver-ai/prolip; 23 pages, 5.7 MB

Analyzing the structure of sampled features from an input data distribution is challenging when constrained by limited measurements in both the number of inputs and features. Traditional approaches often rely on the eigenvalue spectrum of the sample covariance matrix derived from finite measurement matrices; however, these spectra are sensitive to the size of the measurement matrix, leading to biased insights. In this paper, we introduce a novel algorithm that provides unbiased estimates of the spectral moments of the kernel integral operator in the limit of infinite inputs and features from finitely sampled measurement matrices. Our method, based on dynamic programming, is efficient and capable of estimating the moments of the operator spectrum. We demonstrate the accuracy of our estimator on radial basis function (RBF) kernels, highlighting its consistency with the theoretical spectra. Furthermore, we showcase the practical utility and robustness of our method in understanding the geometry of learned representations in neural networks.

Deep learning models are known to be vulnerable to adversarial attacks by injecting sophisticated designed perturbations to input data. Training-time defenses still exhibit a significant performance gap between natural accuracy and robust accuracy. In this paper, we investigate a new test-time adversarial defense method via diffusion-based recovery along opposite adversarial paths (OAPs). We present a purifier that can be plugged into a pre-trained model to resist adversarial attacks. Different from prior arts, the key idea is excessive denoising or purification by integrating the opposite adversarial direction with reverse diffusion to push the input image further toward the opposite adversarial direction. For the first time, we also exemplify the pitfall of conducting AutoAttack (Rand) for diffusion-based defense methods. Through the lens of time complexity, we examine the trade-off between the effectiveness of adaptive attack and its computation complexity against our defense. Experimental evaluation along with time cost analysis verifies the effectiveness of the proposed method.

Large-scale quantum computation requires to be performed in the fault-tolerant manner. One crucial issue of fault-tolerant quantum computing (FTQC) is reducing the overhead of implementing logical gates. Recently proposed correlated decoding and ``algorithmic fault tolerance" achieve fast logical gates that enables universal quantum computation. However, for circuits involving mid-circuit measurements and feedback, this approach is incompatible with window-based decoding, which is a natural requirement for handling large-scale circuits. In this letter, we propose an alternative architecture that employs delayed fixup circuits, integrating window-based correlated decoding with fast transversal gates. This design significantly reduce both the frequency and duration of correlated decoding, while maintaining support for constant-time logical gates and universality across a broad class of quantum codes. More importantly, by spatial parallelism of windows, this architecture well adapts to time-optimal FTQC, making it particularly useful for large-scale computation. Using Shor's algorithm as an example, we explore the application of our architecture and reveals the promising potential of using fast transversal gates to perform large-scale quantum computing tasks with acceptable overhead on physical systems like ion traps., Comment: 11 pages, 9 figures

Customer churn, particularly in the telecommunications sector, influences both costs and profits. As the explainability of models becomes increasingly important, this study emphasizes not only the explainability of customer churn through machine learning models, but also the importance of identifying multivariate patterns and setting soft bounds for intuitive interpretation. The main objective is to use a machine learning model and fuzzy-set theory with top-\textit{k} HUIM to identify highly associated patterns of customer churn with intuitive identification, referred to as Highly Associated Fuzzy Churn Patterns (HAFCP). Moreover, this method aids in uncovering association rules among multiple features across low, medium, and high distributions. Such discoveries are instrumental in enhancing the explainability of findings. Experiments show that when the top-5 HAFCPs are included in five datasets, a mixture of performance results is observed, with some showing notable improvements. It becomes clear that high importance features enhance explanatory power through their distribution and patterns associated with other features. As a result, the study introduces an innovative approach that improves the explainability and effectiveness of customer churn prediction models., Comment: 18 pages single columns, 4 figures, This paper is an extended version of a work originally presented at the 6th International Workshop on Utility-Driven Mining and Learning (held in conjunction with the 28th Pacific-Asia Conference on Knowledge Discovery and Data Mining - PAKDD 2024) on May 7, 2024

Observations suggest that filaments in molecular clouds can grow by mass accretion while forming cores via fragmentation. Here we present one of the first large sample studies of filament accretion using velocity gradient measurements of star-forming filaments on the $\sim 0.05$ pc scale with NH$_3$ observations of the Perseus Molecular Cloud, primarily obtained as a part of the GBT Ammonia Survey (GAS). In this study, we find significant correlations between velocity gradient, velocity dispersion, mass per unit length, and the number of cores per unit length of the Perseus filaments. Our results suggest a scenario in which filaments not only grow through mass accretion but also form new cores continuously in the process well into the thermally supercritical regime. Such behavior is contrary to that expected from isolated filament models but consistent with how filaments form within a more realistic cloud environment, suggesting that the cloud environment plays a crucial role in shaping core formation and evolution in filaments. Furthermore, even though velocity gradients within filaments are not oriented randomly, we find no correlation between velocity gradient orientation and the filament properties we analyzed. This result suggests that gravity is unlikely the dominant mechanism imposing order on the $\sim 0.05$ pc scale for dense star-forming gas., Comment: Accepted to ApJ (Oct 17, 2024)

Recent advancements in large audio-language models (LALMs) have shown impressive capabilities in understanding and reasoning about audio and speech information. However, these models still face challenges, including hallucinating non-existent sound events, misidentifying the order of sound events, and incorrectly attributing sound sources, which undermine their reliability and real-world application. To systematically evaluate these issues, we propose three distinct tasks: object existence, temporal order, and object attribute within audio. These tasks assess the models' comprehension of critical audio information aspects. Our experimental results reveal limitations in these fundamental tasks, underscoring the need for better models in recognizing specific sound events, determining event sequences, and identifying sound sources. To improve performance in these areas, we introduce a multi-turn chain-of-thought approach, which demonstrates significantly improved model performance across the proposed tasks., Comment: 5 pages, 1 figure

World models integrate raw data from various modalities, such as images and language to simulate comprehensive interactions in the world, thereby displaying crucial roles in fields like mixed reality and robotics. Yet, applying the world model for accurate video prediction is quite challenging due to the complex and dynamic intentions of the various scenes in practice. In this paper, inspired by the human rethinking process, we decompose the complex video prediction into four meta-tasks that enable the world model to handle this issue in a more fine-grained manner. Alongside these tasks, we introduce a new benchmark named Embodied Video Anticipation Benchmark (EVA-Bench) to provide a well-rounded evaluation. EVA-Bench focused on evaluating the video prediction ability of human and robot actions, presenting significant challenges for both the language model and the generation model. Targeting embodied video prediction, we propose the Embodied Video Anticipator (EVA), a unified framework aiming at video understanding and generation. EVA integrates a video generation model with a visual language model, effectively combining reasoning capabilities with high-quality generation. Moreover, to enhance the generalization of our framework, we tailor-designed a multi-stage pretraining paradigm that adaptatively ensembles LoRA to produce high-fidelity results. Extensive experiments on EVA-Bench highlight the potential of EVA to significantly improve performance in embodied scenes, paving the way for large-scale pre-trained models in real-world prediction tasks.

The aggressiveness of prostate cancer, the most common cancer in men worldwide, is primarily assessed based on histopathological data using the Gleason scoring system. While artificial intelligence (AI) has shown promise in accurately predicting Gleason scores, these predictions often lack inherent explainability, potentially leading to distrust in human-machine interactions. To address this issue, we introduce a novel dataset of 1,015 tissue microarray core images, annotated by an international group of 54 pathologists. The annotations provide detailed localized pattern descriptions for Gleason grading in line with international guidelines. Utilizing this dataset, we develop an inherently explainable AI system based on a U-Net architecture that provides predictions leveraging pathologists' terminology. This approach circumvents post-hoc explainability methods while maintaining or exceeding the performance of methods trained directly for Gleason pattern segmentation (Dice score: 0.713 $\pm$ 0.003 trained on explanations vs. 0.691 $\pm$ 0.010 trained on Gleason patterns). By employing soft labels during training, we capture the intrinsic uncertainty in the data, yielding strong results in Gleason pattern segmentation even in the context of high interobserver variability. With the release of this dataset, we aim to encourage further research into segmentation in medical tasks with high levels of subjectivity and to advance the understanding of pathologists' reasoning processes., Comment: 58 pages, 15 figures (incl. supplementary)

For every integer $r\geq 2$ and every $\epsilon>0$, we construct an explicit infinite family of quantum LDPC codes supporting a transversal $C^{r-1}Z$ gate with length $N$, dimension $K\geq N^{1-\epsilon}$, distance $D\geq N^{1/r}/\operatorname{poly}(\log N)$, and stabilizer weight $w\leq\operatorname{poly}(\log N)$. The previous state of the art construction (in most parameter regimes) was the $r$-dimensional color code, which has only constant dimension $K=O(1)$, and otherwise has the same parameters up to polylogarithmic factors. Our construction provides the first known codes with low-weight stabilizers that are capable of magic state distillation with arbitrarily small yield parameter $\gamma=\log(N/K)/\log(D)>0$. A classical analogue of transversal $C^{r-1}Z$ gates is given by the multiplication property, which requires component-wise products of classical codewords to belong to another similar code. As a byproduct of our techniques, we also obtain a new construction of classical locally testable codes with such a multiplication property. We construct our codes as products of chain complexes associated to classical LDPC codes, which in turn we obtain by imposing local Reed-Solomon codes on a specific spectral expander that we construct. We prove that our codes support the desired transversal $C^{r-1}Z$ gates by using the multiplication property to combine local circuits based on the topological structure.

A major goal in quantum computing is to build a fault-tolerant quantum computer. One approach involves quantum low-density parity-check (qLDPC) codes that support transversal non-Clifford gates. In this work, we provide a large family of such codes. The key insight is to interpret the logical operators of qLDPC codes as geometric surfaces and use the intersection number of these surfaces to define the non-Clifford operation. At a more abstract level, this construction is based on defining the cup product on the chain complex induced from a sheaf.