Search

Missing data is a pervasive challenge in wireless networks and many other domains, often compromising the performance of machine learning and deep learning models. To address this, we propose a novel framework, FGATT, that combines the Fuzzy Graph Attention Network (FGAT) with the Transformer encoder to perform robust and accurate data imputation. FGAT leverages fuzzy rough sets and graph attention mechanisms to capture spatial dependencies dynamically, even in scenarios where predefined spatial information is unavailable. The Transformer encoder is employed to model temporal dependencies, utilizing its self-attention mechanism to focus on significant time-series patterns. A self-adaptive graph construction method is introduced to enable dynamic connectivity learning, ensuring the framework's applicability to a wide range of wireless datasets. Extensive experiments demonstrate that our approach outperforms state-of-the-art methods in imputation accuracy and robustness, particularly in scenarios with substantial missing data. The proposed model is well-suited for applications in wireless sensor networks and IoT environments, where data integrity is critical.

We revisit the long-standing question of whether water molecules dissociate on the Ru(0001) surface through nanosecond-scale path-integral molecular dynamics simulations on a sizable supercell. This is made possible through the development of an efficient and reliable machine-learning potential with near first-principles accuracy, overcoming the limitations of previous ab initio studies. We show that the quantum delocalization associated with nuclear quantum effects enables rapid and frequent proton transfers between water molecules, thereby facilitating the water dissociation on Ru(0001). This work provides the direct theoretical evidence of water dissociation on Ru(0001), resolving the enduring issue in surface sciences and offering crucial atomistic insights into water-metal interfaces., Comment: 21 pages, 12 figures (include Supplemental Material)

Nitriding introduces nitrides into the surface of steels, significantly enhancing the surface me-chanical properties. By combining the variable composition evolutionary algorithm and first-principles calculations based on density functional theory, 50 thermodynamically stable or metastable Fe-N compounds with various stoichiometric ratios were identified, exhibiting also dynamic and mechanical stability. The mechanical properties of these structures were systemati-cally studied, including the bulk modulus, shear modulus, Young's modulus, Poisson's ratio, Pugh's ratio, Cauchy pressure, Klemen parameters, universal elastic anisotropy, Debye tempera-ture, and Vickers hardness. All identified stable and metastable Fe-N compounds were found in the ductile region, with most exhibiting homogeneous elastic properties and isotropic metallic bonding. As the nitrogen concentration increases, their bulk moduli generally increase as well. The Vickers hardness values of Fe-N compounds range from 3.5 to 10.5 GPa, which are signifi-cantly higher than that of pure Fe (2.0 GPa), due to the stronger Fe-N bonds strength. This study provides insights into optimizing and designing Fe-N alloys with tailored mechanical properties., Comment: 19 pages, 19 figures

Large Language Models (LLMs) have revolutionized natural language processing (NLP) by delivering state-of-the-art performance across a variety of tasks. Among these, Transformer-based models like BERT and GPT rely on pooling layers to aggregate token-level embeddings into sentence-level representations. Common pooling mechanisms such as Mean, Max, and Weighted Sum play a pivotal role in this aggregation process. Despite their widespread use, the comparative performance of these strategies on different LLM architectures remains underexplored. To address this gap, this paper investigates the effects of these pooling mechanisms on two prominent LLM families -- BERT and GPT, in the context of sentence-level sentiment analysis. Comprehensive experiments reveal that each pooling mechanism exhibits unique strengths and weaknesses depending on the task's specific requirements. Our findings underline the importance of selecting pooling methods tailored to the demands of particular applications, prompting a re-evaluation of common assumptions regarding pooling operations. By offering actionable insights, this study contributes to the optimization of LLM-based models for downstream tasks., Comment: 4 figures

Averaging iterations of Stochastic Gradient Descent (SGD) have achieved empirical success in training deep learning models, such as Stochastic Weight Averaging (SWA), Exponential Moving Average (EMA), and LAtest Weight Averaging (LAWA). Especially, with a finite weight averaging method, LAWA can attain faster convergence and better generalization. However, its theoretical explanation is still less explored since there are fundamental differences between finite and infinite settings. In this work, we first generalize SGD and LAWA as Finite Weight Averaging (FWA) and explain their advantages compared to SGD from the perspective of optimization and generalization. A key challenge is the inapplicability of traditional methods in the sense of expectation or optimal values for infinite-dimensional settings in analyzing FWA's convergence. Second, the cumulative gradients introduced by FWA introduce additional confusion to the generalization analysis, especially making it more difficult to discuss them under different assumptions. Extending the final iteration convergence analysis to the FWA, this paper, under a convexity assumption, establishes a convergence bound $\mathcal{O}(\log\left(\frac{T}{k}\right)/\sqrt{T})$, where $k\in[1, T/2]$ is a constant representing the last $k$ iterations. Compared to SGD with $\mathcal{O}(\log(T)/\sqrt{T})$, we prove theoretically that FWA has a faster convergence rate and explain the effect of the number of average points. In the generalization analysis, we find a recursive representation for bounding the cumulative gradient using mathematical induction. We provide bounds for constant and decay learning rates and the convex and non-convex cases to show the good generalization performance of FWA. Finally, experimental results on several benchmarks verify our theoretical results., Comment: 34 pages

The capture of changes in dynamic systems, especially ordinary differential equations (ODEs), is an important and challenging task, with multiple applications in biomedical research and other scientific areas. This article proposes a fast and mathematically rigorous online method, called ODE-informed MAnifold-constrained Gaussian process Inference for Change point detection(O-MAGIC), to detect changes of parameters in the ODE system using noisy and sparse observation data. O-MAGIC imposes a Gaussian process prior to the time series of system components with a latent manifold constraint, induced by restricting the derivative process to satisfy ODE conditions. To detect the parameter changes from the observation, we propose a procedure based on a two-sample generalized likelihood ratio (GLR) test that can detect multiple change points in the dynamic system automatically. O-MAGIC bypasses conventional numerical integration and achieves substantial savings in computation time. By incorporating the ODE structures through manifold constraints, O-MAGIC enjoys a significant advantage in detection delay, while following principled statistical construction under the Bayesian paradigm, which further enables it to handle systems with missing data or unobserved components. O-MAGIC can also be applied to general nonlinear systems. Simulation studies on three challenging examples: SEIRD model, Lotka-Volterra model and Lorenz model are provided to illustrate the robustness and efficiency of O-MAGIC, compared with numerical integration and other popular time-series-based change point detection benchmark methods.

Based on 32162 molecular clouds from the Milky Way Imaging Scroll Painting project, we obtain new face-on molecular gas maps of the northern outer Galaxy. The total molecular gas surface density map reveals three segments of spirals, extending 16-43 kiloparsecs in length. The Perseus and Outer arms stand out prominently, appearing as quasi-continuous structures along most of their length. At the Galactic outskirts, about 1306 clouds connect the two segments of the new spiral arm discovered by Dame & Thaddeus (2011) in the first quadrant and Sun et al. (2015) in the second quadrant, possibly extending the arm into the outer third quadrant. Logarithmic spirals can be fitted to the CO arm segments with pitch angles ranging from 4 to 12 degree. These CO arms extend beyond previous CO studies and the optical radius, reaching a galactic radius of about 22 kiloparsecs, comparable to the HI radial range., Comment: 10 pages, 4 figures, 1 table, ApJL accepted

Minimax optimization is gaining increasing attention in modern machine learning applications. Driven by large-scale models and massive volumes of data collected from edge devices, as well as the concern to preserve client privacy, communication-efficient distributed minimax optimization algorithms become popular, such as Local Stochastic Gradient Descent Ascent (Local-SGDA), and Local Decentralized SGDA (Local-DSGDA). While most existing research on distributed minimax algorithms focuses on convergence rates, computation complexity, and communication efficiency, the generalization performance remains underdeveloped, whereas generalization ability is a pivotal indicator for evaluating the holistic performance of a model when fed with unknown data. In this paper, we propose the stability-based generalization analytical framework for Distributed-SGDA, which unifies two popular distributed minimax algorithms including Local-SGDA and Local-DSGDA, and conduct a comprehensive analysis of stability error, generalization gap, and population risk across different metrics under various settings, e.g., (S)C-(S)C, PL-SC, and NC-NC cases. Our theoretical results reveal the trade-off between the generalization gap and optimization error and suggest hyperparameters choice to obtain the optimal population risk. Numerical experiments for Local-SGDA and Local-DSGDA validate the theoretical results.

Combining the efficiency of semi-empirical potentials with the accuracy of quantum mechanical methods, machine-learning interatomic potentials (MLIPs) have significantly advanced atomistic modeling in computational materials science and chemistry. This necessitates the continual development of MLIP models with improved accuracy and efficiency, which enable long-time scale molecular dynamics simulations to unveil the intricate underlying mechanisms that would otherwise remain elusive. Among various existing MLIP models, the moment tensor potential (MTP) model employs a highly descriptive rotationally-covariant moment tensor to describe the local atomic environment, enabling the use of even linear regression for model fitting. Although the current MTP model has achieved state-of-the-art efficiency for similar accuracy, there is still room for optimizing the contraction process of moment tensors. In this work, we propose an effective genetic algorithm based optimization scheme that can significantly reduce the number of independent moment tensor components and intermediate tensor components. This leads to a speedup of nearly one order of magnitude in efficiency and also improved accuracy compared to the traditional MTP model for intricate basis sets. We have applied our improved MTP model to predicting the energetic and dynamical properties of various point and planar defects in Ni-Al alloys, showing overall good performances and in general outperforming the semi-empirical potentials. This work paves the way for fast and accurate atomistic modeling of complex systems and provides a useful tool for modeling defects in Ni-Al alloys., Comment: 44 pages, 12 figures

Large pretrained transformer models have revolutionized modern AI applications with their state-of-the-art performance in natural language processing (NLP). However, their substantial parameter count poses challenges for real-world deployment. To address this, researchers often reduce model size by pruning parameters based on their magnitude or sensitivity. Previous research has demonstrated the limitations of magnitude pruning, especially in the context of transfer learning for modern NLP tasks. In this paper, we introduce a new magnitude-based pruning algorithm called mixture Gaussian prior pruning (MGPP), which employs a mixture Gaussian prior for regularization. MGPP prunes non-expressive weights under the guidance of the mixture Gaussian prior, aiming to retain the model's expressive capability. Extensive evaluations across various NLP tasks, including natural language understanding, question answering, and natural language generation, demonstrate the superiority of MGPP over existing pruning methods, particularly in high sparsity settings. Additionally, we provide a theoretical justification for the consistency of the sparse transformer, shedding light on the effectiveness of the proposed pruning method.

Recently, a first-order phase transition associated with charge density wave (CDW) has been observed at low temperatures in intermetallic compound BaFe$_2$Al$_9$. However, this transition is absent in its isostructural sister compound BaCo$_2$Al$_9$. Consequently, an intriguing question arises as to the underlying factors that differentiate BaFe$_2$Al$_9$ from BaCo$_2$Al$_9$ and drive the CDW transition in BaFe$_2$Al$_9$. Here, we set out to address this question by conducting a comparative \emph{ab initio} study of the electronic structures, lattice dynamics, \textcolor{black}{and electron-phonon interactions} of their high-temperature phases. We find that both compounds are dynamically stable with similar phonon dispersions. The electronic structure calculations reveal that both compounds are nonmagnetic metals; however, they exhibit distinct band structures around the Fermi level. In particular, BaFe$_2$Al$_9$ exhibits a higher density of states at the Fermi level with dominant partially filled Fe-$3d$ states and a more intricate Fermi surface. This leads to an electronic instability of BaFe$_2$Al$_9$ toward the CDW transition, which is manifested by the diverged electronic susceptibility at the CDW wave vector $\mathbf{q}_{\rm CDW}$=(0.5, 0, 0.3), observable in both the real and imaginary parts. Conversely, BaCo$_2$Al$_9$ does not display such behavior, aligning well with experimental observations. Although the electron-phonon interactions in BaFe$_2$Al$_9$ surpass those in BaCo$_2$Al$_9$ by two orders of magnitude, the strength is relatively weak at the CDW wave vector, suggesting that the CDW in BaFe$_2$Al$_9$ is primarily driven by electronic factors., Comment: 9 pages, 6 figures

In recent years, Transformer-based models (Transformers) have achieved significant success in multivariate time series forecasting (MTSF). However, previous works focus on extracting features either from the time domain or the frequency domain, which inadequately captures the trends and periodic characteristics. To address this issue, we propose a wavelet learning framework to model complex temporal dependencies of the time series data. The wavelet domain integrates both time and frequency information, allowing for the analysis of local characteristics of signals at different scales. Additionally, the Softmax self-attention mechanism used by Transformers has quadratic complexity, which leads to excessive computational costs when capturing long-term dependencies. Therefore, we propose a novel attention mechanism: Rotary Route Attention (RoRA). Unlike Softmax attention, RoRA utilizes rotary position embeddings to inject relative positional information to sequence tokens and introduces a small number of routing tokens $r$ to aggregate information from the $KV$ matrices and redistribute it to the $Q$ matrix, offering linear complexity. We further propose WaveRoRA, which leverages RoRA to capture inter-series dependencies in the wavelet domain. We conduct extensive experiments on eight real-world datasets. The results indicate that WaveRoRA outperforms existing state-of-the-art models while maintaining lower computational costs. Our code is available at https://github.com/Leopold2333/WaveRoRA., Comment: Model architecture changed

The rise of non-magnetic topological semimetals, which provide a promising platform for observing and controlling various spin-orbit effects, has led to significant advancements in the field of topological spintronics. RhSi exists in two distinct polymorphs: cubic and orthorhombic crystal structures. The noncentrosymmetric B20 cubic structure has been extensively studied for hosting unconventional multifold fermions. In contrast, the orthorhombic structure, which crystallizes in the Pnma space group (No. 62), remains less explored and belongs to the family of topological Dirac semimetals. In this work, we investigate the structural, magnetic, and electrical properties of RhSi textured-epitaxial films grown on Si(111) substrates, which crystallize in the orthorhombic structure. We investigate the efficiency of pure spin current transport across RhSi/permalloy interfaces and the subsequent spin-to-charge current conversion via inverse spin Hall effect measurements. The xperimentally determined spin Hall conductivity in orthorhombic RhSi reaches a maximum value of 126 ($\hbar$/e)($\Omega$.cm)$^{-1}$ at 10 K, which aligns reasonably well with first-principles calculations that attribute the spin Hall effect in RhSi to the spin Berry curvature mechanism. Additionally, we demonstrate the ability to achieve a sizable spin-mixing conductance (34.7 nm$^{-2}$) and an exceptionally high interfacial spin transparency of 88$%$ in this heterostructure, underlining its potential for spin-orbit torque switching applications. Overall, this study broadens the scope of topological spintronics, emphasizing the controlled interfacial spin-transport processes and subsequent spin-to-charge conversion in a previously unexplored topological Dirac semimetal RhSi/ferromagnet heterostructure.

We propose an Autoregressive (AR) Moving-average (MA) attention structure that can adapt to various linear attention mechanisms, enhancing their ability to capture long-range and local temporal patterns in time series. In this paper, we first demonstrate that, for the time series forecasting (TSF) task, the previously overlooked decoder-only autoregressive Transformer model can achieve results comparable to the best baselines when appropriate tokenization and training methods are applied. Moreover, inspired by the ARMA model from statistics and recent advances in linear attention, we introduce the full ARMA structure into existing autoregressive attention mechanisms. By using an indirect MA weight generation method, we incorporate the MA term while maintaining the time complexity and parameter size of the underlying efficient attention models. We further explore how indirect parameter generation can produce implicit MA weights that align with the modeling requirements for local temporal impacts. Experimental results show that incorporating the ARMA structure consistently improves the performance of various AR attentions on TSF tasks, achieving state-of-the-art results.

As a popular paradigm for juggling data privacy and collaborative training, federated learning (FL) is flourishing to distributively process the large scale of heterogeneous datasets on edged clients. Due to bandwidth limitations and security considerations, it ingeniously splits the original problem into multiple subproblems to be solved in parallel, which empowers primal dual solutions to great application values in FL. In this paper, we review the recent development of classical federated primal dual methods and point out a serious common defect of such methods in non-convex scenarios, which we say is a "dual drift" caused by dual hysteresis of those longstanding inactive clients under partial participation training. To further address this problem, we propose a novel Aligned Federated Primal Dual (A-FedPD) method, which constructs virtual dual updates to align global consensus and local dual variables for those protracted unparticipated local clients. Meanwhile, we provide a comprehensive analysis of the optimization and generalization efficiency for the A-FedPD method on smooth non-convex objectives, which confirms its high efficiency and practicality. Extensive experiments are conducted on several classical FL setups to validate the effectiveness of our proposed method.

Rutile RuO$_2$ has been posited as a potential $d$-wave altermagnetism candidate, with a predicted significant spin splitting up to 1.4 eV. Despite accumulating theoretical predictions and transport measurements, direct spectroscopic observation of spin splitting has remained elusive. Here, we employ spin- and angle-resolved photoemission spectroscopy to investigate the band structures and spin polarization of thin-film and single-crystal RuO$_2$. Contrary to expectations of altermagnetism, our analysis indicates that RuO$_2$'s electronic structure aligns with those predicted under non-magnetic conditions, exhibiting no evidence of the hypothesized spin splitting. Additionally, we observe significant in-plane spin polarization of the low-lying bulk bands, which is antisymmetric about the high-symmetry plane and contrary to the $d$-wave spin texture due to time-reversal symmetry breaking in altermagnetism. These findings definitively challenge the altermagnetic order previously proposed for rutile RuO$_2$, prompting a reevaluation of its magnetic properties., Comment: 7 pages, 4 figures. Published in Physical Review Letters

Extending geodetic and astrometric Very Long Baseline Interferometry (VLBI) observations from traditional centimeter wavebands to millimeter wavebands offers numerous scientific potentials and benefits. However, it was considered quite challenging due to various factors, including the increased effects of atmospheric opacity and turbulence at millimeter wavelengths. Here, we present the results of the first geodetic-mode VLBI experiment, simultaneously observing 82 sources at 22/43/88/132 GHz (K/Q/W/D bands) using the Korean VLBI Network (KVN). We introduced the frequency phase transfer (FPT) method to geodetic VLBI analysis, an approach for calibrating atmospheric phase fluctuations at higher frequencies by transferring phase solutions from lower frequencies. With a 2-minute scan, FPT improved the signal-to-noise ratio (SNR) of most fringes, some by over 100%, thereby enhancing the detection rate of weak sources at millimeter wavebands. Additionally, FPT reduced systematic errors in group delay and delay rate, with the weighted root-mean-squares (WRMS) of the post-fitting residuals decreasing from 25.0 ps to 20.5 ps at the W band and from 39.3 ps to 27.6 ps at the D band. There were no notable differences observed in calibrating atmospheric phase fluctuations at the K band (WRMS = 12.4 ps) and Q band (WRMS = 11.8 ps) with the KVN baselines. This experiment demonstrated that the millimeter waveband can be used for geodetic and astrometric applications with high precision., Comment: 17 pages, 6 figures, accepted by The Astronomical Journal. Your feedback to improve the manuscript would be greatly appreciated

Inference and inverse problems are closely related concepts, both fundamentally involving the deduction of unknown causes or parameters from observed data. Bayesian inference, a powerful class of methods, is often employed to solve a variety of problems, including those related to causal inference. Variational inference, a subset of Bayesian inference, is primarily used to efficiently approximate complex posterior distributions. Variational Autoencoders (VAEs), which combine variational inference with deep learning, have become widely applied across various domains. This study explores the potential of VAEs for solving inverse problems, such as Independent Component Analysis (ICA), without relying on an explicit inverse mapping process. Unlike other VAE-based ICA methods, this approach discards the encoder in the VAE architecture, directly setting the latent variables as trainable parameters. In other words, the latent variables are no longer outputs of the encoder but are instead optimized directly through the objective function to converge to appropriate values. We find that, with a suitable prior setup, the latent variables, represented by trainable parameters, can exhibit mutually independent properties as the parameters converge, all without the need for an encoding process. This approach, referred to as the Half-VAE, bypasses the inverse mapping process by eliminating the encoder. This study demonstrates the feasibility of using the Half-VAE to solve ICA without the need for an explicit inverse mapping process.

The Canis Major (CMa) region is known for its prominent arc-shaped morphology, visible at multiple wavelengths. This study integrates molecular gas data with high-precision astrometric parameters of young stellar objects (YSOs) from Gaia DR3 to provide the first three-dimensional (3D) insights into the dynamical evolution and star formation history of the CMa region. By utilizing the average distances and proper motions of the YSOs as proxies for those of the molecular clouds (MCs), we confirm the presence of a slowly expanding shell-like morphology in the CMa region, with the estimated radius of 47$\pm$11 pc and expansion velocity of 1.6$\pm$0.7 km/s. Further, the dynamical evolution of the shell supports its expansion, with an expansion timescale of $\sim$4.4 Myr obtained by the traceback analysis assuming constant velocities. Finally, a momentum estimate suggests that at least 2 supernova explosions (SNe) are needed to power the observed expanding shell, reinforcing the previous hypothesis of multiple SNe events. This study effectively combines the CO data with the astrometric data of YSOs from Gaia, offering significant support for the future studies on the 3D morphology and kinematics of MCs., Comment: 19 pages, 10 figures. Accepted for publication in AJ

Federated learning (FL) is an efficient collaborative training paradigm extensively developed with a focus on local privacy, and differential privacy (DP) is a classical approach to capture and ensure the reliability of private security. Their powerful cooperation provides a promising paradigm for the large-scale private clients. As a predominant implementation, the noisy perturbation has been widely studied, being theoretically proven to offer significant protections. However, existing analyses in FL-DP mostly rely on the composition theorem and cannot tightly quantify the privacy leakage challenges, which is tight for a few communication rounds but yields an arbitrarily loose and divergent bound eventually. This also implies a counterintuitive judgment, suggesting that FL-DP may not provide adequate privacy support during long-term training. To further investigate the convergent privacy and reliability of the FL-DP framework, in this paper, we comprehensively evaluate the worst privacy of two classical methods under the non-convex and smooth objectives based on the $f$-DP analysis. With the aid of the shifted interpolation technique, we successfully prove that privacy in {\ttfamily Noisy-FedAvg} has a tight convergent bound. Moreover, with the regularization of the proxy term, privacy in {\ttfamily Noisy-FedProx} has a stable constant lower bound. Our analysis further demonstrates a solid theoretical foundation for the reliability of privacy in FL-DP. Meanwhile, our conclusions can also be losslessly converted to other classical DP analytical frameworks, e.g. $(\epsilon,\delta)$-DP and R$\acute{\text{e}}$nyi-DP (RDP).

Exploring high-efficiency and low-cost electrocatalysts is valuable for water-splitting technologies. Recently, Si-group compounds have attracted increasing attention in electrocatalysis, considering the abundant Si-group elements on Earth. However, Si-group compounds for HER electrocatalysis have not been systematically studied. In this study, we unveil the activity trends of non-noble metal catalyst A15-type V3M (i.e., V3Si, V3Ge, and V3Sn) superconductors and show that V3Si is the most efficient HER catalyst because of the high electronic conductivity and suitable d-band center. Among them, the V3Si only requires 33.4 mV to reach 10 mA cm-2, and only 57.6 mV and 114.6 mV are required to attain a high current density of 100 mA cm-2 and 500 mA cm-2, respectively. These low overpotentials are close to the 34.3 mV at 10 mA cm-2 of state-of-art Pt/C (20 %) but superior to 168.5 mV of Pt/C (20 %) at 100 mA cm-2. Furthermore, the V3Si illustrates exceptional durability with no obvious decay in the 120 h at the different current densities (i.e., 10 - 250 mA cm-2). The excellent HER activity of V3Si alloy can be ascribed to the synergies of superior electronic conductivity and suitable d-band center. Moreover, DFT calculations reveal that the absolute hydrogen adsorption Gibbs free energy is decreased after introducing the V to Si. Beyond offering a stable and high-performance electrocatalyst in an acidic medium, this work inspires the rational design of desirable silicide electrocatalysts., Comment: 25 pages, 5 figures

Recent advances in machine learning have significantly improved prediction accuracy in various applications. However, ensuring the calibration of probabilistic predictions remains a significant challenge. Despite efforts to enhance model calibration, the rigorous statistical evaluation of model calibration remains less explored. In this work, we develop confidence intervals the $\ell_2$ Expected Calibration Error (ECE). We consider top-1-to-$k$ calibration, which includes both the popular notion of confidence calibration as well as full calibration. For a debiased estimator of the ECE, we show asymptotic normality, but with different convergence rates and asymptotic variances for calibrated and miscalibrated models. We develop methods to construct asymptotically valid confidence intervals for the ECE, accounting for this behavior as well as non-negativity. Our theoretical findings are supported through extensive experiments, showing that our methods produce valid confidence intervals with shorter lengths compared to those obtained by resampling-based methods.

The first part of this series introduced the effectiveness of frequency diverse array (FDA) jamming through direct wave propagation in countering airborne phased multiple-input multiple-output (Phased-MIMO) radar. This part focuses on the effectiveness of FDA scattered wave (FDA-SW) jamming on the space-time adaptive processing (STAP) for airborne phased-MIMO radar. Distinguished from the clutter signals, the ground equidistant scatterers of FDA-SW jamming constitute an elliptical ring, whose trajectory equations are mathematically derived to further determine the spatial frequency and Doppler frequency. For the phased-MIMO radar with different transmitting partitions, the effects of jamming frequency offset of FDA-SW on the clutter rank and STAP performance are discussed. Theoretical analysis provides the variation interval of clutter rank and the relationship between the jamming frequency offset and the improvement factor (IF) notch of phased-MIMO-STAP. Importantly, the requirements of jamming frequency offset for both two-part applications are discussed in this part. Numerical results verify these mathematical findings and validate the effectiveness of the proposed FDA jamming in countering the phased-MIMO radar.

Phased multiple-input multiple-output (Phased-MIMO) radar has received increasing attention for enjoying the advantages of waveform diversity and range-dependency from frequency diverse array MIMO (FDA-MIMO) radar without sacrificing coherent processing gain through partitioning transmit subarray. This two-part series proposes a framework of electronic countermeasures (ECM) inspired by frequency diverse array (FDA) radar, called FDA jamming, evaluating its effectiveness for countering airborne phased-MIMO radar. This part introduces the principles and categories of FDA jammer and proposes the FDA jamming signal model based on the two cases of phased-MIMO radar, phased-array (PA) radar and FDA-MIMO radar. Moreover, the effects of FDA jamming on matched filtering and spatial filtering of PA and FDA-MIMO radar are analyzed. Numerical results verify the theoretical analysis and validate the effectiveness of the proposed FDA jamming in countering phased-MIMO radar.

The combination of frequency diverse array (FDA) radar technology with the multiple input multiple output (MIMO) radar architecture and waveform diversity techniques potentially promises a high integration gain with respect to conventional phased array (PA) radars. In this paper, we propose an approach to the design of the transmitter and the receiver of a coherent FDA (C-FDA) radar, that enables it to perform the demodulation with spectral overlapping, due to the small frequency offset. To this purpose, we derive the generalized space-time-range signal model and we prove that the proposed C-FDA radar has a higher coherent array gain than a PA radar, and at the same time, it effectively resolves the secondary range-ambiguous (SRA) problem of FDA-MIMO radar, allowing for mainlobe interference suppression and range-ambiguous clutter suppression. Numerical analysis results prove the effectiveness of the proposed C-FDA radar in terms on anti-interference and anti-clutter capabilities over conventional radars.

The crystal symmetry plays a pivotal role in protecting the nontrivial electronic states in a topological phase. Manipulation of the crystal symmetry and hence the nontrivial topological states would serve as a fertile ground to explore exotic topological properties. Combining experimental and theoretical investigations, we demonstrate herein the flexible switch of nontrivial topological states in the single phase of kagome magnet GdMn6Ge6. The intrinsic anomalous Hall effect caused by distinct Berry curvatures along different crystallographic directions is realized through selectively breaking the mirror symmetries in these directions by external magnetic field, which is fully supported by the first-principles calculations. Our results set an explicit example demonstrating the strong correlation between structure symmetry and nontrivial topological states, as well as the switchable topological properties in a single magnetic topological phase., Comment: Main Text 15 pages + SI 12 pages, 4 main figures + 11 SI figures + 1 SI table

In this study, high-quality thin films of the topological semimetal phase NiTe$_2$ were prepared using molecular beam epitaxy (MBE) technique, confirmed through X-ray diffraction with pronounced Laue oscillations. Electrical transport experiments reveal that thick films have properties similar to bulk materials. By employing co-deposition, we introduced either magnetic or non-magnetic elements during the growth of thinner films, significantly altering their electrical properties. Notably, magnetic element Cr induces long-range ferromagnetic ordering, leading to the observation of significant anomalous Hall effect in NiTe2 thin films. The Hall conductivity remains nearly constant well below the Curie temperature, indicating the correlation with the intrinsic topological nature of the band structure. Theoretical first principles band calculations support the generation of the Weyl semimetal state in the material through magnetic doping. These findings pave the way for exploring more magnetic Weyl semimetal materials and related low-dimensional quantum devices based on topological semimetal materials., Comment: 14 panges, 4 figures

The objective of the panoramic activity recognition task is to identify behaviors at various granularities within crowded and complex environments, encompassing individual actions, social group activities, and global activities. Existing methods generally use either parameter-independent modules to capture task-specific features or parameter-sharing modules to obtain common features across all tasks. However, there is often a strong interrelatedness and complementary effect between tasks of different granularities that previous methods have yet to notice. In this paper, we propose a model called MPT-PAR that considers both the unique characteristics of each task and the synergies between different tasks simultaneously, thereby maximizing the utilization of features across multi-granularity activity recognition. Furthermore, we emphasize the significance of temporal and spatial information by introducing a spatio-temporal relation-enhanced module and a scene representation learning module, which integrate the the spatio-temporal context of action and global scene into the feature map of each granularity. Our method achieved an overall F1 score of 47.5\% on the JRDB-PAR dataset, significantly outperforming all the state-of-the-art methods.

While fiducial inference was widely considered a big blunder by R.A. Fisher, the goal he initially set --`inferring the uncertainty of model parameters on the basis of observations' -- has been continually pursued by many statisticians. To this end, we develop a new statistical inference method called extended Fiducial inference (EFI). The new method achieves the goal of fiducial inference by leveraging advanced statistical computing techniques while remaining scalable for big data. EFI involves jointly imputing random errors realized in observations using stochastic gradient Markov chain Monte Carlo and estimating the inverse function using a sparse deep neural network (DNN). The consistency of the sparse DNN estimator ensures that the uncertainty embedded in observations is properly propagated to model parameters through the estimated inverse function, thereby validating downstream statistical inference. Compared to frequentist and Bayesian methods, EFI offers significant advantages in parameter estimation and hypothesis testing. Specifically, EFI provides higher fidelity in parameter estimation, especially when outliers are present in the observations; and eliminates the need for theoretical reference distributions in hypothesis testing, thereby automating the statistical inference process. EFI also provides an innovative framework for semi-supervised learning.

Altermagnet (AM) is a new proposed magnetic state with collinear antiferromagnetic ground state but presents some transport properties that were only believed to exist in ferromagnets or non-collinear antiferromagnets. To have a comprehensive understanding of the transport properties of AMs, especially from the experimental point of view, a promising altermagnetic metal is crucial. In all the proposed altermagnetic metals, RuO$_2$ has a special position, since it is the first proposed AM with the largest spin splitting and several important altermagnetism featured experiments were first performed based on it. However, a very recent report based on sensitive muon-spin measurements suggest a super small local magnetization from Ru, i.e. a nonmagnetic ground state in RuO$_2$. Therefore, a determination of the existence of the altermagnetic ground state is the basic starting point for all the previously altermagnetic transport properties in RuO$_2$. In this work, we propose to identify its magnetic ground state from the Fermi surface (FS) via the electronic transport property of quantum oscillation (QO). We systematically analyzed the FSs of RuO$_2$ in both nonmagnetic and altermagnetic states via first principles calculations. Our work should be helpful for future experiments on QO measurements to confirm its ground state by the interplay between transport measurements and computations., Comment: 11 pages, 6 figures

We study the gas inflows towards the Galactic Central Molecular Zone (CMZ) based on the gas morphological and kinematic features from the MWISP in the region of l=1.2 deg--19.0 deg and |b|<3.0 deg. We find that the near dust lane extends to l~15 deg, in which the end of the large-scale gas structure intersects with the 3 kpc-ring at a distance of ~5 kpc. Intriguingly, many filamentary MCs, together with the bow-like/ballistic-like clouds and continuous CO features with notable velocity gradient, are finely outlined along the long structure. These MCs also have relatively large velocity dispersions, indicating the shocked gas generated by local continuous accretion and thus the enhanced turbulence along the entire gas structure. We suggest that the ~3.1--3.6 kpc long CO structure originates from the accretion molecular gas driven by the Galactic bar. The gas near the bar end at the 3 kpc-ring becomes an important reservoir for the large-scale accreting flows inwards to the CMZ through the bar channel. The inclination angle of the bar is estimated to be 20--26 deg, while the pattern speed of the bar is 30--35 km/s. The total mass of the whole gas lane is about (0.9-1.7)x10^7 Msun according to the calculated X_CO=(0.6-1.4)x10^20 cm^-2 (Kkm/s)^-1 from the large-scale CO data and the complementary HI data. The mean gas inflow rate is about 0.8-1.4 Msun/yr, which seems to be comparable to the outflow's rate of the Galactic nuclear winds after applying the updated lower X-factor value above., Comment: 16 pages, 3 figures

Nonlinear Hall effect (NHE) can be generated via Berry curvature dipole (BCD) on nonequilibrium Fermi surface in a non-magnetic system without inversion symmetry.To achieve a large BCD, strong local Berry curvatures and their variation with respect to momentum are necessary and hence topological materials with strong inter-band coupling emerge as promising candidates. In this study, we propose a switchable and robust BCD in the newlydiscovered dual quantum spin Hall insulator (QSHI) $\text{TaIrTe}_4$ by applying out-of-plane electric fields. Switchable BCD could be found along with topological phase transitions or insulator-metal transition in the primitive cell and CDW phases of $\text{TaIrTe}_4$ monolayer. This work presents an instructive strategy for achieving a switchable and robust BCD within dual QSHIs, which should be helpful for designing the NHE-based THz radiations detector.

Identifying multi-exciton states generated from singlet fission is key to understanding the carrier multiplication process, which presents a strategy for improving the efficiency of photovoltaics and bio-imaging. Broadband optically detected magnetic resonance is a sensitive technique to detect multi-exciton states. Here we report a dominant species emerging under intense light excitation corresponding to a weakly exchange coupled triplet pair located on adjacent molecules oriented by nearly 90 degrees, contrasting to the pi-stacked triplet pair under low excitation intensity. The weakly coupled species model precisely reproduces the intricate spin transitions in the Hilbert space of the triplet pair. Combining the magneto photoluminescence and high-magnetic field ODMR, we also identify a strongly exchange-coupled state of three triplet excitons formed by photoexcited V2, which manifests through the magnetic field induced level crossings between its quintet and triplet manifolds. The excellent agreement between the experimental Zeeman fan and the two-triplet spin Hamiltonian highlights the potential of multi-exciton states for quantum information processing.

Electronic Health Records (EHRs) contain rich patient information and are crucial for clinical research and practice. In recent years, deep learning models have been applied to EHRs, but they often rely on massive features, which may not be readily available for all patients. We propose HTP-Star, which leverages hypergraph structures with a pretrain-then-finetune framework for modeling EHR data, enabling seamless integration of additional features. Additionally, we design two techniques, namely (1) Smoothness-inducing Regularization and (2) Group-balanced Reweighting, to enhance the model's robustness during fine-tuning. Through experiments conducted on two real EHR datasets, we demonstrate that HTP-Star consistently outperforms various baselines while striking a balance between patients with basic and extra features., Comment: CHIL 2024

Optical control and read-out of the ground state spin structure has been demonstrated for defect states in crystalline semiconductors, including the diamond NV- center, and these are promising systems for quantum technologies. Molecular organic semiconductors offer synthetic control of spin placement, in contrast to current limitations in these crystalline systems. Here we report the discovery of spin-optical addressability in a diradical molecule that comprises two trityl radical groups coupled via a fluorene bridge. We demonstrate the three important properties that enable operation as a spin-photon interface: (i) triplet and singlet spin states show photoluminescence peaked at 640 and 700 nm respectively; this allows easy optical measurement of ground state spin. (ii) the ground state spin exchange is small (~60 {\mu}eV) that allows preparation of ground state spin population. This can be achieved by spin-selective excited state intersystem crossing, and we report up to 8% microwave-driven contrast in photoluminescence. (iii) both singlet and triplet manifolds have near-unity photoluminescence quantum yield, which is in contrast to the near-zero quantum yields in prior reports of molecular diradicals. Our results establish these tuneable open-shell organic molecules as a platform to engineer tailor-made spin-optical interfaces.

Dual quantum spin Hall insulator (QSHI) is a newly discovered topological state in the 2D material TaIrTe$_4$, exhibiting both a traditional $Z_2$ band gap at charge neutrality point and a van Hove singularity (VHS) induced correlated $Z_2$ band gap with weak doping. Inspired by the recent progress in theoretical understanding and experimental measurements, we predicted a promising dual QSHI in the counterpart material of the NbIrTe4 monolayer by first-principles calculations. In addition to the well-known band inversion at the charge neutrality point, two new band inversions were found after CDW phase transition when the chemical potential is near the VHS, one direct and one indirect $Z_2$ band gap. The VHS-induced non-trivial band gap is around 10 meV, much larger than that from TaIrTe$_4$. Furthermore, since the new generated band gap is mainly dominated by the $4d$ orbitals of Nb, electronic correlation effects should be relatively stronger in NbIrTe$_4$ as compared to TaIrTe$_4$. Therefore, the dual QSHI state in the NbIrTe$_4$ monolayer is expected to be a good platform for investigating the interplay between topology and correlation effects.

Recent Transformer-based large language models (LLMs) demonstrate in-context learning ability to perform various functions based solely on the provided context, without updating model parameters. To fully utilize the in-context capabilities in time series forecasting (TSF) problems, unlike previous Transformer-based or LLM-based time series forecasting methods, we reformulate "time series forecasting tasks" as input tokens by constructing a series of (lookback, future) pairs within the tokens. This method aligns more closely with the inherent in-context mechanisms, and is more parameter-efficient without the need of using pre-trained LLM parameters. Furthermore, it addresses issues such as overfitting in existing Transformer-based TSF models, consistently achieving better performance across full-data, few-shot, and zero-shot settings compared to previous architectures.

Time series (TS) forecasting has been an unprecedentedly popular problem in recent years, with ubiquitous applications in both scientific and business fields. Various approaches have been introduced to time series analysis, including both statistical approaches and deep neural networks. Although neural network approaches have illustrated stronger ability of representation than statistical methods, they struggle to provide sufficient interpretablility, and can be too complicated to optimize. In this paper, we present WEITS, a frequency-aware deep learning framework that is highly interpretable and computationally efficient. Through multi-level wavelet decomposition, WEITS novelly infuses frequency analysis into a highly deep learning framework. Combined with a forward-backward residual architecture, it enjoys both high representation capability and statistical interpretability. Extensive experiments on real-world datasets have demonstrated competitive performance of our model, along with its additional advantage of high computation efficiency. Furthermore, WEITS provides a general framework that can always seamlessly integrate with state-of-the-art approaches for time series forecast., Comment: arXiv admin note: text overlap with arXiv:2310.09488 by other authors

In this work, we report a study on the relationship between flux and intensity for molecular clouds. Our analysis is established on high-quality CO images from the Milky Way Imaging Scroll Painting (MWISP) project. The new flux-intensity relation characterizes the flux variation of molecular clouds above specific intensity levels. We found that the flux-intensity relation exhibits two prominent features. First, the flux-intensity relation generally follows exponential shapes; secondly, hierarchical structures of molecular clouds are imprinted on flux-intensity relations. Specifically, 12CO flux-intensity relations are composed of one or more exponential segments, and for molecular clouds with segmented flux-intensity relations, the edge and the flux of the high-temperature component are strikingly consistent with 13CO emission. Further analysis shows that a similar relationship also exists between 13CO flux-intensity relations and C18O emission. The mean brightness temperature of molecular clouds is tightly associated with the decay rate of flux, the break temperature of exponential segments, and, to a certain extent, the flux fraction of the high-temperature component. Broadly, the flux-intensity relation of a molecular tracer, either in optically thick or in optically thin cases, has the capability to outline the silhouette of internal structures of molecular clouds, proving to be a potent tool for probing structures of molecular clouds., Comment: 10 pages, 6 figures. Accepted for publication by ApJL

Long-term time series forecasting (LTSF) provides longer insights into future trends and patterns. Over the past few years, deep learning models especially Transformers have achieved advanced performance in LTSF tasks. However, LTSF faces inherent challenges such as long-term dependencies capturing and sparse semantic characteristics. Recently, a new state space model (SSM) named Mamba is proposed. With the selective capability on input data and the hardware-aware parallel computing algorithm, Mamba has shown great potential in balancing predicting performance and computational efficiency compared to Transformers. To enhance Mamba's ability to preserve historical information in a longer range, we design a novel Mamba+ block by adding a forget gate inside Mamba to selectively combine the new features with the historical features in a complementary manner. Furthermore, we apply Mamba+ both forward and backward and propose Bi-Mamba+, aiming to promote the model's ability to capture interactions among time series elements. Additionally, multivariate time series data in different scenarios may exhibit varying emphasis on intra- or inter-series dependencies. Therefore, we propose a series-relation-aware decider that controls the utilization of channel-independent or channel-mixing tokenization strategy for specific datasets. Extensive experiments on 8 real-world datasets show that our model achieves more accurate predictions compared with state-of-the-art methods., Comment: New Mamba-based architecture. All experiments rerun

Topological insulating states in two-dimensional (2D) materials are ideal systems to study different types of quantized response signals due to their in gap metallic states. Very recently, the quantum spin Hall (QSH) effect was discovered in monolayer $\text{TaIrTe}_4$ via the observation of quantized longitudinal conductance that rarely exists in other 2D topological insulators. The non-trivial $Z_2$ topological charges can exist at both charge neutrality point and the van Hove singularity point with correlation effect induced band gap. Based on this model 2D material, we studied the switch of quantized signals between longitudinal conductance and transversal Hall conductance via tuning external magnetic field. In $Z_2$ topological phase of monolayer $\text{TaIrTe}_4$, the zero Chern number can be understood as 1-1=0 from the double band inversion from spin-up and spin-down channels. After applying a magnetic field perpendicular to the plane, the Zeeman split changes the band order for one branch of the band inversion from spin-up and spin-down channels, along with a sign charge of the Berry phase. Then the net Chern number of 1-1=0 is tuned to 1+1=2 or -1-1=-2 depending on the orientation of the magnetic field. The quantized signal not only provides another effective method for the verification of topological state in monolayer $\text{TaIrTe}_4$, but also offers a strategy for the utilization of the new quantum topological states based on switchable quantized responses.