Search

We show that there exists a huge amount of multipartite entanglement in holography by studying the upper bound for holographic $n$-partite information $I_n$ that $n-1$ fixed boundary subregions participate. We develop methods to find the $n$-th region $E$ that makes $I_n$ reach the upper bound. Through the explicit evaluation, it is shown that $I_n$, an IR term without UV divergence, could diverge when the number of intervals or strips in region $E$ approaches infinity. At this upper bound configuration, we could argue that $I_n$ fully comes from the $n$-partite global quantum entanglement. Our results indicate: fewer-partite entanglement in holography emerges from more-partite entanglement; $n-1$ distant local subregions are highly $n$-partite entangling. Moreover, the relationship between the convexity of a boundary subregion and the multipartite entanglement it participates, and the difference between multipartite entanglement structure in different dimensions are revealed as well., Comment: 61 pages, 25 figures

In the radiation therapy of nasopharyngeal carcinoma (NPC), clinicians typically delineate the gross tumor volume (GTV) using non-contrast planning computed tomography to ensure accurate radiation dose delivery. However, the low contrast between tumors and adjacent normal tissues necessitates that radiation oncologists manually delineate the tumors, often relying on diagnostic MRI for guidance. % In this study, we propose a novel approach to directly segment NPC gross tumors on non-contrast planning CT images, circumventing potential registration errors when aligning MRI or MRI-derived tumor masks to planning CT. To address the low contrast issues between tumors and adjacent normal structures in planning CT, we introduce a 3D Semantic Asymmetry Tumor segmentation (SATs) method. Specifically, we posit that a healthy nasopharyngeal region is characteristically bilaterally symmetric, whereas the emergence of nasopharyngeal carcinoma disrupts this symmetry. Then, we propose a Siamese contrastive learning segmentation framework that minimizes the voxel-wise distance between original and flipped areas without tumor and encourages a larger distance between original and flipped areas with tumor. Thus, our approach enhances the sensitivity of features to semantic asymmetries. % Extensive experiments demonstrate that the proposed SATs achieves the leading NPC GTV segmentation performance in both internal and external testing, \emph{e.g.}, with at least 2\% absolute Dice score improvement and 12\% average distance error reduction when compared to other state-of-the-art methods in the external testing.

In this article, we solve the instantaneous Bethe-Salpeter equation with a linear plus Coulomb potential and conduct a meticulous study of the mass spectrum and wave function of toponium. Our investigation reveals that, owing to the exceedingly heavy mass of the top quark, the mass splitting between singlet and triplet states, as well as within the triplet states, is negligible. Consequently, relativistic corrections can be safely disregarded in the study of toponium. As such, we present the nonrelativistic wave functions for $S$-wave, $P$-wave, and $D$-wave toponia and study the decays $\eta_t\to \gamma\gamma$, $\eta_t\to gg$, and $\Theta\to \ell^+\ell^-$., Comment: 8 pages, 1 figure

We formulate a stable reduction conjecture that extends Deligne-Mumford's stable reduction to higher dimensions and provide a simple proof that it holds in large characteristic, assuming two standard conjectures of the Minimal Model Program. As a result, we recover the Hacon-Kov\'acs theorem on the properness of the moduli stack $\overline{\mathscr{M}}_{2,v,k}$ of stable surfaces of volume $v$ defined over $k=\overline{k}$, provided that $\operatorname{char}k>C(v)$, a constant depending only on $v$.

We synthesized crystalline films of neodymium nickel oxide (NdNiO3), a perovskite quantum material, switched the films from a metal phase (intrinsic) into an insulator phase (electron-doped) by field-driven lithium-ion intercalation, and characterized their structural and optical properties. Time-of-flight secondary-ion mass spectrometry (ToF-SIMS) showed that the intercalation process resulted in a gradient of the dopant concentration along the thickness direction of the films, turning the films into insulator-metal bilayers. We used variable-angle spectroscopic ellipsometry to measure the complex refractive indices of the metallic and insulating phases of NdNiO3. The insulator phase has a refractive index of n ~ 2 and low absorption in the visible and near infrared, and analysis of the complex refractive indices indicated that the band gap of the insulating phase is roughly 3-4 eV. Electrical control of the optical band gap, with corresponding large changes to the optical refractive indices, creates new opportunities for tunable optics., Comment: Main text + supplementary

In this work, we derive three recursive formulas for the integrals of products of Hermite polynomials. The derivation is notably straightforward, relying solely on the well-established properties of Hermite polynomials and the technique of integration by parts. These results hold broad relevance across various fields of physics and mathematics. Specifically, they would be applied to accurately compute two- and three-body matrix elements in ab initio simulations of one-dimensional few-body systems confined in harmonic traps. Additionally, we provide a numerical subroutine that implements these recursive formulas, which accompanies this work., Comment: 12 pages, comments are welcome

We report the detection of H$_2$O maser emission in 4 out of 77 (5.2%) mid-IR red galaxies that meet the color criteria of $W1-W2 > 0.5$ and $W1-W4 > 7$ and are classified as Type-2 AGNs based on optical, near-IR, and mid-IR spectral energy distribution (SED) fitting. Here, $W1$, $W2$, and $W4$ represent the IR magnitudes at 3.4, 4.6, and 22 micron, respectively, as measured by the Wide-field Infrared Survey Explorer. Three of the four newly identified maser galaxies are classified as either Seyfert 2 or LINER systems, but none are disk maser systems. Our analysis indicates that AGN identifications based solely on SED fitting are unreliable, resulting in an unexpectedly low detection rate. By restricting our sample to optically classified Type 2 AGNs that satisfy the mid-IR color criteria, we achieve a maser detection rate of ~13-18%, aligning with previous predictions for mid-IR red sources. These selection criteria are the most effective to date for facilitating new maser detections, particularly in light of the recent identification of additional Type 2 AGNs identified from ongoing galaxy and AGN surveys., Comment: 11 pages, 3 tables, 3 figures

We show that deep neural networks achieve dimension-independent rates of convergence for learning structured densities such as those arising in image, audio, video, and text applications. More precisely, we demonstrate that neural networks with a simple $L^2$-minimizing loss achieve a rate of $n^{-1/(4+r)}$ in nonparametric density estimation when the underlying density is Markov to a graph whose maximum clique size is at most $r$, and we provide evidence that in the aforementioned applications, this size is typically constant, i.e., $r=O(1)$. We then establish that the optimal rate in $L^1$ is $n^{-1/(2+r)}$ which, compared to the standard nonparametric rate of $n^{-1/(2+d)}$, reveals that the effective dimension of such problems is the size of the largest clique in the Markov random field. These rates are independent of the data's ambient dimension, making them applicable to realistic models of image, sound, video, and text data. Our results provide a novel justification for deep learning's ability to circumvent the curse of dimensionality, demonstrating dimension-independent convergence rates in these contexts.

Learning diverse policies for non-prehensile manipulation is essential for improving skill transfer and generalization to out-of-distribution scenarios. In this work, we enhance exploration through a two-fold approach within a hybrid framework that tackles both discrete and continuous action spaces. First, we model the continuous motion parameter policy as a diffusion model, and second, we incorporate this into a maximum entropy reinforcement learning framework that unifies both the discrete and continuous components. The discrete action space, such as contact point selection, is optimized through Q-value function maximization, while the continuous part is guided by a diffusion-based policy. This hybrid approach leads to a principled objective, where the maximum entropy term is derived as a lower bound using structured variational inference. We propose the Hybrid Diffusion Policy algorithm (HyDo) and evaluate its performance on both simulation and zero-shot sim2real tasks. Our results show that HyDo encourages more diverse behavior policies, leading to significantly improved success rates across tasks - for example, increasing from 53% to 72% on a real-world 6D pose alignment task. Project page: https://leh2rng.github.io/hydo, Comment: 8 pages

A charge density wave (CDW) is a phase of matter characterized by a periodic modulation of the valence electron density accompanied by a distortion of the lattice structure. The microscopic details of CDW formation are closely tied to the dynamic charge susceptibility, $\chi(q,\omega)$, which describes the behavior of electronic collective modes. Despite decades of extensive study, the behavior of $\chi(q,\omega)$ in the vicinity of a CDW transition has never been measured with high energy resolution ($\sim$meV). Here, we investigate the canonical CDW transition in ErTe$_3$ using momentum-resolved electron energy loss spectroscopy (M-EELS), a technique uniquely sensitive to valence band charge excitations. Unlike phonons in these materials, which undergo conventional softening due to the Kohn anomaly at the CDW wavevector, the electronic excitations display purely relaxational dynamics that are well described by a diffusive model. The diffusivity peaks around 250 K, just below the critical temperature. Additionally, we report, for the first time, a divergence in the real part of $\chi(q,\omega)$ in the static limit ($\omega \rightarrow 0$), a phenomenon predicted to characterize CDWs since the 1970s. These results highlight the importance of energy- and momentum-resolved measurements of electronic susceptibility and demonstrate the power of M-EELS as a versatile probe of charge dynamics in materials.

The CMS and ATLAS Collaborations have recently reported their findings based on the comprehensive run 2 dataset, detailing their searches for a light Higgs boson with a mass of approximately 95 GeV. We investigate the excesses observed in the $\gamma\gamma$, $\tau{\bar\tau}$ and $b{\bar b}$ data at approximately 95 GeV in the $U(1)_X$ model. Additionally, it also mixes with the SM-like Higgs boson. Research indicates that, in this model, identifying this singlet Higgs state as the lightest Higgs boson holds tremendous potential for explaining the excess observed at approximately 95 GeV. In our calculations, we maintain the masses of the lightest and next-to-lightest Higgs bosons at approximately 95 GeV and 125 GeV, respectively. The study finds that the theoretical predictions for the signal strengths $\mu(h_{95})_{\gamma\gamma}$ $\mu(h_{95})_{\tau{\bar\tau}}$ and $\mu(h_{95})_{b{\bar b}}$ in the $U(1)_X$ model align well with the excesses observed by CMS., Comment: 23 pages, 5 figures

The integration of quantum computing into classical machine learning architectures has emerged as a promising approach to enhance model efficiency and computational capacity. In this work, we introduce the Quantum Kernel-Based Long Short-Term Memory (QK-LSTM) network, which utilizes quantum kernel functions within the classical LSTM framework to capture complex, non-linear patterns in sequential data. By embedding input data into a high-dimensional quantum feature space, the QK-LSTM model reduces the reliance on large parameter sets, achieving effective compression while maintaining accuracy in sequence modeling tasks. This quantum-enhanced architecture demonstrates efficient convergence, robust loss minimization, and model compactness, making it suitable for deployment in edge computing environments and resource-limited quantum devices (especially in the NISQ era). Benchmark comparisons reveal that QK-LSTM achieves performance on par with classical LSTM models, yet with fewer parameters, underscoring its potential to advance quantum machine learning applications in natural language processing and other domains requiring efficient temporal data processing.

Observations have revealed unique temperature profiles in hot Jupiter atmospheres. We propose that the energy transport by vertical mixing could lead to such thermal features. In our new scenario, strong absorbers, TiO and VO are not necessary. Vertical mixing could be naturally excited by atmospheric circulation or internal gravity wave breaking. We perform radiative transfer calculations by taking into account the vertical mixing driven energy transport. The radiative equilibrium (RE) is replaced by radiative-mixing equilibrium (RME). We investigate how the mixing strength, $K_{\rm zz}$, affects the atmospheric temperature-pressure profile. Strong mixing can heat the lower atmosphere and cool the upper atmosphere. This effect has important effects on the atmosphere thermal features that would form without mixing. In certain circumstances, it can induce temperature inversions in scenarios where the temperature monotonically increases with increasing pressure under conditions of lower thermal band opacity. Temperature inversions show up as $K_{\rm zz}$ increases with altitude due to shear interaction with the convection layer. The atmospheric thermal structure of HD~209458b can be well fitted with $K_{\rm zz} \propto (P/1\ {\rm bar})^{-1/2}\ {\rm cm}^{2} \ {\rm s}^{-1}$. Our findings suggest vertical mixing promotes temperature inversions and lowers $K_{\rm zz}$ estimates compared to prior studies. Incorporating chemical species into vertical mixing will significantly affect the thermal profile due to their temperature sensitivity., Comment: 12 pages, 6 figure. Accepted in ApJ

The strange metal is a peculiar phase of matter in which the electron scattering rate, $\tau^{-1} \sim k_B T/\hbar$, which determines the electrical resistance, is universal across a wide family of materials and determined only by fundamental constants. In 1989, theorists hypothesized that this universality would manifest as scale-invariant behavior in the dynamic charge susceptibility, $\chi''(q,\omega)$. Here, we present momentum-resolved inelastic electron scattering measurements of the strange metal Bi$_2$Sr$_2$CaCu$_2$O$_{8+x}$ showing that the susceptibility has the scale-invariant form $\chi''(q,\omega) = T^{-\nu} f(\omega/T)$, with exponent $\nu = 0.93$. We find the response is consistent with conformal invariance, meaning the dynamics may be thought of as occurring on a circle of radius $1/T$ in imaginary time, characterized by conformal dimension $\Delta = 0.05$. Our study indicates that the strange metal is a universal phenomenon whose properties are not determined by microscopic properties of a particular material., Comment: 14 pages, 4 figures + supplementary data

Since the initial discovery of two-dimensional van der Waals (vdW) materials, significant effort has been made to incorporate the three properties of magnetism, band structure topology, and strong electron correlations $-$ to leverage emergent quantum phenomena and expand their potential applications. However, the discovery of a single vdW material that intrinsically hosts all three ingredients has remained an outstanding challenge. Here we report the discovery of a Kondo-interacting topological antiferromagnet in the vdW 5$f$ electron system UOTe. It has a high antiferromagnetic (AFM) transition temperature of 150 K, with a unique AFM configuration that breaks the combined parity and time reversal ($PT$) symmetry in an even number of layers while maintaining zero net magnetic moment. Our angle-resolved photoemission spectroscopy (ARPES) measurements reveal Dirac bands near the Fermi level, which combined with our theoretical calculations demonstrate UOTe as an AFM Dirac semimetal. Within the AFM order, we observed the presence of the Kondo interaction, as evidenced by the emergence of a 5$f$ flat band near the Fermi level below 100 K and hybridization between the Kondo band and the Dirac band. Our density functional theory calculations in its bilayer form predict UOTe as a rare example of a fully-compensated AFM Chern insulator., Comment: Accepted to Advanced Materials

Reinforcement learning from human feedback (RLHF) provides a paradigm for aligning large language models (LLMs) with human preferences. This involves the initial training of a reward model based on pairwise human feedback. The reward model is subsequently utilized in reinforcement learning to assess the scores of each generated sentence as a whole, further guiding the optimization of LLMs. However, current approaches have a significant shortcoming: \emph{They allocate a single, sparse, and delayed reward to an entire sequence of output}. This may overlook some significant individual contributions of each token towards the desired outcome. To overcome this limitation, our paper proposes a novel reward redistribution method called R3HF, which facilitates a more fine-grained, token-level reward allocation. Specifically, our method treats the reward prediction task of the reward model as a regression problem. As a result, the redistributed rewards are computed by evaluating the specific contribution of each token to the reward model's output. This detailed approach improves the model's understanding of language nuances, leading to more precise enhancements in its performance. Our method is crafted to integrate seamlessly with most current techniques while incurring minimal computational costs. Through comprehensive experiments across diverse datasets and tasks, we have verified the effectiveness and superiority of our approach.

Nonlinear partial differential equations (PDEs) are crucial for modeling complex fluid dynamics and are foundational to many computational fluid dynamics (CFD) applications. However, solving these nonlinear PDEs is challenging due to the vast computational resources they demand, highlighting the pressing need for more efficient computational methods. Quantum computing offers a promising but technically challenging approach to solving nonlinear PDEs. Recently, Liao proposed a framework that leverages quantum computing to accelerate the solution of nonlinear PDEs based on the homotopy analysis method (HAM), a semi-analytical technique that transforms nonlinear PDEs into a series of linear PDEs. However, the no-cloning theorem in quantum computing poses a major limitation, where directly applying quantum simulation to each HAM step results in exponential complexity growth with the HAM truncation order. This study introduces a "secondary linearization" approach that maps the whole HAM process into a system of linear PDEs, allowing for a one-time solution using established quantum PDE solvers. Our method preserves the exponential speedup of quantum linear PDE solvers while ensuring that computational complexity increases only polynomially with the HAM truncation order. We demonstrate the efficacy of our approach by applying it to the Burgers' equation and the Korteweg-de Vries (KdV) equation. Our approach provides a novel pathway for transforming nonlinear PDEs into linear PDEs, with potential applications to fluid dynamics. This work thus lays the foundation for developing quantum algorithms capable of solving the Navier-Stokes equations, ultimately offering a promising route to accelerate their solutions using quantum computing., Comment: 22 pages, 4 figures

Regional prompting, or compositional generation, which enables fine-grained spatial control, has gained increasing attention for its practicality in real-world applications. However, previous methods either introduce additional trainable modules, thus only applicable to specific models, or manipulate on score maps within cross-attention layers using attention masks, resulting in limited control strength when the number of regions increases. To handle these limitations, we present RAG, a Regional-Aware text-to-image Generation method conditioned on regional descriptions for precise layout composition. RAG decouple the multi-region generation into two sub-tasks, the construction of individual region (Regional Hard Binding) that ensures the regional prompt is properly executed, and the overall detail refinement (Regional Soft Refinement) over regions that dismiss the visual boundaries and enhance adjacent interactions. Furthermore, RAG novelly makes repainting feasible, where users can modify specific unsatisfied regions in the last generation while keeping all other regions unchanged, without relying on additional inpainting models. Our approach is tuning-free and applicable to other frameworks as an enhancement to the prompt following property. Quantitative and qualitative experiments demonstrate that RAG achieves superior performance over attribute binding and object relationship than previous tuning-free methods., Comment: Code is available at https://github.com/NJU-PCALab/RAG-Diffusion

In this paper, we address the quantitative regularity and blow-up criteria for classical solutions to the three-dimensional incompressible Navier-Stokes equations in a critical Besov space setting. Specifically, we consider solutions $u\in L^\infty_T(\dot{B}_{p,\infty}^{-1+\frac{3}{p}})$ such that $|D|^{-1+\frac{3}{p}}|u|\in L^\infty_t (L_x^p)$ with $3

In the United States, skin cancer ranks as the most commonly diagnosed cancer, presenting a significant public health issue due to its high rates of occurrence and the risk of serious complications if not caught early. Recent advancements in dataset curation and deep learning have shown promise in quick and accurate detection of skin cancer. However, current open-source datasets have significant class imbalances which impedes the effectiveness of these deep learning models. In healthcare, generative artificial intelligence (AI) models have been employed to create synthetic data, addressing data imbalance in datasets by augmenting underrepresented classes and enhancing the overall quality and performance of machine learning models. In this paper, we build on top of previous work by leveraging new advancements in generative AI, notably Stable Diffusion and DreamBooth. We introduce Cancer-Net SCa-Synth, an open access synthetically generated 2D skin lesion dataset for skin cancer classification. Further analysis on the data effectiveness by comparing the ISIC 2020 test set performance for training with and without these synthetic images for a simple model highlights the benefits of leveraging synthetic data to improve performance. Cancer-Net SCa-Synth is publicly available at https://github.com/catai9/Cancer-Net-SCa-Synth as part of a global open-source initiative for accelerating machine learning for cancer care.

In the United States, prostate cancer is the second leading cause of deaths in males with a predicted 35,250 deaths in 2024. However, most diagnoses are non-lethal and deemed clinically insignificant which means that the patient will likely not be impacted by the cancer over their lifetime. As a result, numerous research studies have explored the accuracy of predicting clinical significance of prostate cancer based on magnetic resonance imaging (MRI) modalities and deep neural networks. Despite their high performance, these models are not trusted by most clinical scientists as they are trained solely on a single modality whereas clinical scientists often use multiple magnetic resonance imaging modalities during their diagnosis. In this paper, we investigate combining multiple MRI modalities to train a deep learning model to enhance trust in the models for clinically significant prostate cancer prediction. The promising performance and proposed training pipeline showcase the benefits of incorporating multiple MRI modalities for enhanced trust and accuracy., Comment: Findings paper presented at Machine Learning for Health (ML4H) symposium 2024, December 15-16, 2024, Vancouver, Canada, 6 pages

Diabetic Retinopathy (DR) is a primary cause of blindness, necessitating early detection and diagnosis. This paper focuses on referable DR classification to enhance the applicability of the proposed method in clinical practice. We develop an advanced cross-learning DR classification method leveraging transfer learning and cross-attention mechanisms. The proposed method employs the Swin U-Net architecture to segment lesion maps from DR fundus images. The Swin U-Net segmentation model, enriched with DR lesion insights, is transferred to generate a lesion map. Both the fundus image and its segmented lesion map are used as complementary inputs for the classification model. A cross-attention mechanism is deployed to improve the model's ability to capture fine-grained details from the input pairs. Our experiments, utilizing two public datasets, FGADR and EyePACS, demonstrate a superior accuracy of 94.6%, surpassing current state-of-the-art methods by 4.4%. To this end, we aim for the proposed method to be seamlessly integrated into clinical workflows, enhancing accuracy and efficiency in identifying referable DR., Comment: ACCV 2024 accepted

Graph Convolutional Network (GCN) are widely used in Graph Anomaly Detection (GAD) due to their natural compatibility with graph structures, resulting in significant performance improvements. However, most researchers approach GAD as a graph node classification task and often rely on low-pass filters or feature aggregation from neighboring nodes. This paper proposes a novel approach by introducing a High-Pass Graph Convolution Network (HP-GCN) for GAD. The proposed HP-GCN leverages high-frequency components to detect anomalies, as anomalies tend to increase high-frequency signals within the network of normal nodes. Additionally, isolated nodes, which lack interactions with other nodes, present a challenge for Graph Neural Network (GNN). To address this, the model segments the graph into isolated nodes and nodes within connected subgraphs. Isolated nodes learn their features through Multi-Layer Perceptron (MLP), enhancing detection accuracy. The model is evaluated and validated on YelpChi, Amazon, T-Finance, and T-Social datasets. The results showed that the proposed HP-GCN can achieve anomaly detection accuracy of 96.10%, 98.16%, 96.46%, and 98.94%, respectively. The findings demonstrate that the HP-GCN outperforms existing GAD methods based on spatial domain GNN as well as those using low-pass and band-pass filters in spectral domain GCN. The findings underscore the effectiveness of this method in improving anomaly detection performance. Source code can be found at: https://github.com/meteor0033/High-pass_GAD.git.

The definition of heat current operator for systems for non-pairwise additive interactions and its impact on related lattice thermal conductivity ($\kappa_{L}$) via molecular dynamics simulation (MD) are ambiguous and controversial when migrating from conventional empirical potential models to machine learning potential (MLP) models. Empirical model descriptions are often limited to three- to four-body interaction while a sophisticated representation of the many-body physics could be resembled in MLPs. Herein, we study and compare the significance of many-body interaction to the heat current computation in one of the most popular MLP models, the Moment Tensor Potential (MTP). Non-equilibrium MD simulations and equilibrium MD simulations among four different materials, $PbTe$, amorphous $Sc_{0.2}Sb_{2}Te_{3}$, graphene, and $BAs$, were performed. We found inconsistency between the simulation thermostat and its implemented heat current operator in our non-equilibrium MD results which violate law of energy conservation and suggest a need for revision. We revisit the virial stress tensor expression within the calculator and identified the lack of a generalised many-body heat current description in it. We uncover the influence of the modified heat current formula that could alter the $\kappa_{L}$ results 29% to 64% using the equilibrium MD computational approach. Our work demonstrates the importance of a many-body description during thermal analysis in MD simulations when MLPs are in concern. This work sheds light on a better understanding of the relationship between interatomic interaction and its heat transport mechanism., Comment: 9 pages, 9 figures

Temporal Heterogeneous Networks play a crucial role in capturing the dynamics and heterogeneity inherent in various real-world complex systems, rendering them a noteworthy research avenue for link prediction. However, existing methods fail to capture the fine-grained differential distribution patterns and temporal dynamic characteristics, which we refer to as spatial heterogeneity and temporal heterogeneity. To overcome such limitations, we propose a novel \textbf{C}ontrastive Learning-based \textbf{L}ink \textbf{P}rediction model, \textbf{CLP}, which employs a multi-view hierarchical self-supervised architecture to encode spatial and temporal heterogeneity. Specifically, aiming at spatial heterogeneity, we develop a spatial feature modeling layer to capture the fine-grained topological distribution patterns from node- and edge-level representations, respectively. Furthermore, aiming at temporal heterogeneity, we devise a temporal information modeling layer to perceive the evolutionary dependencies of dynamic graph topologies from time-level representations. Finally, we encode the spatial and temporal distribution heterogeneity from a contrastive learning perspective, enabling a comprehensive self-supervised hierarchical relation modeling for the link prediction task. Extensive experiments conducted on four real-world dynamic heterogeneous network datasets verify that our \mymodel consistently outperforms the state-of-the-art models, demonstrating an average improvement of 10.10\%, 13.44\% in terms of AUC and AP, respectively.

Parkinson's disease (PD), a degenerative disorder of the central nervous system, is commonly diagnosed using functional medical imaging techniques such as single-photon emission computed tomography (SPECT). In this study, we utilized two SPECT data sets (n = 634 and n = 202) from different hospitals to develop a model capable of accurately predicting PD stages, a multiclass classification task. We used the entire three-dimensional (3D) brain images as input and experimented with various model architectures. Initially, we treated the 3D images as sequences of two-dimensional (2D) slices and fed them sequentially into 2D convolutional neural network (CNN) models pretrained on ImageNet, averaging the outputs to obtain the final predicted stage. We also applied 3D CNN models pretrained on Kinetics-400. Additionally, we incorporated an attention mechanism to account for the varying importance of different slices in the prediction process. To further enhance model efficacy and robustness, we simultaneously trained the two data sets using weight sharing, a technique known as cotraining. Our results demonstrated that 2D models pretrained on ImageNet outperformed 3D models pretrained on Kinetics-400, and models utilizing the attention mechanism outperformed both 2D and 3D models. The cotraining technique proved effective in improving model performance when the cotraining data sets were sufficiently large., Comment: 34 pages, 7 figures, and 4 tables

Despite huge progress in skeleton-based action recognition, its generalizability to different domains remains a challenging issue. In this paper, to solve the skeleton action generalization problem, we present a recover-and-resample augmentation framework based on a novel complete action prior. We observe that human daily actions are confronted with temporal mismatch across different datasets, as they are usually partial observations of their complete action sequences. By recovering complete actions and resampling from these full sequences, we can generate strong augmentations for unseen domains. At the same time, we discover the nature of general action completeness within large datasets, indicated by the per-frame diversity over time. This allows us to exploit two assets of transferable knowledge that can be shared across action samples and be helpful for action completion: boundary poses for determining the action start, and linear temporal transforms for capturing global action patterns. Therefore, we formulate the recovering stage as a two-step stochastic action completion with boundary pose-conditioned extrapolation followed by smooth linear transforms. Both the boundary poses and linear transforms can be efficiently learned from the whole dataset via clustering. We validate our approach on a cross-dataset setting with three skeleton action datasets, outperforming other domain generalization approaches by a considerable margin., Comment: accepted by NeurIPS 2024

A naive classical representation of an n-qubit state requires specifying exponentially many amplitudes in the computational basis. Past works have demonstrated that classical neural networks can succinctly express these amplitudes for many physically relevant states, leading to computationally powerful representations known as neural quantum states. What underpins the efficacy of such representations? We show that conditional correlations present in the measurement distribution of quantum states control the performance of their neural representations. Such conditional correlations are basis dependent, arise due to measurement-induced entanglement, and reveal features not accessible through conventional few-body correlations often examined in studies of phases of matter. By combining theoretical and numerical analysis, we demonstrate how the state's entanglement and sign structure, along with the choice of measurement basis, give rise to distinct patterns of short- or long-range conditional correlations. Our findings provide a rigorous framework for exploring the expressive power of neural quantum states., Comment: 37 pages, 9 figures

Traditional blockchain systems, such as Ethereum, typically rely on a \emph{single volatile cryptocurrency for transaction fees}. This leads to fluctuating transaction fee prices and limits the flexibility of users' payment options. To address these issues, we propose MStableChain, which leverage multiple stablecoins as native tokens for transaction fee settlements, thus ensuring stable transaction fees and flexible payment options. To address the challenges of mass adoption and practicality, we propose several core designs. To maintain compatibility with the Ethereum Virtual Machine (EVM) for mass adoption while supporting multiple native stablecoins, MStableChain employs a multi-currency units, multi-type RPCs mechanism. This mechanism enables the system to handle multiple stablecoins without altering the EVM or requiring changes to user applications. Furthermore, an oracle-based gas fee adjustment mechanism is proposed to manage exchange rates between different stablecoins, ensuring equitable transaction costs across various currencies. The system also introduces a secure, on-chain voting-based management protocol for the administrative functions related to these stablecoins. Experimental results from a prototype implementation demonstrate that MStableChain provides stable transaction fee prices, high effectiveness, and good usability., Comment: In submission to IEEE TSC

The Chasing All Transients Constellation Hunters (CATCH) space mission is focused on exploring the dynamic universe via X-ray follow-up observations of various transients. The first pathfinder of the CATCH mission, CATCH-1, was launched on June 22, 2024, alongside the Space-based multiband astronomical Variable Objects Monitor (SVOM) mission. CATCH-1 is equipped with narrow-field optimized Micro Pore Optics (MPOs) featuring a large effective area and incorporates four Silicon Drift Detectors (SDDs) in its focal plane. This paper presents the system calibration results conducted before the satellite integration. Utilizing the data on the performance of the mirror and detectors obtained through the system calibration, combined with simulated data, the ground calibration database can be established. Measuring the relative positions of the mirror and detector system, which were adjusted during system calibration, allows for accurate installation of the entire satellite. Furthermore, the paper outlines the operational workflow of the ground network post-satellite launch.

This study examines the capabilities of advanced Large Language Models (LLMs), particularly the o1 model, in the context of literary analysis. The outputs of these models are compared directly to those produced by graduate-level human participants. By focusing on two Nobel Prize-winning short stories, 'Nine Chapters' by Han Kang, the 2024 laureate, and 'Friendship' by Jon Fosse, the 2023 laureate, the research explores the extent to which AI can engage with complex literary elements such as thematic analysis, intertextuality, cultural and historical contexts, linguistic and structural innovations, and character development. Given the Nobel Prize's prestige and its emphasis on cultural, historical, and linguistic richness, applying LLMs to these works provides a deeper understanding of both human and AI approaches to interpretation. The study uses qualitative and quantitative evaluations of coherence, creativity, and fidelity to the text, revealing the strengths and limitations of AI in tasks typically reserved for human expertise. While LLMs demonstrate strong analytical capabilities, particularly in structured tasks, they often fall short in emotional nuance and coherence, areas where human interpretation excels. This research underscores the potential for human-AI collaboration in the humanities, opening new opportunities in literary studies and beyond.

Large curvature perturbations can source an observable amount of stochastic gravitational wave background (SGWB). We consider several scenarios where small-scale curvature perturbations are naturally enhanced due to the presence of additional spectator fields during inflation. The same spectator fields can lead to a period of early matter domination (EMD) after inflation. We compute the inflationary spectrum of curvature perturbation and determine its evolution at later times, taking into account both the onset and the end of the EMD epoch, and also the impact of relative velocity perturbation between matter and radiation. The feature that the same field is responsible for both enhanced perturbations and the EMD era, leads to a predictive framework within which the full frequency dependence of SGWB can be computed. The SGWB can be observed in several detectors, including those focused on the nano-Hz regime. Our numerical framework can also be used to study other non-standard cosmological histories., Comment: 38 pages, 14 figures

The aim of this paper is to investigate the boundedness of periodic Fourier integral operators in Lebesgue spaces with variable exponent $L^{p(\cdot)}$ on the $n$-dimensional torus. We deal with operators of type $(\rho, \delta)$ which symbols belong to the H\"{o}rmander class $S^{m}_{\rho, \delta}(\mathbb{T}^{n}\times\mathbb{Z}^{n})$ for $0\leq\delta<\rho\leq1.$, Comment: 15 pages

Large language models (LLMs) are employed to simulate human-like responses in social surveys, yet it remains unclear if they develop biases like social desirability response (SDR) bias. To investigate this, GPT-4 was assigned personas from four societies, using data from the 2022 Gallup World Poll. These synthetic samples were then prompted with or without a commitment statement intended to induce SDR. The results were mixed. While the commitment statement increased SDR index scores, suggesting SDR bias, it reduced civic engagement scores, indicating an opposite trend. Additional findings revealed demographic associations with SDR scores and showed that the commitment statement had limited impact on GPT-4's predictive performance. The study underscores potential avenues for using LLMs to investigate biases in both humans and LLMs themselves.

3D visual grounding is crucial for robots, requiring integration of natural language and 3D scene understanding. Traditional methods depending on supervised learning with 3D point clouds are limited by scarce datasets. Recently zero-shot methods leveraging LLMs have been proposed to address the data issue. While effective, these methods only use object-centric information, limiting their ability to handle complex queries. In this work, we present VLM-Grounder, a novel framework using vision-language models (VLMs) for zero-shot 3D visual grounding based solely on 2D images. VLM-Grounder dynamically stitches image sequences, employs a grounding and feedback scheme to find the target object, and uses a multi-view ensemble projection to accurately estimate 3D bounding boxes. Experiments on ScanRefer and Nr3D datasets show VLM-Grounder outperforms previous zero-shot methods, achieving 51.6% Acc@0.25 on ScanRefer and 48.0% Acc on Nr3D, without relying on 3D geometry or object priors. Codes are available at https://github.com/OpenRobotLab/VLM-Grounder ., Comment: CoRL 2024 Camera Ready. 25 pages. A novel zero-shot 3D visual grounding framework based solely on 2D images

We study holomorphic isometries between bounded symmetric domains with respect to the Bergman metrics up to a normalizing constant. In particular, we first consider a holomorphic isometry from the complex unit ball into an irreducible bounded symmetric domain with respect to the Bergman metrics. In this direction, we show that images of (nonempty) affine-linear sections of the complex unit ball must be the intersections of the image of the holomorphic isometry with certain affine-linear subspaces. We also construct a surjective holomorphic submersion from a certain subdomain of the target bounded symmetric domain onto the complex unit ball such that the image of the holomorphic isometry lies inside the subdomain and the holomorphic isometry is a global holomorphic section of the holomorphic submersion. This construction could be generalized to any holomorphic isometry between bounded symmetric domains with respect to the \emph{canonical K\"ahler metrics}. Using some classical results for complex-analytic subvarieties of Stein manifolds, we have obtained further geometric results for images of such holomorphic isometries.

In an extension of MSSM with two triplets and a singlet, called the TNMSSM, there are seven neutralinos which can enrich the study of cold dark matter if one expects that the weakly interacting massive particle (WIMP) is responsible for the observation of Planck satellite. Such a model, compared to the MSSM, can naturally offer a solution to the $\mu$ problem, and its lightest neutralino, which is bino-like, can also provide a correct relic density by using the coannihilation mechanism due to the newly added triplinos. Taking into account the related experimental measurements, such as the bound on the SM-like Higgs mass, the $B$ meson rare decays, the anomalous magnetic moment of the muon $a_\mu$, the Large Hadron Collider (LHC) measurements and the latest dark matter direct detection experiment LUX-ZEPLIN (LZ), the TNMSSM parameter space can be strictly limited. In respect to all the constraints mentioned above, we find that a bino-like neutralino with a mass in the region $[100, 450]~\rm{GeV}$ can successfully account for the correct dark matter relic density. Additionally, most of the viable parameter space can be tested in the near future experiments such as the Xenon-nT experiment or LHC.

Extreme-mass-ratio inspirals (EMRIs), consisting of a massive black hole and a stellar compact object, are one of the most important sources for space-borne gravitational wave detectors like TianQin. Their population study can be used to constrain astrophysical models that interpret the EMRI formation mechanisms. In this paper, as a first step, we employ a parametrization method to describe the EMRI population model in the loss cone formation channel. This approach, however, can be extended to other models such as the accretion disc driven formation channel. We present the phenomenological characteristic of the MBH mass, spin, and redshift distributions. Then, we investigate the posterior distribution of the hyper-parameters that describe this population model. Our results show that TianQin could recover almost all the posterior of the hyper-parameters within $1\sigma$ confidence interval. With one hundred detectable EMRI events, the hyper-parameters $\alpha_1, \alpha_2, b$, which describe the MBH mass distribution, could be measured with an accuracy of $37\%$, $24\%$, and $3\%$, respectively. The hyper-parameters $\mu_z$, and $\sigma_z$, which describe the redshift distribution, have $\mu_z$ above the detectable range of TianQin, and $\sigma_z$ measured with an accuracy of $14.5\%$. With this estimation accuracy, the EMRI population characteristics can be effectively demonstrated, potentially serving as evidence for EMRI formation in the future studies. Furthermore, with an increasing number of detectable events, the parameter estimation for the hyper-parameters will improve and the confidence intervals will be narrowed., Comment: 11 pages, 5 figures

A fundamental challenge in modern physics is bridging the gap between an exact description of few-body microscopic systems and the emergent description of many-body macroscopic systems. This gap may be bridged by tracing the properties of well-controlled intermediate-size mesoscopic systems. Here, we study mesoscopic signatures of a spatial self-organization phase transition in deterministically prepared arrays of between 10 and 22 atoms inside an optical cavity. Through precise engineering of the atom-cavity interactions, we reveal how critical behavior depends on atom number. We identify characteristic dynamical behaviors related to symmetry breaking and system size in the self-organized regime, and observe a finite optomechanical susceptibility at the critical point. This work opens the door to probing particle-number- and time-resolved properties of phase transitions in mesoscopic systems., Comment: 21 pages, 9 figures

We describe the doping effects on a metallic breathing pyrochlore compound, Cr4PtGa17. Upon doping with Sb, i.e., Cr4Pt(Ga1-xSbx)17, it was found that a selective doping on one of the seven Ga sites occurs. With increasing dopant level, the ferromagnetism in the parent compound is gradually suppressed, along with a decrease in fitted Curie-Weiss temperature (from 61 (1) K to -1.8 (1) K) and effective moment (from ~2.26 muB/f.u. to ~0.68 muB/f.u.). Low-temperature heat capacity measurements confirm the absence of magnetic ordering above 0.4 K for the three most doped samples. Meanwhile, electrical resistivity measurements display a metal-semiconductor transition with increasing Sb contents, which is attributed to an increase of Fermi energy based on the calculations of electronic band structure and density of states. Moreover, we have speculated that the ferromagnetism in Cr4PtGa17 is governed by itinerant electrons according to our observations. This study of Sb-doping effect on Cr4PtGa17 provides deeper understanding of magnetism of this system and possibilities for future modifications., Comment: 29 pages, 7 figures, 6 tables

Recent advances in CV and NLP have been largely driven by scaling up the number of network parameters, despite traditional theories suggesting that larger networks are prone to overfitting. These large networks avoid overfitting by integrating components that induce a simplicity bias, guiding models toward simple and generalizable solutions. However, in deep RL, designing and scaling up networks have been less explored. Motivated by this opportunity, we present SimBa, an architecture designed to scale up parameters in deep RL by injecting a simplicity bias. SimBa consists of three components: (i) an observation normalization layer that standardizes inputs with running statistics, (ii) a residual feedforward block to provide a linear pathway from the input to output, and (iii) a layer normalization to control feature magnitudes. By scaling up parameters with SimBa, the sample efficiency of various deep RL algorithms-including off-policy, on-policy, and unsupervised methods-is consistently improved. Moreover, solely by integrating SimBa architecture into SAC, it matches or surpasses state-of-the-art deep RL methods with high computational efficiency across DMC, MyoSuite, and HumanoidBench. These results demonstrate SimBa's broad applicability and effectiveness across diverse RL algorithms and environments., Comment: preprint

Recent advancements in text-to-image diffusion models have shown remarkable creative capabilities with textual prompts, but generating personalized instances based on specific subjects, known as subject-driven generation, remains challenging. To tackle this issue, we present a new hybrid framework called HybridBooth, which merges the benefits of optimization-based and direct-regression methods. HybridBooth operates in two stages: the Word Embedding Probe, which generates a robust initial word embedding using a fine-tuned encoder, and the Word Embedding Refinement, which further adapts the encoder to specific subject images by optimizing key parameters. This approach allows for effective and fast inversion of visual concepts into textual embedding, even from a single image, while maintaining the model's generalization capabilities., Comment: ECCV 2024, the project page: https://sites.google.com/view/hybridbooth

We consider the problem of estimating a structured multivariate density, subject to Markov conditions implied by an undirected graph. In the worst case, without Markovian assumptions, this problem suffers from the curse of dimensionality. Our main result shows how the curse of dimensionality can be avoided or greatly alleviated under the Markov property, and applies to arbitrary graphs. While existing results along these lines focus on sparsity or manifold assumptions, we introduce a new graphical quantity called "graph resilience" and show how it controls the sample complexity. Surprisingly, although one might expect the sample complexity of this problem to scale with local graph parameters such as the degree, this turns out not to be the case. Through explicit examples, we compute uniform deviation bounds and illustrate how the curse of dimensionality in density estimation can thus be circumvented. Notable examples where the rate improves substantially include sequential, hierarchical, and spatial data., Comment: Work accepted to NeurIPS 2024

Although AlphaZero has achieved superhuman levels in Go, recent research has highlighted its vulnerability in particular situations requiring a more comprehensive understanding of the entire board. To address this challenge, this paper introduces ResTNet, a network that interleaves residual networks and Transformer. Our empirical experiments demonstrate several advantages of using ResTNet. First, it not only improves playing strength but also enhances the ability of global information. Second, it defends against an adversary Go program, called cyclic-adversary, tailor-made for attacking AlphaZero algorithms, significantly reducing the average probability of being attacked rate from 70.44% to 23.91%. Third, it improves the accuracy from 59.15% to 80.01% in correctly recognizing ladder patterns, which are one of the challenging patterns for Go AIs. Finally, ResTNet offers a potential explanation of the decision-making process and can also be applied to other games like Hex. To the best of our knowledge, ResTNet is the first to integrate residual networks and Transformer in the context of AlphaZero for board games, suggesting a promising direction for enhancing AlphaZero's global understanding.

The UNet architecture has transformed image segmentation. UNet's versatility and accuracy have driven its widespread adoption, significantly advancing fields reliant on machine learning problems with images. In this work, we give a clear and concise mathematical explanation of UNet. We explain what is the meaning and function of each of the components of UNet. We will show that UNet is solving a control problem. We decompose the control variables using multigrid methods. Then, operator-splitting techniques is used to solve the problem, whose architecture exactly recovers the UNet architecture. Our result shows that UNet is a one-step operator-splitting algorithm for the control problem.

We introduce Audio-Agent, a multimodal framework for audio generation, editing and composition based on text or video inputs. Conventional approaches for text-to-audio (TTA) tasks often make single-pass inferences from text descriptions. While straightforward, this design struggles to produce high-quality audio when given complex text conditions. In our method, we utilize a pre-trained TTA diffusion network as the audio generation agent to work in tandem with GPT-4, which decomposes the text condition into atomic, specific instructions, and calls the agent for audio generation. Consequently, Audio-Agent generates high-quality audio that is closely aligned with the provided text or video while also supporting variable-length generation. For video-to-audio (VTA) tasks, most existing methods require training a timestamp detector to synchronize video events with generated audio, a process that can be tedious and time-consuming. We propose a simpler approach by fine-tuning a pre-trained Large Language Model (LLM), e.g., Gemma2-2B-it, to obtain both semantic and temporal conditions to bridge video and audio modality. Thus our framework provides a comprehensive solution for both TTA and VTA tasks without substantial computational overhead in training.

In this paper, we introduce Reward-RAG, a novel approach designed to enhance the Retrieval-Augmented Generation (RAG) model through Reward-Driven Supervision. Unlike previous RAG methodologies, which focus on training language models (LMs) to utilize external knowledge retrieved from external sources, our method adapts retrieval information to specific domains by employing CriticGPT to train a dedicated reward model. This reward model generates synthesized datasets for fine-tuning the RAG encoder, aligning its outputs more closely with human preferences. The versatility of our approach allows it to be effectively applied across various domains through domain-specific fine-tuning. We evaluate Reward-RAG on publicly available benchmarks from multiple domains, comparing it to state-of-the-art methods. Our experimental results demonstrate significant improvements in performance, highlighting the effectiveness of Reward-RAG in improving the relevance and quality of generated responses. These findings underscore the potential of integrating reward models with RAG to achieve superior outcomes in natural language generation tasks.

Accurate 3D object detection in real-world environments requires a huge amount of annotated data with high quality. Acquiring such data is tedious and expensive, and often needs repeated effort when a new sensor is adopted or when the detector is deployed in a new environment. We investigate a new scenario to construct 3D object detectors: learning from the predictions of a nearby unit that is equipped with an accurate detector. For example, when a self-driving car enters a new area, it may learn from other traffic participants whose detectors have been optimized for that area. This setting is label-efficient, sensor-agnostic, and communication-efficient: nearby units only need to share the predictions with the ego agent (e.g., car). Naively using the received predictions as ground-truths to train the detector for the ego car, however, leads to inferior performance. We systematically study the problem and identify viewpoint mismatches and mislocalization (due to synchronization and GPS errors) as the main causes, which unavoidably result in false positives, false negatives, and inaccurate pseudo labels. We propose a distance-based curriculum, first learning from closer units with similar viewpoints and subsequently improving the quality of other units' predictions via self-training. We further demonstrate that an effective pseudo label refinement module can be trained with a handful of annotated data, largely reducing the data quantity necessary to train an object detector. We validate our approach on the recently released real-world collaborative driving dataset, using reference cars' predictions as pseudo labels for the ego car. Extensive experiments including several scenarios (e.g., different sensors, detectors, and domains) demonstrate the effectiveness of our approach toward label-efficient learning of 3D perception from other units' predictions.

State-of-the-art medical multi-modal large language models (med-MLLM), like LLaVA-Med or BioMedGPT, leverage instruction-following data in pre-training. However, those models primarily focus on scaling the model size and data volume to boost performance while mainly relying on the autoregressive learning objectives. Surprisingly, we reveal that such learning schemes might result in a weak alignment between vision and language modalities, making these models highly reliant on extensive pre-training datasets - a significant challenge in medical domains due to the expensive and time-consuming nature of curating high-quality instruction-following instances. We address this with LoGra-Med, a new multi-graph alignment algorithm that enforces triplet correlations across image modalities, conversation-based descriptions, and extended captions. This helps the model capture contextual meaning, handle linguistic variability, and build cross-modal associations between visuals and text. To scale our approach, we designed an efficient end-to-end learning scheme using black-box gradient estimation, enabling faster LLaMa 7B training. Our results show LoGra-Med matches LLAVA-Med performance on 600K image-text pairs for Medical VQA and significantly outperforms it when trained on 10% of the data. For example, on VQA-RAD, we exceed LLAVA-Med by 20.13% and nearly match the 100% pre-training score (72.52% vs. 72.64%). We also surpass SOTA methods like BiomedGPT on visual chatbots and RadFM on zero-shot image classification with VQA, highlighting the effectiveness of multi-graph alignment., Comment: First version, fixed typo