Search

Interconnection networks, or `interconnects,' play a crucial role in administering the communication among computing units of high-performance computing (HPC) systems. Efficient provisioning of interconnects minimizes the processing delay wherein computing units await information sharing between each other, thereby enhancing the overall computation efficiency. Ideally, interconnects are designed with topologies tailored to match specific workflows, requiring diverse structures for different applications. However, since modifying their structures mid-operation renders impractical, indirect communication incurs across distant units. In managing numerous long-routed data deliveries, heavy burdens on the network side may lead to the under-utilization of computing resources. In view of state-of-the-art HPC paradigms that solicit dense interconnections for diverse computation-hungry applications, this article presents a versatile wireless interconnecting framework, coined as Wireless Interconnection NEtwork (WINE). The framework exploits cutting-edge wireless technologies that promote workload adaptability and scalability of modern interconnects. Design and implementation of wirelessly reliable links are strategized under network-oriented scrutiny of HPC architectures. A virtual HPC platform is developed to assess WINE's feasibilities, verifying its practicality for integration into modern HPC infrastructures., Comment: 20 pages, 5 figures, to be published in IEEE Wireless Communications Magazine

Reaction-Diffusion systems arise in diverse areas of science and engineering. Due to the peculiar characteristics of such equations, analytic solutions are usually not available and numerical methods are the main tools for approximating the solutions. In the last decade, artificial neural networks have become an active area of development for solving partial differential equations. However, several challenges remain unresolved with these methods when applied to reaction-diffusion equations. In this work, we focus on two main problems. The implementation of homogeneous Neumann boundary conditions and long-time integrations. For the homogeneous Neumann boundary conditions, we explore four different neural network methods based on the PINN approach. For the long time integration in Reaction-Diffusion systems, we propose a domain splitting method in time and provide detailed comparisons between different implementations of no-flux boundary conditions. We show that the domain splitting method is crucial in the neural network approach, for long time integration in Reaction-Diffusion systems. We demonstrate numerically that domain splitting is essential for avoiding local minima, and the use of different boundary conditions further enhances the splitting technique by improving numerical approximations. To validate the proposed methods, we provide numerical examples for the Diffusion, the Bistable and the Barkley equations and provide a detailed discussion and comparisons of the proposed methods., Comment: 35 pages, 12 figures, research paper

Polarons, quasiparticles arising from electron-phonon coupling, are crucial in understanding material properties such as high-temperature superconductivity and colossal magnetoresistance. However, scarce studies have been performed to investigate the formation of polarons in low-dimensional materials with phonon polarity and electronic structure transitions. In this work, we studied polarons of tellurene that are composed of chiral chains of tellurium atoms. The frequency and linewidth of the A1 phonon, which becomes increasingly polar for thinner tellurene, exhibit an abrupt change when the thickness of tellurene is below 10 nm. Meanwhile, the field effect mobility of tellurene drops rapidly as the thickness is smaller than 10 nm. These phonon and transport signatures, combined with the calculated phonon polarity and band structure, suggest a crossover from large polarons for bulk tellurium to small polarons for few-layer tellurene. Effective field theory considers the phonon renormalization in the strong coupling (small polaron) regime, and semi-quantitatively reproduces the observed phonon hardening and broadening effects in few-layer tellurene. This polaron crossover stems from the quasi-1D nature of tellurene where modulation of the interchain distance reduces the dielectric screening and promotes electron-phonon coupling. Our work provides valuable insights into the influence of polarons on phononic, electronic, and structural properties in low-dimensional materials.

Lip reading aims to predict spoken language by analyzing lip movements. Despite advancements in lip reading technologies, performance degrades when models are applied to unseen speakers due to their sensitivity to variations in visual information such as lip appearances. To address this challenge, speaker adaptive lip reading technologies have advanced by focusing on effectively adapting a lip reading model to target speakers in the visual modality. The effectiveness of adapting language information, such as vocabulary choice, of the target speaker has not been explored in the previous works. Moreover, existing datasets for speaker adaptation have limited vocabulary size and pose variations, limiting the validation of previous speaker-adaptive methods in real-world scenarios. To address these issues, we propose a novel speaker-adaptive lip reading method that adapts a pre-trained model to target speakers at both vision and language levels. Specifically, we integrate prompt tuning and the LoRA approach, applying them to a pre-trained lip reading model to effectively adapt the model to target speakers. In addition, to validate its effectiveness in real-world scenarios, we introduce a new dataset, VoxLRS-SA, derived from VoxCeleb2 and LRS3. It contains a vocabulary of approximately 100K words, offers diverse pose variations, and enables the validation of adaptation methods in wild, sentence-level lip reading for the first time. Through various experiments, we demonstrate that the existing speaker-adaptive method also improves performance in the wild at the sentence level. Moreover, with the proposed adaptation method, we show that the proposed method achieves larger improvements when applied to the target speaker, compared to the previous works., Comment: Code available: https://github.com/JeongHun0716/Personalized-Lip-Reading

Emergence of objective, classical properties in quantum systems can be described in the modern language of quantum information theory. In this work, we present an example of such an analysis. We apply the quantum channel theory to a boson-spin model of open quantum systems and calculate, using recoilless approximation and the Floquet theory, the Hoevo quantity, which bounds the capacity of the channel, broadcasting information about the central system into its environment. We analyze both the short-time regime, showing quadratic in time initial growth of the capacity, and the asymptotic regime. Complicated dependence on the model parameters, such as temperature, tunneling energy for the environment, etc is also analyzed, showing e.g. regimes where the Holevo bound reaches its maximum., Comment: 10 pages, 6 figues

The electroweak monopole, when coupled to gravity, turns to the Reissner-Nordstrom type primordial magnetic blackhole whose mass is bounded below, with the lower bound $M_P \sqrt \alpha$. This changes the overall picture of the monopole production mechanism in the early universe drastically and has deep implications in cosmolpgy. In particular, this enhances the possibility that the electroweak monopoles turned to the primordial magnetic blackholes could become the seed of stellar objects and galaxies, and account for the dark matter of the universe. Moreover, this tells that we have a new type of primordial blackhole different from the popular primordial blackhole in cosmology, the electroweak primordial magnetic blackhole based on a totally different production mechanism. We discuss the physical implications of the electroweak primordial magnetic blackhole.

In this study, we evaluate the predictive power of density functional theory (DFT) for the magnetic properties of MnBi\(_2\)Te\(_4\) (MBT), an intrinsically magnetic topological insulator with potential applications in spintronics and quantum computing. Our theoretical understanding of MBT has been challenged by discrepancies between experimental results and \textit{ab initio} calculations, particularly with respect to its electronic and magnetic properties. Our results show that the magnetic phase diagram of MBT varies significantly depending on the Hubbard $U$ parameter in the DFT framework, highlighting the importance of benchmark calculations. To address these challenges, we establish an optimized Hubbard $U$ approach derived from Diffusion Monte Carlo (DMC) calculations, which directly solves the many-body Schr\"{o}dinger equation based on the stochastic process, and implement it in the DFT framework. Once the optimized $U$ value is determined as a function of strain, we apply it to achieve DMC-level accuracy within our DFT framework. This approach is instrumental in accurately describing the magnetic states of MBT and understanding the underlying mechanisms governing its magnetic properties and their dependence on external factors., Comment: 8 pages, 5 figures

We propose three novel metrics for evaluating the accuracy of a set of estimated camera poses given the ground truth: Translation Alignment Score (TAS), Rotation Alignment Score (RAS), and Pose Alignment Score (PAS). The TAS evaluates the translation accuracy independently of the rotations, and the RAS evaluates the rotation accuracy independently of the translations. The PAS is the average of the two scores, evaluating the combined accuracy of both translations and rotations. The TAS is computed in four steps: (1) Find the upper quartile of the closest-pair-distances, $d$. (2) Align the estimated trajectory to the ground truth using a robust registration method. (3) Collect all distance errors and obtain the cumulative frequencies for multiple thresholds ranging from $0.01d$ to $d$ with a resolution $0.01d$. (4) Add up these cumulative frequencies and normalize them such that the theoretical maximum is 1. The TAS has practical advantages over the existing metrics in that (1) it is robust to outliers and collinear motion, and (2) there is no need to adjust parameters on different datasets. The RAS is computed in a similar manner to the TAS and is also shown to be more robust against outliers than the existing rotation metrics. We verify our claims through extensive simulations and provide in-depth discussion of the strengths and weaknesses of the proposed metrics.

The detection of semantic and covariate out-of-distribution (OOD) examples is a critical yet overlooked challenge in digital pathology (DP). Recently, substantial insight and methods on OOD detection were presented by the ML community, but how do they fare in DP applications? To this end, we establish a benchmark study, our highlights being: 1) the adoption of proper evaluation protocols, 2) the comparison of diverse detectors in both a single and multi-model setting, and 3) the exploration into advanced ML settings like transfer learning (ImageNet vs. DP pre-training) and choice of architecture (CNNs vs. transformers). Through our comprehensive experiments, we contribute new insights and guidelines, paving the way for future research and discussion.

Many reaction-diffusion systems in various applications exhibit traveling wave solutions that evolve on multiple spatio-temporal scales. These traveling wave solutions are crucial for understanding the underlying dynamics of the system. In this work, we present sixth-order weighted essentially non-oscillatory (WENO) methods within the finite difference framework to solve reaction-diffusion systems. The WENO method allows us to use fewer grid points and larger time steps compared to classical finite difference methods. Our focus is on solving the reaction-diffusion system for the traveling wave solution with the sharp front. Although the WENO method is popular for hyperbolic conservation laws, especially for problems with discontinuity, it can be adapted for the equations of parabolic type, such as reaction-diffusion systems, to effectively handle sharp wave fronts. Thus, we employed the WENO methods specifically developed for equations of parabolic type. We considered various reaction-diffusion equations, including Fisher's, Zeldovich, Newell-Whitehead-Segel, bistable equations, and the Lotka-Volterra competition-diffusion system, all of which yield traveling wave solutions with sharp wave fronts. Numerical examples in this work demonstrate that the central WENO method is highly more accurate and efficient than the commonly used finite difference method. We also provide an analysis related to the numerical speed of the sharp propagating front in the Newell-Whitehead-Segel equation. The overall results confirm that the central WENO method is highly efficient and is recommended for solving reaction-diffusion equations with sharp wave fronts.

There are 46,972 prime knots with crossing number 14. Among them 19,536 are alternating and have arc index 16. Among the non-alternating knots, 17, 477, and 3,180 have arc index 10, 11, and 12, respectively. The remaining 23,762 have arc index 13 or 14. There are none with arc index smaller than 10 or larger than 14. We used the Dowker-Thistlethwaite code of the 23,762 knots provided by the program Knotscape to locate non-alternating edges in their diagrams. Our method requires at least six non-alternating edges to find arc presentations with 13 arcs. We obtained 8,027 knots having arc index 13. We show them by their minimal grid diagrams. The remaining 15,735 prime non-alternating 14 crossing knots have arc index 14 as determined by the lower bound obtained from the Kauffman polynomial., Comment: 11 pages, 8 figures, 200 grid diagrams. Interested readers may typeset for 8,027 grid diagrams following authors' instruction. arXiv admin note: substantial text overlap with arXiv:2402.02717

In-context learning (ICL) leverages in-context examples as prompts for the predictions of Large Language Models (LLMs). These prompts play a crucial role in achieving strong performance. However, the selection of suitable prompts from a large pool of labeled examples often entails significant annotation costs. To address this challenge, we propose Sub-SA (Submodular Selective Annotation), a submodule-based selective annotation method. The aim of Sub-SA is to reduce annotation costs while improving the quality of in-context examples and minimizing the time consumption of the selection process. In Sub-SA, we design a submodular function that facilitates effective subset selection for annotation and demonstrates the characteristics of monotonically and submodularity from the theoretical perspective. Specifically, we propose RPR (Reward and Penalty Regularization) to better balance the diversity and representativeness of the unlabeled dataset attributed to a reward term and a penalty term, respectively. Consequently, the selection for annotations can be effectively addressed with a simple yet effective greedy search algorithm based on the submodular function. Finally, we apply the similarity prompt retrieval to get the examples for ICL., Comment: Accepted by ECAI 2024

In this paper, we introduce the finite difference weighted essentially non-oscillatory (WENO) scheme based on the neural network for hyperbolic conservation laws. We employ the supervised learning and design two loss functions, one with the mean squared error and the other with the mean squared logarithmic error, where the WENO3-JS weights are computed as the labels. Each loss function consists of two components where the first component compares the difference between the weights from the neural network and WENO3-JS weights, while the second component matches the output weights of the neural network and the linear weights. The former of the loss function enforces the neural network to follow the WENO properties, implying that there is no need for the post-processing layer. Additionally the latter leads to better performance around discontinuities. As a neural network structure, we choose the shallow neural network (SNN) for computational efficiency with the Delta layer consisting of the normalized undivided differences. These constructed WENO3-SNN schemes show the outperformed results in one-dimensional examples and improved behavior in two-dimensional examples, compared with the simulations from WENO3-JS and WENO3-Z.

To analyze the topological properties of the given discrete data, one needs to consider a continuous transform called filtration. Persistent homology serves as a tool to track changes of homology in the filtration. The outcome of the topological analysis of data varies depending on the choice of filtration, making the selection of filtration crucial. Filtration learning is an attempt to find an optimal filtration that minimizes the loss function. Exact Multi-parameter Persistent Homology (EMPH) has been recently proposed, particularly for topological time-series analysis, that utilizes the exact formula of rank invariant instead of calculating it. In this paper, we propose a framework for filtration learning of EMPH. We formulate an optimization problem and propose an algorithm for solving the problem. We then apply the proposed algorithm to several classification problems. Particularly, we derive the exact formula of the gradient of the loss function with respect to the filtration parameter, which makes it possible to directly update the filtration without using automatic differentiation, significantly enhancing the learning process., Comment: 28 pages

We demonstrate the effectiveness of simple observer-based linear feedback policies for "pixels-to-torques" control of robotic systems using only a robot-facing camera. Specifically, we show that the matrices of an image-based Luenberger observer (linear state estimator) for a "student" output-feedback policy can be learned from demonstration data provided by a "teacher" state-feedback policy via simple linear-least-squares regression. The resulting linear output-feedback controller maps directly from high-dimensional raw images to torques while being amenable to the rich set of analytical tools from linear systems theory, allowing us to enforce closed-loop stability constraints in the learning problem. We also investigate a nonlinear extension of the method via the Koopman embedding. Finally, we demonstrate the surprising effectiveness of linear pixels-to-torques policies on a cartpole system, both in simulation and on real-world hardware. The policy successfully executes both stabilizing and swing-up trajectory tracking tasks using only camera feedback while subject to model mismatch, process and sensor noise, perturbations, and occlusions., Comment: Submitted to Workshop on Algorithmic Foundations of Robotics (WAFR) 2024

Applying the holographic method, we investigate an RG flow and IR physics holographically when a two-dimensional conformal field theory is deformed by a relevant scalar operator. To do so, we first assume an RG flow from a UV to new IR CFT. On the dual gravity side, such an RG flow can be described by rolling down of a bulk scalar field from an unstable to stable equilibrium point. After considering a simple scalar potential allowing several local extrema, we study the change of a ground state along the RG flow. We show that the entanglement entropy at an IR fixed point leads to a logarithmic divergence due to restoring of the conformal symmetry. We study how the change of the ground state affects two-point functions. In the probe limit, we numerically calculate the change of a conformal dimension caused by the modification of the ground state. We further study the analytic form of the IR conformal dimension which is perfectly matched to the numerical result., Comment: 15 pages with appendices; typos corrected, references added

In this paper, we introduce a novel Face-to-Face spoken dialogue model. It processes audio-visual speech from user input and generates audio-visual speech as the response, marking the initial step towards creating an avatar chatbot system without relying on intermediate text. To this end, we newly introduce MultiDialog, the first large-scale multimodal (i.e., audio and visual) spoken dialogue corpus containing 340 hours of approximately 9,000 dialogues, recorded based on the open domain dialogue dataset, TopicalChat. The MultiDialog contains parallel audio-visual recordings of conversation partners acting according to the given script with emotion annotations, which we expect to open up research opportunities in multimodal synthesis. Our Face-to-Face spoken dialogue model incorporates a textually pretrained large language model and adapts it into the audio-visual spoken dialogue domain by incorporating speech-text joint pretraining. Through extensive experiments, we validate the effectiveness of our model in facilitating a face-to-face conversation. Demo and data are available at https://multidialog.github.io and https://huggingface.co/datasets/IVLLab/MultiDialog, respectively., Comment: Accepted to ACL 2024 (Oral)

The significance of mass spectrometry lies in its unparalleled ability to accurately identify and quantify molecules in complex samples, providing invaluable insights into molecular structures and interactions. Here, we leverage diamond nanostructures as highly sensitive mass sensors by utilizing a self-excitation mechanism under an electron beam in a conventional scanning electron microscope (SEM). The diamond molecular balance (DMB) exhibits an exceptional mass resolution of 0.36 MDa, based on its outstanding mechanical quality factor and frequency stability, along with an extensive dynamic range from MDa to TDa. This positions the DMB at the forefront of molecular balances operating at room temperature. Notably, the DMB demonstrates its ability to measure the mass of a single bacteriophage T4 by precisely locating the analyte on the device. These findings highlight the groundbreaking potential of the DMB as a revolutionary tool for mass spectrometry at room temperature., Comment: 16 pages, 4 figures

We study the previously proposed quasilocal angular momentum of gravitational fields in the absence of isometries. The quasilocal angular momentum $L(\xi)$ has the following attractive properties; ({\it i}) it follows from the Einstein's constraint equations, ({\it ii}) it satisfies the Poisson algebra $\{L(\xi), L(\eta) \}_{\rm P.B.} =({1/16\pi)}\, L( [\xi, \eta]_{\rm L} )$, ({\it iii}) its Poisson algebra reduces to the standard $SO(3)$ algebra of angular momentum at null infinity, and ({\it iv}) it reproduces the standard value for the Kerr spacetime at null infinity. It will be argued that our definition is a quasilocal and canonical generalization of A. Rizzi's geometric definition at null infinity. We also propose a new definition of an {\it invariant} quasilocal angular momentum $L^{2}$ such that $\{ L^2, L(\xi) \}_{\rm P.B.} = 0$, which becomes $(ma)^{2}$ at the null infinity of the Kerr spacetime. Therefore, it may be regarded as a quasilocal generalization of the Casimir invariant of ordinary angular momentum in the flat spacetime.

Algorithmic detection of facial palsy offers the potential to improve current practices, which usually involve labor-intensive and subjective assessment by clinicians. In this paper, we present a multimodal fusion-based deep learning model that utilizes unstructured data (i.e. an image frame with facial line segments) and structured data (i.e. features of facial expressions) to detect facial palsy. We then contribute to a study to analyze the effect of different data modalities and the benefits of a multimodal fusion-based approach using videos of 21 facial palsy patients. Our experimental results show that among various data modalities (i.e. unstructured data - RGB images and images of facial line segments and structured data - coordinates of facial landmarks and features of facial expressions), the feed-forward neural network using features of facial expression achieved the highest precision of 76.22 while the ResNet-based model using images of facial line segments achieved the highest recall of 83.47. When we leveraged both images of facial line segments and features of facial expressions, our multimodal fusion-based deep learning model slightly improved the precision score to 77.05 at the expense of a decrease in the recall score.

With advanced AI/ML, there has been growing research on explainable AI (XAI) and studies on how humans interact with AI and XAI for effective human-AI collaborative decision-making. However, we still have a lack of understanding of how AI systems and XAI should be first presented to users without technical backgrounds. In this paper, we present the findings of semi-structured interviews with health professionals (n=12) and students (n=4) majoring in medicine and health to study how to improve onboarding with AI and XAI. For the interviews, we built upon human-AI interaction guidelines to create onboarding materials of an AI system for stroke rehabilitation assessment and AI explanations and introduce them to the participants. Our findings reveal that beyond presenting traditional performance metrics on AI, participants desired benchmark information, the practical benefits of AI, and interaction trials to better contextualize AI performance, and refine the objectives and performance of AI. Based on these findings, we highlight directions for improving onboarding with AI and XAI and human-AI collaborative decision-making.

Partial differential equations (PDEs) with multiple scales or those defined over sufficiently large domains arise in various areas of science and engineering and often present problems when approximating the solutions numerically. Machine learning techniques are a relatively recent method for solving PDEs. Despite the increasing number of machine learning strategies developed to approximate PDEs, many remain focused on relatively small domains. When scaling the equations, a large domain is naturally obtained, especially when the solution exhibits multiscale characteristics. This study examines two-scale equations whose solution structures exhibit distinct characteristics: highly localized in some regions and significantly flat in others. These two regions must be adequately addressed over a large domain to approximate the solution more accurately. We focus on the vanishing gradient problem given by the diminishing gradient zone of the activation function over large domains and propose a stratified sampling algorithm to address this problem. We compare the uniform random classical sampling method over the entire domain and the proposed stratified sampling method. The numerical results confirm that the proposed method yields more accurate and consistent solutions than classical methods., Comment: 35 pages, 14 figures

In this paper, we explore the feasibility of using a transformer-based, spatiotemporal attention network (STAN) for gradient-based time-series explanations. First, we trained the STAN model for video classifications using the global and local views of data and weakly supervised labels on time-series data (i.e. the type of an activity). We then leveraged a gradient-based XAI technique (e.g. saliency map) to identify salient frames of time-series data. According to the experiments using the datasets of four medically relevant activities, the STAN model demonstrated its potential to identify important frames of videos.

Large language models are well-known to be effective at few-shot in-context learning (ICL). Recent advancements in multimodal foundation models have enabled unprecedentedly long context windows, presenting an opportunity to explore their capability to perform ICL with many more demonstrating examples. In this work, we evaluate the performance of multimodal foundation models scaling from few-shot to many-shot ICL. We benchmark GPT-4o and Gemini 1.5 Pro across 10 datasets spanning multiple domains (natural imagery, medical imagery, remote sensing, and molecular imagery) and tasks (multi-class, multi-label, and fine-grained classification). We observe that many-shot ICL, including up to almost 2,000 multimodal demonstrating examples, leads to substantial improvements compared to few-shot (<100 examples) ICL across all of the datasets. Further, Gemini 1.5 Pro performance continues to improve log-linearly up to the maximum number of tested examples on many datasets. Given the high inference costs associated with the long prompts required for many-shot ICL, we also explore the impact of batching multiple queries in a single API call. We show that batching up to 50 queries can lead to performance improvements under zero-shot and many-shot ICL, with substantial gains in the zero-shot setting on multiple datasets, while drastically reducing per-query cost and latency. Finally, we measure ICL data efficiency of the models, or the rate at which the models learn from more demonstrating examples. We find that while GPT-4o and Gemini 1.5 Pro achieve similar zero-shot performance across the datasets, Gemini 1.5 Pro exhibits higher ICL data efficiency than GPT-4o on most datasets. Our results suggest that many-shot ICL could enable users to efficiently adapt multimodal foundation models to new applications and domains. Our codebase is publicly available at https://github.com/stanfordmlgroup/ManyICL .

Recent studies have actively employed persistent homology (PH), a topological data analysis technique, to analyze the topological information in time series data. Many successful studies have utilized graph representations of time series data for PH calculation. Given the diverse nature of time series data, it is crucial to have mechanisms that can adjust the PH calculations by incorporating domain-specific knowledge. In this context, we introduce a methodology that allows the adjustment of PH calculations by reflecting relevant domain knowledge in specific fields. We introduce the concept of featured time series, which is the pair of a time series augmented with specific features such as domain knowledge, and an influence vector that assigns a value to each feature to fine-tune the results of the PH. We then prove the stability theorem of the proposed method, which states that adjusting the influence vectors grants stability to the PH calculations. The proposed approach enables the tailored analysis of a time series based on the graph representation methodology, which makes it applicable to real-world domains. We consider two examples to verify the proposed method's advantages: anomaly detection of stock data and topological analysis of music data.

This paper introduces a landing guidance strategy for reusable launch vehicles (RLVs) using a model predictive approach based on sequential convex programming (SCP). The proposed approach devises two distinct optimal control problems (OCPs): planning a fuel-optimal landing trajectory that accommodates practical path constraints specific to RLVs, and determining real-time optimal tracking commands. This dual optimization strategy allows for reduced computational load through adjustable prediction horizon lengths in the tracking task, achieving near closed-loop performance. Enhancements in model fidelity for the tracking task are achieved through an alternative rotational dynamics representation, enabling a more stable numerical solution of the OCP and accounting for vehicle transient dynamics. Furthermore, modifications of aerodynamic force in both planning and tracking phases are proposed, tailored for thrust-vector-controlled RLVs, to reduce the fidelity gap without adding computational complexity. Extensive 6-DOF simulation experiments validate the effectiveness and improved guidance performance of the proposed algorithm.

A model of supergravity inflation we recently proposed can produce slow roll inflation and a realistic spectrum of particles even without F-term supersymmetry breaking. Supersymmetry is broken only by a D-term induced by a recently discovered new type of Fayet-Iliopoulos (FI) term. Almost all supersymmetric partners of the standard model fields can get masses as high as the inflationary Hubble scale. The exception is gauginos, for which the vanishing of F-terms implies an exact cancellation that keeps their masses exactly zero. To cure this problem without spoiling the simplicity of our model we introduce a new term that further enlarges the space of supergravity effective actions. It is an F-term that, similarly to the new FI term, becomes singular in the supersymmetric limit. We show that this term can produce large gaugino masses without altering the spectrum of other states and without lowering the cutoff of the effecive theory., Comment: 17 pages, 2 figures

Deep learning-based joint source-channel coding (deep JSCC) has been demonstrated to be an effective approach for wireless image transmission. Nevertheless, most existing work adopts an autoencoder framework to optimize conventional criteria such as Mean Squared Error (MSE) and Structural Similarity Index (SSIM) which do not suffice to maintain the perceptual quality of reconstructed images. Such an issue is more prominent under stringent bandwidth constraints or low signal-to-noise ratio (SNR) conditions. To tackle this challenge, we propose DiffJSCC, a novel framework that leverages the prior knowledge of the pre-trained Statble Diffusion model to produce high-realism images via the conditional diffusion denoising process. Our DiffJSCC first extracts multimodal spatial and textual features from the noisy channel symbols in the generation phase. Then, it produces an initial reconstructed image as an intermediate representation to aid robust feature extraction and a stable training process. In the following diffusion step, DiffJSCC uses the derived multimodal features, together with channel state information such as the signal-to-noise ratio (SNR), as conditions to guide the denoising diffusion process, which converts the initial random noise to the final reconstruction. DiffJSCC employs a novel control module to fine-tune the Stable Diffusion model and adjust it to the multimodal conditions. Extensive experiments on diverse datasets reveal that our method significantly surpasses prior deep JSCC approaches on both perceptual metrics and downstream task performance, showcasing its ability to preserve the semantics of the original transmitted images. Notably, DiffJSCC can achieve highly realistic reconstructions for 768x512 pixel Kodak images with only 3072 symbols (<0.008 symbols per pixel) under 1dB SNR channels.

The Euler class characterizes the topology of two real bands isolated from other bands in two-dimensions. Despite various intriguing topological properties predicted up to now, the candidate real materials hosting electronic Euler bands are extremely rare. Here, we show that in a quantum spin Hall insulator with two-fold rotation $C_{2z}$ about the $z$-axis, a pair of bands with nontrivial $\mathbb{Z}_2$ invariant turn into magnetic Euler bands under in-plane Zeeman field or in-plane ferromagnetic ordering. The resulting magnetic insulator generally carries a nontrivial second Stiefel-Whitney invariant. In particular, when the topmost pair of occupied bands carry a nonzero Euler number, the corresponding magnetic insulator can be called a magnetic Euler insulator. Moreover, the topological phase transition between a trivial magnetic insulator and a magnetic Stiefel-Whitney or Euler insulator is mediated by a stable topological semimetal phase in which Dirac nodes carrying non-Abelian topological charges exhibit braiding processes across the transition. Using the first-principles calculations, we propose various candidate materials hosting magnetic Euler bands. We especially show that ZrTe$_5$ bilayers under in-plane ferromagnetism are a candidate system for magnetic Stiefel-Whitney insulators in which the non-Abelian braiding-induced topological phase transitions can occur under pressure.

Link prediction (LP), inferring the connectivity between nodes, is a significant research area in graph data, where a link represents essential information on relationships between nodes. Although graph neural network (GNN)-based models have achieved high performance in LP, understanding why they perform well is challenging because most comprise complex neural networks. We employ persistent homology (PH), a topological data analysis method that helps analyze the topological information of graphs, to explain the reasons for the high performance. We propose a novel method that employs PH for LP (PHLP) focusing on how the presence or absence of target links influences the overall topology. The PHLP utilizes the angle hop subgraph and new node labeling called degree double radius node labeling (Degree DRNL), distinguishing the information of graphs better than DRNL. Using only a classifier, PHLP performs similarly to state-of-the-art (SOTA) models on most benchmark datasets. Incorporating the outputs calculated using PHLP into the existing GNN-based SOTA models improves performance across all benchmark datasets. To the best of our knowledge, PHLP is the first method of applying PH to LP without GNNs. The proposed approach, employing PH while not relying on neural networks, enables the identification of crucial factors for improving performance.

In this study, we consider the infinitely many-armed bandit problems in a rested rotting setting, where the mean reward of an arm may decrease with each pull, while otherwise, it remains unchanged. We explore two scenarios regarding the rotting of rewards: one in which the cumulative amount of rotting is bounded by $V_T$, referred to as the slow-rotting case, and the other in which the cumulative number of rotting instances is bounded by $S_T$, referred to as the abrupt-rotting case. To address the challenge posed by rotting rewards, we introduce an algorithm that utilizes UCB with an adaptive sliding window, designed to manage the bias and variance trade-off arising due to rotting rewards. Our proposed algorithm achieves tight regret bounds for both slow and abrupt rotting scenarios. Lastly, we demonstrate the performance of our algorithm using numerical experiments.

We have investigated interlayer interactions in the bilayer PtTe$_{2}$ system, which influence the electronic energy bands near the Fermi levels. Our diffusion Monte Carlo (DMC) calculations for the high-symmetry bilayer stackings (AA, AB, AC) manifest distinct interlayer binding characteristics among the stacking modes by revealing significantly different interlayer separations depending on the stackings, which is critical to understanding the interlayer coupling of the twisted bilayers consisting of various local stacking arrangements. Furthermore, a comparison between the interlayer separations obtained from DMC and density functional theory (DFT) shows that meta-GGA-based vdW-DFT results agree with DMC for different layer stackings, including twisted bilayers, but only the ground-state AA stacking matches well with GGA-based DFT predictions. This underscores the importance of accurate exchange-correlation potentials even for capturing the stacking-dependent interlayer binding properties. We further show that the variability in DFT-predicted interlayer separations is responsible for the large discrepancy of band structures in the 21.79$^{\circ}$-twisted bilayer PtTe$_{2}$, affecting its classification as metallic or semiconducting. These results demonstrate the importance of obtaining a correct description of stacking-dependent interlayer coupling in modeling delicate bilayer systems at finite twists.

This paper presents an I/O interface with Xtalk Minimizing Affine Signaling (XMAS), which is designed to support high-speed data transmission in die-to-die communication over silicon interposers or similar high-density interconnects susceptible to crosstalk. The operating principles of XMAS are elucidated through rigorous analyses, and its advantages over existing signaling are validated through numerical experiments. XMAS not only demonstrates exceptional crosstalk removing capabilities but also exhibits robustness against noise, especially simultaneous switching noise. Fabricated in a 28-nm CMOS process, the prototype XMAS transceiver achieves an edge density of 3.6TB/s/mm and an energy efficiency of 0.65pJ/b. Compared to the single-ended signaling, the crosstalk-induced peak-to-peak jitter of the received eye with XMAS is reduced by 75% at 10GS/s/pin data rate, and the horizontal eye opening extends to 0.2UI at a bit error rate < 10$^{-12}$.

The beam response to an external periodic excitation delivers relevant information about the optics, tune distribution and stability of a circulating beam in a storage ring. In this contribution the horizontal beam response to the excitation (transfer function) under conditions typical for slow extraction is presented for a coasting beam. The resulting spectrum exhibits a splitting behaviour. The single particle dynamics is discussed and an interpretation based on simulation results is presented.

This study demonstrates the developments of self-assembled optical metasurfaces to overcome inherent limitations in polarization density (P) within natural materials, which hinder achieving high refractive indices (n) at optical frequencies. The Maxwellian macroscopic description establishes a link between P and n, revealing a static limit in natural materials, restricting n to approximately 4.0 at optical frequencies. Optical metasurfaces, utilizing metallic colloids on a deep-subwavelength scale, offer a solution by unnaturally enhancing n through electric dipolar (ED) resonances. Self-assembly enables the creation of nanometer-scale metallic gaps between metallic nanoparticles (NPs), paving the way for achieving exceptionally high n at optical frequencies. This study focuses on assembling polyhedral gold (Au) NPs into a closely packed monolayer by rationally designing the polymeric ligand to balance attractive and repulsive forces, in that polymeric brush-mediated self-assembly of the close-packed Au NP monolayer is robustly achieved over a large-area. The resulting monolayer of Au nanospheres (NSs), nanooctahedras (NOs), and nanocubes (NCs) exhibits high macroscopic integrity and crystallinity, sufficiently enough for pushing n to record-high regimes. The study underlies the significance of capacitive coupling in achieving an unnaturally high n and explores fine-tuning Au NC size to optimize this coupling. The achieved n of 10.12 at optical frequencies stands as a benchmark, highlighting the potential of polyhedral Au NPs in advancing optical metasurfaces.

Recent progress in diffusion models has profoundly enhanced the fidelity of image generation, but it has raised concerns about copyright infringements. While prior methods have introduced adversarial perturbations to prevent style imitation, most are accompanied by the degradation of artworks' visual quality. Recognizing the importance of maintaining this, we introduce a visually improved protection method while preserving its protection capability. To this end, we devise a perceptual map to highlight areas sensitive to human eyes, guided by instance-aware refinement, which refines the protection intensity accordingly. We also introduce a difficulty-aware protection by predicting how difficult the artwork is to protect and dynamically adjusting the intensity based on this. Lastly, we integrate a perceptual constraints bank to further improve the imperceptibility. Results show that our method substantially elevates the quality of the protected image without compromising on protection efficacy.

This paper presents the concept of an equivalence relation between the set of optimal control problems. By leveraging this concept, we show that the boundary of the reachability set can be constructed by the solutions of time optimal problems. Alongside, a more generalized equivalence theorem is presented together. The findings facilitate the use of solution structures from a certain class of optimal control problems to address problems in corresponding equivalent classes. As a byproduct, we state and prove the construction methods of the reachability sets of three-dimensional curves with prescribed curvature bound. The findings are twofold: Firstly, we prove that any boundary point of the reachability set, with the terminal direction taken into account, can be accessed via curves of H, CSC, CCC, or their respective subsegments, where H denotes a helicoidal arc, C a circular arc with maximum curvature, and S a straight segment. Secondly, we show that any boundary point of the reachability set, without considering the terminal direction, can be accessed by curves of CC, CS, or their respective subsegments. These findings extend the developments presented in literature regarding planar curves, or Dubins car dynamics, into spatial curves in $\mathbb{R}^3$. For higher dimensions, we confirm that the problem of identifying the reachability set of curvature bounded paths subsumes the well-known Markov-Dubins problem. These advancements in understanding the reachability of curvature bounded paths in $\mathbb{R}^3$ hold significant practical implications, particularly in the contexts of mission planning problems and time optimal guidance., Comment: Submitted to Automatica

Portrait stylization is a challenging task involving the transformation of an input portrait image into a specific style while preserving its inherent characteristics. The recent introduction of Stable Diffusion (SD) has significantly improved the quality of outcomes in this field. However, a practical stylization framework that can effectively filter harmful input content and preserve the distinct characteristics of an input, such as skin-tone, while maintaining the quality of stylization remains lacking. These challenges have hindered the wide deployment of such a framework. To address these issues, this study proposes a portrait stylization framework that incorporates a nudity content identification module (NCIM) and a skin-tone-aware portrait stylization module (STAPSM). In experiments, NCIM showed good performance in enhancing explicit content filtering, and STAPSM accurately represented a diverse range of skin tones. Our proposed framework has been successfully deployed in practice, and it has effectively satisfied critical requirements of real-world applications., Comment: Accepted to ICASSP 2024

Speculative decoding is an effective method for lossless acceleration of large language models during inference. It uses a fast model to draft a block of tokens which are then verified in parallel by the target model, and provides a guarantee that the output is distributed identically to a sample from the target model. In prior works, draft verification is performed independently token-by-token. Surprisingly, we show that this approach is not optimal. We propose Block Verification, a simple draft verification algorithm that verifies the entire block jointly and provides additional wall-clock speedup. We prove that the proposed mechanism is optimal in the expected number of tokens produced each iteration and specifically is never worse than the standard token-level verification. Empirically, block verification provides modest but consistent wall-clock speedups over the standard token verification algorithm of 5%-8% in a range of tasks and datasets. Given that block verification does not increase code complexity, maintains the strong lossless guarantee of the standard speculative decoding verification algorithm, cannot deteriorate performance, and, in fact, consistently improves it, it can be used as a good default in speculative decoding implementations.

The aim of this paper is to design the explicit radial basis function (RBF) Runge-Kutta methods for the initial value problem. We construct the two-, three- and four-stage RBF Runge-Kutta methods based on the Gaussian RBF Euler method with the shape parameter, where the analysis of the local truncation error shows that the s-stage RBF Runge-Kutta method could formally achieve order s+1. The proof for the convergence of those RBF Runge-Kutta methods follows. We then plot the stability region of each RBF Runge-Kutta method proposed and compare with the one of the correspondent Runge-Kutta method. Numerical experiments are provided to exhibit the improved behavior of the RBF Runge-Kutta methods over the standard ones.

Magnetic random access memory that uses magnetic tunnel junction memory cells is a high performance, non-volatile memory technology that goes beyond traditional charge-based memories. Today its speed is limited by the high magnetization of the memory storage layer. Here we show that fast and highly reliable switching is possible using a very low magnetization ferrimagnetic Heusler alloy, Mn3Ge. Moreover, the tunneling magnetoresistance is the highest yet achieved for a ferrimagnetic material at ambient temperature. Furthermore, the devices were prepared on technologically relevant amorphous substrates using a novel combination of a nitride seed layer and a chemical templating layer. These results show a clear path to the lowering of switching currents using ferrimagnetic Heusler materials and, therefore, to the scaling of high performance magnetic random access memories beyond those nodes possible with ferromagnetic devices., Comment: main manuscript 14 pages, 4 main figures and supplementary information. Submitted to Nature naotechnology

Cross-device federated learning (FL) is a technique that trains a model on data distributed across typically millions of edge devices without data leaving the devices. SGD is the standard client optimizer for on device training in cross-device FL, favored for its memory and computational efficiency. However, in centralized training of neural language models, adaptive optimizers are preferred as they offer improved stability and performance. In light of this, we ask if language models can be modified such that they can be efficiently trained with SGD client optimizers and answer this affirmatively. We propose a scale-invariant Coupled Input Forget Gate (SI CIFG) recurrent network by modifying the sigmoid and tanh activations in the recurrent cell and show that this new model converges faster and achieves better utility than the standard CIFG recurrent model in cross-device FL in large scale experiments. We further show that the proposed scale invariant modification also helps in federated learning of larger transformer models. Finally, we demonstrate the scale invariant modification is also compatible with other non-adaptive algorithms. Particularly, our results suggest an improved privacy utility trade-off in federated learning with differential privacy.

Recent advancements in Spatial Transcriptomics (ST) technology have facilitated detailed gene expression analysis within tissue contexts. However, the high costs and methodological limitations of ST necessitate a more robust predictive model. In response, this paper introduces TRIPLEX, a novel deep learning framework designed to predict spatial gene expression from Whole Slide Images (WSIs). TRIPLEX uniquely harnesses multi-resolution features, capturing cellular morphology at individual spots, the local context around these spots, and the global tissue organization. By integrating these features through an effective fusion strategy, TRIPLEX achieves accurate gene expression prediction. Our comprehensive benchmark study, conducted on three public ST datasets and supplemented with Visium data from 10X Genomics, demonstrates that TRIPLEX outperforms current state-of-the-art models in Mean Squared Error (MSE), Mean Absolute Error (MAE), and Pearson Correlation Coefficient (PCC). The model's predictions align closely with ground truth gene expression profiles and tumor annotations, underscoring TRIPLEX's potential in advancing cancer diagnosis and treatment., Comment: Accepted to CVPR 2024

In this work, we demonstrate the formation and electronic influence of lateral heterointerfaces in FeSn containing Kagome and honeycomb layers. Lateral heterostructures offer spatially resolved property control, enabling the integration of dissimilar materials and promoting phenomena not typically observed in vertical heterostructures. Using the molecular beam epitaxy technique, we achieve a controllable synthesis of lateral heterostructures in the Kagome metal FeSn. With scanning tunneling microscopy/spectroscopy in conjunction with first-principles calculations, we provide a comprehensive understanding of the bonding motif connecting the Fe3Sn-terminated Kagome and Sn2-terminated honeycomb surfaces. More importantly, we reveal a distance-dependent evolution of the electronic states in the vicinity of the heterointerfaces. This evolution is significantly influenced by the orbital character of the flat bands. Our findings suggest an approach to modulate the electronic properties of the Kagome lattice, which should be beneficial for the development of future quantum devices., Comment: To appear ACS Nano

In this paper, we propose a radar odometry structure that directly utilizes radar velocity measurements for dead reckoning while maintaining its ability to update estimations within the Kalman filter framework. Specifically, we employ the Doppler velocity obtained by a 4D Frequency Modulated Continuous Wave (FMCW) radar in conjunction with gyroscope data to calculate poses. This approach helps mitigate high drift resulting from accelerometer biases and double integration. Instead, tilt angles measured by gravitational force are utilized alongside relative distance measurements from radar scan matching for the filter's measurement update. Additionally, to further enhance the system's accuracy, we estimate and compensate for the radar velocity scale factor. The performance of the proposed method is verified through five real-world open-source datasets. The results demonstrate that our approach reduces position error by 62% and rotation error by 66% on average compared to the state-of-the-art radar-inertial fusion method in terms of absolute trajectory error., Comment: 9 pages, 5 figures, 1 table, IROS 2024

The kagome superconductor CsV$_3$Sb$_5$ hosts a variety of charge density wave (CDW) phases, which play a fundamental role in the formation of other exotic electronic instabilities. However, identifying the precise structure of these CDW phases and their intricate relationships remain the subject of intense debate, due to the lack of static probes that can distinguish the CDW phases with identical spatial periodicity. Here, we unveil the competition between two coexisting $2\times2\times2$ CDWs in CsV$_3$Sb$_5$ harnessing time-resolved X-ray diffraction. By analyzing the light-induced changes in the intensity of CDW superlattice peaks, we demonstrate the presence of both phases, each displaying a significantly different amount of melting upon excitation. The anomalous light-induced sharpening of peak width further shows that the phase that is more resistant to photo-excitation exhibits an increase in domain size at the expense of the other, thereby showcasing a hallmark of phase competition. Our results not only shed light on the interplay between the multiple CDW phases in CsV$_3$Sb$_5$, but also establish a non-equilibrium framework for comprehending complex phase relationships that are challenging to disentangle using static techniques., Comment: 10 pages, 4 figures with supplemental Material

Recent studies have focused on enhancing the performance of 3D object detection models. Among various approaches, ground-truth sampling has been proposed as an augmentation technique to address the challenges posed by limited ground-truth data. However, an inherent issue with ground-truth sampling is its tendency to increase false positives. Therefore, this study aims to overcome the limitations of ground-truth sampling and improve the performance of 3D object detection models by developing a new augmentation technique called false-positive sampling. False-positive sampling involves retraining the model using point clouds that are identified as false positives in the model's predictions. We propose an algorithm that utilizes both ground-truth and false-positive sampling and an algorithm for building the false-positive sample database. Additionally, we analyze the principles behind the performance enhancement due to false-positive sampling. Our experiments demonstrate that models utilizing false-positive sampling show a reduction in false positives and exhibit improved object detection performance. On the KITTI and Waymo Open datasets, models with false-positive sampling surpass the baseline models by a large margin.

Topologically ordered phases have robust degenerate ground states against the local perturbations, providing a promising platform for fault-tolerant quantum computation. Despite of the non-local feature of the topological order, we find that local non-Hermitian perturbations can induce the transition between the topologically ordered ground states. In this work, we study the toric code in the presence of non-Hermitian perturbations. By controlling the non-Hermiticity, we show that non-orthogonal ground states can exhibit an eigenstate coalescence and have the spectral singularity, known as an exceptional point (EP). We explore the potential of the EPs in the control of topological order. Adiabatic encircling EPs allows for the controlled switching of eigenstates, enabling dynamic manipulation between the ground state degeneracy. Interestingly, we show a property of our scheme that arbitrary strengths of local perturbations can induce the EP and eigenstate switching. Finally, we also show the orientation-dependent behavior of non-adiabatic transitions (NAT) during the dynamic encirclement around an EP. Our work shows that control of the non-Hermiticity can serve as a promising strategy for fault-tolerant quantum information processing., Comment: 5 pages and supplementary materials

We propose a robust method for point cloud registration that can handle both unknown scales and extreme outlier ratios. Our method, dubbed PCR-99, uses a deterministic 3-point sampling approach with two novel mechanisms that significantly boost the speed: (1) an improved ordering of the samples based on pairwise scale consistency, prioritizing the point correspondences that are more likely to be inliers, and (2) an efficient outlier rejection scheme based on triplet scale consistency, prescreening bad samples and reducing the number of hypotheses to be tested. Our evaluation shows that, up to 98% outlier ratio, the proposed method achieves comparable performance to the state of the art. At 99% outlier ratio, however, it outperforms the state of the art for both known-scale and unknown-scale problems. Especially for the latter, we observe a clear superiority in terms of robustness and speed., Comment: Accepted to ECCV 2024 Workshop on Recovering 6D Object Pose (R6D)

Two-dimensional hybrid organic-inorganic perovskites (HOIPs) have emerged as promising materials for light-emitting diode applications. In this study, by using time-of-flight neutron spectroscopy we identified and quantitatively separated the lattice vibrational and molecular rotational dynamics of two perovskites, butylammonium lead iodide $(\text{BA})_{2}\text{PbI}_{4}$ and phenethyl-ammonium lead iodide $\text{(PEA)}_{2}\text{PbI}_{4}$. By examining the corresponding temperature dependence, we found that the lattice vibrations, as evidenced by neutron spectra, are consistent with the lattice dynamics obtained from Raman scattering. We revealed that the rotational dynamics of organic molecules in these materials tend to suppress their photoluminescence quantum yield while the vibrational dynamics did not show predominant correlations with their optoelectronic properties. This study proposes that the rotational motions of the polarized molecules could significantly interrupt the exciton binding energy potential, cause the exciton dissociations, enhance the non-radiative recombination rates, and hence reduce the photoluminescence yield. These findings provide a deeper understanding of the fundamental interactions in 2D HOIPs and may guide the design of more efficient light-emitting materials for advanced technological applications.