Search

Indoor radar perception has seen rising interest due to affordable costs driven by emerging automotive imaging radar developments and the benefits of reduced privacy concerns and reliability under hazardous conditions (e.g., fire and smoke). However, existing radar perception pipelines fail to account for distinctive characteristics of the multi-view radar setting. In this paper, we propose Radar dEtection TRansformer (RETR), an extension of the popular DETR architecture, tailored for multi-view radar perception. RETR inherits the advantages of DETR, eliminating the need for hand-crafted components for object detection and segmentation in the image plane. More importantly, RETR incorporates carefully designed modifications such as 1) depth-prioritized feature similarity via a tunable positional encoding (TPE); 2) a tri-plane loss from both radar and camera coordinates; and 3) a learnable radar-to-camera transformation via reparameterization, to account for the unique multi-view radar setting. Evaluated on two indoor radar perception datasets, our approach outperforms existing state-of-the-art methods by a margin of 15.38+ AP for object detection and 11.77+ IoU for instance segmentation, respectively., Comment: 24 pages, Accepted to NeurIPS 2024

Large language models (LLMs) are increasingly used to model human social behavior, with recent research exploring their ability to simulate social dynamics. Here, we test whether LLMs mirror human behavior in social dilemmas, where individual and collective interests conflict. Humans generally cooperate more than expected in laboratory settings, showing less cooperation in well-mixed populations but more in fixed networks. In contrast, LLMs tend to exhibit greater cooperation in well-mixed settings. This raises a key question: Are LLMs about to emulate human behavior in cooperative dilemmas on networks? In this study, we examine networked interactions where agents repeatedly engage in the Prisoner's Dilemma within both well-mixed and structured network configurations, aiming to identify parallels in cooperative behavior between LLMs and humans. Our findings indicate critical distinctions: while humans tend to cooperate more within structured networks, LLMs display increased cooperation mainly in well-mixed environments, with limited adjustment to networked contexts. Notably, LLM cooperation also varies across model types, illustrating the complexities of replicating human-like social adaptability in artificial agents. These results highlight a crucial gap: LLMs struggle to emulate the nuanced, adaptive social strategies humans deploy in fixed networks. Unlike human participants, LLMs do not alter their cooperative behavior in response to network structures or evolving social contexts, missing the reciprocity norms that humans adaptively employ. This limitation points to a fundamental need in future LLM design -- to integrate a deeper comprehension of social norms, enabling more authentic modeling of human-like cooperation and adaptability in networked environments.

In this paper, we investigate the parking process on a uniform random rooted binary tree with $n$ vertices. Viewing each vertex as a single parking space, a random number of cars independently arrive at and attempt to park on each vertex one at a time. If a car attempts to park on an occupied vertex, it traverses the unique path on the tree towards the root, parking at the first empty vertex it encounters. If this is not possible, the car exits the tree at the root. We shall investigate the limit of the probability of the event that all cars can park when $\lfloor \alpha n \rfloor$ cars arrive, with $\alpha > 0$. We find that there is a phase transition at $\alpha_c = 2 - \sqrt{2}$, with this event having positive limiting probability when $\alpha < \alpha_c$, and the probability tending to 0 as $n \rightarrow \infty$ for $\alpha > \alpha_c$. This is analogous to the work done by Goldschmidt and Przykucki (arXiv:1610.08786) and Goldschmidt and Chen (arXiv:1911.03816), while agreeing with the general result proven by Curien and H\'enard (arXiv:2205.15932)., Comment: 16 pages, 0 figures

Efficient deployment of resource-intensive transformers on edge devices necessitates cross-stack optimization. We thus study the interrelation between structured pruning and systolic acceleration, matching the size of pruned blocks with the systolic array dimensions. In this setting, computations of pruned weight blocks can be skipped, reducing run-time and energy consumption, but potentially impacting quality of service (QoS). To evaluate the trade-offs between systolic array size and sparsity opportunities, we present a novel co-design framework that integrates algorithmic optimization, system simulation, and hardware design. Targeting speech recognition using transformers as a case study, we analyze how configuration choices across the stack affect performance metrics. Results demonstrate that structured pruning on systems featuring systolic array acceleration can effectively increase performance, while maintaining high QoS levels. Up to 26% system-wide speedups due to structured pruning were measured, with only 1.4% word error rate degradation on the standard Librispeech dataset., Comment: 7 pages, 10 figures

With their potential to significantly reduce traffic accidents, enhance road safety, optimize traffic flow, and decrease congestion, autonomous driving systems are a major focus of research and development in recent years. Beyond these immediate benefits, they offer long-term advantages in promoting sustainable transportation by reducing emissions and fuel consumption. Achieving a high level of autonomy across diverse conditions requires a comprehensive understanding of the environment. This is accomplished by processing data from sensors such as cameras, radars, and LiDARs through a software stack that relies heavily on machine learning algorithms. These ML models demand significant computational resources and involve large-scale data movement, presenting challenges for hardware to execute them efficiently and at high speed. In this survey, we first outline and highlight the key components of self-driving systems, covering input sensors, commonly used datasets, simulation platforms, and the software architecture. We then explore the underlying hardware platforms that support the execution of these software systems. By presenting a comprehensive view of autonomous driving systems and their increasing demands, particularly for higher levels of autonomy, we analyze the performance and efficiency of scaled-up off-the-shelf GPU/CPU-based systems, emphasizing the challenges within the computational components. Through examples showcasing the diverse computational and memory requirements in the software stack, we demonstrate how more specialized hardware and processing closer to memory can enable more efficient execution with lower latency. Finally, based on current trends and future demands, we conclude by speculating what a future hardware platform for autonomous driving might look like.

The surge of data available on the internet has led to the adoption of various computational methods to analyze and extract valuable insights from this wealth of information. Among these, the field of Machine Learning (ML) has thrived by leveraging data to extract meaningful insights. However, ML techniques face notable challenges when dealing with real-world data, often due to issues of imbalance, noise, insufficient labeling, and high dimensionality. To address these limitations, some researchers advocate for the adoption of Topological Data Analysis (TDA), a statistical approach that discerningly captures the intrinsic shape of data despite noise. Despite its potential, TDA has not gained as much traction within the Natural Language Processing (NLP) domain compared to structurally distinct areas like computer vision. Nevertheless, a dedicated community of researchers has been exploring the application of TDA in NLP, yielding 85 papers we comprehensively survey in this paper. Our findings categorize these efforts into theoretical and nontheoretical approaches. Theoretical approaches aim to explain linguistic phenomena from a topological viewpoint, while non-theoretical approaches merge TDA with ML features, utilizing diverse numerical representation techniques. We conclude by exploring the challenges and unresolved questions that persist in this niche field. Resources and a list of papers on this topic can be found at: https://github.com/AdaUchendu/AwesomeTDA4NLP.

The characterization of magnetic fields within molecular clouds is fundamental to understanding star formation processes. Accurately gauging the three-dimensional structure of these fields presents a challenge, as observational techniques such as dust polarization and the Zeeman effect each provide only partial information on the orientation and line-of-sight strength, respectively. By analyzing a suite of AREPO simulations, this paper investigates how observables can relate to underlying physical properties to derive a more comprehensive picture of the magnetic field's inclination angle and strength, specifically in regions where both dust polarization and Zeeman data are available. To demonstrate the method, we produce synthetic observations of the polarization angle dispersion and line-of-sight Alfv\'en Mach Number and explore the behavior of the inclination angle, $\gamma$, and strength of the magnetic field in regions where both Zeeman and dust polarization data are available. We find that dust polarization data can be used to determine the inclination angle if the cloud is known to be trans-Alfv\'enic or sub-Alfv\'enic. The strength of the magnetic field relative to turbulence can be estimated by comparing polarization observations to Zeeman observations. Comparing the dispersion of the polarization angle to the estimated line-of-sight Alfv\'en Mach Number provides clues about the strength of the magnetic field and, consequently, the orientation of the magnetic field., Comment: 16 pages, 12 figures, 1 table

We introduce the ParClusterers Benchmark Suite (PCBS) -- a collection of highly scalable parallel graph clustering algorithms and benchmarking tools that streamline comparing different graph clustering algorithms and implementations. The benchmark includes clustering algorithms that target a wide range of modern clustering use cases, including community detection, classification, and dense subgraph mining. The benchmark toolkit makes it easy to run and evaluate multiple instances of different clustering algorithms, which can be useful for fine-tuning the performance of clustering on a given task, and for comparing different clustering algorithms based on different metrics of interest, including clustering quality and running time. Using PCBS, we evaluate a broad collection of real-world graph clustering datasets. Somewhat surprisingly, we find that the best quality results are obtained by algorithms that not included in many popular graph clustering toolkits. The PCBS provides a standardized way to evaluate and judge the quality-performance tradeoffs of the active research area of scalable graph clustering algorithms. We believe it will help enable fair, accurate, and nuanced evaluation of graph clustering algorithms in the future., Comment: This is a preliminary version of a paper that will appear at VLDB'25

A self-interacting dynamics that mimics the standard Consensus-Based Optimization (CBO) model is introduced. This single-particle dynamics is shown to converge to a unique invariant measure that approximates the global minimum of a given function. As an application, its connection to CBO with Personal Best introduced by C. Totzeck and M.-T. Wolfram (Math. Biosci. Eng., 2020) has been established., Comment: This version contains supplementary material gathered in an appendix

We study the problem of clock synchronization in a networked system with arbitrary starts for all nodes. We consider a synchronous network of $n$ nodes, where each node has a local clock that is an integer counter. Eventually, clocks must be all equal and increase by one in each round modulo some period $P$. The purpose of this paper is to study whether clock synchronization can be achieved with bounded memory, that is every node maintains a number of states that does not depend on the network size. In particular, we are interested in clock synchronization algorithms which work in dynamic networks, i.e., tolerate that communication links continuously fail and come-up. We first focus on self-stabilizing solutions for clock synchronization, and prove that there is no such algorithm that is bounded memory, even in the case of static networks. More precisely, we show a lower bound of $n+1$ states at each node required to achieve clock synchronization in static strongly connected networks with at most $n$ nodes, and derive a lower bound of $n-2$ rounds on synchronization time, in the worst case. We then prove that, when the self-stabilizing requirement is removed, the impossibility of clock synchronization with bounded memory still holds in the dynamic setting: every solution for the clock synchronization problem in dynamic networks with at most $n$ nodes requires each node to have $\Omega(\log n)$ states.

Let $\A$ be a finite dimensional vector space and $\Phi$ be a finite root system in $\A$. To this data is associated an affine poly-simplicial complex. Motivated by a forthcoming construction of connectified higher buildings, we study "affine weight polytopes" associated to these data. We prove that these polytopes tesselate $\A$. We also prove a kind of "mixed" tessellation, involving the affine weight polytopes and the poly-simplical structure on $\A$.

We consider a class of external potentials on the complex plane $\mathbb{C}$ for which the coincidence set to the obstacle problem contains a Jordan curve in the exterior of the droplet. We refer to this curve as a spectral outpost. We study the corresponding Coulomb gas at $\beta=2$. Generalizing recent work in the radially symmetric case, we prove that the number of particles which fall near the spectral outpost has an asymptotic Heine distribution, as the number of particles $n\to\infty$.We also consider a class of potentials with disconnected droplets whose connected components are separated by a ring-shaped spectral gap. We prove that the fluctuations of the number of particles that fall near a given component has an asymptotic discrete normal distribution, which depends on $n$. For the case of disconnected droplets we also consider fluctuations of general smooth linear statistics and show that they tend to distribute as the sum of a Gaussian field and an independent, oscillatory, discrete Gaussian field. Our techniques involve a new asymptotic formula on the norm of monic orthogonal polynomials in the bifurcation regime and a variant of the method of limit Ward identities of Ameur, Hedenmalm, and Makarov., Comment: 37 pages

We consider the Hospital/Residents (HR) problem in the presence of ties in preference lists. Among the three notions of stability, viz. weak, strong, and super stability, we focus on the notion of strong stability. Strong stability has many desirable properties both theoretically and practically; however, its existence is not guaranteed. In this paper, our objective is to optimally increase the quotas of hospitals to ensure that a strongly stable matching exists in the modified instance. First, we show that if ties are allowed in residents' preference lists, it may not be possible to augment the hospital quotas to obtain an instance that admits a strongly stable matching. When residents' preference lists are strict, we explore two natural optimization criteria: (i) minimizing the maximum capacity increase for any hospital (MINMAX), and (ii) minimizing the total capacity increase across all hospitals (MINSUM). We show that the MINMAX problem is NP-hard in general. When hospital preference lists can have ties of length at most $\ell+1$, we give a polynomial-time algorithm that increases each hospital's quota by at most $\ell$, ensuring the resulting instance admits a strongly stable matching. We show that the MINSUM problem admits a polynomial-time algorithm. However, when each hospital incurs a cost for each capacity increase, the problem becomes NP-hard, even if the costs are 0 or 1. This also implies that the problem cannot be approximated to any multiplicative factor. We also consider a related problem under the MINSUM objective. Given an HR instance and a forced pair $(r^*,h^*)$, the goal is to decide if it is possible to increase hospital quotas (if necessary) to obtain a strongly stable matching that matches the pair $(r^*,h^*)$. We show a polynomial-time algorithm for this problem.

It is a common belief that quantum key distribution systems are the one and only information-theoretically secure physical layer security protocol that enables secure data transmission without a need for the legitimate parties to have any channel knowledge. It is also known that this high security profile results in severe rate restrictions for the parties utilizing the quantum key distribution systems. This observation raises the question of whether quantifying the level of ignorance of the legitimate parties with regard to the channel parameters may enable us to navigate the large gray zone between insecure but highly performant systems on the one side and perfectly secure but highly non-performant systems on the other side. Indeed, by proving a capacity formula for the bosonic compound wiretap channel using the binary phase shift keying alphabet, we are able to quantify in this work exactly how channel uncertainty penalizes data transmission rates., Comment: 6 pages, 2 figures

In this work we present an a priori error analysis for solving the unsteady advection equation on cut cell meshes along a straight ramp in two dimensions. The space discretization uses a lowest order upwind-type discontinuous Galerkin scheme involving a \textit{Domain of Dependence} (DoD) stabilization to correct the update in the neighborhood of small cut cells. Thereby, it is possible to employ explicit time stepping schemes with a time step length that is independent of the size of the very small cut cells. Our error analysis is based on a general framework for error estimates for first-order linear partial differential equations that relies on consistency, boundedness, and discrete dissipation of the discrete bilinear form. We prove these properties for the space discretization involving DoD stabilization. This allows us to prove, for the fully discrete scheme, a quasi-optimal error estimate of order one half in a norm that combines the $L^\infty$-in-time $L^2$-in-space norm and a seminorm that contains velocity weighted jumps. We also provide corresponding numerical results.

Modern cryptography, such as Rivest Shamir Adleman (RSA) and Secure Hash Algorithm (SHA), has been designed by humans based on our understanding of cryptographic methods. Neural Network (NN) based cryptography is being investigated due to its ability to learn and implement random cryptographic schemes that may be harder to decipher than human-designed algorithms. NN based cryptography may create a new cryptographic scheme that is NN specific and that changes every time the NN is (re)trained. This is attractive since it would require an adversary to restart its process(es) to learn or break the cryptographic scheme every time the NN is (re)trained. Current challenges facing NN-based encryption include additional communication overhead due to encoding to correct bit errors, quantizing the continuous-valued output of the NN, and enabling One-Time-Pad encryption. With this in mind, the Random Adversarial Data Obfuscation Model (RANDOM) Adversarial Neural Cryptography (ANC) network is introduced. RANDOM is comprised of three new NN layers: the (i) projection layer, (ii) inverse projection layer, and (iii) dot-product layer. This results in an ANC network that (i) is computationally efficient, (ii) ensures the encrypted message is unique to the encryption key, and (iii) does not induce any communication overhead. RANDOM only requires around 100 KB to store and can provide up to 2.5 megabytes per second of end-to-end encrypted communication., Comment: 8 pages

In language processing, transformers benefit greatly from text being condensed. This is achieved through a larger vocabulary that captures word fragments instead of plain characters. This is often done with Byte Pair Encoding. In the context of images, tokenisation of visual data is usually limited to regular grids obtained from quantisation methods, without global content awareness. Our work improves tokenisation of visual data by bringing Byte Pair Encoding from 1D to multiple dimensions, as a complementary add-on to existing compression. We achieve this through counting constellations of token pairs and replacing the most frequent token pair with a newly introduced token. The multidimensionality only increases the computation time by a factor of 2 for images, making it applicable even to large datasets like ImageNet within minutes on consumer hardware. This is a lossless preprocessing step. Our evaluation shows improved training and inference performance of transformers on visual data achieved by compressing frequent constellations of tokens: The resulting sequences are shorter, with more uniformly distributed information content, e.g. condensing empty regions in an image into single tokens. As our experiments show, these condensed sequences are easier to process. We additionally introduce a strategy to amplify this compression further by clustering the vocabulary.

This paper addresses how to assign a monetary value to scientific publications, particularly in the case of multi-author papers arising from large-scale research collaborations. Contemporary science increasingly relies on extensive and varied collaborations to tackle global challenges in fields such as life sciences, climate science, energy, high-energy physics, astronomy, and many others. We argue that existing literature fails to address the collaborative nature of research by overlooking the relationship between coauthorship and scientists productivity. Using the Marginal Cost of Production (MCP) approach, we first highlight the methodological limitations of ignoring this relationship, then propose a generalised MCP model to value co-authorship. As a case study, we examine High-Energy Physics (HEP) collaborations at the Large Hadron Collider (LHC) at CERN, analysing approximately half a million scientific outputs by over 50,000 authors from 1990 to 2021. Our findings indicate that collaborative adjustments yield monetary valuations for subsets of highly collaborative papers up to 3 orders of magnitude higher than previous estimates, with elevated values correlating with high research quality. This study contributes to the literature on research output evaluation, addressing debates in science policy around assessing research performance and impact. Our methodology is applicable to authorship valuation both within academia and in large-scale scientific collaborations, fitting diverse research impact assessment frameworks or as self-standing procedure. Additionally, we discuss the conditions under which this method may complement survey-based approaches., Comment: 38 pages, excluding annexes, 15 figures. Working paper to be submitted to "Scientometrics"

Lateral movement is a crucial component of advanced persistent threat (APT) attacks in networks. Attackers exploit security vulnerabilities in internal networks or IoT devices, expanding their control after initial infiltration to steal sensitive data or carry out other malicious activities, posing a serious threat to system security. Existing research suggests that attackers generally employ seemingly unrelated operations to mask their malicious intentions, thereby evading existing lateral movement detection methods and hiding their intrusion traces. In this regard, we analyze host authentication log data from a graph perspective and propose a multi-scale lateral movement detection framework called LMDetect. The main workflow of this framework proceeds as follows: 1) Construct a heterogeneous multigraph from host authentication log data to strengthen the correlations among internal system entities; 2) Design a time-aware subgraph generator to extract subgraphs centered on authentication events from the heterogeneous authentication multigraph; 3) Design a multi-scale attention encoder that leverages both local and global attention to capture hidden anomalous behavior patterns in the authentication subgraphs, thereby achieving lateral movement detection. Extensive experiments on two real-world authentication log datasets demonstrate the effectiveness and superiority of our framework in detecting lateral movement behaviors.

This study investigates how 18-year-old students, parents, and experts in China utilize artificial intelligence (AI) tools to support decision-making in college applications during college entrance exam -- a highly competitive, score-driven, annual national exam. Through 32 interviews, we examine the use of Quark GaoKao, an AI tool that generates college application lists and acceptance probabilities based on exam scores, historical data, preferred locations, etc. Our findings show that AI tools are predominantly used by parents with limited involvement from students, and often focus on immediate exam results, failing to address long-term career goals. We also identify challenges such as misleading AI recommendations, and irresponsible use of AI by third-party consultant agencies. Finally, we offer design insights to better support multi-stakeholders' decision-making in families, especially in the Chinese context, and discuss how emerging AI tools create barriers for families with fewer resources.

We investigate the phase transitions in a one-dimensional system with colored noise. Previous studies indicated that the phase diagram of this system included extended and disorder-induced localized phases. However, by studying the properties of wave functions, we find that this phase diagram can be further refined, revealing the existence of a bound phase for the large potential amplitude $W$ and noise control parameter $\alpha$. In the bound phase, the wave function cannot extend throughout the entire chain, tails decay faster than exponentially and its distribution expands as the system size increases. By adjusting the potential amplitude to induce a transition from the extended phase to the bound phase, we find that bound states coexist with extended states in the spectrum. In contrast, when the system transitions from the Anderson localized phase to the bound phase, we do not observe the obvious coexistence of Anderson localized and bound states. Finally, by performing the time evolution, we find that the dynamic transition point of the bound phase is inconsistent with the static one for large $\alpha$., Comment: 10 pages, 12 figures, To be published in Physical Review B

We construct a family of polytopes, which we call Chevalley polytopes, associated to homogeneous spaces $X=G/P$ in their projective embeddings $X\hookrightarrow \mathbb{P}(V_{\varpi})$ together with a choice of reduced expression for the minimal coset representative $w^P$ of $w_0$ in $W/W_P$. When $X$ is minuscule in its minimal embedding, we describe our construction in terms of order polytopes of minuscule posets and use the associated combinatorics to show that minuscule Chevalley polytopes are Newton-Okounkov bodies for $X$ and that the Pl\"ucker coordinates on $X$ form a Khovanskii basis for $\mathbb{C}[X]$. We conjecture similar properties for general $X$ and general embeddings $X\hookrightarrow\mathbb{P}(V_\varpi)$, along with a remarkable decomposition property which we consider as a polytopal shadow of the Littlewood-Richardson rule. We highlight a connection between Chevalley polytopes and string polytopes and give examples where Chevalley polytopes possess better combinatorial properties than string polytopes. We conclude with several examples further illustrating and supporting our conjectures., Comment: 24 pages

We present a coarse-to-fine neural deformation model to simultaneously recover the camera pose and the 4D reconstruction of an unknown object from multiple RGB sequences in the wild. To that end, our approach does not consider any pre-built 3D template nor 3D training data as well as controlled illumination conditions, and can sort out the problem in a self-supervised manner. Our model exploits canonical and image-variant spaces where both coarse and fine components are considered. We introduce a neural local quadratic model with spatio-temporal consistency to encode fine details that is combined with canonical embeddings in order to establish correspondences across sequences. We thoroughly validate the method on challenging scenarios with complex and real-world deformations, providing both quantitative and qualitative evaluations, an ablation study and a comparison with respect to competing approaches. Our project is available at https://github.com/smontode24/4DPV., Comment: 17th Asian Conference on Computer Vision (ACCV 2024)

We produce twisted derived equivalences between torsors under abelian varieties and their moduli spaces of simple semi-homogeneous sheaves. We also establish the natural converse to this result and show that a large class of twisted derived equivalences, including all derived equivalences, between torsors arise in this way. As corollaries, we obtain partial extensions of the usual derived equivalence criterion for abelian varieties established by Orlov and Polishchuk.

Large language models (LLMs) based on the Transformer architecture are widely employed across various domains and tasks. However, their increasing size imposes significant hardware demands, limiting practical deployment. To mitigate this, model pruning techniques have been developed to create more efficient models while maintaining high performance. Despite this, post-training after pruning is crucial for performance recovery and can be resource-intensive. This paper investigates the post-training requirements of pruned LLMs and introduces a scaling law to determine the optimal amount of post-training data. Post-training experiments with the Llama-3 and Qwen-2.5 series models, pruned using depth pruning, width pruning, and 2:4 semi-structured pruning, show that higher pruning ratios necessitate more post-training data for performance recovery, whereas larger LLMs require less. The proposed scaling law predicts a model's loss based on its parameter counts before and after pruning, as well as the post-training token counts. Furthermore, we find that the scaling law established from smaller LLMs can be reliably extrapolated to larger LLMs. This work provides valuable insights into the post-training of pruned LLMs and offers a practical scaling law for optimizing post-training data usage.

We consider $\mathbb{Z}_q$-valued clock models on a regular tree, for general classes of ferromagnetic nearest neighbor interactions which have a discrete rotational symmetry. It has been proved recently that, at strong enough coupling, families of homogeneous Markov chain Gibbs states $\mu_A$ coexist whose single-site marginals concentrate on $A\subset \mathbb{Z}_q$, and which are not convex combinations of each other [AbHeKuMa24]. In this note, we aim at a description of the extremal decomposition of $\mu_A$ for $|A|\geq 2$ into all extremal Gibbs measures, which may be spatially inhomogeneous. First, we show that in regimes of very strong coupling, $\mu_A$ is not extremal. Moreover, $\mu_A$ possesses a single-site reconstruction property which holds for spin values sent from the origin to infinity, when these initial values are chosen from $A$. As our main result, we show that $\mu_A$ decomposes into uncountably many extremal inhomogeneous states. The proof is based on multi-site reconstruction which allows to derive concentration properties of branch overlaps. Our method is based on a new good site/bad site decomposition adapted to the $A$-localization property, together with a coarse graining argument in local state space., Comment: 32 pages, 3 figures

Model interpretability is a key challenge that has yet to align with the advancements observed in contemporary state-of-the-art deep learning models. In particular, deep learning aided vision tasks require interpretability, in order for their adoption in more specialized domains such as medical imaging. Although the field of explainable AI (XAI) developed methods for interpreting vision models along with early convolutional neural networks, recent XAI research has mainly focused on assigning attributes via saliency maps. As such, these methods are restricted to providing explanations at a sample level, and many explainability methods suffer from low adaptability across a wide range of vision models. In our work, we re-think vision-model explainability from a novel perspective, to probe the general input structure that a model has learnt during its training. To this end, we ask the question: "How would a vision model fill-in a masked-image". Experiments on standard vision datasets and pre-trained models reveal consistent patterns, and could be intergrated as an additional model-agnostic explainability tool in modern machine-learning platforms. The code will be available at \url{https://github.com/BoTZ-TND/FillingTheBlanks.git}

Many magnetic white dwarfs exhibit a polarised spectrum that periodically varies as the star rotates because the magnetic field is not symmetric about the rotation axis. In this work, we report the discovery that while weakly magnetic white dwarfs of all ages with M < 1Mo show polarimetric variability with a period between hours and several days, the large majority of magnetic white dwarfs in the same mass range with cooling ages older than 2 Gyr and field strengths > 10 MG show little or no polarimetric variability. This could be interpreted as extremely slow rotation, but a lack of known white dwarfs with measured periods longer than two weeks means that we do not see white dwarfs slowing their rotation. We therefore suggest a different interpretation: old strongly magnetic white dwarfs do not vary because their fields are roughly symmetric about the rotation axes. Symmetry may either be a consequence of field evolution or a physical characteristic intrinsic to the way strong fields are generated in older stars. Specifically, a strong magnetic field could distort the shape of a star, forcing the principal axis of maximum inertia away from the spin axis. Eventually, as a result of energy dissipation, the magnetic axis will align with the angular momentum axis. We also find that the higher-mass strongly magnetised white dwarfs, which are likely the products of the merging of two white dwarfs, may appear as either polarimetrically variable or constant. This may be the symptom of two different formation channels or the consequence of the fact that a dynamo operating during a merger may produce diverse magnetic configurations. Alternatively, the massive white dwarfs with constant polarisation may be rotating with periods much shorter than the typical exposure times of the observations., Comment: Accepted by A&A

We prove that infinite mapping class group orbits are dense in the character variety of Deroin-Tholozan representations. In other words, the action is minimal except for finite orbits. Our arguments rely on the symplectic structure of the character variety, emphasizing this geometric perspective over its algebraic properties., Comment: 39 pages, 15 figures

Reinforcement learning (RL) is a sub-domain of machine learning, mainly concerned with solving sequential decision-making problems by a learning agent that interacts with the decision environment to improve its behavior through the reward it receives from the environment. This learning paradigm is, however, well-known for being time-consuming due to the necessity of collecting a large amount of data, making RL suffer from sample inefficiency and difficult generalization. Furthermore, the construction of an explicit reward function that accounts for the trade-off between multiple desiderata of a decision problem is often a laborious task. These challenges have been recently addressed utilizing transfer and inverse reinforcement learning (T-IRL). In this regard, this paper is devoted to a comprehensive review of realizing the sample efficiency and generalization of RL algorithms through T-IRL. Following a brief introduction to RL, the fundamental T-IRL methods are presented and the most recent advancements in each research field have been extensively reviewed. Our findings denote that a majority of recent research works have dealt with the aforementioned challenges by utilizing human-in-the-loop and sim-to-real strategies for the efficient transfer of knowledge from source domains to the target domain under the transfer learning scheme. Under the IRL structure, training schemes that require a low number of experience transitions and extension of such frameworks to multi-agent and multi-intention problems have been the priority of researchers in recent years.

We propose to measure the beam normal single spin asymmetry in elastic scattering of transversely polarized electron from target nuclei with 12 $\leq Z \leq$ 90 at Q$^2$ = 0.0092 GeV$^2$ to study its nuclear dependence. While the theoretical calculations based on two-photon exchange suggest no nuclear dependence at this kinematics, the results of 208Pb from Jefferson Lab show a striking disagreement from both theoretical predictions and light nuclei measurements. The proposed measurements will provide new data for intermediate to heavy nuclei where no data exists for $Z \geq$ 20 in the kinematics of previous high-energy experiments. It will allow one to investigate the missing contributions that are not accounted in the current theoretical models., Comment: Submitted to Jefferson Lab PAC52

We study the critical dynamics of a scalar field theory with $Z_2$ symmetry in the dynamic universality class of Model A in two and three spatial dimensions with classical-statistical lattice simulations. In particular, we measure the non-equilibrium behavior of the system under a quench protocol in which the symmetry-breaking external field is changed at a constant rate through the critical point. Using the well-established Kibble-Zurek scaling theory we compute non-equilibrium scaling functions of cumulants of the order parameter up to fourth order. Together with the static critical exponents and the dynamic critical exponent, these fully describe the universal non-equilibrium evolution of the system near the critical point. We further extend the analysis to include finite-size effects and observe good collapse of our data onto two-dimensional universal non-equilibrium and finite-size scaling functions., Comment: 18 pages, 7 figures

We show how solutions to the Ricci flow on Lorentzian manifolds, along with its generalizations, can be linked to Einstein's field equations. The approach involves deformations of the matter sector that are generated by quadratic functionals of the stress-energy tensor. We provide illustrative examples by explicitly constructing analytical solutions within maximally symmetric spacetimes and in the context of Born-Infeld's nonlinear electrodynamics. Finally, we discuss configurations involving global topological monopoles, emphasizing the versatility of this approach across various geometric and physical settings., Comment: 10 pages, 1 figure

The safety monitoring for nonlinear dynamical systems with embedded neural network components is addressed in this paper. The interval-observer-based safety monitor is developed consisting of two auxiliary neural networks derived from the neural network components of the dynamical system. Due to the presence of nonlinear activation functions in neural networks, we use quadratic constraints on the global sector to abstract the nonlinear activation functions in neural networks. By combining a quadratic constraint approach for the activation function with Lyapunov theory, the interval observer design problem is transformed into a series of quadratic and linear programming feasibility problems to make the interval observer operate with the ability to correctly estimate the system state with estimation errors within acceptable limits. The applicability of the proposed method is verified by simulation of the lateral vehicle control system.

Artificial spin ices provide a controlled platform for investigating diverse physical phenomena, such as geometric frustration, magnetic monopoles, and phase transitions, via deliberate design. Here, we introduce a novel approach by developing artificial spin ice on the surfaces of a three-dimensional cube, which leads to emergent geometric frustration mediated by topologically protected domain walls, distinct from its flat counterparts. These domain walls connect vertices at the corners of cube that acting as intrinsic topological defects. Utilizing Monte Carlo simulations, we observe robust, topologically protected correlations among the intrinsic topological defects, regardless of their spatial separation. Our findings demonstrate that three-dimensional surfaces can unveil emergent properties absent in flat architectures.

Super $L_\infty$-algebras unify extended super-symmetry with rational classifying spaces for higher flux densities: The super-invariant super-fluxes which control super $p$-branes and their supergravity target super-spaces are, together with their (non-linear) Bianchi identities, neatly encoded in (non-abelian) super-$L_\infty$ cocycles. These are the rational shadows of flux-quantization laws (in ordinary cohomology, K-theory, Cohomotopy, iterated K-theory, etc). We first review, in streamlined form while filling some previous gaps, double-dimensional reduction/oxidation and 10D superspace T-duality along higher-dimensional super-tori. We do so tangent super-space wise, by viewing it as an instance of adjunctions (dualities) between super-$L_\infty$-extensions and -cyclifications, applied to the avatar super-flux densities of 10D supergravity. In particular, this yields a derivation, at the rational level, of the traditional laws of "topological T-duality" from the super-$L_\infty$ structure of type II superspace. At this level, we also discuss a higher categorical analog of T-duality involving M-branes. Then, by considering super-space T-duality along all 1+9 spacetime dimensions while retaining the 11th dimension as in F-theory, we find the M-algebra appearing as the complete brane-charge extension of the fully T-doubled/correspondence super-spacetime. On this backdrop, we recognize the "decomposed" M-theory 3-form on the "hidden M-algebra" as an M-theoretic lift of the Poincar\'e super 2-form that controls superspace T-duality as the integral kernel of the super Fourier-Mukai transform. This provides the super-space structure of an M-theory lift of the doubled/correspondence space geometry, which controls T-duality., Comment: 90 pages, some figures

We use the theory of Bernstein functions, completely monotonic functions, and Levy processes to define a positive random process $\tau(t)$. For radar clutter one may think of $\tau(t)$ as the instantaneous power of the scattered radar signal that is described by a compound-Gaussian model. Thus the results herein give a mechanism for defining and simulating a compound-Gaussian random process that can be used in various radar studies. We give several examples of the sample paths of this process., Comment: 31 pages, 14 figures

Low latency and high data rate performance are essential in wireless communication systems. This paper explores trade-offs between latency and data rates for optical wireless communication. We introduce a latency-optimized model utilizing compound codes as one corner case and a data rate-optimized model employing channel estimation via pilot signals and feedback before data transmission. Trade-offs between the two extremes are displayed. Most importantly, we detail operating points that can only be reached when the receiver side of the link employs optimal quantum measurement strategies. Furthermore, we propose an IoT application in a robot factory as an example scenario. Our findings reveal a trade-off between latency and data rate driven by two basic algorithms: compound codes reduce latency at the cost of data rates, while channel estimation enhances data rates at the cost of latency., Comment: 6 pages, 2 figures

Vision Transformers (ViTs) and Convolutional Neural Networks (CNNs) face inherent challenges in image matting, particularly in preserving fine structural details. ViTs, with their global receptive field enabled by the self-attention mechanism, often lose local details such as hair strands. Conversely, CNNs, constrained by their local receptive field, rely on deeper layers to approximate global context but struggle to retain fine structures at greater depths. To overcome these limitations, we propose a novel Morpho-Aware Global Attention (MAGA) mechanism, designed to effectively capture the morphology of fine structures. MAGA employs Tetris-like convolutional patterns to align the local shapes of fine structures, ensuring optimal local correspondence while maintaining sensitivity to morphological details. The extracted local morphology information is used as query embeddings, which are projected onto global key embeddings to emphasize local details in a broader context. Subsequently, by projecting onto value embeddings, MAGA seamlessly integrates these emphasized morphological details into a unified global structure. This approach enables MAGA to simultaneously focus on local morphology and unify these details into a coherent whole, effectively preserving fine structures. Extensive experiments show that our MAGA-based ViT achieves significant performance gains, outperforming state-of-the-art methods across two benchmarks with average improvements of 4.3% in SAD and 39.5% in MSE.

The task of partial scene text retrieval involves localizing and searching for text instances that are the same or similar to a given query text from an image gallery. However, existing methods can only handle text-line instances, leaving the problem of searching for partial patches within these text-line instances unsolved due to a lack of patch annotations in the training data. To address this issue, we propose a network that can simultaneously retrieve both text-line instances and their partial patches. Our method embeds the two types of data (query text and scene text instances) into a shared feature space and measures their cross-modal similarities. To handle partial patches, our proposed approach adopts a Multiple Instance Learning (MIL) approach to learn their similarities with query text, without requiring extra annotations. However, constructing bags, which is a standard step of conventional MIL approaches, can introduce numerous noisy samples for training, and lower inference speed. To address this issue, we propose a Ranking MIL (RankMIL) approach to adaptively filter those noisy samples. Additionally, we present a Dynamic Partial Match Algorithm (DPMA) that can directly search for the target partial patch from a text-line instance during the inference stage, without requiring bags. This greatly improves the search efficiency and the performance of retrieving partial patches. The source code and dataset are available at https://github.com/lanfeng4659/PSTR., Comment: Accepted on TPAMI

The integration of intelligent and connected technologies in modern vehicles, while offering enhanced functionalities through Electronic Control Unit and interfaces like OBD-II and telematics, also exposes the vehicle's in-vehicle network (IVN) to potential cyberattacks. In this paper, we consider a specific type of cyberattack known as the injection attack. As demonstrated by empirical data from real-world cybersecurity adversarial competitions(available at https://mimic2024.xctf.org.cn/race/qwmimic2024 ), these injection attacks have excitation effect over time, gradually manipulating network traffic and disrupting the vehicle's normal functioning, ultimately compromising both its stability and safety. To profile the abnormal behavior of attackers, we propose a novel injection attack detector to extract long-term features of attack behavior. Specifically, we first provide a theoretical analysis of modeling the time-excitation effects of the attack using Multi-Dimensional Hawkes Process (MDHP). A gradient descent solver specifically tailored for MDHP, MDHP-GDS, is developed to accurately estimate optimal MDHP parameters. We then propose an injection attack detector, MDHP-Net, which integrates optimal MDHP parameters with MDHP-LSTM blocks to enhance temporal feature extraction. By introducing MDHP parameters, MDHP-Net captures complex temporal features that standard Long Short-Term Memory (LSTM) cannot, enriching temporal dependencies within our customized structure. Extensive evaluations demonstrate the effectiveness of our proposed detection approach.

Pediatric heart diseases present a broad spectrum of congenital and acquired diseases. More complex congenital malformations require a differentiated and multimodal decision-making process, usually including echocardiography as a central imaging method. Artificial intelligence (AI) offers considerable promise for clinicians by facilitating automated interpretation of pediatric echocardiography data. However, adapting AI technologies for pediatric echocardiography analysis has challenges such as limited public data availability, data privacy, and AI model transparency. Recently, researchers have focused on disruptive technologies, such as federated learning (FL) and explainable AI (XAI), to improve automatic diagnostic and decision support workflows. This study offers a comprehensive overview of the limitations and opportunities of AI in pediatric echocardiography, emphasizing the synergistic workflow and role of XAI and FL, identifying research gaps, and exploring potential future developments. Additionally, three relevant clinical use cases demonstrate the functionality of XAI and FL with a focus on (i) view recognition, (ii) disease classification, (iii) segmentation of cardiac structures, and (iv) quantitative assessment of cardiac function., Comment: This article is planned for submission to Frontiers Journal

Guidance is an error-correcting technique used to improve the perceptual quality of images generated by diffusion models. Typically, the correction is achieved by linear extrapolation, using an auxiliary diffusion model that has lower performance than the primary model. Using a 2D toy example, we show that it is highly beneficial when the auxiliary model exhibits similar errors as the primary one but stronger. We verify this finding in higher dimensions, where we show that competitive generative performance to state-of-the-art guidance methods can be achieved when the auxiliary model differs from the primary one only by having stronger weight regularization. As an independent contribution, we investigate whether upweighting long-range spatial dependencies improves visual fidelity. The result is a novel guidance method, which we call sliding window guidance (SWG), that guides the primary model with itself by constraining its receptive field. Intriguingly, SWG aligns better with human preferences than state-of-the-art guidance methods while requiring neither training, architectural modifications, nor class conditioning. The code will be released., Comment: Preprint. 19 pages, 14 figures in total, including references and appendix

X-Ray bursts (XRBs) are powerful thermonuclear events on the surface of accreting neutron stars (NSs), which can synthesize intermediate-mass elements. Although the high surface gravity prevents an explosive ejection, a small fraction of the envelope may be ejected by radiation-driven winds. In our previous works, we have developed a non-relativistic radiative wind model and coupled it to an XRB hydrodynamic simulation. We now apply this technique to another model featuring consecutive bursts. We determine the mass-loss and chemical composition of the wind ejecta. Results show that, for a representative XRB, about $0.1\%$ of the envelope mass is ejected per burst, at an average rate of $3.9 \times 10^{-12}\,M_\odot \texttt{yr}^{-1}$. Between $66\%$ and $76\%$ of the ejecta composition is $^{60}$Ni, $^{64}$Zn, $^{68}$Ge, $^{4}$He and $^{58}$Ni. We also report on the evolution of observational quantities during the wind phase and simulate NICER observations that resemble those of 4U 1820-40., Comment: 6 pages, 3 figures, part of 2024 XMM-Newton Science Conference Proceedings, Madrid

Multimodal Large Language Models (MLLMs) excel at descriptive tasks within images but often struggle with precise object localization, a critical element for reliable visual interpretation. In contrast, traditional object detection models provide high localization accuracy but frequently generate detections lacking contextual coherence due to limited modeling of inter-object relationships. To address this fundamental limitation, we introduce the \textbf{Visual-Linguistic Agent (VLA), a collaborative framework that combines the relational reasoning strengths of MLLMs with the precise localization capabilities of traditional object detectors. In the VLA paradigm, the MLLM serves as a central Linguistic Agent, working collaboratively with specialized Vision Agents for object detection and classification. The Linguistic Agent evaluates and refines detections by reasoning over spatial and contextual relationships among objects, while the classification Vision Agent offers corrective feedback to improve classification accuracy. This collaborative approach enables VLA to significantly enhance both spatial reasoning and object localization, addressing key challenges in multimodal understanding. Extensive evaluations on the COCO dataset demonstrate substantial performance improvements across multiple detection models, highlighting VLA's potential to set a new benchmark in accurate and contextually coherent object detection.

This study investigates uncertainty quantification (UQ) using quantum-classical hybrid machine learning (ML) models for applications in complex and dynamic fields, such as attaining resiliency in supply chain digital twins and financial risk assessment. Although quantum feature transformations have been integrated into ML models for complex data tasks, a gap exists in determining their impact on UQ within their hybrid architectures (quantum-classical approach). This work applies existing UQ techniques for different models within a hybrid framework, examining how quantum feature transformation affects uncertainty propagation. Increasing qubits from 4 to 16 shows varied model responsiveness to outlier detection (OD) samples, which is a critical factor for resilient decision-making in dynamic environments. This work shows how quantum computing techniques can transform data features for UQ, particularly when combined with traditional methods.

We calculate the two-loop corrections in curvature perturbation power spectrum in models of single field inflation incorporating an intermediate USR phase employed for PBHs formation. Among the total eleven one-particle irreducible Feynman diagrams, we calculate the corrections from the ``double scoop" two-loop diagram involving two vertices of quartic Hamiltonians. We demonstrate that the fractional two-loop correction in power spectrum scales like the square of the fractional one-loop correction. We confirm our previous findings that the loop corrections become arbitrarily large when the transition from the USR phase to the final attractor phase is very sharp. This suggests that in order for the analysis to be under perturbative control against the loop corrections, one requires a mild transition with a long enough relaxation period towards the final attractor phase., Comment: 21 pages, 2 figures. arXiv admin note: text overlap with arXiv:2403.03841

A well-known result of Shalom says that lattices in SO$(n,1)$ are $L^p$ measure equivalent for all $p

Forks in the Bitcoin network result from the natural competition in the blockchain's Proof-of-Work consensus protocol. Their frequency is a critical indicator for the efficiency of a distributed ledger as they can contribute to resource waste and network insecurity. We introduce a model for the estimation of natural fork rates in a network of heterogeneous miners as a function of their number, the distribution of hash rates and the block propagation time over the peer-to-peer infrastructure. Despite relatively simplistic assumptions, such as zero propagation delay within mining pools, the model predicts fork rates which are comparable with the empirical stale blocks rate. In the past decade, we observe a reduction in the number of mining pools approximately by a factor 3, and quantify its consequences for the fork rate, whilst showing the emergence of a truncated power-law distribution in hash rates, justified by a rich-get-richer effect constrained by global energy supply limits. We demonstrate, both empirically and with the aid of our quantitative model, that the ratio between the block propagation time and the mining time is a sufficiently accurate estimator of the fork rate, but also quantify its dependence on the heterogeneity of miner activities. We provide empirical and theoretical evidence that both hash rate concentration and lower block propagation time reduce fork rates in distributed ledgers. Our work introduces a robust mathematical setting for investigating power concentration and competition on a distributed network, for interpreting discrepancies in fork rates -- for example caused by selfish mining practices and asymmetric propagation times -- thus providing an effective tool for designing future and alternative scenarios for existing and new blockchain distributed mining systems., Comment: 18 pages, 10 figures

We examine the onset of Anderson localization in three-dimensional systems with structural disorder in the form of lattice irregularities and in the absence of any on-site disordered potential. Analyzing two models with distinct types of lattice regularities, we show that the Anderson localization transition occurs when the strength of the structural disorder is smoothly increased. Performing finite-size scaling analysis of the results, we show that the transition belongs to the same universality class as regular Anderson localization induced by onsite disorder. Our work identifies a new class of structurally disordered lattice models in which destructive interference of matter waves may inhibit transport and lead to a transition between metallic and localized phases., Comment: 8 pages, 6 figures