Search

Global attention has been focused on extreme climatic changes. This paper investigates the relationship between different phases of solar activity and extreme precipitation events in Kerala, India. Sunspot number and rainfall data were analysed over 122 years (1901-2022) on an annual scale. A negative correlation was observed in the winter and post-monsoon seasons, while positive correlations were seen in the pre-monsoon and monsoon seasons, all of which were statistically significant. Using cross-wavelet transform, the temporal relationship between sunspot number and rainfall values was investigated, revealing significant cross-power at an 8-12 year scale across all seasons. Wavelet coherence between the two data sets demonstrated significant correlation at the 2-4 and 4-8 year scales throughout the four seasons. The results show that the seasonal rainfall over Kerala is related to solar activity. The solar phases of Solar Cycles 14-24 were determined for all seasons, and the years with excessive and insufficient rainfall were identified. It was observed that the descending phase had an impact on excess rainfall events during the winter and pre-monsoon seasons, while the ascending phase notably affected the monsoon and post-monsoon seasons. The study specifically examined the different magnetic polarities of sunspots in alternating solar cycles, focusing on even and odd cycles. It was found that extreme rainfall events were more frequent during the winter and pre-monsoon seasons in the even cycles, whereas in the odd cycles, they were more prevalent during the monsoon and post-monsoon seasons. These findings are presented for the first time and may offer new perspectives on how different phases affect rainfall. This study suggests a physical link between solar activity and extreme precipitation in Kerala, which could increase predictability., Comment: 15 pages, 8 figures, 4 tables (Submitted to Advances in Space Research)

Contraction analysis offers, through elegant mathematical developments, a unified way of designing observers for a general class of nonlinear systems, where the observer correction term is obtained by solving an infinite dimensional inequality that guarantees global exponential convergence. However, solving the matrix partial differential inequality involved in contraction analysis design is both analytically and numerically challenging and represents a long-lasting challenge that prevented its wide use. Therefore, the present paper proposes a novel approach that relies on an unsupervised Physics Informed Neural Network (PINN) to design the observer's correction term by enforcing the partial differential inequality in the loss function. The performance of the proposed PINN-based nonlinear observer is assessed in numerical simulation as well as its robustness to measurement noise and neural network approximation error.

The Travelling Salesman Problem (TSP) remains a fundamental challenge in combinatorial optimization, inspiring diverse algorithmic strategies. This paper revisits the "heatmap + Monte Carlo Tree Search (MCTS)" paradigm that has recently gained traction for learning-based TSP solutions. Within this framework, heatmaps encode the likelihood of edges forming part of the optimal tour, and MCTS refines this probabilistic guidance to discover optimal solutions. Contemporary approaches have predominantly emphasized the refinement of heatmap generation through sophisticated learning models, inadvertently sidelining the critical role of MCTS. Our extensive empirical analysis reveals two pivotal insights: 1) The configuration of MCTS strategies profoundly influences the solution quality, demanding meticulous tuning to leverage their full potential; 2) Our findings demonstrate that a rudimentary and parameter-free heatmap, derived from the intrinsic $k$-nearest nature of TSP, can rival or even surpass the performance of complicated heatmaps, with strong generalizability across various scales. Empirical evaluations across various TSP scales underscore the efficacy of our approach, achieving competitive results. These observations challenge the prevailing focus on heatmap sophistication, advocating a reevaluation of the paradigm to harness both components synergistically. Our code is available at: https://github.com/LOGO-CUHKSZ/rethink_mcts_tsp.

This paper presents the first gyrokinetic (GK) simulations of edge and scrape-off layer (SOL) turbulence accelerated by a velocity-space spectral approach in the full-f GK code GENE-X. Building upon the original grid velocity-space discretization, we derive and implement a new spectral formulation and verify the numerical implementation using the method of manufactured solution. We conduct a series of spectral turbulence simulations focusing on the TCV-X21 reference case [Oliveira D. S. et al., Nucl. Fusion 62, 096001 (2022)] and compare these results with previously validated grid simulations [Ulbl P. et al., Phys. Plasmas 30, 107986 (2023)]. The spectral approach reproduces the outboard midplane (OMP) profiles (density, temperature, and radial electric field), dominated by trapped electron mode (TEM) turbulence, with excellent agreement and significantly lower velocity-space resolution. Thus, the spectral approach reduces the computational cost by at least an order of magnitude, achieving a speed-up of approximately 50 for the TCV-X21 case. This enables high-fidelity GK simulations to be performed within a few days on modern CPU-based supercomputers for medium-sized devices and establishes GENE-X as a powerful tool for studying edge and SOL turbulence, moving towards reactor-relevant devices like ITER.

One fundamental problem in studying dynamical process is whether it is possible and how to construct prediction model for an unknown system via sampled time series, especially in the modern big data era. The research in this area is beneficial to experimentalists in physics, chemistry, especially, in biological science, where it is hard to construct a prediction models by first principles. Therefore constructing prediction model for the observable of a complex system is of great practical significance in various areas of science and engineering. In the present paper, we show in terms of Lebesgue measure that, at least in the linear case, one can almost surely construct by linear algebra approach the prediction model about observable of unknown systems only via observed time series in the settings of discrete time and continuous time linear systems, even in the situation that one has no information about the underlying dynamical process and output function that generates the observed time series. Interestingly, we can obtain the characteristic polynomial of the unknown matrices for both of discrete time and continuous time linear systems with probability 1.

This paper describes the R package fdesigns that implements a methodology for identifying Bayesian optimal experimental designs for models whose factor settings are functions, known as profile factors. This type of experiments which involve factors that vary dynamically over time, presenting unique challenges in both estimation and design due to the infinite-dimensional nature of functions. The package fdesigns implements a dimension reduction method leveraging basis functions of the B-spline basis system. The package fdesigns contains functions that effectively reduce the design problem to the optimisation of basis coefficients for functional linear functional generalised linear models, and it accommodates various options. Applications of the fdesigns package are demonstrated through a series of examples that showcase its capabilities in identifying optimal designs for functional linear and generalised linear models. The examples highlight how the package's functions can be used to efficiently design experiments involving both profile and scalar factors, including interactions and polynomial effects.

Combining classical optimization with parameterized quantum circuit evaluation, variational quantum algorithms (VQAs) are among the most promising algorithms in near-term quantum computing. Similar to neural networks (NNs), VQAs iteratively update circuit parameters to optimize a cost function. However, the training of variational quantum circuits (VQCs) is susceptible to a phenomenon known as barren plateaus (BPs). Various methods have been proposed to mitigate this issue, such as using neural networks to generate VQC parameters. In this paper, we improve the NN-based BP mitigation approach by refining the neural network architecture and extend its applicability to a more generalized scenario that includes random quantum inputs and VQC structures. We evaluate the effectiveness of this approach by comparing the convergence speed before and after it is utilized. Furthermore, we give an explanation for the effectiveness of this method by utilizing a loss landscape visualization technique and the expressibility metric of VQC. The smoothness of the loss landscape offers an intuitive insight into the method's utility, while the reduction in expressibility accounts for the enhanced trainability. Our research highlights the universal applicability of the NN-based BP mitigation approach, underscoring its potential to drive progress in the development of VQAs across diverse domains.

Endogenous treatment and sample selection are two concomitant sources of endogeneity that challenge the validity of causal inference. In this paper, we focus on the partial identification of treatment effects within a standard two-period difference-in-differences framework when the outcome is observed for an endogenously selected subpopulation. The identification strategy embeds Lee's (2009) bounding approach based on principal stratification, which divides the population into latent subgroups based on selection behaviour in counterfactual treatment states in both periods. We establish identification results for four latent types and illustrate the proposed approach by applying it to estimate 1) the effect of a job training program on earnings and 2) the effect of a working-from-home policy on employee performance.

There is increasing concern about the unilateral power of the organizations involved in the development, alignment, and governance of AI. Recent pilots - such as Meta's Community Forums and Anthropic's Collective Constitutional AI - have illustrated a promising direction, where democratic processes might be used to meaningfully improve public involvement and trust in critical decisions. However, there is no standard framework for evaluating such processes. In this paper, building on insights from the theory and practice of deliberative democracy, we provide a "Democracy Levels" framework for evaluating the degree to which decisions in a given domain are made democratically. The framework can be used (i) to define milestones in a roadmap for the democratic AI, pluralistic AI, and public AI ecosystems, (ii) to guide organizations that need to increase the legitimacy of their decisions on difficult AI governance questions, and (iii) as a rubric by those aiming to evaluate AI organizations and keep them accountable., Comment: 11 pages. Accepted to the Workshop on Pluralistic Alignment at NeurIPS 2024

Retrieval-augmented generation (RAG) has emerged as a promising approach to enhance the performance of large language models (LLMs) in knowledge-intensive tasks such as those from medical domain. However, the sensitive nature of the medical domain necessitates a completely accurate and trustworthy system. While existing RAG benchmarks primarily focus on the standard retrieve-answer setting, they overlook many practical scenarios that measure crucial aspects of a reliable medical system. This paper addresses this gap by providing a comprehensive evaluation framework for medical question-answering (QA) systems in a RAG setting for these situations, including sufficiency, integration, and robustness. We introduce Medical Retrieval-Augmented Generation Benchmark (MedRGB) that provides various supplementary elements to four medical QA datasets for testing LLMs' ability to handle these specific scenarios. Utilizing MedRGB, we conduct extensive evaluations of both state-of-the-art commercial LLMs and open-source models across multiple retrieval conditions. Our experimental results reveals current models' limited ability to handle noise and misinformation in the retrieved documents. We further analyze the LLMs' reasoning processes to provides valuable insights and future directions for developing RAG systems in this critical medical domain.

Audio-driven portrait animation has made significant advances with diffusion-based models, improving video quality and lipsync accuracy. However, the increasing complexity of these models has led to inefficiencies in training and inference, as well as constraints on video length and inter-frame continuity. In this paper, we propose JoyVASA, a diffusion-based method for generating facial dynamics and head motion in audio-driven facial animation. Specifically, in the first stage, we introduce a decoupled facial representation framework that separates dynamic facial expressions from static 3D facial representations. This decoupling allows the system to generate longer videos by combining any static 3D facial representation with dynamic motion sequences. Then, in the second stage, a diffusion transformer is trained to generate motion sequences directly from audio cues, independent of character identity. Finally, a generator trained in the first stage uses the 3D facial representation and the generated motion sequences as inputs to render high-quality animations. With the decoupled facial representation and the identity-independent motion generation process, JoyVASA extends beyond human portraits to animate animal faces seamlessly. The model is trained on a hybrid dataset of private Chinese and public English data, enabling multilingual support. Experimental results validate the effectiveness of our approach. Future work will focus on improving real-time performance and refining expression control, further expanding the applications in portrait animation. The code will be available at: https://jdhalgo.github.io/JoyVASA.

Multi-point vital sign monitoring is essential for providing detailed insights into physiological changes. Traditional single-sensor approaches are inadequate for capturing multi-point vibrations. Existing contact-based solutions, while addressing this need, can cause discomfort and skin allergies, whereas noncontact optical and acoustic methods are highly susceptible to light interference and environmental noise. In this paper, we aim to develop a non-contact, multi-point vital sign monitoring technique using MIMO radar, focused on physically differentiating and precisely measuring chest-wall surface vibrations at multiple points induced by cardiopulmonary mechanical activity. The primary challenges in developing such a technique involve developing algorithms to extract and separate entangled signals, as well as establishing a reliable method for validating detection accuracy. To address these limitations, we introduce MultiVital, a wireless system that leverages mmWave Multiple-input Multiple-output (MIMO) radar for synchronous multi-point vital sign monitoring. It integrates two reference modalities: five-channel seismocardiography (SCG) sensors and a one-channel electrocardiogram (ECG) electrode, enabling comprehensive radar-based research and performance validation across multiple physiological metrics. Additionally, we have developed a multi-modal signal processing framework, consisting of a radar signal processing module, an SCG calibration module, and a spatial alignment scheme. To evaluate the radar signal processing module, we conducted mathematical derivation and simulation. The experimental results indicate that the noncontact MultiVital system achieves multi-point synchronous monitoring with high precision, highly consistent with the results from reference modalities., Comment: 15 pages

In General Relativity, Birkhoff's theorem asserts that any spherically symmetric vacuum solution must be static and asymptotically flat. In this paper, we study the validity of Birkhoff's theorem for a broad class of modified gravity theories in four spacetime dimensions, including quadratic and higher-order gravity models. We demonstrate that the Schwarzschild spacetime remains the unique Einstein branch solution outside any spherically symmetric configuration of these theories. Consequently, unlike black holes, the breakdown of junction conditions at the surface of the star further implies that the actual spacetime metric outside a horizonless star in these modified theories cannot simultaneously be spherically symmetric and remain within the Einstein branch. This insight offers a unique observational probe for theories beyond General Relativity., Comment: 5 pages, no figure, comments are welcome!

In this paper, we consider an unconstrained (-1,1)-quadratic fractional optimization in the following form: $\min_{x\in\{-1,1\}^n}~(x^TAx+\alpha)/(x^TBx+\beta)$, where $A$ and $B$, given by their nonzero eigenvalues and associated eigenvectors, have ranks not exceeding fixed integers $r_a$ and $r_b$, respectively. We show that this problem can be solved in $O(n^{r_a+r_b+1}\log^2 n)$ by the accelerated Newton-Dinkelbach method when the matrices $A$ has nonpositive diagonal entries only, $B$ has nonnegative diagonal entries only. Furthermore, this problem can be solved in $O(n^{r_a+r_b+2}\log^2 n)$ when $A$ has $O(\log(n))$ positive diagonal entries, $B$ has $O(\log(n))$ negative diagonal entries., Comment: 13 pages, 1 figure

The present paper continues the work of [2]. For any symmetrizable generalized Cartan Matrix $C$ and the corresponding quantum group $\mathbf{U}$, we consider the associated quiver $Q$ with an admissible automorphism $a$. We construct the category $\widetilde{\mathcal{Q}/\mathcal{N}}$ of the localization of Lusztig sheaves for the quiver with the automorphism. Its Grothendieck group gives a realization of the integrable highest weight $\mathbf{U}-$module $\Lambda_{\lambda}$, and modulo the traceless ones Lusztig sheaves provide the (signed) canonical basis of $\Lambda_{\lambda}$. As an application, the symmetrizable crystal structures on Nakajima's quiver varieties and Lusztig's nilpotent varieties of preprojective algebras are deduced.

This paper builds upon an existing speech emotion recognition model by adding an additional LSTM layer to improve the accuracy and processing efficiency of emotion recognition from audio data. By capturing the long-term dependencies within audio sequences through a dual-layer LSTM network, the model can recognize and classify complex emotional patterns more accurately. Experiments conducted on the RAVDESS dataset validated this approach, showing that the modified dual layer LSTM model improves accuracy by 2% compared to the single-layer LSTM while significantly reducing recognition latency, thereby enhancing real-time performance. These results indicate that the dual-layer LSTM architecture is highly suitable for handling emotional features with long-term dependencies, providing a viable optimization for speech emotion recognition systems. This research provides a reference for practical applications in fields like intelligent customer service, sentiment analysis and human-computer interaction.

To balance the quality and inference cost of a Foundation Model (FM, such as large language models (LLMs)) powered software, people often opt to train a routing model that routes requests to FMs with different sizes and capabilities. Existing routing models rely on learning the optimal routing decision from carefully curated data, require complex computations to be updated, and do not consider the potential evolution of weaker FMs. In this paper, we propose Real-time Adaptive Routing (RAR), an approach to continuously adapt FM routing decisions while using guided in-context learning to enhance the capabilities of weaker FM. The goal is to reduce reliance on stronger, more expensive FMs. We evaluate our approach on different subsets of the popular MMLU benchmark. Over time, our approach routes 50.2% fewer requests to computationally expensive models while maintaining around 90.5% of the general response quality. In addition, the guides generated from stronger models have shown intra-domain generalization and led to a better quality of responses compared to an equivalent approach with a standalone weaker FM.

Bethe-Salpeter equation (BSE) in the self-consistent Hartree-Fock (HF) basis is often used for describing complex many-body effects in material science applications. Its exact solution on the real-frequency axis at finite temperature for polarization using the diagrammatic Monte Carlo method [Phys. Rev. B \textbf{109}, 045152, (2024)] captures effects of multiple Coulomb scattering of a single particle-hole excitation, but does not account for multiple pair excitations important for studying dielectric loses in metals at frequencies comparable to the plasmon mode. In this paper we report technical developments which allow one to efficiently compute the dielectric response in a wide frequency range from zero to a few Fermi energies without systematic bias at finite $T$. By applying it to the homogeneous electron gas we demonstrate how at small momenta the gap in the spectral density between the electron-hole and plasmon excitations, existing within the HF-BSE approach, is filled with two particle-hole excitations and is completely washed out already at temperature $T \sim \varepsilon_F/10$., Comment: 5 pages, 4 figures

In this paper, we introduce a novel method for active learning of deterministic real-time one-counter automata (DROCA). The existing techniques for learning DROCA rely on observing the behaviour of the DROCA up to exponentially large counter-values. Our algorithm eliminates this need and requires only a polynomial number of queries. Additionally, our method differs from existing techniques as we learn a minimal counter-synchronous DROCA, resulting in much smaller counter-examples on equivalence queries. Learning a minimal counter-synchronous DROCA cannot be done in polynomial time unless P = NP, even in the case of visibly one-counter automata. We use a SAT solver to overcome this difficulty. The solver is used to compute a minimal separating DFA from a given set of positive and negative samples. We prove that the equivalence of two counter-synchronous DROCAs can be checked significantly faster than that of general DROCAs. For visibly one-counter automata, we have discovered an even faster algorithm for equivalence checking. We implemented the proposed learning algorithm and tested it on randomly generated DROCAs. Our evaluations show that the proposed method outperforms the existing techniques on the test set.

As financial markets grow increasingly complex, there is a rising need for automated tools that can effectively assist human analysts in equity research, particularly within sell-side research. While Generative AI (GenAI) has attracted significant attention in this field, existing AI solutions often fall short due to their narrow focus on technical factors and limited capacity for discretionary judgment. These limitations hinder their ability to adapt to new data in real-time and accurately assess risks, which diminishes their practical value for investors. This paper presents FinRobot, the first AI agent framework specifically designed for equity research. FinRobot employs a multi-agent Chain of Thought (CoT) system, integrating both quantitative and qualitative analyses to emulate the comprehensive reasoning of a human analyst. The system is structured around three specialized agents: the Data-CoT Agent, which aggregates diverse data sources for robust financial integration; the Concept-CoT Agent, which mimics an analysts reasoning to generate actionable insights; and the Thesis-CoT Agent, which synthesizes these insights into a coherent investment thesis and report. FinRobot provides thorough company analysis supported by precise numerical data, industry-appropriate valuation metrics, and realistic risk assessments. Its dynamically updatable data pipeline ensures that research remains timely and relevant, adapting seamlessly to new financial information. Unlike existing automated research tools, such as CapitalCube and Wright Reports, FinRobot delivers insights comparable to those produced by major brokerage firms and fundamental research vendors. We open-source FinRobot at \url{https://github. com/AI4Finance-Foundation/FinRobot}., Comment: The 1st Workshop on LLMs and Generative AI for Finance, ICAIF 2024

Terwilliger algebras are finite-dimensional semisimple algebras that were first introduced by Paul Terwilliger in 1992 in studies of association schemes and distance-regular graphs. The Terwilliger algebras of the conjugacy class association schemes of the symmetric groups $\operatorname {sym}(n)$, for $3\leq n \leq 6$, have been studied and completely determined. The case for $\operatorname {sym}(7)$ is computationally much more difficult and has a potential application to find the size of the largest permutation codes of $\operatorname {sym}(7)$ with a minimal distance of at least $4$. In this paper, the dimension, the Wedderburn decomposition, and the block dimension decomposition of the Terwilliger algebra of the conjugacy class scheme of the group $\operatorname {sym}(7)$ are determined.

Steering vectors are a promising approach to control the behaviour of large language models. However, their underlying mechanisms remain poorly understood. While sparse autoencoders (SAEs) may offer a potential method to interpret steering vectors, recent findings show that SAE-reconstructed vectors often lack the steering properties of the original vectors. This paper investigates why directly applying SAEs to steering vectors yields misleading decompositions, identifying two reasons: (1) steering vectors fall outside the input distribution for which SAEs are designed, and (2) steering vectors can have meaningful negative projections in feature directions, which SAEs are not designed to accommodate. These limitations hinder the direct use of SAEs for interpreting steering vectors.

In broad terms, accessibility measures opportunities reachable (such as shops, residents, etc.) within a given time frame. Urban Rail Transit (URT) plays a crucial role in providing accessibility, but it is susceptible to disruptions. In city centers with dense public transport (PT) networks, travelers can often find alternative lines. However, in suburbs where PT is sparse, disruptions have a more significant impact on accessibility. The traditional approach consists in deploying bridge and replacement buses to mitigate URT disruptions without specific care to accessibility. Yet, the question arises: is this approach the most effective way to restore accessibility? To the best of our knowledge, our paper is the first to propose a bus re-routing method with the objective of restoring accessibility during URT disruptions. We formulate an integer program and develop a two-stage heuristic algorithm to maximize restored accessibility. The efficacy of our method is always the present assessed in \'Evry-Courcouronnes and Choisy-le-Roi, France. The results show that, compared to conventional replacement methods, our strategy improves accessibility in particular in the areas most affected by the disruption. Such results are observed even when no additional vehicles are deployed, and at the same time, achieving a reduction in the kilometers traveled. Despite it is well understood that accessibility is the most relevant benefit a transportation system can produce, this aspect is reflected by the traditional approaches in remediation to disruption. With this work, we show instead how to make accessibility the main guiding principle in remediation.

We define a natural notion of standard translation for the formulas of conditional logic which is analogous to the standard translation of modal formulas into the first-order logic. We briefly show that this translation works (modulo a lightweight first-order encoding of the conditional models) for the minimal classical conditional logic $\mathsf{CK}$ introduced by Brian Chellas; however, the main result of the paper is that a classically equivalent reformulation of these notions (i.e. of standard translation plus theory of conditional models) also faithfully embeds the basic Nelsonian conditional logic $\mathsf{N4CK}$, introduced in arXiv:2311.02361 into $\mathsf{QN4}$, the paraconsistent variant of Nelson's first-order logic of strong negation. Thus $\mathsf{N4CK}$ is the logic induced by the Nelsonian reading of the classical Chellas semantics of conditionals and can, therefore, be considered a faithful analogue of $\mathsf{CK}$ on the non-classical basis provided by the propositional fragment of $\mathsf{QN4}$. Moreover, the methods used to prove our main result can be easily adapted to the case of modal logic, which allows to improve an older result by S. Odintsov and H. Wansing about the standard translation embedding of the Nelsonian modal logic $\mathsf{FSK}^d$ into $\mathsf{QN4}$., Comment: 53 pages, 1 figure

Cryptographic agility is gaining attention due to its crucial role in maintaining cryptographic security in a rapidly evolving technological landscape. However, despite its increasing importance, the term cryptographic agility remains vaguely defined and there is no clear consensus on its exact meaning. This lack of clarity poses a challenge since the need for agility becomes more urgent as new cryptographic vulnerabilities and advanced computing threats emerge, emphasizing the need for a systematic approach to clarify and refine the notion on cryptographic agility. In this paper, we systematize the concept of cryptographic agility by providing three research contributions. First, we review current definitions across academic and gray literature, identifying six distinct categories to differentiate every aspect within the definitions. Second, we synthesize these insights to establish a comprehensive, canonical definition of cryptographic agility. Third, we explore the relationship between cryptographic agility and the related concepts cryptographic versatility and interoperability. In our discussion, we examine the relevance of cryptographic agility, highlight its trade-offs with complexity, assess its individual applicability, and illustrate its various contexts by offering an additional application-specific definition. Our work provides a new perspective on cryptographic agility and related concepts, based on systematical research to clarify and enhance its future use., Comment: 18 pages, 1 figure

In adaptive clinical trials, the conventional confidence interval (CI) for a treatment effect is prone to undesirable properties such as undercoverage and potential inconsistency with the final hypothesis testing decision. Accordingly, as is stated in recent regulatory guidance on adaptive designs, there is the need for caution in the interpretation of CIs constructed during and after an adaptive clinical trial. However, it may be unclear which of the available CIs in the literature are preferable. This paper is the second in a two-part series that explores CIs for adaptive trials. Part I provided a methodological review of approaches to construct CIs for adaptive designs. In this paper (part II), we present an extended case study based around a two-stage group sequential trial, including a comprehensive simulation study of the proposed CIs for this setting. This facilitates an expanded description of considerations around what makes for an effective CI procedure following an adaptive trial. We show that the CIs can have notably different properties. Finally, we propose a set of guidelines for researchers around the choice of CIs and the reporting of CIs following an adaptive design., Comment: 40 pages

The paper presents a Graph Attention Convolutional Network (GACN) for flow reconstruction from very sparse data in time-varying geometries. The model incorporates a feature propagation algorithm as a preprocessing step to handle extremely sparse inputs, leveraging information from neighboring nodes to initialize missing features. In addition, a binary indicator is introduced as a validity mask to distinguish between the original and propagated data points, enabling more effective learning from sparse inputs. Trained on a unique data set of Direct Numerical Simulations (DNS) of a motored engine at a technically relevant operating condition, the GACN shows robust performance across different resolutions and domain sizes and can effectively handle unstructured data and variable input sizes. The model is tested on previously unseen DNS data as well as on an experimental data set from Particle Image Velocimetry (PIV) measurements that were not considered during training. A comparative analysis shows that the GACN consistently outperforms both a conventional Convolutional Neural Network (CNN) and cubic interpolation methods on the DNS and PIV test sets by achieving lower reconstruction errors and better capturing fine-scale turbulent structures. In particular, the GACN effectively reconstructs flow fields from domains up to 14 times larger than those observed during training, with the performance advantage increasing for larger domains.

Video recordings of user activities, particularly desktop recordings, offer a rich source of data for understanding user behaviors and automating processes. However, despite advancements in Vision-Language Models (VLMs) and their increasing use in video analysis, extracting user actions from desktop recordings remains an underexplored area. This paper addresses this gap by proposing two novel VLM-based methods for user action extraction: the Direct Frame-Based Approach (DF), which inputs sampled frames directly into VLMs, and the Differential Frame-Based Approach (DiffF), which incorporates explicit frame differences detected via computer vision techniques. We evaluate these methods using a basic self-curated dataset and an advanced benchmark adapted from prior work. Our results show that the DF approach achieves an accuracy of 70% to 80% in identifying user actions, with the extracted action sequences being re-playable though Robotic Process Automation. We find that while VLMs show potential, incorporating explicit UI changes can degrade performance, making the DF approach more reliable. This work represents the first application of VLMs for extracting user action sequences from desktop recordings, contributing new methods, benchmarks, and insights for future research.

This paper extends the mathematical theory of axisymmetrization and vorticity depletion within the two-dimensional (2D) Euler equations, with an emphasis on the dynamics of radially symmetric, monotonic vorticity profiles. By analyzing inviscid damping, we establish new optimal decay rates for radial and angular velocity components in weighted Sobolev spaces, showing that vorticity depletion enhances damping effects beyond those observed in passive scalar dynamics. Our methodology involves the construction of advanced Greens functions and the use of spectral techniques to achieve precise asymptotic expansions, providing a comprehensive framework for analyzing long-term stability. These results mark the first rigorous confirmation of enhanced inviscid damping rates in axisymmetric vortices, substantially advancing the theoretical understanding of coherent vortex structures in high Reynolds number flows. This work has potential applications in fluid stability theory, turbulence modeling, and other fields that involve the study of inviscid flows., Comment: 22 pages

In this paper, we establish the existence of positive density collection of $d\in\mathbb{N}$ such that class numbers of $\mathbb{Q}(\sqrt{d}), \ \mathbb{Q}(\sqrt{d+1})\dots\mathbb{Q}(\sqrt{d+n})$ are not divisible by $3^k$ for $n=3^{k+1}-5$ for any $k\in\mathbb{N}$. This result constitutes the indivisibility counterpart of Iizuka's conjecture. For the same choice of $n$, we prove the existence of positive density collection of $d$, in the set of negative integers, such that the class numbers of $\mathbb{Q}(\sqrt{d}), \ \mathbb{Q}(\sqrt{d+1}),\dots,\mathbb{Q}(\sqrt{d+n})$ are not divisible by $3^{k+1}$. Further, we write the set of all square-free natural numbers as an increasing sequence $(d_n)$ and prove the existence of positive density collection of $i$ in the set of natural numbers such that the class numbers of the number fields $\mathbb{Q}(\sqrt{d_i}), \ \mathbb{Q}(\sqrt{d_{i+1}}),\ \mathbb{Q}(\sqrt{d_{i+2}}),$ $ \mathbb{Q}(\sqrt{d_{i+3}}),\dots, \mathbb{Q}(\sqrt{d_{i+n}})$ are not divisible by $3^k$ for $n=3^{k+1}-5$. For higher degree, we show that certain limit of the collection of imaginary bi-quadratic fields whose class number is not divisible by $3$ over all the imaginary biquadratic fields is positive.

The integration of Distributed Energy Resources (DERs) into power distribution systems has made microgrids foundational to grid modernization. These DERs, connected through power electronic inverters, create power electronics dominated grid architecture, introducing unique challenges for fault detection. While external line faults are widely studied, inverter faults remain a critical yet underexplored issue. This paper proposes various data mining techniques for the effective detection and localization of inverter faults-essential for preventing catastrophic grid failures. Furthermore, the difficulty of differentiating between system anomalies and internal inverter faults within Power Electronics-Driven Grids (PEDGs) is addressed. To enhance grid resilience, this work applies advanced artificial intelligence methods to distinguish anomalies from true internal faults, identifying the specific malfunctioning switch. The proposed FaultNet-ML methodology is validated on a 9-bus system dominated by inverters, illustrating its robustness in a PEDG environment., Comment: 5 pages, 2 figures, submitted to 2025 IEEE Power and Energy Society General Meeting (PESGM 2025), Austin, TX

In this paper, we investigate the performance of an integrated sensing and communication (ISAC) system within a cell-free massive multiple-input multiple-output (MIMO) system. Each access point (AP) operates in the millimeter-wave (mmWave) frequency band. The APs jointly serve the user equipments (UEs) in the downlink while simultaneously detecting a target through dedicated sensing beams, which are directed toward a reconfigurable intelligent surface (RIS). Although the AP-RIS, RIS-target, and AP-target channels have both line-of-sight (LoS) and non-line-of-sight (NLoS) parts, it is assumed only knowledge of the LoS paths is available. A key contribution of this study is the consideration of clutter, which degrades the target detection if not handled. We propose an algorithm to alternatively optimize the transmit power allocation and the RIS phase-shift matrix, maximizing the target signal-to-clutter-plus-noise ratio (SCNR) while ensuring a minimum signal-to-interference-plus-noise ratio (SINR) for the UEs. Numerical results demonstrate that exploiting clutter subspace significantly enhances detection probability, particularly at high clutter-to-noise ratios, and reveal that an increased number of transmit side clusters impair detection performance. Finally, we highlight the performance gains achieved using a dedicated sensing stream., Comment: submitted to IEEE ICC25

It is well known that Kleisli categories provide a natural language to model side effects. For instance, in the theory of coalgebras, behavioural equivalence coincides with language equivalence (instead of bisimilarity) when nondeterministic automata are modelled as coalgebras living in the Kleisli category of the powerset monad. In this paper, our aim is to establish decorated trace semantics based on language and ready equivalences for conditional transition systems (CTSs) with/without upgrades. To this end, we model CTSs as coalgebras living in the Kleisli category of a relative monad. Our results are twofold. First, we reduce the problem of defining a Kleisli lifting for the machine endofunctor in the context of a relative monad to the classical notion of Kleisli lifting. Second, we provide a recipe based on indexed categories to construct a Kleisli lifting for general endofunctors., Comment: 40th Conference on Mathematical Foundations of Programming Semantics (MFPS)

This paper investigates a numerical solution of Allen-Cahn equation with constant and degenerate mobility, with polynomial and logarithmic energy functionals, with deterministic and random initial functions, and with advective term in one, two, and three spatial dimensions, based on the physics-informed neural network (PINN). To improve the learning capacity of the PINN, we incorporate the energy dissipation property of the Allen-Cahn equation as a penalty term into the loss function of the network. To facilitate the learning process of random initials, we employ a continuous analogue of the initial random condition by utilizing the Fourier series expansion. Adaptive methods from traditional numerical analysis are also integrated to enhance the effectiveness of the proposed PINN. Numerical results indicate a consistent decrease in the discrete energy, while also revealing phenomena such as phase separation and metastability.

The widespread implementation of urban surveillance systems has necessitated more sophisticated techniques for anomaly detection to ensure enhanced public safety. This paper presents a significant advancement in the field of anomaly detection through the application of Two-Stream Inflated 3D (I3D) Convolutional Networks. These networks substantially outperform traditional 3D Convolutional Networks (C3D) by more effectively extracting spatial and temporal features from surveillance videos, thus improving the precision of anomaly detection. Our research advances the field by implementing a weakly supervised learning framework based on Multiple Instance Learning (MIL), which uniquely conceptualizes surveillance videos as collections of 'bags' that contain instances (video clips). Each instance is innovatively processed through a ranking mechanism that prioritizes clips based on their potential to display anomalies. This novel strategy not only enhances the accuracy and precision of anomaly detection but also significantly diminishes the dependency on extensive manual annotations. Moreover, through meticulous optimization of model settings, including the choice of optimizer, our approach not only establishes new benchmarks in the performance of anomaly detection systems but also offers a scalable and efficient solution for real-world surveillance applications. This paper contributes significantly to the field of computer vision by delivering a more adaptable, efficient, and context-aware anomaly detection system, which is poised to redefine practices in urban surveillance., Comment: 11 pages, 8 figures

This paper presents a step towards a formal controller design method for autonomous agents based on knowledge awareness to improve decision-making. Our approach is to first create an organized repository of information (a knowledge base) for autonomous agents which can be accessed and then translated into temporal specifications. Secondly, to develop a controller with formal guarantees that meets a combination of mission-specific objective and the specification from the knowledge base, we utilize an abstraction-based controller design (ABCD) approach, capable of managing both nonlinear dynamics and temporal requirements. Unlike the conventional offline ABCD approach, our method dynamically updates the controller whenever the knowledge base prompts changes in the specifications. A three-dimensional nonlinear car model navigating an urban road scenario with traffic signs and obstacles is considered for validation. Results show the effectiveness of the method in guiding the autonomous agents to the target while complying with the knowledge base and the mission-specific objective.

We have developed a new regression technique, the maximum likelihood (ML)-based method and its variant, the KS-test based method, designed to obtain unbiased regression results from typical astronomical data. A normalizing flow model is employed to automatically estimate the unobservable intrinsic distribution of the independent variable as well as the unobservable correlation between uncertainty level and intrinsic value of both independent and dependent variables from the observed data points in a variational inference based empirical Bayes approach. By incorporating these estimated distributions, our method comprehensively accounts for the uncertainties associated with both independent and dependent variables. Our test on both mock data and real astronomical data from PHANGS-ALMA and PHANGS-JWST demonstrates that both the ML based method and the KS-test based method significantly outperform the existing widely-used methods, particularly in cases of low signal-to-noise ratios. The KS-test based method exhibits remarkable robustness against deviations from underlying assumptions, complex intrinsic distributions, varying correlations between uncertainty levels and intrinsic values, inaccuracies in uncertainty estimations, outliers, and saturation effects. We recommend the KS-test based method as the preferred choice for general applications, while the ML based method is suggested for small samples with sizes of $N < 100$. A GPU-compatible Python implementation of our methods, nicknamed ``raddest'', will be made publicly available upon acceptance of this paper., Comment: 22 pages, 16 + 3 figures, 1 table; submitted to ApJ; comments welcome

A central question in multilingual language modeling is whether large language models (LLMs) develop a universal concept representation, disentangled from specific languages. In this paper, we address this question by analyzing latent representations (latents) during a word translation task in transformer-based LLMs. We strategically extract latents from a source translation prompt and insert them into the forward pass on a target translation prompt. By doing so, we find that the output language is encoded in the latent at an earlier layer than the concept to be translated. Building on this insight, we conduct two key experiments. First, we demonstrate that we can change the concept without changing the language and vice versa through activation patching alone. Second, we show that patching with the mean over latents across different languages does not impair and instead improves the models' performance in translating the concept. Our results provide evidence for the existence of language-agnostic concept representations within the investigated models., Comment: 12 pages, 10 figures, previously published under the title "How Do Llamas Process Multilingual Text? A Latent Exploration through Activation Patching" at the ICML 2024 mechanistic interpretability workshop https://openreview.net/forum?id=0ku2hIm4BS

Pulsar timing array experiments have recently found evidence for a stochastic gravitational wave (GW) background, which induces correlations among pulsar timing residuals described by the Hellings and Downs (HD) curve. Standard calculations of the HD correlation and its variance assume an isotropic background. However, for a background of astrophysical origin, we expect a higher GW spectral density in directions with higher galaxy number densities. In a companion paper, we have developed a theoretical formalism to account for the anisotropies arising from large-scale galaxy clustering, leading to a new contribution to the variance of the HD correlation. In this subsequent work, we provide numerical results for this novel effect. We consider a GW background resulting from mergers of supermassive black hole binaries, and relate the merger number density to the overdensity of galaxies. We find that anisotropies due to large-scale galaxy clustering lead to a standard deviation of the HD correlation at most at percent level, remaining well below the standard contributions to the HD variance. Hence, this kind of anisotropies in the GW source distribution does not represent a substantial contamination to the correlations of timing residuals in present and future PTA surveys. Suitable statistical methods to extract the galaxy clustering signal from PTA data will be investigated in the future., Comment: 20 pages, 6 figures

With the rise of Speech Large Language Models (Speech LLMs), there has been growing interest in discrete speech tokens for their ability to integrate with text-based tokens seamlessly. Compared to most studies that focus on continuous speech features, although discrete-token based LLMs have shown promising results on certain tasks, the performance gap between these two paradigms is rarely explored. In this paper, we present a fair and thorough comparison between discrete and continuous features across a variety of semantic-related tasks using a light-weight LLM (Qwen1.5-0.5B). Our findings reveal that continuous features generally outperform discrete tokens, particularly in tasks requiring fine-grained semantic understanding. Moreover, this study goes beyond surface-level comparison by identifying key factors behind the under-performance of discrete tokens, such as limited token granularity and inefficient information retention. To enhance the performance of discrete tokens, we explore potential aspects based on our analysis. We hope our results can offer new insights into the opportunities for advancing discrete speech tokens in Speech LLMs., Comment: 5 tables, 4 figures

We consider solutions of stochastic differential equations which diverge to infinity as the time parameter goes to infinity. If the coefficients converge as the spacial variable goes to infinity, then the solutions will get close to some Gaussian processes with positive drifts as the time parameter goes to infinity. In this paper, we prove Berry-Esseen type bounds for the solutions in this setting. In particular, we obtain bounds of the total variation distance between the law of the centered and scaled solutions of the stochastic differential equations and the standard normal distribution with an optimal rate of convergence in the time parameter. In the proof we apply the Malliavin-Stein method to estimate the total variation distance., Comment: 41 pages

As the application of large language models in various fields continues to expand, materials science also ushers in opportunities for AI-driven innovation. The traditional way of relying on manual search for materials science-related information is now using artificial intelligence technology as an auxiliary tool to improve the efficiency of materials science research. To accelerate researchers' knowledge acquisition and intelligent decision-making support in materials science research, this paper proposes a large language model Polymetis model for a variety of materials fields, aiming to provide highly professional knowledge answers in the field of materials, covering energy materials, functional materials, alloy materials, physical chemistry, biology, and other material directions. The model uses a dataset of about 2 million material knowledge instructions, and in the process of building the dataset, we developed the Intelligent Extraction Large Model (IELM), which is specially used to extract and form structured knowledge from scientific texts, avoiding a large number of costs that need to be manually annotated, and improving efficiency. We inject this data into the GLM4-9B model for learning to enhance its inference capabilities in a variety of material domains. In addition, we have introduced enhanced prompt strategies to ensure that the answers to the model are more organized and comprehensive, providing efficient and comprehensive intelligent support for the diverse needs of materials science exploration, and promoting the development of material science.

There are three kinds of multiple polylogarithms; complex, finite and symmetric. The dualities for the complex and finite cases are known. In this paper, we present proofs of them via iterated integrals and its symmetric counterpart by a similar method.

In this paper we find the first infinite family of hyperbolic 3-manifolds which admit tight contact structures but do not have any tight projectively Anosov flow. These manifolds are obtained as rational surgeries on the figure eight knot., Comment: 18 pages, 3 figures. Comments welcome!

The distinct characteristics of multiomics data, including complex interactions within and across biological layers and disease heterogeneity (e.g., heterogeneity in etiology and clinical symptoms), drive us to develop novel designs to address unique challenges in multiomics prediction. In this paper, we propose the multi-view knowledge transfer learning (MVKTrans) framework, which transfers intra- and inter-omics knowledge in an adaptive manner by reviewing data heterogeneity and suppressing bias transfer, thereby enhancing classification performance. Specifically, we design a graph contrastive module that is trained on unlabeled data to effectively learn and transfer the underlying intra-omics patterns to the supervised task. This unsupervised pretraining promotes learning general and unbiased representations for each modality, regardless of the downstream tasks. In light of the varying discriminative capacities of modalities across different diseases and/or samples, we introduce an adaptive and bi-directional cross-omics distillation module. This module automatically identifies richer modalities and facilitates dynamic knowledge transfer from more informative to less informative omics, thereby enabling a more robust and generalized integration. Extensive experiments on four real biomedical datasets demonstrate the superior performance and robustness of MVKTrans compared to the state-of-the-art. Code and data are available at https://github.com/Yaolab-fantastic/MVKTrans.

Most existing work on event extraction has focused on sentence-level texts and presumes the identification of a trigger-span -- a word or phrase in the input that evokes the occurrence of an event of interest. Event arguments are then extracted with respect to the trigger. Indeed, triggers are treated as integral to, and trigger detection as an essential component of, event extraction. In this paper, we provide the first investigation of the role of triggers for the more difficult and much less studied task of document-level event extraction. We analyze their usefulness in multiple end-to-end and pipelined neural event extraction models for three document-level event extraction datasets, measuring performance using triggers of varying quality (human-annotated, LLM-generated, keyword-based, and random). Our research shows that trigger effectiveness varies based on the extraction task's characteristics and data quality, with basic, automatically-generated triggers serving as a viable alternative to human-annotated ones. Furthermore, providing detailed event descriptions to the extraction model helps maintain robust performance even when trigger quality degrades. Perhaps surprisingly, we also find that the mere existence of trigger input, even random ones, is important for prompt-based LLM approaches to the task.

Several initiatives have been undertaken to conceptually model the domain of scholarly data using ontologies and to create respective Knowledge Graphs. Yet, the full potential seems unleashed, as automated means for automatic population of said ontologies are lacking, and respective initiatives from the Semantic Web community are not necessarily connected: we propose to make scholarly data more sustainably accessible by leveraging Wikidata's infrastructure and automating its population in a sustainable manner through LLMs by tapping into unstructured sources like conference Web sites and proceedings texts as well as already existing structured conference datasets. While an initial analysis shows that Semantic Web conferences are only minimally represented in Wikidata, we argue that our methodology can help to populate, evolve and maintain scholarly data as a community within Wikidata. Our main contributions include (a) an analysis of ontologies for representing scholarly data to identify gaps and relevant entities/properties in Wikidata, (b) semi-automated extraction -- requiring (minimal) manual validation -- of conference metadata (e.g., acceptance rates, organizer roles, programme committee members, best paper awards, keynotes, and sponsors) from websites and proceedings texts using LLMs. Finally, we discuss (c) extensions to visualization tools in the Wikidata context for data exploration of the generated scholarly data. Our study focuses on data from 105 Semantic Web-related conferences and extends/adds more than 6000 entities in Wikidata. It is important to note that the method can be more generally applicable beyond Semantic Web-related conferences for enhancing Wikidata's utility as a comprehensive scholarly resource. Source Repository: https://github.com/scholarly-wikidata/ DOI: https://doi.org/10.5281/zenodo.10989709 License: Creative Commons CC0 (Data), MIT (Code), Comment: 17 pages, accepted at EKAW-24

Traditional phase I dose finding cancer clinical trial designs aim to determine the maximum tolerated dose (MTD) of the investigational cytotoxic agent based on a single toxicity outcome, assuming a monotone dose-response relationship. However, this assumption might not always hold for newly emerging therapies such as immuno-oncology therapies and molecularly targeted therapies, making conventional dose finding trial designs based on toxicity no longer appropriate. To tackle this issue, numerous early phase dose finding clinical trial designs have been developed to identify the optimal biological dose (OBD), which takes both toxicity and efficacy outcomes into account. In this article, we review the current model-assisted dose finding designs, BOIN-ET, BOIN12, UBI, TEPI-2, PRINTE, STEIN, and uTPI to identify the OBD and compare their operating characteristics. Extensive simulation studies and a case study using a CAR T-cell therapy phase I trial have been conducted to compare the performance of the aforementioned designs under different possible dose-response relationship scenarios. The simulation results demonstrate that the performance of different designs varies depending on the particular dose-response relationship and the specific metric considered. Based on our simulation results and practical considerations, STEIN, PRINTE, and BOIN12 outperform the other designs from different perspectives., Comment: This paper was recently accepted by the Journal of Biopharmaceutical Statistics in October 2024 and is currently undergoing proofing. The DOI for this paper is 10.1080/10543406.2024.2424845

Personalized Federated Learning is essential in AI-driven ubiquitous systems, supporting the distributed development of models able to adapt to diverse and evolving user behaviors while safeguarding privacy. Despite addressing heterogeneous user data distributions in collaborative model training, existing methods often face limitations balancing personalization and generalization, oversimplifying user similarities, or relying heavily on global models. In this paper, we propose FedSub, a novel federated approach designed to enhance personalization through the use of class-aware prototypes and model subnetworks. Prototypes serve as compact representations of user data, clustered on the server to identify similarities based on specific label patterns. Concurrently, subnetworks -- model components necessary to process each class -- are extracted locally and fused by the server according to these clusters, producing highly tailored model updates for each user. This fine-grained, class-specific aggregation of clients' models allows FedSub to capture the unique characteristics of individual user data patterns. The effectiveness of FedSub is validated in three real-world scenarios characterized by high data heterogeneity, derived from human activity recognition and mobile health applications. Experimental evaluations demonstrate FedSub's performance improvements with respect to the state-of-the-art and significant advancements in personalization for ubiquitous systems based on personal mobile and wearable devices., Comment: Submitted to Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)

We propose an approach to analogical inference that marries the neuro-symbolic computational power of complex-sampled hyperdimensional computing (HDC) with Conceptual Spaces Theory (CST), a promising theory of semantic meaning. CST sketches, at an abstract level, approaches to analogical inference that go beyond the standard predicate-based structure mapping theories. But it does not describe how such an approach can be operationalized. We propose a concrete HDC-based architecture that computes several types of analogy classified by CST. We present preliminary proof-of-concept experimental results within a toy domain and describe how it can perform category-based and property-based analogical reasoning., Comment: Analogy-angle workshop full paper at IJCAI 2024