Search

In this paper, we present a novel transformer-based architecture for end-to-end image compression. Our architecture incorporates blocks that effectively capture local dependencies between tokens, eliminating the need for positional encoding by integrating convolutional operations within the multi-head attention mechanism. We demonstrate through experiments that our proposed framework surpasses state-of-the-art CNN-based architectures in terms of the trade-off between bit-rate and distortion and achieves comparable results to transformer-based methods while maintaining lower computational complexity., Comment: Published in: IEEE Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA) 2023 Poznan, Poland

Optical Character Recognition (OCR) continues to face accuracy challenges that impact subsequent applications. To address these errors, we explore the utility of OCR confidence scores for enhancing post-OCR error detection. Our study involves analyzing the correlation between confidence scores and error rates across different OCR systems. We develop ConfBERT, a BERT-based model that incorporates OCR confidence scores into token embeddings and offers an optional pre-training phase for noise adjustment. Our experimental results demonstrate that integrating OCR confidence scores can enhance error detection capabilities. This work underscores the importance of OCR confidence scores in improving detection accuracy and reveals substantial disparities in performance between commercial and open-source OCR technologies.

Orbital angular momentum (OAM) in electromagnetic (EM) waves can significantly enhance spectrum efficiency in wireless communications without requiring additional power, time, or frequency resources. Different OAM modes in EM waves create orthogonal channels, thereby improving spectrum efficiency. Additionally, OAM waves can more easily maintain orthogonality in line-of-sight (LOS) transmissions, offering an advantage over multiple-input and multiple-output (MIMO) technology in LOS scenarios. However, challenges such as divergence and crosstalk hinder OAM's efficiency. Additionally, channel modeling for OAM transmissions is still limited. A reliable channel model with balanced accuracy and complexity is essential for further system analysis. In this paper, we present a quasi-deterministic channel model for OAM channels in the 5.8 GHz and 28 GHz bands based on measurement data. Accurate measurement, especially at high frequencies like millimeter bands, requires synchronized RF channels to maintain phase coherence and purity, which is a major challenge for OAM channel measurement. To address this, we developed an 8-channel OAM generation device at 28 GHz to ensure beam integrity. By measuring and modeling OAM channels at 5.8 GHz and 28 GHz with a modified 3D geometric-based stochastic model (GBSM), this study provides insights into OAM channel characteristics, aiding simulation-based analysis and system optimization., Comment: 13 pages, 13 figures, submitted to IEEE Transactions on Wireless Communications (TWC)

Author profiling is the task of inferring characteristics about individuals by analyzing content they share. Supervised machine learning still dominates automatic systems that perform this task, despite the popularity of prompting large language models to address natural language understanding tasks. One reason is that the classification instances consist of large amounts of posts, potentially a whole user profile, which may exceed the input length of Transformers. Even if a model can use a large context window, the entirety of posts makes the application of API-accessed black box systems costly and slow, next to issues which come with such "needle-in-the-haystack" tasks. To mitigate this limitation, we propose a new method for author profiling which aims at distinguishing relevant from irrelevant content first, followed by the actual user profiling only with relevant data. To circumvent the need for relevance-annotated data, we optimize this relevance filter via reinforcement learning with a reward function that utilizes the zero-shot capabilities of large language models. We evaluate our method for Big Five personality trait prediction on two Twitter corpora. On publicly available real-world data with a skewed label distribution, our method shows similar efficacy to using all posts in a user profile, but with a substantially shorter context. An evaluation on a version of these data balanced with artificial posts shows that the filtering to relevant posts leads to a significantly improved accuracy of the predictions., Comment: preprint, under review, supplementary material will be made available upon acceptance of the paper

The recent discovery of a superconductivity signature in La3Ni2O7-{\delta} under a pressure of 14 GPa, with a superconducting transition temperature of around 80 K, has attracted considerable attention. An important aspect of investigating electronic structures is discerning the extent to which the electronic ground state of La3Ni2O7-{\delta} resembles the parent state of the cuprate superconductor, a charge transfer insulator with long-range antiferromagnetism. Through X-ray absorption spectroscopy, we have uncovered the crucial influence of oxygen ligands on the electronic ground states of the Ni ions, displaying a charge transfer nature akin to cuprate but with distinct orbital configurations. Both in-plane and out-of-plane Zhang-Rice singlets associated with Ni d_(x^2-y^2 ) and d_(z^2) orbitals are identified, together with a strong interlayer coupling through inner apical oxygen. Additionally, in La3Ni2O7-{\delta} films, we have detected a superlattice reflection (1/4, 1/4, L) at the Ni L absorption edge using resonant X-ray scattering measurements. Further examination of the resonance profile indicates that the reflection originates from the Ni d orbitals. By evaluating the reflection's azimuthal angle dependence, we have confirmed the presence of collinear antiferromagnetic spin ordering and charge-like anisotropy ordered with the same periodicity. Notably, our findings reveal a microscopic relationship between these two components in the temperature dependence of the scattering intensity of the reflection. This investigation enriches our understanding of high-temperature superconductivity in La3Ni2O7-{\delta} under high pressure.

Machine vision systems, which can efficiently manage extensive visual perception tasks, are becoming increasingly popular in industrial production and daily life. Due to the challenge of simultaneously obtaining accurate depth and texture information with a single sensor, multimodal data captured by cameras and LiDAR is commonly used to enhance performance. Additionally, cloud-edge cooperation has emerged as a novel computing approach to improve user experience and ensure data security in machine vision systems. This paper proposes a pioneering solution to address the feature compression problem in multimodal 3D object detection. Given a sparse tensor-based object detection network at the edge device, we introduce two modes to accommodate different application requirements: Transmission-Friendly Feature Compression (T-FFC) and Accuracy-Friendly Feature Compression (A-FFC). In T-FFC mode, only the output of the last layer of the network's backbone is transmitted from the edge device. The received feature is processed at the cloud device through a channel expansion module and two spatial upsampling modules to generate multi-scale features. In A-FFC mode, we expand upon the T-FFC mode by transmitting two additional types of features. These added features enable the cloud device to generate more accurate multi-scale features. Experimental results on the KITTI dataset using the VirConv-L detection network showed that T-FFC was able to compress the features by a factor of 6061 with less than a 3% reduction in detection performance. On the other hand, A-FFC compressed the features by a factor of about 901 with almost no degradation in detection performance. We also designed optional residual extraction and 3D object reconstruction modules to facilitate the reconstruction of detected objects. The reconstructed objects effectively reflected details of the original objects.

Deep sequence models are receiving significant interest in current machine learning research. By representing probability distributions that are fit to data using maximum likelihood estimation, such models can model data on general observation spaces (both continuous and discrete-valued). Furthermore, they can be applied to a wide range of modelling problems, including modelling of dynamical systems which are subject to control. The problem of learning data-driven models of systems subject to control is well studied in the field of system identification. In particular, there exist theoretical convergence and consistency results which can be used to analyze model behaviour and guide model development. However, these results typically concern models which provide point predictions of continuous-valued variables. Motivated by this, we derive convergence and consistency results for a class of nonlinear probabilistic models defined on a general observation space. The results rely on stability and regularity assumptions, and can be used to derive consistency conditions and bias expressions for nonlinear probabilistic models of systems under control. We illustrate the results on examples from linear system identification and Markov chains on finite state spaces., Comment: 9 pages, no figures. To be presented at the 63rd IEEE Conference on Decision and Control

Kepler's thinking is highly original and the inspiration for discovering his famous third law is based on his rather curious geometric approach in his Harmonices mundi for explaining consonances. In this article we try to use a modern mathematical approach based on Kepler's ideas how to characterize the seven consonances with the help of the numbers of edges of polygons constructible by ruler and compass., Comment: 12 pages

Recent advancements in large language models (LLMs) have sparked optimism about their potential to accelerate scientific discovery, with a growing number of works proposing research agents that autonomously generate and validate new ideas. Despite this, no evaluations have shown that LLM systems can take the very first step of producing novel, expert-level ideas, let alone perform the entire research process. We address this by establishing an experimental design that evaluates research idea generation while controlling for confounders and performs the first head-to-head comparison between expert NLP researchers and an LLM ideation agent. By recruiting over 100 NLP researchers to write novel ideas and blind reviews of both LLM and human ideas, we obtain the first statistically significant conclusion on current LLM capabilities for research ideation: we find LLM-generated ideas are judged as more novel (p < 0.05) than human expert ideas while being judged slightly weaker on feasibility. Studying our agent baselines closely, we identify open problems in building and evaluating research agents, including failures of LLM self-evaluation and their lack of diversity in generation. Finally, we acknowledge that human judgements of novelty can be difficult, even by experts, and propose an end-to-end study design which recruits researchers to execute these ideas into full projects, enabling us to study whether these novelty and feasibility judgements result in meaningful differences in research outcome., Comment: main paper is 20 pages

Large language models (LLMs) have significantly improved code generation, particularly in one-pass code generation. However, most existing approaches focus solely on generating code in a single programming language, overlooking the potential of leveraging the multi-language capabilities of LLMs. LLMs have varying patterns of errors across different languages, suggesting that a more robust approach could be developed by leveraging these multi-language outputs. In this study, we propose Multi-Programming Language Ensemble (MPLE), a novel ensemble-based method that utilizes code generation across multiple programming languages to enhance overall performance. By treating each language-specific code generation process as an individual "weak expert" and effectively integrating their outputs, our method mitigates language-specific errors and biases. This multi-language ensemble strategy leverages the complementary strengths of different programming languages, enabling the model to produce more accurate and robust code. Our approach can be seamlessly integrated with commonly used techniques such as the reflection algorithm and Monte Carlo tree search to improve code generation quality further. Experimental results show that our framework consistently enhances baseline performance by up to 17.92% on existing benchmarks (HumanEval and HumanEval-plus), with a standout result of 96.25% accuracy on the HumanEval benchmark, achieving new state-of-the-art results across various LLM models. The code will be released at https://github.com/NinjaTech-AI/MPLE, Comment: Code available at https://github.com/NinjaTech-AI/MPLE

This paper formulates adaptive controller design as a minimax dual control problem. The objective is to design a controller that minimizes the worst-case performance over a set of uncertain systems. The uncertainty is described by a set of linear time-invariant systems with unknown parameters. The main contribution is a common framework for both state feedback and output feedback control. We show that for finite uncertainty sets, the minimax dual control problem admits a finite-dimensional information state. This information state can be used to design adaptive controllers that ensure that the closed-loop has finite gain. The controllers are derived from a set of Bellman inequalities that are amenable to numerical solutions. The proposed framework is illustrated on a challenging numerical example., Comment: 38 pages, 9 figures, included in the first author's PhD Thesis. Code: https://github.com/kjellqvist/MinimaxAdaptiveControl.jl

We present an explicit Bethe-ansatz wavefunction to a 1D spin-$\frac{1}{2}$ interacting fermion system, manifesting a many-body resonance resulting from the interplay between interaction and non-Hermitian spin-orbit coupling. In the dilute limit, the wavefunction is greatly simplified and then factorized into Slater determinants and a Jastrow factor. An effective thermodynamic distribution is constructed with an effective Hamiltonian including a repulsion resulting from Pauli's exclusion principle and a distinctive zigzag potential arising from the resonance. The competition between these effects leads to a transition from a uniformly distributed configuration to a phase separation. The connection to the recent cold atom experimental efforts of realizing on-site atom-loss is discussed., Comment: 6+4 pages, 2+2 figures

In this paper, we extend the framework of quantitative information flow (QIF) to include adversaries that use Kolmogorov-Nagumo $f$-mean to infer secrets of a private system. Specifically, in our setting, an adversary uses Kolmogorov-Nagumo $f$-mean to compute its best actions before and after observing the system's randomized outputs. This leads to generalized notions of prior and posterior vulnerability and generalized axiomatic relations that we will derive to elucidate how these $f$-mean based vulnerabilities interact with each other. We demonstrate usefulness of this framework by showing how some notions of leakage that had been derived outside of the QIF framework and so far seemed incompatible with it are indeed explainable via such extension of QIF. These leakage measures include $\alpha$-leakage, which is the same as Arimoto mutual information of order $\alpha$, maximal $\alpha$-leakage which is the $\alpha$-leakage capacity, and $(\alpha,\beta)$ leakage, which is a generalization of the above and captures local differential privacy as a special case. We also propose a new pointwise notion of gain function, which we coin pointwise information gain. We show that this pointwise information gain can explain R\'eyni divergence and Sibson mutual information of order $\alpha \in [0,\infty]$ as the Kolmogorov-Nagumo average of the gain with a proper choice of function $f$.

Knowledge Graph Completion has been increasingly adopted as a useful method for several tasks in biomedical research, like drug repurposing or drug-target identification. To that end, a variety of datasets and Knowledge Graph Embedding models has been proposed over the years. However, little is known about the properties that render a dataset useful for a given task and, even though theoretical properties of Knowledge Graph Embedding models are well understood, their practical utility in this field remains controversial. We conduct a comprehensive investigation into the topological properties of publicly available biomedical Knowledge Graphs and establish links to the accuracy observed in real-world applications. By releasing all model predictions and a new suite of analysis tools we invite the community to build upon our work and continue improving the understanding of these crucial applications.

Perturbation-based post-hoc image explanation methods are commonly used to explain image prediction models by perturbing parts of the input to measure how those parts affect the output. Due to the intractability of perturbing each pixel individually, images are typically attributed to larger segments. The Randomized Input Sampling for Explanations (RISE) method solved this issue by using smooth perturbation masks. While this method has proven effective and popular, it has not been investigated which parts of the method are responsible for its success. This work tests many combinations of mask sampling, segmentation techniques, smoothing, and attribution calculation. The results show that the RISE-style pixel attribution is beneficial to all evaluated methods. Furthermore, it is shown that attribution calculation is the least impactful parameter. The implementation of this work is available online: https://github.com/guspih/post-hoc-image-perturbation., Comment: This manuscript have been submitted to NLDL 2025

Vertical federated learning is a natural and elegant approach to integrate multi-view data vertically partitioned across devices (clients) while preserving their privacies. Apart from the model training, existing methods requires the collaboration of all clients in the model inference. However, the model inference is probably maintained for service in a long time, while the collaboration, especially when the clients belong to different organizations, is unpredictable in real-world scenarios, such as concellation of contract, network unavailablity, etc., resulting in the failure of them. To address this issue, we, at the first attempt, propose a flexible Active-Passive Federated learning (APFed) framework. Specifically, the active client is the initiator of a learning task and responsible to build the complete model, while the passive clients only serve as assistants. Once the model built, the active client can make inference independently. In addition, we instance the APFed framework into two classification methods with employing the reconstruction loss and the contrastive loss on passive clients, respectively. Meanwhile, the two methods are tested in a set of experiments and achieves desired results, validating their effectiveness.

The last decade has witnessed a number of important and exciting developments that had been achieved for improving recurrence plot based data analysis and to widen its application potential. We will give a brief overview about important and innovative developments, such as computational improvements, alternative recurrence definitions (event-like, multiscale, heterogeneous, and spatio-temporal recurrences) and ideas for parameter selection, theoretical considerations of recurrence quantification measures, new recurrence quantifiers (e.g., for transition detection and causality detection), and correction schemes. New perspectives have recently been opened by combining recurrence plots with machine learning. We finally show open questions and perspectives for futures directions of methodical research., Comment: 34 pages, 14 figures, 1 table

Estimation of the proportion of null hypotheses in a multiple testing problem can greatly enhance the performance of the existing algorithms. Although various estimators for the proportion of null hypotheses have been proposed, most are designed for independent samples, and their effectiveness in dependent scenarios is not well explored. This article investigates the asymptotic behavior of the BH estimator and evaluates its performance across different types of dependence. Additionally, we assess Storey's estimator and another estimator proposed by Patra and Sen (2016) to understand their effectiveness in these settings.

Graph signals are functions of the underlying graph. When the edge-weight between a pair of nodes is high, the corresponding signals generally have a higher correlation. As a result, the signals can be represented in terms of a graph-based generative model. The question then arises whether measurements can be obtained on a few nodes and whether the correlation structure between the signals can be used to reconstruct the graph signal on the remaining nodes. We show that node subsampling is always possible for graph signals obtained through a generative model. Further, a method to determine the number of nodes to select is proposed based on the tolerable error. A correlation-based fast greedy algorithm is developed for selecting the nodes. Finally, we verify the proposed method on different deterministic and random graphs, and show that near-perfect reconstruction is possible with node subsampling.

Recent advances in deep learning (DL) have significantly impacted motor imagery (MI)-based brain-computer interface (BCI) systems, enhancing the decoding of electroencephalography (EEG) signals. However, most studies struggle to identify discriminative patterns across subjects during MI tasks, limiting MI classification performance. In this article, we propose MixNet, a novel classification framework designed to overcome this limitation by utilizing spectral-spatial signals from MI data, along with a multitask learning architecture named MIN2Net, for classification. Here, the spectral-spatial signals are generated using the filter-bank common spatial patterns (FBCSPs) method on MI data. Since the multitask learning architecture is used for the classification task, the learning in each task may exhibit different generalization rates and potential overfitting across tasks. To address this issue, we implement adaptive gradient blending, simultaneously regulating multiple loss weights and adjusting the learning pace for each task based on its generalization/overfitting tendencies. Experimental results on six benchmark data sets of different data sizes demonstrate that MixNet consistently outperforms all state-of-the-art algorithms in subject-dependent and -independent settings. Finally, the low-density EEG MI classification results show that MixNet outperforms all state-of-the-art algorithms, offering promising implications for Internet of Thing (IoT) applications, such as lightweight and portable EEG wearable devices based on low-density montages., Comment: Supplementary materials and source codes are available on-line at https://github.com/Max-Phairot-A/MixNet

An array of the kaon twist-two, three, four generalised transverse momentum dependent parton distributions (GTMDs) has been investigated within the framework of covariant and confining Dyson-Schwinger equations using contact interaction. GTMDs are of great significance as they encompass information regarding both the generalised parton distributions (GPDs) and the transverse momentum dependent parton distributions (TMDs), thus being considered as the parent distribution. From GTMDs, we can derive the twist-two, three, four GPDs and TMDs. GPDs are obtained through the integration of $\bm{k}_{\perp}$ from GTMDs, with a focus on the twist-two GPDs. The first Mellin moments of GPDs yield the form factors of local currents. The second Mellin moments of vector GPDs are related to gravitational form factors. The Wigner distribution can be obtained from a Fourier transform in the transverse space of the GTMDs at skewedness parameter $\xi=0$. The Wigner distributions of an unpolarized, longitudinally polarized, and transversely polarized quark inside the kaon have been calculated. The spin-orbit correlations between a hadron and a quark can be explained based on the phase-space average of Wigner distributions. We investigate the correlation between the longitudinal spin and orbital angular momentum of valence quarks within the pion and kaon. Our findings reveal that $C_z^{u,K}=-0.336$, $C_z^{s,K}=0.242$, and $C_z^{u,\pi}=-0.374$. The parton distribution function in impact parameter space can be derived from the Wigner distribution. The study focuses on the light-front transverse-spin distributions $\rho_u^1\left(\bm{b}_{\bot },\bm{s}_{\perp}\right)$ and $\rho_u^2\left(\bm{b}_{\bot },\bm{s}_{\perp}\right)$, which exhibit distortions, and we calculate their average shift., Comment: 51pages, 58 figures

Generative AI (genAI) tools, such as ChatGPT or Copilot, are advertised to improve developer productivity and are being integrated into software development. However, misaligned trust, skepticism, and usability concerns can impede the adoption of such tools. Research also indicates that AI can be exclusionary, failing to support diverse users adequately. One such aspect of diversity is cognitive diversity -- variations in users' cognitive styles -- that leads to divergence in perspectives and interaction styles. When an individual's cognitive style is unsupported, it creates barriers to technology adoption. Therefore, to understand how to effectively integrate genAI tools into software development, it is first important to model what factors affect developers' trust and intentions to adopt genAI tools in practice? We developed a theoretical model to (1) identify factors that influence developers' trust in genAI tools and (2) examine the relationship between developers' trust, cognitive styles, and their intentions to use these tools. We surveyed software developers (N=238) at two major global tech organizations and employed Partial Least Squares-Structural Equation Modeling (PLS-SEM) to evaluate our model. Our findings reveal that genAI's system/output quality, functional value, and goal maintenance significantly influence developers' trust in these tools. Furthermore, developers' trust and cognitive styles influence their intentions to use these tools. We offer practical suggestions for designing genAI tools for effective use and inclusive user experience.

The recent suggestion of valence-skipping phenomenon driving a two-gap superconductivity in $Ag$-doped SnSe, by Kataria, \textit{et al.} [Phys. Rev. B 107, 174517 (2023)], has brought to the fore a long-standing issue once again. The absence of crystallographically inequivalent Sn cites corroborated by electronic properties of AgSnSe$_2$, calculated using first-principles density functional theory, however, does not appear to provide a strong support in favor of valence-skipping in this system. Interestingly, the signature of avoided band-crossings (with the inclusion of SOC) and non-zero \textit{mirror} Chern number ($n_{\mathcal{M}}$) confirm a non-trivial topology. The presence of mirror symmetry-protected surface states along the mirror planes indicates that AgSnSe$_2$ could be a potential candidate for topological crystalline insulators (TCIs). Moreover, our calculation of electron-phonon coupling and anisotropic superconducting properties of AgSnSe$_2$, using Migdal-Eliashberg theory, gives a single-gap superconductivity with critical temperature $T_c \approx 7$K, consistent with the experimental value of $5$K. The interplay of topology and superconductivity in this three-dimensional material appears quite intriguing and it may provide new insights into the exploration of superconductivity and topology., Comment: 9 pages including references, and 7 figures

Imbalanced data are frequently encountered in real-world classification tasks. Previous works on imbalanced learning mostly focused on learning with a minority class of few samples. However, the notion of imbalance also applies to cases where the minority class contains abundant samples, which is usually the case for industrial applications like fraud detection in the area of financial risk management. In this paper, we take a population-level approach to imbalanced learning by proposing a new formulation called \emph{ultra-imbalanced classification} (UIC). Under UIC, loss functions behave differently even if infinite amount of training samples are available. To understand the intrinsic difficulty of UIC problems, we borrow ideas from information theory and establish a framework to compare different loss functions through the lens of statistical information. A novel learning objective termed Tunable Boosting Loss is developed which is provably resistant against data imbalance under UIC, as well as being empirically efficient verified by extensive experimental studies on both public and industrial datasets.

This paper introduces CryptoAnalytics, a software toolkit for cryptocoins price forecasting with machine learning (ML) techniques. Cryptocoins are tradable digital assets exchanged for specific trading prices. While history has shown the extreme volatility of such trading prices, the ability to efficiently model and forecast the time series resulting from the exchange price volatility remains an open research challenge. Good results can been achieved with state-of-the-art ML techniques, including Gradient-Boosting Machines (GBMs) and Recurrent Neural Networks (RNNs). CryptoAnalytics is a software toolkit to easily train these models and make inference on up-to-date cryptocoin trading price data, with facilities to fetch datasets from one of the main leading aggregator websites, i.e., CoinMarketCap, train models and infer the future trends. This software is implemented in Python. It relies on PyTorch for the implementation of RNNs (LSTM and GRU), while for GBMs, it leverages on XgBoost, LightGBM and CatBoost.

We establish general non-uniqueness results for normalized ground states of nonlinear Schr\"odinger equations with power nonlinearity on metric graphs. Basically, we show that, whenever in the $L^2$-subcritical regime a graph hosts ground states at every mass, for nonlinearity powers close to the $L^2$-critical exponent $p=6$ there is at least one value of the mass for which ground states are non-unique. As a consequence, we also show that, for all such graphs and nonlinearities, there exist action ground states that are not normalized ground states., Comment: 28 pages, 4 figures

The function $p_{xy}$ that interchanges two logical variables $x,y$ in formulas is hard to describe in the following sense. Let $F$ denote the Lindenbaum-Tarski formula-algebra of a finite-variable first order logic, endowed with $p_{xy}$ as a unary function. Each equational axiom system for the equational theory of $F$ has to contain, for each finite $n$, an equation that contains together with $p_{xy}$ at least $n$ algebraic variables, and each of the operations $\exists, =, \lor$. This solves a problem raised by Johnson [J. Symb. Logic] more than 50 years ago: the class of representable polyadic equality algebras of a finite dimension $n\ge 3$ cannot be axiomatized by adding finitely many equations to the equational theory of representable cylindric algebras of dimension $n$. Consequences for proof systems of finite-variable logic and for defining equations of polyadic equality algebras are given.

In [Ammari et al., SIAM J Math Anal., 52 (2020), pp. 5441--5466], the first author with collaborators proved the existence of Dirac dispersion cones at subwavelength scales in bubbly honeycomb phononic crystals. In this paper, we study the time-evolution of wave packets that are spectrally concentrated near such conical points. We prove that the wave packets dynamics is governed by a time-dependent effective Dirac system, which still depends, but in a simple way, on the subwavelength scale., Comment: Comments are welcome

Currently, vision encoder models like Vision Transformers (ViTs) typically excel at image recognition tasks but cannot simultaneously support text recognition like human visual recognition. To address this limitation, we propose UNIT, a novel training framework aimed at UNifying Image and Text recognition within a single model. Starting with a vision encoder pre-trained with image recognition tasks, UNIT introduces a lightweight language decoder for predicting text outputs and a lightweight vision decoder to prevent catastrophic forgetting of the original image encoding capabilities. The training process comprises two stages: intra-scale pretraining and inter-scale finetuning. During intra-scale pretraining, UNIT learns unified representations from multi-scale inputs, where images and documents are at their commonly used resolution, to enable fundamental recognition capability. In the inter-scale finetuning stage, the model introduces scale-exchanged data, featuring images and documents at resolutions different from the most commonly used ones, to enhance its scale robustness. Notably, UNIT retains the original vision encoder architecture, making it cost-free in terms of inference and deployment. Experiments across multiple benchmarks confirm that our method significantly outperforms existing methods on document-related tasks (e.g., OCR and DocQA) while maintaining the performances on natural images, demonstrating its ability to substantially enhance text recognition without compromising its core image recognition capabilities.

Directed graphical models such as Bayesian nets are often used to implement intelligent tutoring systems able to interact in real-time with learners in a purely automatic way. When coping with such models, keeping a bound on the number of parameters might be important for multiple reasons. First, as these models are typically based on expert knowledge, a huge number of parameters to elicit might discourage practitioners from adopting them. Moreover, the number of model parameters affects the complexity of the inferences, while a fast computation of the queries is needed for real-time feedback. We advocate logical gates with uncertainty for a compact parametrization of the conditional probability tables in the underlying Bayesian net used by tutoring systems. We discuss the semantics of the model parameters to elicit and the assumptions required to apply such approach in this domain. We also derive a dedicated inference scheme to speed up computations.

This paper explores the sensitivity gains afforded by spin-squeezed states in atom interferometry, in particular using Bragg diffraction. We introduce a generalised input-output formalism that accurately describes realistic, non-unitary interferometers, including losses due to velocity selectivity and scattering into undesired momentum states. This formalism is applied to evaluate the performance of one-axis twisted spin-squeezed states in improving phase sensitivity. Our results show that by carefully optimising the parameters of the Bragg beam splitters and controlling the degree of squeezing, it is possible to improve the sensitivity of the interferometer by several dB with respect to the standard quantum limit despite realistic levels of losses in light pulse operations. However, the analysis also highlights the challenges associated with achieving these improvements in practice, most notably the impact of finite temperature on the benefits of entanglement. The results suggest ways of optimising interferometric setups to exploit quantum entanglement under realistic conditions, thereby contributing to advances in precision metrology with atom interferometers., Comment: 12 pages

This paper studies the effect of data homogeneity on multi-agent stochastic optimization. We consider the decentralized stochastic gradient (DSGD) algorithm and perform a refined convergence analysis. Our analysis is explicit on the similarity between Hessian matrices of local objective functions which captures the degree of data homogeneity. We illustrate the impact of our analysis through studying the transient time, defined as the minimum number of iterations required for a distributed algorithm to achieve comparable performance as its centralized counterpart. When the local objective functions have similar Hessian, the transient time of DSGD can be as small as ${\cal O}(n^{2/3}/\rho^{8/3})$ for smooth (possibly non-convex) objective functions, ${\cal O}(\sqrt{n}/\rho)$ for strongly convex objective functions, where $n$ is the number of agents and $\rho$ is the spectral gap of graph. These findings provide a theoretical justification for the empirical success of DSGD. Our analysis relies on a novel observation with higher-order Taylor approximation for gradient maps that can be of independent interest. Numerical simulations validate our findings., Comment: 16 pages, 6 figures

Nonreciprocal superconductivity, also called as superconducting diode effect that spontaneously breaks time-reversal symmetry, is characterized by asymmetric critical currents under opposite applied current directions. This distinct state unveils a rich ore of intriguing physical properties, particularly in the realm of nanoscience application of superconductors. Towards the experimental realization of superconducting diode effect, the construction of two-dimensional heterostructures of magnets and $s$-wave superconductors is considered to be a promising pathway. In this study, we present our findings of superconducting diode effect manifested in the magnetic Mott insulator $\alpha$-RuCl$_3$. This phenomenon is induced by the proximity effect within a van der Waals heterostructure, consisting of thin $\alpha$-RuCl$_3$/NbSe$_2$ flakes. Through transport property measurements, we have confirmed a weak superconducting gap of 0.2 meV, which is significantly lower than the intrinsic gap of NbSe$_2$(1.2 meV). Upon the application of a weak magnetic field below 70 mT, we observed an asymmetry in the critical currents under positive and negative applied currents. This observation demonstrates a typical superconducting diode effect in the superconducting $\alpha$-RuCl$_3$. The superconducting diode effect and nonreciprocal resistance are observed exclusively when the magnetic field is aligned out-of-plane. This suggests that an Ising-type spin-orbit coupling in the superconducting $\alpha$-RuCl$_3$ may be responsible for the mechanism. Our findings furnish a platform for the exploration of superconducting diode effect via the artificial construction of heterostructures.

In the literature, the neutrino $\mu$-$\tau$ reflection symmetry (which has the interesting predictions $\theta^{}_{23} =\pi/4$ and $\delta = \pm \pi/2$ for the atmospherical neutrino mixing angle and Dirac CP phase) is an attractive and widely studied candidate for the flavor symmetries in the neutrino sector. But it is known that, when the seesaw model is furnished with this symmetry, the leptogenesis mechanism (which provides an elegant explanation for the baryon-antibaryon asymmetry of the Universe) can only work in the two-flavor regime (which only holds for the right-handed neutrino masses in the range $10^9-10^{12}$ GeV). This prohibits us to have a low scale seesaw model (which has the potential to be directly accessed by running or upcoming collider experiments) that can have the $\mu$-$\tau$ reflection symmetry and successful leptogenesis simultaneously. In this paper, for the first time, we demonstrate that the successful leptogenesis may also be achieved in low scale seesaw models furnished with the $\mu$-$\tau$ reflection symmetry, by means of the flavor non-universality of the conversion efficiencies from the flavored lepton asymmetries to the baryon asymmetry via the sphaleron process. We perform the study in both the resonant leptogenesis regime and the leptogenesis via oscillations (ARS leptogenesis) regime., Comment: arXiv admin note: text overlap with arXiv:2407.18285, arXiv:2403.18630

This work aims to address the technical aspects related to the thermodynamic characterization of natural gas mixtures blended with hydrogen for the introduction of alternative energy sources within the Power-to-Gas framework. For that purpose, new experimental speed of sound data are presented in the pressure range between (0.1 up to 13) MPa and at temperatures of (260, 273.16, 300, 325, and 350) K for two mixtures qualified as primary calibration standards: a 11 component synthetic natural gas mixture (11 M), and another low-calorific $H_{2}$-enriched natural gas mixture with a nominal molar percentage $x_{H_{2}}$ = 3%. Measurements have been gathered using a spherical acoustic resonator with an experimental expanded ($k$ = 2) uncertainty better than 200 parts in $10^{6}$ (0.02%) in the speed of sound. The heat capacity ratio as perfect-gas $\gamma_{pg}$, the molar heat capacity as perfect-gas $C_{p,m}^{pg}$, and the second $\beta_{a}$ and third $\gamma_{a}$ acoustic virial coefficients are derived from the speed of sound values. All the results are compared with the reference mixture models for natural gas-like mixtures, the AGA8-DC92 EoS and the GERG-2008 EoS, with special attention to the impact of hydrogen on those properties. Data are found to be mostly consistent within the model uncertainty in the 11 M synthetic mixture as expected, but for the hydrogen-enriched mixture in the limit of the model uncertainty at the highest measuring pressures.

Millions of people use online social networks to reinforce their sense of belonging, for example by giving and asking for feedback as a form of social validation and self-recognition. It is common to observe disagreement among people beliefs and points of view when expressing this feedback. Modeling and analyzing such interactions is crucial to understand social phenomena that happen when people face different opinions while expressing and discussing their values. In this work, we study a Reddit community in which people participate to judge or be judged with respect to some behavior, as it represents a valuable source to study how users express judgments online. We model threads of this community as complex networks of user interactions growing in time, and we analyze the evolution of their structural properties. We show that the evolution of Reddit networks differ from other real social networks, despite falling in the same category. This happens because their global clustering coefficient is extremely small and the average shortest path length increases over time. Such properties reveal how users discuss in threads, i.e. with mostly one other user and often by a single message. We strengthen such result by analyzing the role that disagreement and reciprocity play in such conversations. We also show that Reddit thread's evolution over time is governed by two subgraphs growing at different speeds. We discover that, in the studied community, the difference of such speed is higher than in other communities because of the user guidelines enforcing specific user interactions. Finally, we interpret the obtained results on user behavior drawing back to Social Judgment Theory., Comment: 29 pages, 9 figures, 5 tables

Considering the emerging applications of quantum technologies, studying energy storage and usage at the quantum level is of great interest. In this context, there is a significant contemporary interest in studying ergotropy, the maximum amount of work that can be extracted unitarily from an energy-storing quantum device. Here, we propose and experimentally demonstrate a feedback-based algorithm (FQErgo) for estimating ergotropy. This method also transforms an arbitrary initial state to its passive state, which allows no further unitary work extraction. FQErgo applies drive fields whose strengths are iteratively adjusted via certain expectation values, conveniently read using a single probe qubit. Thus, FQErgo provides a practical way for unitary energy extraction and for preparing passive states. By numerically analyzing FQErgo on random initial states, we confirm the successful preparation of passive states and estimation of ergotropy, even in the presence of drive errors. Finally, we implement FQErgo on two- and three-qubit NMR registers, prepare their passive states, and accurately estimate their ergotropy.

The increasing accuracy reports of metric monocular depth estimation models lead to a growing interest from the automotive domain. Current model evaluations do not provide deeper insights into the models' performance, also in relation to safety-critical or unseen classes. Within this paper, we present a novel approach for the evaluation of depth estimation models. Our proposed metric leverages three components, a class-wise component, an edge and corner image feature component, and a global consistency retaining component. Classes are further weighted on their distance in the scene and on criticality for automotive applications. In the evaluation, we present the benefits of our metric through comparison to classical metrics, class-wise analytics, and the retrieval of critical situations. The results show that our metric provides deeper insights into model results while fulfilling safety-critical requirements. We release the code and weights on the following repository: \href{https://github.com/leisemann/ca_mmde}, Comment: Accepted at the European Conference on Computer Vision (ECCV) 2024 Workshop on Out Of Distribution Generalization in Computer Vision

One technique for creating semiconductor crystals with new, desired properties involves replacing some atoms in the crystal lattice with additives - atoms of a different type. This substitution not only alters the bulk properties of the crystal but also affects the patterns formed on its surface. A surface that is smooth and regular in a uniform crystal can become bunched or meandered under the same growth conditions if some atoms are replaced by additives. The Vicinal Cellular Automaton (VicCA) model is used to study this behavior, analyzing the mechanism of pattern formation when additives are introduced into the system. It has also been shown that the newly formed structures resulting from the presence of additives can be smoothed by applying successive layers of a homogeneous composition on top for a sufficiently long time. Additives can also serve as smoothing agents for bunched or meandered surface patterns formed in a homogeneous crystal. However, this method is less effective for spatially extended patterns such as nanowires. In most cases, the surface structure obtained after applying homogeneous crystal layers to spatial structures is not completely smoothed but instead takes on a different shape. This behavior is demonstrated, and its underlying mechanism is analyzed., Comment: 13 pages, 7 figures, Submitted to Vacuum

In Naor's model [16], customers decide whether or not to join a queue after observing its length. We suppose that customers are heterogeneous in their service value (reward) $R$ from completed service and homogeneous in the cost of staying in the system per unit of time. It is assumed that the values of customers are independent random variables generated from a common parametric distribution. The manager observes the queue length process, but not the balking customers. Based on the queue length data, an MLE is constructed for the underlying parameters of $R$. We provide verifiable conditions for which the estimator is consistent and asymptotically normal. A dynamic pricing scheme is constructed that starts from some arbitrary price and iteratively updates the price using the estimated parameters. The performance of the estimator and the pricing algorithm are studied through a series of simulation experiments.

Event cameras generate asynchronous and sparse event streams capturing changes in light intensity. They offer significant advantages over conventional frame-based cameras, such as a higher dynamic range and an extremely faster data rate, making them particularly useful in scenarios involving fast motion or challenging lighting conditions. Spiking neural networks (SNNs) share similar asynchronous and sparse characteristics and are well-suited for processing data from event cameras. Inspired by the potential of transformers and spike-driven transformers (spikeformers) in other computer vision tasks, we propose two solutions for fast and robust optical flow estimation for event cameras: STTFlowNet and SDformerFlow. STTFlowNet adopts a U-shaped artificial neural network (ANN) architecture with spatiotemporal shifted window self-attention (swin) transformer encoders, while SDformerFlow presents its fully spiking counterpart, incorporating swin spikeformer encoders. Furthermore, we present two variants of the spiking version with different neuron models. Our work is the first to make use of spikeformers for dense optical flow estimation. We conduct end-to-end training for all models using supervised learning. Our results yield state-of-the-art performance among SNN-based event optical flow methods on both the DSEC and MVSEC datasets, and show significant reduction in power consumption compared to the equivalent ANNs., Comment: Under Review

This paper introduces a new integer programming game (IPG) named the Edge-weighted Budgeted Maximum Coverage (EBMC) game and proposes a new algorithm, the Best Response Plus (BR-plus) algorithm, for finding the best Pure Nash Equilibrium (PNE). We demonstrate this methodology by optimizing county-level decisions to prevent aquatic invasive species (AIS) in Minnesota lakes, where each county-level decision makers has self-serving objectives while AIS is an interconnected issue that crosses county borders. Specifically, we develop EBMC games to model the strategic interactions among county-level decision-makers with two variations in utility functions. We also study and prove the existence of a PNE in these models under specified conditions. We advance the current state-of-the-art, which is limited to only a few players, by presenting the BR-plus algorithm that can handle a large set of players via utilizing the best response dynamics for finding PNE in normal-form games. Experimental results show that our BR-plus algorithm offers computational advantages over the ZR algorithm, especially in larger games, on both random and real-world networks.

This work presents phase envelope and speed of sound data for the (0.60 $CO_{2}$ + 0.40 $C_{3}H_{8}$) and (0.80 $CO_{2}$ + 0.20 $C_{3}H_{8}$) binary mixtures. Phase equilibria was measured using a cylindrical resonator working in the microwave band whereas an acoustic resonator was used for speed of sound measurements. The experimental results were compared with GERG-2008 equation of state, obtaining average absolute deviations by 0.24% in pressure for phase equilibria data and 0.025% for speed of sound data. Speed of sound values were used to derive perfect-gas heat capacities, acoustic virial coefficients, and second density virial coefficients. In addition, AGA8-DC92 equation of state performance was checked for the results derived from speeds of sound.

Generating user intent from a sequence of user interface (UI) actions is a core challenge in comprehensive UI understanding. Recent advancements in multimodal large language models (MLLMs) have led to substantial progress in this area, but their demands for extensive model parameters, computing power, and high latency makes them impractical for scenarios requiring lightweight, on-device solutions with low latency or heightened privacy. Additionally, the lack of high-quality datasets has hindered the development of such lightweight models. To address these challenges, we propose UI-JEPA, a novel framework that employs masking strategies to learn abstract UI embeddings from unlabeled data through self-supervised learning, combined with an LLM decoder fine-tuned for user intent prediction. We also introduce two new UI-grounded multimodal datasets, "Intent in the Wild" (IIW) and "Intent in the Tame" (IIT), designed for few-shot and zero-shot UI understanding tasks. IIW consists of 1.7K videos across 219 intent categories, while IIT contains 914 videos across 10 categories. We establish the first baselines for these datasets, showing that representations learned using a JEPA-style objective, combined with an LLM decoder, can achieve user intent predictions that match the performance of state-of-the-art large MLLMs, but with significantly reduced annotation and deployment resources. Measured by intent similarity scores, UI-JEPA outperforms GPT-4 Turbo and Claude 3.5 Sonnet by 10.0% and 7.2% respectively, averaged across two datasets. Notably, UI-JEPA accomplishes the performance with a 50.5x reduction in computational cost and a 6.6x improvement in latency in the IIW dataset. These results underscore the effectiveness of UI-JEPA, highlighting its potential for lightweight, high-performance UI understanding.

Let $G$ be a simple Lie group. Consider a nilpotent element $e\in \mathfrak{g}$. Let $Z_G(e)$ be the centralizer of $e$ in $G$, and let $A_e:= Z_G(e)/Z_G(e)^{o}$ be its component group. Write $\text{Irr}(\mathcal{B}_e)$ for the set of irreducible components of the Springer fiber $\mathcal{B}_e$. We have an action of $A_e$ on $\text{Irr}(\mathcal{B}_e)$. When $\mathfrak{g}$ is exceptional, we give an explicit description of $\text{Irr}(\mathcal{B}_e)$ as an $A_e$-set. For $\mathfrak{g}$ of classical type, we describe the stabilizers for the $A_e$-action. With this description, we prove a conjecture of Lusztig and Sommers.

We compute the differential cross section for direct quarkonium production in high-energy electron-nucleus collisions at small $x$. Our computation is performed within the nonrelativistic QCD factorization formalism that separates the calculation into short distance coefficients and long distance matrix elements that depend on the color and spin of the state. We obtain the short distance coefficients of the production of the heavy quark pair within the framework of the Color Glass Condensate effective field theory, which resums coherent multiple interactions of the heavy quark pair with the nucleus to all orders. Our results are expressed as the convolution of perturbatively calculable perturbative functions with multi-point light-like Wilson line correlators. In the correlation limit, we establish the correspondence between our CGC formulation with calculations employing the transverse momentum dependent (TMD) framework. We extend this correspondence by resumming kinematic power corrections within the improved TMD framework, which interpolates between the TMD formalism and $k_\perp$ factorization formalism. We present a detailed numerical analysis, focusing on $J/\psi$ production in the kinematics accessible at the future Electron-Ion Collider, highlighting the importance of genuine higher-order saturation contributions when the electron collides with a large nucleus., Comment: 31 pages, 8 figures

Statistical shape analysis of slabular objects like groups of hippocampi is highly useful for medical researchers as it can be useful for diagnoses and understanding diseases. This work proposes a novel object representation based on locally parameterized discrete swept skeletal structures. Further, model fitting and analysis of such representations are discussed. The model fitting procedure is based on boundary division and surface flattening. The quality of the model fitting is evaluated based on the symmetry and tidiness of the skeletal structure as well as the volume of the implied boundary. The power of the method is demonstrated by visual inspection and statistical analysis of a synthetic and an actual data set in comparison with an available skeletal representation.

Sampling and quantization are crucial in digital signal processing, but quantization introduces errors, particularly due to distribution mismatch between input signals and quantizers. Existing methods to reduce this error require precise knowledge of the input's distribution, which is often unavailable. To address this, we propose a blind and adaptive method that minimizes distribution mismatch without prior knowledge of the input distribution. Our approach uses a nonlinear transformation with amplification and modulo-folding, followed by a uniform quantizer. Theoretical analysis shows that sufficient amplification makes the output distribution of modulo-folding nearly uniform, reducing mismatch across various distributions, including Gaussian, exponential, and uniform. To recover the true quantized samples, we suggest using existing unfolding techniques, which, despite requiring significant oversampling, effectively reduce mismatch and quantization error, offering a favorable trade-off similar to predictive coding strategies., Comment: 22 pages,4 figures

We give an algorithm to morph planar graph drawings that achieves small grid size at the expense of allowing a constant number of bends on each edge. The input is an $n$-vertex planar graph and two planar straight-line drawings of the graph on an $O(n) \times O(n)$ grid. The planarity-preserving morph is composed of $O(n)$ linear morphs between successive pairs of drawings, each on an $O(n) \times O(n)$ grid with a constant number of bends per edge. The algorithm to compute the morph runs in $O(n^2)$ time on a word RAM model with standard arithmetic operations -- in particular no square roots or cube roots are required. The first step of the algorithm is to morph each input drawing to a planar orthogonal box drawing where vertices are represented by boxes and each edge is drawn as a horizontal or vertical segment. The second step is to morph between planar orthogonal box drawings. This is done by extending known techniques for morphing planar orthogonal drawings with point vertices., Comment: To appear in the proceedings of the 32nd International Symposium on Graph Drawing and Network Visualization (GD 2024)

Entity matching (EM) is the problem of determining whether two records refer to same real-world entity, which is crucial in data integration, e.g., for product catalogs or address databases. A major drawback of many EM approaches is their dependence on labelled examples. We thus focus on the challenging setting of zero-shot entity matching where no labelled examples are available for an unseen target dataset. Recently, large language models (LLMs) have shown promising results for zero-shot EM, but their low throughput and high deployment cost limit their applicability and scalability. We revisit the zero-shot EM problem with AnyMatch, a small language model fine-tuned in a transfer learning setup. We propose several novel data selection techniques to generate fine-tuning data for our model, e.g., by selecting difficult pairs to match via an AutoML filter, by generating additional attribute-level examples, and by controlling label imbalance in the data. We conduct an extensive evaluation of the prediction quality and deployment cost of our model, in a comparison to thirteen baselines on nine benchmark datasets. We find that AnyMatch provides competitive prediction quality despite its small parameter size: it achieves the second-highest F1 score overall, and outperforms several other approaches that employ models with hundreds of billions of parameters. Furthermore, our approach exhibits major cost benefits: the average prediction quality of AnyMatch is within 4.4% of the state-of-the-art method MatchGPT with the proprietary trillion-parameter model GPT-4, yet AnyMatch requires four orders of magnitude less parameters and incurs a 3,899 times lower inference cost (in dollars per 1,000 tokens)., Comment: 12 pages excluding references, 3 figures, and 5 tables