Search

Reduced order models based on the transport of a lower dimensional manifold representation of the thermochemical state, such as Principal Component (PC) transport and Machine Learning (ML) techniques, have been developed to reduce the computational cost associated with the Direct Numerical Simulations (DNS) of reactive flows. Both PC transport and ML normally require an abundance of data to exhibit sufficient predictive accuracy, which might not be available due to the prohibitive cost of DNS or experimental data acquisition. To alleviate such difficulties, similar data from an existing dataset or domain (source domain) can be used to train ML models, potentially resulting in adequate predictions in the domain of interest (target domain). This study presents a novel probabilistic transfer learning (TL) framework to enhance the trust in ML models in correctly predicting the thermochemical state in a lower dimensional manifold and a sparse data setting. The framework uses Bayesian neural networks, and autoencoders, to reduce the dimensionality of the state space and diffuse the knowledge from the source to the target domain. The new framework is applied to one-dimensional freely-propagating flame solutions under different data sparsity scenarios. The results reveal that there is an optimal amount of knowledge to be transferred, which depends on the amount of data available in the target domain and the similarity between the domains. TL can reduce the reconstruction error by one order of magnitude for cases with large sparsity. The new framework required 10 times less data for the target domain to reproduce the same error as in the abundant data scenario. Furthermore, comparisons with a state-of-the-art deterministic TL strategy show that the probabilistic method can require four times less data to achieve the same reconstruction error.

We study accretion remnants around Milky Way analogs in the IllustrisTNG simulations to determine how well commonly used distribution functions (DFs) describe their phase-space distributions. We identify 30 Milky Way analogs and 116 remnants from mergers with stellar mass ratios greater than 1:20. Two-power density profiles, as well as rotating constant-anisotropy and Osipkov-Merritt DFs are fit to the remnants. We determine that the remnants are suitable for equilibrium modelling by assessing them in the context of the Jeans equation. Each of the models we consider are reasonably able to fit the stellar remnant energy and angular momentum distribution, as well as the magnitude and shape of velocity dispersion profiles. Case studies matched to two well-known merger remnants in the stellar halo-Gaia-Sausage/Enceladus (GS/E) and Sequoia-are explored in more depth. We find good evidence that remnants with high anisotropy $\beta$, such as GS/E, are better modelled with a superposition of two Osipkov-Merritt DFs than either a constant-anisotropy model or a single Osipkov-Merritt DF. We estimate an Osipkov-Merritt profile with scale radius between 2-4 kpc would be a good first-order representation of GS/E, and comment on existing observational evidence for this as well as studies which could demonstrate it. Overall, we find that DF-based models work well for describing the kinematics of large merger remnants. Our results will be an important reference for future studies which seek to constrain both the spatial and kinematic properties of merger remnants in the Milky Way stellar halo., Comment: 17 pages, 11 figures. Submitted to MNRAS. Comments welcome

Integrated photon-pair sources are crucial for scalable photonic quantum systems. Thin-film lithium niobate is a promising platform for on-chip photon-pair generation through spontaneous parametric down-conversion (SPDC). However, the device implementation faces practical challenges. Periodically poled lithium niobate (PPLN), despite enabling flexible quasi-phase matching, suffers from poor fabrication reliability and device repeatability, while conventional modal phase matching (MPM) methods yield limited efficiencies due to inadequate mode overlaps. Here, we introduce a layer-poled lithium niobate (LPLN) nanophotonic waveguide for efficient photon-pair generation. It leverages layer-wise polarity inversion through electrical poling to break spatial symmetry and significantly enhance nonlinear interactions for MPM, achieving a notable normalized second-harmonic generation (SHG) conversion efficiency of 4615% W^{-1}cm^{-2}. Through a cascaded SHG and SPDC process, we demonstrate photon-pair generation with a normalized brightness of 3.1*10^6 Hz nm^{-1} mW^{-2} in a 3.3 mm long LPLN waveguide, surpassing existing on-chip sources under similar operating configurations. Crucially, our LPLN waveguides offer enhanced fabrication reliability and reduced sensitivity to geometric variations and temperature fluctuations compared to PPLN devices. We expect LPLN to become a promising solution for on-chip nonlinear wavelength conversion and non-classical light generation, with immediate applications in quantum communication, networking, and on-chip photonic quantum information processing.

We employ quantum-volume random-circuit sampling to benchmark the two-QPU entanglement-assisted distributed quantum computing (DQC), and compare it with single-QPU quantum computing. We first specify a single-qubit depolarizing noise model in the random circuit. Based on this error model, we show the one-to-one correspondence of three figures of merits, namely average gate fidelity, heavy output probability, and linear cross-entropy. We derive an analytical approximation of the average gate fidelity under the specified noise model, which is shown to align with numerical simulations. The approximation is calculated based on an allocation matrix obtained from the extended connectivity graph of a DQC device. In numerical simulation, we unveil the scalability enhancement in DQC for the QPUs with limited connectivity. Furthermore, we provide a simple formula to estimate the average gate fidelity, which also provides us with a heuristic method to evaluate the scalability enhancement in DQC, and a guide to optimize the structure of a DQC configuration., Comment: 13 page, 14 figures, 5-page Appendix

Variational quantum algorithms (VQAs) are a broad class of algorithms with many applications in science and industry. Applying a VQA to a problem involves optimizing a parameterized quantum circuit by maximizing or minimizing a cost function. A particular challenge associated with VQAs is understanding the properties of associated cost functions. Having the landscapes of VQA cost functions can greatly assist in developing and testing new variational quantum algorithms, but they are extremely expensive to compute. Reconstructing the landscape of a VQA using existing techniques requires a large number of cost function evaluations, especially when the dimension or the resolution of the landscape is high. To address this challenge, we propose a low-rank tensor-completion-based approach for local landscape reconstruction. By leveraging compact low-rank representations of tensors, our technique can overcome the curse of dimensionality and handle high-resolution landscapes. We demonstrate the power of landscapes in VQA development by showcasing practical applications of analyzing penalty terms for constrained optimization problems and examining the probability landscapes of certain basis states.

Cosmic strings are a common prediction in many grand unified theories and a promising source of stochastic gravitational waves (GWs) from the early Universe. In this paper, we point out that the GW signal from cosmic strings produced at a comparatively low energy scale, $v \lesssim 10^9 \textrm{GeV}$, exhibits several novel features that are not present in the case of high-scale cosmic strings. Our findings notably include (i) a sharp cutoff frequency $f_{\rm cut}$ in the GW spectrum from the fundamental oscillation mode on closed string loops and (ii) an oscillating pattern in the total GW spectrum from all oscillation modes whose local minima are located at integer multiples of $f_{\rm cut}$. These features reflect the fact that string loops produced in the early Universe fail to shrink to zero size because of GW emission within the age of the Universe, if their tension is low enough. In addition, they offer an exciting opportunity to directly probe the discrete spectrum of oscillation modes on closed string loops in GW observations. For strings produced at a scale $v \sim 10^9\textrm{GeV}$, the novel features in the GW spectrum are within the sensitivity reach of future experiments such as BBO and DECIGO., Comment: 16 pages, 4 figures

Understanding how language model performance varies with scale is critical to benchmark and algorithm development. Scaling laws are one approach to building this understanding, but the requirement of training models across many different scales has limited their use. We propose an alternative, observational approach that bypasses model training and instead builds scaling laws from ~80 publically available models. Building a single scaling law from multiple model families is challenging due to large variations in their training compute efficiencies and capabilities. However, we show that these variations are consistent with a simple, generalized scaling law where language model performance is a function of a low-dimensional capability space, and model families only vary in their efficiency in converting training compute to capabilities. Using this approach, we show the surprising predictability of complex scaling phenomena: we show that several emergent phenomena follow a smooth, sigmoidal behavior and are predictable from small models; we show that the agent performance of models such as GPT-4 can be precisely predicted from simpler non-agentic benchmarks; and we show how to predict the impact of post-training interventions like Chain-of-Thought and Self-Consistency as language model capabilities continue to improve.

The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and enhance the overall usability and accessibility for diverse language user groups, it is important for the development of language-fair technology. Despite the breakthroughs of LLMs, the investigation into the multilingual scenario remains insufficient, where a comprehensive survey to summarize recent approaches, developments, limitations, and potential solutions is desirable. To this end, we provide a survey with multiple perspectives on the utilization of LLMs in the multilingual scenario. We first rethink the transitions between previous and current research on pre-trained language models. Then we introduce several perspectives on the multilingualism of LLMs, including training and inference methods, model security, multi-domain with language culture, and usage of datasets. We also discuss the major challenges that arise in these aspects, along with possible solutions. Besides, we highlight future research directions that aim at further enhancing LLMs with multilingualism. The survey aims to help the research community address multilingual problems and provide a comprehensive understanding of the core concepts, key techniques, and latest developments in multilingual natural language processing based on LLMs., Comment: 54 pages, Work in Progress

Self-distillation methods using Siamese networks are popular for self-supervised pre-training. DINO is one such method based on a cross-entropy loss between $K$-dimensional probability vectors, obtained by applying a softmax function to the dot product between representations and learnt prototypes. Given the fact that the learned representations are $L^2$-normalized, we show that DINO and its derivatives, such as iBOT, can be interpreted as a mixture model of von Mises-Fisher components. With this interpretation, DINO assumes equal precision for all components when the prototypes are also $L^2$-normalized. Using this insight we propose DINO-vMF, that adds appropriate normalization constants when computing the cluster assignment probabilities. Unlike DINO, DINO-vMF is stable also for the larger ViT-Base model with unnormalized prototypes. We show that the added flexibility of the mixture model is beneficial in terms of better image representations. The DINO-vMF pre-trained model consistently performs better than DINO on a range of downstream tasks. We obtain similar improvements for iBOT-vMF vs iBOT and thereby show the relevance of our proposed modification also for other methods derived from DINO., Comment: Accepted to ICLR 2023

The formula for correlation functions based on quantum $A_\infty$ algebras in arXiv:2203.05366, arXiv:2305.11634, and arXiv:2305.13103 requires dividing the action into the free part and the interaction part. We present a new form of the formula which does not involve such division. The new formula requires choosing a solution to the equations of motion which does not have to be real, and we claim that the formula gives correlation functions evaluated on the Lefschetz thimble associated with the solution we chose. Our formula correctly reproduces correlation functions in perturbation theory, but it can be valid nonperturbatively, and we present numerical evidence for scalar field theories in zero dimensions both in the Euclidean case and the Lorentzian case that correlation functions for finite coupling constants can be reproduced. When the theory consists of a single Lefschetz thimble, our formula gives correlation functions of the theory by choosing the solution corresponding to the thimble. When the theory consists of multiple Lefschetz thimbles, we need to evaluate the ratios of the partition functions for those thimbles and we describe a method of such evaluations based on quantum $A_\infty$ algebras in a forthcoming paper., Comment: 43 pages, 9 figures

The gas surrounding first-generation (Pop III) stars is expected to emit a distinct signature in the form of the HeII recombination line at 1640~\AA (HeII$\lambda$1640). Here we explore the challenges and opportunities in identifying this elusive stellar population via the HeII$\lambda$1640 in $M_\star > 10^{7.5} ~ \mathrm{M_\odot}$ galaxies during the Epoch of Reionization (EoR, $z \simeq 6 - 10$), using JWST/NIRSpec. With this aim in mind, we combine cosmological dustyGadget simulations with analytical modeling of the intrinsic HeII emission. While tentative candidates with bright HeII emission like GN-z11 have been proposed in the literature, the prevalence of such bright systems remains unclear due to significant uncertainties involved in the prediction of the HeII luminosity. In fact, similar Pop III clumps might be almost two orders of magnitude fainter depending on the underlying Pop III model (e.g., with/without stellar mass loss and/or assuming different Pop III-formation efficiencies in star-forming clouds). Moreover, up to $\sim 90 \%$ of these clumps might be missed with NIRSpec/MOS due to the limited FoV, while this problem appears to be less severe with NIRSpec/IFU. We propose deep spectroscopy targeting potential peripheral Pop III clumps around bright, massive galaxies as a promising approach to achieve a clear detection of the first stars., Comment: 13 pages, 5 figures. Submitted to APJL

We consider the problem of learning low-degree quantum objects up to $\varepsilon$-error in $\ell_2$-distance. We show the following results: $(i)$ unknown $n$-qubit degree-$d$ (in the Pauli basis) quantum channels and unitaries can be learned using $O(1/\varepsilon^d)$ queries (independent of $n$), $(ii)$ polynomials $p:\{-1,1\}^n\rightarrow [-1,1]$ arising from $d$-query quantum algorithms can be classically learned from $O((1/\varepsilon)^d\cdot \log n)$ many random examples $(x,p(x))$ (which implies learnability even for $d=O(\log n)$), and $(iii)$ degree-$d$ polynomials $p:\{-1,1\}^n\to [-1,1]$ can be learned through $O(1/\varepsilon^d)$ queries to a quantum unitary $U_p$ that block-encodes $p$. Our main technical contributions are new Bohnenblust-Hille inequalities for quantum channels and completely bounded~polynomials., Comment: 26+4 pages

Modeling the shape of garments has received much attention, but most existing approaches assume the garments to be worn by someone, which constrains the range of shapes they can assume. In this work, we address shape recovery when garments are being manipulated instead of worn, which gives rise to an even larger range of possible shapes. To this end, we leverage the implicit sewing patterns (ISP) model for garment modeling and extend it by adding a diffusion-based deformation prior to represent these shapes. To recover 3D garment shapes from incomplete 3D point clouds acquired when the garment is folded, we map the points to UV space, in which our priors are learned, to produce partial UV maps, and then fit the priors to recover complete UV maps and 2D to 3D mappings. Experimental results demonstrate the superior reconstruction accuracy of our method compared to previous ones, especially when dealing with large non-rigid deformations arising from the manipulations.

Mechanistic interpretability aims to understand the behavior of neural networks by reverse-engineering their internal computations. However, current methods struggle to find clear interpretations of neural network activations because a decomposition of activations into computational features is missing. Individual neurons or model components do not cleanly correspond to distinct features or functions. We present a novel interpretability method that aims to overcome this limitation by transforming the activations of the network into a new basis - the Local Interaction Basis (LIB). LIB aims to identify computational features by removing irrelevant activations and interactions. Our method drops irrelevant activation directions and aligns the basis with the singular vectors of the Jacobian matrix between adjacent layers. It also scales features based on their importance for downstream computation, producing an interaction graph that shows all computationally-relevant features and interactions in a model. We evaluate the effectiveness of LIB on modular addition and CIFAR-10 models, finding that it identifies more computationally-relevant features that interact more sparsely, compared to principal component analysis. However, LIB does not yield substantial improvements in interpretability or interaction sparsity when applied to language models. We conclude that LIB is a promising theory-driven approach for analyzing neural networks, but in its current form is not applicable to large language models.

The sphere graph of $M_r$, a connect sum of $r$ copies of $S^1\times S^2$ was introduced by Hatcher as an analog of the curve graph of a surface to study the outer automorphism group of a free group $F_r$. Bestvina, Bromberg, and Fujiwara proved that the chromatic number of the curve graph is finite; bounds were subsequently improved by Gaster, Greene, and Vlamis. Motivated by the analogy, we provide upper and lower bounds for the chromatic number of the sphere graph of $M_r$. As a corollary to the prime decomposition of 3-manifolds, this gives bounds on the chromatic number of the sphere graph for any orientable 3-manifold., Comment: 7 pages, 2 figures

We consider the problem of selecting an optimal subset of information sources for a hypothesis testing/classification task where the goal is to identify the true state of the world from a finite set of hypotheses, based on finite observation samples from the sources. In order to characterize the learning performance, we propose a misclassification penalty framework, which enables non-uniform treatment of different misclassification errors. In a centralized Bayesian learning setting, we study two variants of the subset selection problem: (i) selecting a minimum cost information set to ensure that the maximum penalty of misclassifying the true hypothesis remains bounded and (ii) selecting an optimal information set under a limited budget to minimize the maximum penalty of misclassifying the true hypothesis. Under mild assumptions, we prove that the objective (or constraints) of these combinatorial optimization problems are weak (or approximate) submodular, and establish high-probability performance guarantees for greedy algorithms. Further, we propose an alternate metric for information set selection which is based on the total penalty of misclassification. We prove that this metric is submodular and establish near-optimal guarantees for the greedy algorithms for both the information set selection problems. Finally, we present numerical simulations to validate our theoretical results over several randomly generated instances., Comment: 23 pages, 4 figures

Learning precise distributions of traffic features (e.g., burst sizes, packet inter-arrival time) is still a largely unsolved problem despite being critical for management tasks such as capacity planning or anomaly detection. A key limitation nowadays is the lack of feedback between the control plane and the data plane. Programmable data planes offer the opportunity to create systems that let data- and control plane to work together, compensating their respective shortcomings. We present FitNets, an adaptive network monitoring system leveraging feedback between the data- and the control plane to learn accurate traffic distributions. In the control plane, FitNets relies on Kernel Density Estimators which allow to provably learn distributions of any shape. In the data plane, FitNets tests the accuracy of the learned distributions while dynamically adapting data collection to the observed distribution fitness, prioritizing under-fitted features. We have implemented FitNets in Python and P4 (including on commercially available programmable switches) and tested it on real and synthetic traffic traces. FitNets is practical: it is able to estimate hundreds of distributions from up to 60 millions samples per second, while providing accurate error estimates and adapting to complex traffic patterns.

The Atlantic Meridional Overturning Circulation (AMOC) exerts a major influence on global climate. There is much debate about whether the current strong AMOC may collapse as a result of anthropogenic forcing and/or internal variability. Increasing the noise in simple salt-advection models can change the apparent AMOC tipping threshold. However, it's not clear if 'present-day' variability is strong enough to induce a collapse. Here, we investigate how internal variability affects the likelihood of AMOC collapse. We examine internal variability of basin-scale salinities and temperatures in four CMIP6 pre-industrial simulations. We fit this to an empirical, process-based AMOC box model, and find that noise-induced AMOC collapse (defined as a decade in which the mean AMOC strength falls below 5 Sv) is unlikely for pre-industrial CMIP6 variability unless external forcing shifts the AMOC closer to a threshold. However, CMIP6 models seem to underestimate present-day Atlantic Ocean variability, and stronger variability substantially increases the likelihood of noise-induced collapse, especially if forcing brings the AMOC close to a stability threshold. Surprisingly, we find a case where forcing temporarily overshoots a stability threshold but noise decreases the probability of collapse. Accurately modelling internal decadal variability is essential for understanding the increased uncertainty in AMOC projections.

Mechanistic Interpretability aims to reverse engineer the algorithms implemented by neural networks by studying their weights and activations. An obstacle to reverse engineering neural networks is that many of the parameters inside a network are not involved in the computation being implemented by the network. These degenerate parameters may obfuscate internal structure. Singular learning theory teaches us that neural network parameterizations are biased towards being more degenerate, and parameterizations with more degeneracy are likely to generalize further. We identify 3 ways that network parameters can be degenerate: linear dependence between activations in a layer; linear dependence between gradients passed back to a layer; ReLUs which fire on the same subset of datapoints. We also present a heuristic argument that modular networks are likely to be more degenerate, and we develop a metric for identifying modules in a network that is based on this argument. We propose that if we can represent a neural network in a way that is invariant to reparameterizations that exploit the degeneracies, then this representation is likely to be more interpretable, and we provide some evidence that such a representation is likely to have sparser interactions. We introduce the Interaction Basis, a tractable technique to obtain a representation that is invariant to degeneracies from linear dependence of activations or Jacobians.

Proving local robustness is crucial to increase the reliability of neural networks. While many verifiers prove robustness in $L_\infty$ $\epsilon$-balls, very little work deals with robustness verification in $L_0$ $\epsilon$-balls, capturing robustness to few pixel attacks. This verification introduces a combinatorial challenge, because the space of pixels to perturb is discrete and of exponential size. A previous work relies on covering designs to identify sets for defining $L_\infty$ neighborhoods, which if proven robust imply that the $L_0$ $\epsilon$-ball is robust. However, the number of neighborhoods to verify remains very high, leading to a high analysis time. We propose covering verification designs, a combinatorial design that tailors effective but analysis-incompatible coverings to $L_0$ robustness verification. The challenge is that computing a covering verification design introduces a high time and memory overhead, which is intensified in our setting, where multiple candidate coverings are required to identify how to reduce the overall analysis time. We introduce CoVerD, an $L_0$ robustness verifier that selects between different candidate coverings without constructing them, but by predicting their block size distribution. This prediction relies on a theorem providing closed-form expressions for the mean and variance of this distribution. CoVerD constructs the chosen covering verification design on-the-fly, while keeping the memory consumption minimal and enabling to parallelize the analysis. The experimental results show that CoVerD reduces the verification time on average by up to 5.1x compared to prior work and that it scales to larger $L_0$ $\epsilon$-balls.

Fix a prime $p$ and polynomials $f,g\in \mathbb{Q}_p[x]$. If the Newton polygon of $g$ consists of a single segment with negative slope, we show under some mild conditions that the Newton polygon of $f\circ g$ is identical to that of $f$, but stretched horizontally by a factor of $\operatorname{deg} g$. Specializing to the case $f=g$, this implies that all iterates of certain pure polynomials are irreducible, recovering a classical result of Odoni on the dynamical irreducibility of Eisenstein polynomials. We also prove that the Taylor polynomials of the exponential function (a well-known family of irreducible polynomials) remain irreducible upon composition with all iterates of certain pure polynomials of large enough degree., Comment: 10 pages

Multiple imputation (MI) models can be improved by including auxiliary covariates (AC), but their performance in high-dimensional data is not well understood. We aimed to develop and compare high-dimensional MI (HDMI) approaches using structured and natural language processing (NLP)-derived AC in studies with partially observed confounders. We conducted a plasmode simulation study using data from opioid vs. non-steroidal anti-inflammatory drug (NSAID) initiators (X) with observed serum creatinine labs (Z2) and time-to-acute kidney injury as outcome. We simulated 100 cohorts with a null treatment effect, including X, Z2, atrial fibrillation (U), and 13 other investigator-derived confounders (Z1) in the outcome generation. We then imposed missingness (MZ2) on 50% of Z2 measurements as a function of Z2 and U and created different HDMI candidate AC using structured and NLP-derived features. We mimicked scenarios where U was unobserved by omitting it from all AC candidate sets. Using LASSO, we data-adaptively selected HDMI covariates associated with Z2 and MZ2 for MI, and with U to include in propensity score models. The treatment effect was estimated following propensity score matching in MI datasets and we benchmarked HDMI approaches against a baseline imputation and complete case analysis with Z1 only. HDMI using claims data showed the lowest bias (0.072). Combining claims and sentence embeddings led to an improvement in the efficiency displaying the lowest root-mean-squared-error (0.173) and coverage (94%). NLP-derived AC alone did not perform better than baseline MI. HDMI approaches may decrease bias in studies with partially observed confounders where missingness depends on unobserved factors.

Mean-field control (MFC) problems aim to find the optimal policy to control massive populations of interacting agents. These problems are crucial in areas such as economics, physics, and biology. We consider the non-local setting, where the interactions between agents are governed by a suitable kernel. For $N$ agents, the interaction cost has $\mathcal{O}(N^2)$ complexity, which can be prohibitively slow to evaluate and differentiate when $N$ is large. To this end, we propose an efficient primal-dual algorithm that utilizes basis expansions of the kernels. The basis expansions reduce the cost of computing the interactions, while the primal-dual methodology decouples the agents at the expense of solving for a moderate number of dual variables. We also demonstrate that our approach can further be structured in a multi-resolution manner, where we estimate optimal dual variables using a moderate $N$ and solve decoupled trajectory optimization problems for large $N$. We illustrate the effectiveness of our method on an optimal control of 5000 interacting quadrotors.

We study the data-generating processes for factors expressed in return differences, which the literature on time-series asset pricing seems to have overlooked. For the factors' data-generating processes or long-short zero-cost portfolios, a meaningful definition of returns is impossible; further, the compounded market factor (MF) significantly underestimates the return difference between the market and the risk-free rate compounded separately. Surprisingly, if MF were treated coercively as periodic-rebalancing long-short (i.e., the same as size and value), Fama-French three-factor (FF3) would be economically unattractive for lacking compounding and irrelevant for suffering from the small "size of an effect." Otherwise, FF3 might be misspecified if MF were buy-and-hold long-short. Finally, we show that OLS with net returns for single-index models leads to inflated alphas, exaggerated t-values, and overestimated Sharpe ratios (SR); worse, net returns may lead to pathological alphas and SRs. We propose defining factors (and SRs) with non-difference compound returns., Comment: 43 pages, 9 tables, 1 figure

In the e-commerce domain, the accurate extraction of attribute-value pairs from product listings (e.g., Brand: Apple) is crucial for enhancing search and recommendation systems. The automation of this extraction process is challenging due to the vast diversity of product categories and their respective attributes, compounded by the lack of extensive, accurately annotated training datasets and the demand for low latency to meet the real-time needs of e-commerce platforms. To address these challenges, we introduce GenToC, a novel two-stage model for extracting attribute-value pairs from product titles. GenToC is designed to train with partially-labeled data, leveraging incomplete attribute-value pairs and obviating the need for a fully annotated dataset. Moreover, we introduce a bootstrapping method that enables GenToC to progressively refine and expand its training dataset. This enhancement substantially improves the quality of data available for training other neural network models that are typically faster but are inherently less capable than GenToC in terms of their capacity to handle partially-labeled data. By supplying an enriched dataset for training, GenToC significantly advances the performance of these alternative models, making them more suitable for real-time deployment. Our results highlight the unique capability of GenToC to learn from a limited set of labeled data and to contribute to the training of more efficient models, marking a significant leap forward in the automated extraction of attribute-value pairs from product titles. GenToC has been successfully integrated into India's largest B2B e-commerce platform, IndiaMART.com, achieving a significant increase of 21.1% in recall over the existing deployed system while maintaining a high precision of 89.5% in this challenging task.

We define two types of the $\alpha$-Farey maps $F_{\alpha}$ and $F_{\alpha, \flat}$ for $0 < \alpha < \tfrac{1}{2}$, which were previously defined only for $\tfrac{1}{2} \le \alpha \le 1$ by R.~Natsui (2004). Then, for each $0 < \alpha < \tfrac{1}{2}$, we construct the natural extension maps on the plane and show that the natural extension of $F_{\alpha, \flat}$ is metrically isomorphic to the natural extension of the original Farey map. As an application, we show that the set of normal numbers associted with $\alpha$-continued fractions does not vary by the choice of $\alpha$, $0 < \alpha < 1$. This extends the result by C.~Kraaikamp and H.~Nakada (2000)., Comment: 9 figures

This paper introduces a randomized Householder QR factorization (RHQR). This factorization can be used to obtain a well conditioned basis of a set of vectors and thus can be employed in a variety of applications. The RHQR factorization of the input matrix $W$ is equivalent to the standard Householder QR factorization of matrix $\Psi W$, where $\Psi$ is a sketching matrix that can be obtained from any subspace embedding technique. For this reason, the RHQR algorithm can also be reconstructed from the Householder QR factorization of the sketched problem, yielding a single-synchronization randomized QR factorization (reconstructRHQR). In most contexts, left-looking RHQR requires a single synchronization per iteration, with half the computational cost of Householder QR, and a similar cost to Randomized Gram-Schmidt (RGS) overall. We discuss the usage of RHQR factorization in the Arnoldi process and then in GMRES, showing thus how it can be used in Krylov subspace methods to solve systems of linear equations. Based on Charles Sheffield's connection between Householder QR and Modified Gram-Schmidt (MGS), a BLAS2-RGS is also derived. Numerical experiments show that RHQR produces a well conditioned basis whose sketch is numerically orthogonal even for the most difficult inputs, and an accurate factorization. The same results were observed with the high-dimensional operations made in half-precision. The reconstructed RHQR from the HQR factorization of the sketch was stabler than the standard Randomized Cholesky QR. The first version of this work was made available on HAL on the 7th of July 2023 and can be found at https://hal.science/hal-04156310/

It is a challenge to estimate fund performance by compounded returns. Arguably, it is incorrect to use yearly returns directly for compounding, with reported annualized return of above 60% for Medallion for the 31 years up to 2018. We propose an estimation based on fund sizes and trading profits and obtain a compounded return of 32.6% before fees with a 3% financing rate. Alternatively, we suggest using the manager's wealth as a proxy and arriving at a compounded growth rate of 25.6% for Simons for the 33 years up to 2020. We conclude that the annualized compounded return of Medallion before fees is probably under 35%. Our findings have implications for how to compute fund performance correctly., Comment: 9 pages, 2 tables

The correct referencing of the binding energy (BE) scale is essential for the accuracy of chemical analysis by x-ray photoelectron spectroscopy. The C 1s C C/C-H peak from adventitious carbon (AdC), most commonly used for that purpose, was previously shown to shift by several eVs following changes in the sample work function, thus indicating that AdC aligns to the sample vacuum level (VL). Here, results from a much larger sample set are presented including 360 specimens of thin-film samples comprising metals, nitrides, carbides, borides, oxides, carbonitrides, and oxynitrides. Irrespective of the material system the C 1s peak of AdC is found to follow changes in the sample work function fully confirming previous results. Several observations exclude differential charging as plausible explanation. All experimental evidence points instead to the VL alignment at the AdC/sample interface as the source of shifts. Should the C 1s peak of AdC be used for spectra referencing the measurement of sample work function is necessary, irrespective of whether samples are measured grounded or insulated from the spectrometer.

We study a prototypical non-polynomial decision-making model for which agents in a population potentially alternate between two consumption strategies, one related to the exploitation of an unlimited but considerably expensive resource and the other a comparably cheaper but restricted and slowly renewable source. In particular, we study a model following a Boltzmann-like exploration policy, enhancing the accuracy at which the exchange rates are captured with respect to classical polynomial approaches by considering sigmoidal functions to represent the cost-profit relation in both exploit strategies. Additionally, given the intrinsic timescale separation between the decision-making process and recovery rates of the renewable resource, we use geometric singular perturbation theory to analyze the model. We further use numerical analysis to determine parameter ranges for which the model undergoes bifurcations. These bifurcations, being related to critical states of the system, are relevant to the fast transitions between strategies. Hence, we design controllers to regulate such rapid transitions by taking advantage of the system's criticality., Comment: 40 pages, 20 figures

We perform numerical investigation of nearly self-similar blowup of generalized axisymmetric Navier-Stokes equations and Boussinesq system with a time-dependent fractional dimension. The dynamic change of the space dimension is proportional to the ratio R(t)/Z(t), where (R(t),Z(t)) is the position at which the maximum vorticity achieves its global maximum. This choice of space dimension is to ensure that the advection along the r-direction has the same scaling as that along the z-direction, thus preventing formation of two-scale solution structure. For the generalized axisymmetric Navier-Stokes equations with solution dependent viscosity, we show that the solution develops a self-similar blowup with dimension equal to 3.188 and the self-similar profile satisfies the axisymmetric Navier-Stokes equations with constant viscosity. We also study the nearly self-similar blowup of the axisymmetric Boussinesq system with constant viscosity. The generalized axisymmetric Boussinesq system preserves almost all the known properties of the 3D Navier-Stokes equations except for the conservation of angular momentum. We present convincing numerical evidence that the generalized axisymmetric Boussinesq system develops a stable nearly self-similar blowup solution with maximum vorticity increased by O(10^{30})., Comment: 34 pages, 28 figures. arXiv admin note: text overlap with arXiv:2107.06509

We study properties of point-like impurities preserving flavor symmetry and supersymmetry in four-dimensional ${\cal N} = 2$ field theories. At large distances, such impurities are described by half-BPS superconformal line defects. By working in the $\text{AdS}_2\times \text{S}^2$ conformal frame, we develop a novel and simpler way of deriving the superconformal Ward identities relating the various two-point functions of flavor current multiplet operators in the presence of the defect. We use these relations to simplify a certain integrated two-point function of flavor current multiplet operators that, in Lagrangian theories, can be computed using supersymmetric localization. The simplification gives an integral constraint on the two-point function of the flavor current multiplet superconformal primary with trivial integration measure in the $\text{AdS}_2\times \text{S}^2$ conformal frame. We provide several consistency checks on our Ward identities., Comment: 41 pages + Appendices

Extant life contains numerous non-equilibrium mechanisms to create order not achievable at equilibrium; it is generally assumed that these mechanisms evolved because the resulting order was sufficiently beneficial to overcome associated costs of time and energy. Here, we identify a broad range of conditions under which non-equilibrium order-creating mechanisms will evolve as an inevitable consequence of self-replication, even if the order is not directly functional. We show that models of polymerases, when expanded to include known stalling effects, can evolve kinetic proofreading through selection for fast replication alone, consistent with data from recent mutational screens. Similarly, replication contingent on fast self-assembly can select for non-equilibrium instabilities and result in more ordered structures without any direct selection for order. We abstract these results into a framework that predicts that self-replication intrinsically amplifies dissipative order-enhancing mechanisms if the distribution of replication times is wide enough. Our work suggests the intriguing possibility that non-equilibrium order can arise more easily than assumed, even before that order is directly functional, with consequences impacting mutation rate evolution and kinetic traps in self-assembly to the origin of life.

We present an automata-based algorithm to synthesize omega-regular causes for omega-regular effects on executions of a reactive system, such as counterexamples uncovered by a model checker. Our theory is a generalization of temporal causality, which has recently been proposed as a framework for drawing causal relationships between trace properties on a given trace. So far, algorithms exist only for verifying a single causal relationship and, as an extension, cause synthesis through enumeration, which is complete only for a small fragment of effect properties. This work presents the first complete cause-synthesis algorithm for the class of omega-regular effects. We show that in this case, causes are guaranteed to be omega-regular themselves and can be computed as, e.g., nondeterministic B\"uchi automata. We demonstrate the practical feasibility of this algorithm with a prototype tool and evaluate its performance for cause synthesis and cause checking., Comment: 36th International Conference on Computer Aided Verification (CAV 2024)

In recent years, various large foundation models have been proposed for image segmentation. There models are often trained on large amounts of data corresponding to general computer vision tasks. Hence, these models do not perform well on medical data. There have been some attempts in the literature to perform parameter-efficient finetuning of such foundation models for medical image segmentation. However, these approaches assume that all the parameters of the model are available for adaptation. But, in many cases, these models are released as APIs or blackboxes, with no or limited access to the model parameters and data. In addition, finetuning methods also require a significant amount of compute, which may not be available for the downstream task. At the same time, medical data can't be shared with third-party agents for finetuning due to privacy reasons. To tackle these challenges, we pioneer a blackbox adaptation technique for prompted medical image segmentation, called BAPS. BAPS has two components - (i) An Image-Prompt decoder (IP decoder) module that generates visual prompts given an image and a prompt, and (ii) A Zero Order Optimization (ZOO) Method, called SPSA-GC that is used to update the IP decoder without the need for backpropagating through the foundation model. Thus, our method does not require any knowledge about the foundation model's weights or gradients. We test BAPS on four different modalities and show that our method can improve the original model's performance by around 4%., Comment: Accepted early at MICCAI 2024

Let ${\Bbb G}$ be a locally compact quantum group and ${\mathcal T}(L^2({\Bbb G}))$ be the Banach algebra of trace class operators on $L^2({\Bbb G})$ with the convolution induced by the right fundamental unitary of ${\Bbb G}$. We study the space of harmonic operators $\widetilde{\mathcal H}_\omega$ in ${\mathcal B}(L^2({\Bbb G}))$ associated to a contractive element $\omega\in {\mathcal T}(L^2({\Bbb G}))$. We characterize the existence of non-zero harmonic operators in ${\mathcal K}(L^2({\Bbb G}))$ and relate them with some properties of the quantum group ${\Bbb G}$, such as finiteness, amenability and co-amenability.

Memristors are considered key building blocks for the development of neuromorphic computing hardware. For ferroelectric memristors with a capacitor-like structure, the polarization direction modulates the height of the Schottky barriers -- present at ferroelectric/metal interfaces -- that control the device resistance. Here, we unveil the coexistence of multiple memristive mechanisms in Pt/Ca:HfO$_2$/Pt devices fabricated on silicon by a simple and effective low-toxicity chemical solution method. Depending on the fabrication conditions, either dielectric or ferroelectric devices are obtained, each one presenting a distinct memristive response. The devices are forming-free and can sustain ferroelectric switching and memristive behavior simultaneously. Aided by numerical simulations, we describe this behavior as a competition of different mechanisms, including the effect of the ferroelectric polarization on Schottky interfaces and oxygen vacancy electromigration. Finally, we propose a simple learning algorithm for time-series recognition, designed to take advantage of the resistance relaxations present in the case of the ferroelectric devices., Comment: 10 pages, 4 figures

We use the Ultraviolet Imaging of the Cosmic Assembly Near-infrared Deep Extragalactic Legacy Survey fields (UVCANDELS) to measure half-light radii in the rest-frame far-UV for $\sim$16,000 disk-like galaxies over $0.5\leq z \leq 3$. We compare these results to rest-frame optical sizes that we measure in a self-consistent way and find that the stellar mass-size relation of disk galaxies is steeper in the rest-frame UV than in the optical across our entire redshift range. We show that this is mainly driven by massive galaxies ($\gtrsim10^{10}$M$_\odot$), which we find to also be among the most dusty. Our results are consistent with the literature and have commonly been interpreted as evidence of inside-out growth wherein galaxies form their central structures first. However, they could also suggest that the centers of massive galaxies are more heavily attenuated than their outskirts. We distinguish between these scenarios by modeling and selecting galaxies at $z=2$ from the VELA simulations suite in a way that is consistent with UVCANDELS. We show that the effects of dust alone can account for the size differences we measure at $z=2$. This indicates that, at different wavelengths, size differences and the different slopes of the stellar mass-size relation do not constitute evidence for inside-out growth., Comment: Accepted for publication in ApJ. 22 pages, 12 figures, and 4 tables

This paper presents the design and analysis of a superdirective rectenna optimized for enhanced RF-to-DC efficiency and realised gain, featuring direct impedance matching between the antenna and the rectifier. Employing passively loaded, low profile strip dipoles on a low-loss substrate, the rectenna achieves a realised gain of 6.9 dBi and an RF-to-DC efficiency of 22.1% at -20 dBm.

When encountering complex fluorescence decays that deviate from exponentiality, a very appealing and powerful approach is to use lifetime (or equivalent rate constant) distributions. These are related by Laplace transform to multi-exponential functions, stretched exponentials, Becquerel's law, and others. In the case of bimolecular quenching, time-independent probability distributions of the rate constants have occasionally been used. Here we show that this mathematical formalism has a clear physical interpretation only when the fluorophore and quencher molecules are immobile, as in the solid state. However, such an interpretation is no longer possible once we consider the motion of fluorophores with respect to quenchers. Therefore, for systems in which the relative motion of fluorophores and quenchers cannot be neglected, it is not appropriate to use the time-independent continuous reaction rate or decay time distributions to describe, fit, or rationalize experimental results., Comment: The following article has been submitted to the Journal of Chemical Physics. After it is published, the updated version can be found at https://pubs.aip.org/aip/jcp

Global Navigation Satellite Systems (GNSS) provide precise location, while Real Time Kinematics (RTK) allow mobile receivers (termed rovers), leveraging fixed stations, to correct errors in their Position Navigation and Timing (PNT) solution. This allows compensating for multi-path effects, ionospheric errors, and observation biases, enabling consumer receivers to achieve centimeter-level accuracy. While network distribution of correction streams can be protected with common secure networking practices, the reference stations can still be attacked by GNSS spoofing or jamming. This work investigates (i) the effect RTK reference station spoofing has on the rover's PNT solution quality and (ii) the potential countermeasures towards hardening the RTK infrastructure., Comment: To appear in the 17th ACM Conference on Security and Privacy in Wireless and Mobile Networks

We use a design workbook of speculative scenarios as a values elicitation activity with 14 participants. The workbook depicts use case scenarios with smart home camera technologies that involve surveillance and uneven power relations. The scenarios were initially designed by the researchers to explore scenarios of privacy and surveillance within three social relationships involving "primary" and "non-primary" users: Parents-Children, Landlords-Tenants, and Residents-Domestic Workers. When the scenarios were utilized as part of a values elicitation activity with participants, we found that they reflected on a broader set of interconnected social values beyond privacy and surveillance, including autonomy and agency, physical safety, property rights, trust and accountability, and fairness. The paper suggests that future research about ethical issues in smart homes should conceptualize privacy as interconnected with a broader set of social values (which can align or be in tension with privacy), and reflects on considerations for doing research with non-primary users., Comment: Proceedings of the 2023 ACM Designing Interactive Systems Conference (DIS '23)

We investigate hyper-doping, a promising approach to introduce a high concentration of impurities into silicon beyond its solid solubility limit, for its potential applications in near-infrared plasmonics. We systematically explore the incorporation of dopants into silicon using ion implantation and pulsed laser melting annealing processes. Reflectance spectra analysis shows an achievable plasma wavelength of around 1.5 $\mu$m for dopant concentrations exceeding 4 at.%. Complex refractive index data for the doped silicon samples are extracted, revealing their potential for near-infrared plasmonic applications. Moreover, we propose a fabrication process that allows for the creation of hyper-doped silicon nanoparticles without the need for additional masking steps. Our research paves the way for designing CMOS-compatible plasmonic nanostructures operating in the telecommunication wavelength range. The study's findings offer significant insights into the utilization of hyper-doped silicon for advanced photonic and optoelectronic applications.

Using the measured and projected invisible mass spectrum of the $K^+\to\pi^+\nu\bar\nu$ mode, we determine the current and future constraints within the model-independent framework of the weak effective theory at dimension-six. We work in two different operator bases depending whether neutrinos are Majorana or Dirac fermions. This makes it possible to transparently incorporate mass effects of additional sterile neutrinos for all operators., Comment: Prepared for the 2024 Electroweak session of the 58th Rencontres de Moriond, 5 pages, 4 figures

Inverse design of optical components based on adjoint sensitivity analysis has the potential to address the most challenging photonic engineering problems. However existing inverse design tools based on finite-difference-time-domain (FDTD) models are poorly suited for optimizing waveguide modes for adiabatic transformation or perturbative coupling, which lies at the heart of many important photonic devices. Among these, dispersion engineering of optical waveguides is especially challenging in ultrafast and nonlinear optical applications involving broad optical bandwidths and frequency-dependent anisotropic dielectric material response. In this work we develop gradient back-propagation through a general purpose electromagnetic eigenmode solver and use it to demonstrate waveguide dispersion optimization for second harmonic generation with maximized phase-matching bandwidth. This optimization of three design parameters converges in eight steps, reducing the computational cost of optimization by ~100x compared to exhaustive search and identifies new designs for broadband optical frequency doubling of laser sources in the 1.3-1.4 micron wavelength range.Furthermore we demonstrate that the computational cost of gradient back-propagation is independent of the number of parameters, as required for optimization of complex geometries. This technique enables practical inverse design for a broad range of previously intractable photonic devices.

Unconstrained optimization problems are typically solved using iterative methods, which often depend on line search techniques to determine optimal step lengths in each iteration. This paper introduces a novel line search approach. Traditional line search methods, aimed at determining optimal step lengths, often discard valuable data from the search process and focus on refining step length intervals. This paper proposes a more efficient method using Bayesian optimization, which utilizes all available data points, i.e., function values and gradients, to guide the search towards a potential global minimum. This new approach more effectively explores the search space, leading to better solution quality. It is also easy to implement and integrate into existing frameworks. Tested on the challenging CUTEst test set, it demonstrates superior performance compared to existing state-of-the-art methods, solving more problems to optimality with equivalent resource usage., Comment: To be featured in LION18 2024

We provide an algorithm to decide whether a class of finite graphs that has bounded linear clique width is well-quasi-ordered by the induced subgraph relation in the presence of a labelling of the vertices, where the class is given by an $\mathsf{MSO}$-transduction from finite words. This study leverages tools from automata theory, and the proof scheme allows to derive a weak version of the Pouzet conjecture for classes of bounded linear clique-width. We also provide an automata based characterization of which classes of $\mathsf{NLC}$ graphs are labelled-well-quasi-ordered by the induced subgraph relation, where we recover the results of Daligault Rao and Thomass\'e by encoding the models into trees with the gap embedding relation of Dershowitz and Tzameret., Comment: 24 pages

Developers use different means to document the security concerns of their code. Because of all of these opportunities, they may forget where the information is stored, or others may not be aware of it, and leave it unmaintained for so long that it becomes obsolete, if not useless. In this work, we analyzed different sources of code documentation from four large-scale, real-world, open-source projects in an industrial setting to understand where developers report their security concerns. In particular, we manually inspected 2.559 instances taken from source code comments, commit messages, and issue trackers. Overall, we found that developers prefer to document security concerns in source code comments and issue trackers. We also found that the longer the comments stay unfixed, the more likely they remain unfixed. Thus, to create awareness among developers, we implemented a pipeline to remind them about the introduction or removal of comments pointing to a security problem., Comment: Accepted as an extended abstract for XP'24

We fix a complex analytic normal singularity germ $(X,o)$ of dimension $\geq 2$ and a (not necessarily irreducible) reduced Weil divisor $(S,o)\subset (X,o)$. The embedded resolution of the pair determines a multi-index filtration of the local ring $\mathcal{O}_{X,o}$, which measures the embedded geometry of the pair. Furthermore, from the (induced) resolution of $(S,o)$ we also consider a multi-index filtration associated with $(S,o)$. This latter one can be lifted to a filtration of $\mathcal{O}_{X,o}$ too. The main result proves that the second filtration of $\mathcal{O}_{X,o}$ can be realized as a `limit' filtration of the first one (if we blow up certain centers sufficiently many times)., Comment: 10 pages

The unluckiest star orbits a supermassive black hole elliptically. Every time it reaches the pericenter, it shallowly enters the tidal radius and gets partially tidal disrupted, producing a series of flares. Confirmation of a repeated partial tidal disruption event (pTDE) requires not only evidence to rule out other types of transients, but also proof that only one star is involved, as TDEs from multiple stars can also produce similar flares. In this letter, we report the discovery of a repeated pTDE, AT 2022dbl. In a quiescent galaxy at z=0.0284, two separate optical/UV flares have been observed in 2022 and 2024, with no bright X-ray, radio or mid-infrared counterparts. Compared to the first flare, the second flare has a similar blackbody temperature of ~26,000 K, slightly lower peak luminosity, and slower rise and fall phases. Compared to the ZTF TDEs, their blackbody parameters, bolometric energies and light curve shapes are all similar. The spectra taken during the second flare show a steeper continuum than the late-time spectra of the previous flare, consistent with a newly risen flare. More importantly, the possibility of two independent TDEs can be largely ruled out because the optical spectra taken around the peak of the two flares exhibit highly similar broad Balmer, N III and possible He II emission lines, especially the extreme ~4100{\AA} emission lines. This represents the first robust spectroscopic evidence for a repeated pTDE, which can soon be verified by observing the third flare, given its short orbital period., Comment: 15 pages, 8 figures, submitted to ApJ Letters on 2024 Apr 27