Search

Reduced order models based on the transport of a lower dimensional manifold representation of the thermochemical state, such as Principal Component (PC) transport and Machine Learning (ML) techniques, have been developed to reduce the computational cost associated with the Direct Numerical Simulations (DNS) of reactive flows. Both PC transport and ML normally require an abundance of data to exhibit sufficient predictive accuracy, which might not be available due to the prohibitive cost of DNS or experimental data acquisition. To alleviate such difficulties, similar data from an existing dataset or domain (source domain) can be used to train ML models, potentially resulting in adequate predictions in the domain of interest (target domain). This study presents a novel probabilistic transfer learning (TL) framework to enhance the trust in ML models in correctly predicting the thermochemical state in a lower dimensional manifold and a sparse data setting. The framework uses Bayesian neural networks, and autoencoders, to reduce the dimensionality of the state space and diffuse the knowledge from the source to the target domain. The new framework is applied to one-dimensional freely-propagating flame solutions under different data sparsity scenarios. The results reveal that there is an optimal amount of knowledge to be transferred, which depends on the amount of data available in the target domain and the similarity between the domains. TL can reduce the reconstruction error by one order of magnitude for cases with large sparsity. The new framework required 10 times less data for the target domain to reproduce the same error as in the abundant data scenario. Furthermore, comparisons with a state-of-the-art deterministic TL strategy show that the probabilistic method can require four times less data to achieve the same reconstruction error.

We study accretion remnants around Milky Way analogs in the IllustrisTNG simulations to determine how well commonly used distribution functions (DFs) describe their phase-space distributions. We identify 30 Milky Way analogs and 116 remnants from mergers with stellar mass ratios greater than 1:20. Two-power density profiles, as well as rotating constant-anisotropy and Osipkov-Merritt DFs are fit to the remnants. We determine that the remnants are suitable for equilibrium modelling by assessing them in the context of the Jeans equation. Each of the models we consider are reasonably able to fit the stellar remnant energy and angular momentum distribution, as well as the magnitude and shape of velocity dispersion profiles. Case studies matched to two well-known merger remnants in the stellar halo-Gaia-Sausage/Enceladus (GS/E) and Sequoia-are explored in more depth. We find good evidence that remnants with high anisotropy $\beta$, such as GS/E, are better modelled with a superposition of two Osipkov-Merritt DFs than either a constant-anisotropy model or a single Osipkov-Merritt DF. We estimate an Osipkov-Merritt profile with scale radius between 2-4 kpc would be a good first-order representation of GS/E, and comment on existing observational evidence for this as well as studies which could demonstrate it. Overall, we find that DF-based models work well for describing the kinematics of large merger remnants. Our results will be an important reference for future studies which seek to constrain both the spatial and kinematic properties of merger remnants in the Milky Way stellar halo., Comment: 17 pages, 11 figures. Submitted to MNRAS. Comments welcome

Integrated photon-pair sources are crucial for scalable photonic quantum systems. Thin-film lithium niobate is a promising platform for on-chip photon-pair generation through spontaneous parametric down-conversion (SPDC). However, the device implementation faces practical challenges. Periodically poled lithium niobate (PPLN), despite enabling flexible quasi-phase matching, suffers from poor fabrication reliability and device repeatability, while conventional modal phase matching (MPM) methods yield limited efficiencies due to inadequate mode overlaps. Here, we introduce a layer-poled lithium niobate (LPLN) nanophotonic waveguide for efficient photon-pair generation. It leverages layer-wise polarity inversion through electrical poling to break spatial symmetry and significantly enhance nonlinear interactions for MPM, achieving a notable normalized second-harmonic generation (SHG) conversion efficiency of 4615% W^{-1}cm^{-2}. Through a cascaded SHG and SPDC process, we demonstrate photon-pair generation with a normalized brightness of 3.1*10^6 Hz nm^{-1} mW^{-2} in a 3.3 mm long LPLN waveguide, surpassing existing on-chip sources under similar operating configurations. Crucially, our LPLN waveguides offer enhanced fabrication reliability and reduced sensitivity to geometric variations and temperature fluctuations compared to PPLN devices. We expect LPLN to become a promising solution for on-chip nonlinear wavelength conversion and non-classical light generation, with immediate applications in quantum communication, networking, and on-chip photonic quantum information processing.

We employ quantum-volume random-circuit sampling to benchmark the two-QPU entanglement-assisted distributed quantum computing (DQC), and compare it with single-QPU quantum computing. We first specify a single-qubit depolarizing noise model in the random circuit. Based on this error model, we show the one-to-one correspondence of three figures of merits, namely average gate fidelity, heavy output probability, and linear cross-entropy. We derive an analytical approximation of the average gate fidelity under the specified noise model, which is shown to align with numerical simulations. The approximation is calculated based on an allocation matrix obtained from the extended connectivity graph of a DQC device. In numerical simulation, we unveil the scalability enhancement in DQC for the QPUs with limited connectivity. Furthermore, we provide a simple formula to estimate the average gate fidelity, which also provides us with a heuristic method to evaluate the scalability enhancement in DQC, and a guide to optimize the structure of a DQC configuration., Comment: 13 page, 14 figures, 5-page Appendix

Variational quantum algorithms (VQAs) are a broad class of algorithms with many applications in science and industry. Applying a VQA to a problem involves optimizing a parameterized quantum circuit by maximizing or minimizing a cost function. A particular challenge associated with VQAs is understanding the properties of associated cost functions. Having the landscapes of VQA cost functions can greatly assist in developing and testing new variational quantum algorithms, but they are extremely expensive to compute. Reconstructing the landscape of a VQA using existing techniques requires a large number of cost function evaluations, especially when the dimension or the resolution of the landscape is high. To address this challenge, we propose a low-rank tensor-completion-based approach for local landscape reconstruction. By leveraging compact low-rank representations of tensors, our technique can overcome the curse of dimensionality and handle high-resolution landscapes. We demonstrate the power of landscapes in VQA development by showcasing practical applications of analyzing penalty terms for constrained optimization problems and examining the probability landscapes of certain basis states.

Cosmic strings are a common prediction in many grand unified theories and a promising source of stochastic gravitational waves (GWs) from the early Universe. In this paper, we point out that the GW signal from cosmic strings produced at a comparatively low energy scale, $v \lesssim 10^9 \textrm{GeV}$, exhibits several novel features that are not present in the case of high-scale cosmic strings. Our findings notably include (i) a sharp cutoff frequency $f_{\rm cut}$ in the GW spectrum from the fundamental oscillation mode on closed string loops and (ii) an oscillating pattern in the total GW spectrum from all oscillation modes whose local minima are located at integer multiples of $f_{\rm cut}$. These features reflect the fact that string loops produced in the early Universe fail to shrink to zero size because of GW emission within the age of the Universe, if their tension is low enough. In addition, they offer an exciting opportunity to directly probe the discrete spectrum of oscillation modes on closed string loops in GW observations. For strings produced at a scale $v \sim 10^9\textrm{GeV}$, the novel features in the GW spectrum are within the sensitivity reach of future experiments such as BBO and DECIGO., Comment: 16 pages, 4 figures

Understanding how language model performance varies with scale is critical to benchmark and algorithm development. Scaling laws are one approach to building this understanding, but the requirement of training models across many different scales has limited their use. We propose an alternative, observational approach that bypasses model training and instead builds scaling laws from ~80 publically available models. Building a single scaling law from multiple model families is challenging due to large variations in their training compute efficiencies and capabilities. However, we show that these variations are consistent with a simple, generalized scaling law where language model performance is a function of a low-dimensional capability space, and model families only vary in their efficiency in converting training compute to capabilities. Using this approach, we show the surprising predictability of complex scaling phenomena: we show that several emergent phenomena follow a smooth, sigmoidal behavior and are predictable from small models; we show that the agent performance of models such as GPT-4 can be precisely predicted from simpler non-agentic benchmarks; and we show how to predict the impact of post-training interventions like Chain-of-Thought and Self-Consistency as language model capabilities continue to improve.

The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and enhance the overall usability and accessibility for diverse language user groups, it is important for the development of language-fair technology. Despite the breakthroughs of LLMs, the investigation into the multilingual scenario remains insufficient, where a comprehensive survey to summarize recent approaches, developments, limitations, and potential solutions is desirable. To this end, we provide a survey with multiple perspectives on the utilization of LLMs in the multilingual scenario. We first rethink the transitions between previous and current research on pre-trained language models. Then we introduce several perspectives on the multilingualism of LLMs, including training and inference methods, model security, multi-domain with language culture, and usage of datasets. We also discuss the major challenges that arise in these aspects, along with possible solutions. Besides, we highlight future research directions that aim at further enhancing LLMs with multilingualism. The survey aims to help the research community address multilingual problems and provide a comprehensive understanding of the core concepts, key techniques, and latest developments in multilingual natural language processing based on LLMs., Comment: 54 pages, Work in Progress

Self-distillation methods using Siamese networks are popular for self-supervised pre-training. DINO is one such method based on a cross-entropy loss between $K$-dimensional probability vectors, obtained by applying a softmax function to the dot product between representations and learnt prototypes. Given the fact that the learned representations are $L^2$-normalized, we show that DINO and its derivatives, such as iBOT, can be interpreted as a mixture model of von Mises-Fisher components. With this interpretation, DINO assumes equal precision for all components when the prototypes are also $L^2$-normalized. Using this insight we propose DINO-vMF, that adds appropriate normalization constants when computing the cluster assignment probabilities. Unlike DINO, DINO-vMF is stable also for the larger ViT-Base model with unnormalized prototypes. We show that the added flexibility of the mixture model is beneficial in terms of better image representations. The DINO-vMF pre-trained model consistently performs better than DINO on a range of downstream tasks. We obtain similar improvements for iBOT-vMF vs iBOT and thereby show the relevance of our proposed modification also for other methods derived from DINO., Comment: Accepted to ICLR 2023

The formula for correlation functions based on quantum $A_\infty$ algebras in arXiv:2203.05366, arXiv:2305.11634, and arXiv:2305.13103 requires dividing the action into the free part and the interaction part. We present a new form of the formula which does not involve such division. The new formula requires choosing a solution to the equations of motion which does not have to be real, and we claim that the formula gives correlation functions evaluated on the Lefschetz thimble associated with the solution we chose. Our formula correctly reproduces correlation functions in perturbation theory, but it can be valid nonperturbatively, and we present numerical evidence for scalar field theories in zero dimensions both in the Euclidean case and the Lorentzian case that correlation functions for finite coupling constants can be reproduced. When the theory consists of a single Lefschetz thimble, our formula gives correlation functions of the theory by choosing the solution corresponding to the thimble. When the theory consists of multiple Lefschetz thimbles, we need to evaluate the ratios of the partition functions for those thimbles and we describe a method of such evaluations based on quantum $A_\infty$ algebras in a forthcoming paper., Comment: 43 pages, 9 figures