Search

We introduce a technique for multi-document grounded multi-turn synthetic dialog generation that incorporates three main ideas. First, we control the overall dialog flow using taxonomy-driven user queries that are generated with Chain-of-Thought (CoT) prompting. Second, we support the generation of multi-document grounded dialogs by mimicking real-world use of retrievers to update the grounding documents after every user-turn in the dialog. Third, we apply LLM-as-a-Judge to filter out queries with incorrect answers. Human evaluation of the synthetic dialog data suggests that the data is diverse, coherent, and includes mostly correct answers. Both human and automatic evaluations of answerable queries indicate that models fine-tuned on synthetic dialogs consistently out-perform those fine-tuned on existing human generated training data across four publicly available multi-turn document grounded benchmark test sets.

Atomically thin two-dimensional (2D) hexagonal boron nitride (hBN) has emerged as an essential material for the encapsulation layer in van der Waals heterostructures and efficient deep ultra-violet optoelectronics. This is primarily due to its remarkable physical properties and ultrawide bandgap (close to 6 eV, and even larger in some cases) properties. Color centers in hBN refer to intrinsic vacancies and extrinsic impurities within the 2D crystal lattice, which result in distinct optical properties in the ultraviolet (UV) to near-infrared (IR) range. Furthermore, each color center in hBN exhibits a unique emission spectrum and possesses various spin properties. These characteristics open up possibilities for the development of next-generation optoelectronics and quantum information applications, including room-temperature single-photon sources and quantum sensors. Here, we provide a comprehensive overview of the atomic configuration, optical and quantum properties, and different techniques employed for the formation of color centers in hBN. A deep understanding of color centers in hBN allows for advances in the development of next-generation UV optoelectronic applications, solid-state quantum technologies, and nanophotonics by harnessing the exceptional capabilities offered by hBN color centers.

Keyphrase Prediction (KP) is essential for identifying keyphrases in a document that can summarize its content. However, recent Natural Language Processing (NLP) advances have developed more efficient KP models using deep learning techniques. The limitation of a comprehensive exploration jointly both keyphrase extraction and generation using pre-trained language models spotlights a critical gap in the literature, compelling our survey paper to bridge this deficiency and offer a unified and in-depth analysis to address limitations in previous surveys. This paper extensively examines the topic of pre-trained language models for keyphrase prediction (PLM-KP), which are trained on large text corpora via different learning (supervisor, unsupervised, semi-supervised, and self-supervised) techniques, to provide respective insights into these two types of tasks in NLP, precisely, Keyphrase Extraction (KPE) and Keyphrase Generation (KPG). We introduce appropriate taxonomies for PLM-KPE and KPG to highlight these two main tasks of NLP. Moreover, we point out some promising future directions for predicting keyphrases.

We present a catalog of stellar parameters (effective temperature $T_{\rm eff}$, surface gravity $\log g$, age, and metallicity [Fe/H]) and elemental-abundance ratios ([C/Fe], [Mg/Fe], and [$\alpha$/Fe]) for some five million stars (4.5 million dwarfs and 0.5 million giants stars) in the Milky Way, based on stellar colors from the Javalambre Photometric Local Universe Survey (J-PLUS) DR3 and \textit{Gaia} EDR3. These estimates are obtained through the construction of a large spectroscopic training set with parameters and abundances adjusted to uniform scales, and trained with a Kernel Principal Component Analysis. Owing to the seven narrow/medium-band filters employed by J-PLUS, we obtain precisions in the abundance estimates that are as good or better than derived from medium-resolution spectroscopy for stars covering a wide range of the parameter space: 0.10-0.20 dex for [Fe/H] and [C/Fe], and 0.05 dex for [Mg/Fe] and [$\alpha$/Fe]. Moreover, systematic errors due to the influence of molecular carbon bands on previous photometric-metallicity estimates (which only included two narrow/medium-band blue filters) have now been removed, resulting in photometric-metallicity estimates down to [Fe/H] $\sim -4.0$, with typical uncertainties of 0.25 dex and 0.40 dex for dwarfs and giants, respectively. This large photometric sample should prove useful for the exploration of the assembly and chemical-evolution history of our Galaxy., Comment: 31 pages, 20 figures, 3 tables, accepeted by ApJ

Spin- and charge-lattice interactions are potential key factors in the microscopic mechanism of high-temperature superconductivity in cuprates. Although both interactions can dramatically shape the low-energy electronic structure, their phenomenological roles in superconductivity are usually investigated independently. Employing angle-resolved photoemission spectroscopy, we reveal the spectroscopic fingerprint of short-range antiferromagnetic order in conjunction with enhanced electron-phonon interaction in the electron-doped cuprate superconductor $\mathrm{Nd_{1.85}Ce_{0.15}CuO_4}$. The observed mode coupling exhibits a strong momentum dependence that is in striking contrast to the node-antinode dichotomy previously observed in the hole-doped cuprates. Our results reveal an intimate relationship between electron-phonon coupling and antiferromagnetic fluctuations, which collectively sets the stage for unconventional superconductivity in the electron-doped cuprates.

Syntactic elements, such as word order and case markers, are fundamental in natural language processing. Recent studies show that syntactic information boosts language model performance and offers clues for people to understand their learning mechanisms. Unlike languages with a fixed word order such as English, Korean allows for varied word sequences, despite its canonical structure, due to case markers that indicate the functions of sentence components. This study explores whether Korean language models can accurately capture this flexibility. We note that incomplete word orders and omitted case markers frequently appear in ordinary Korean communication. To investigate this further, we introduce the Syntactically Incomplete Korean (SIKO) dataset. Through SIKO, we assessed Korean language models' flexibility with incomplete syntax and confirmed the dataset's training value. Results indicate these models reflect Korean's inherent flexibility, accurately handling incomplete inputs. Moreover, fine-tuning with SIKO enhances the ability to handle common incomplete Korean syntactic forms. The dataset's simple construction process, coupled with significant performance enhancements, solidifies its standing as an effective data augmentation technique., Comment: COLM 2024; Code and dataset is available in https://github.com/grayapple-git/SIKO

Humans share a wide variety of images related to their personal experiences within conversations via instant messaging tools. However, existing works focus on (1) image-sharing behavior in singular sessions, leading to limited long-term social interaction, and (2) a lack of personalized image-sharing behavior. In this work, we introduce Stark, a large-scale long-term multi-modal conversation dataset that covers a wide range of social personas in a multi-modality format, time intervals, and images. To construct Stark automatically, we propose a novel multi-modal contextualization framework, Mcu, that generates long-term multi-modal dialogue distilled from ChatGPT and our proposed Plan-and-Execute image aligner. Using our Stark, we train a multi-modal conversation model, Ultron 7B, which demonstrates impressive visual imagination ability. Furthermore, we demonstrate the effectiveness of our dataset in human evaluation. We make our source code and dataset publicly available., Comment: Project website: https://stark-dataset.github.io

GreenLearning networks (GL) directly learn Green's function in physical space, making them an interpretable model for capturing unknown solution operators of partial differential equations (PDEs). For many PDEs, the corresponding Green's function exhibits asymptotic smoothness. In this paper, we propose a framework named Green Multigrid networks (GreenMGNet), an operator learning algorithm designed for a class of asymptotically smooth Green's functions. Compared with the pioneering GL, the new framework presents itself with better accuracy and efficiency, thereby achieving a significant improvement. GreenMGNet is composed of two technical novelties. First, Green's function is modeled as a piecewise function to take into account its singular behavior in some parts of the hyperplane. Such piecewise function is then approximated by a neural network with augmented output(AugNN) so that it can capture singularity accurately. Second, the asymptotic smoothness property of Green's function is used to leverage the Multi-Level Multi-Integration (MLMI) algorithm for both the training and inference stages. Several test cases of operator learning are presented to demonstrate the accuracy and effectiveness of the proposed method. On average, GreenMGNet achieves $3.8\%$ to $39.15\%$ accuracy improvement. To match the accuracy level of GL, GreenMGNet requires only about $10\%$ of the full grid data, resulting in a $55.9\%$ and $92.5\%$ reduction in training time and GPU memory cost for one-dimensional test problems, and a $37.7\%$ and $62.5\%$ reduction for two-dimensional test problems.

In this paper, we present Period Singer, a novel end-to-end singing voice synthesis (SVS) model that utilizes variational inference for periodic and aperiodic components, aimed at producing natural-sounding waveforms. Recent end-to-end SVS models have demonstrated the capability of synthesizing high-fidelity singing voices. However, owing to deterministic pitch conditioning, they do not fully address the one-to-many problem. To address this problem, we present the Period Singer architecture, which integrates variational autoencoders for the periodic and aperiodic components. Additionally, our methodology eliminates the dependency on an external aligner by estimating the phoneme alignment through a monotonic alignment search within note boundaries. Our empirical evaluations show that Period Singer outperforms existing end-to-end SVS models on Mandarin and Korean datasets. The efficacy of the proposed method was further corroborated by ablation studies., Comment: Accepted by Interspeech 2024

This paper proposes empirically tractable multidimensional matching models, focusing on worker-job matching. We generalize the parametric model proposed by Lindenlaub (2017), which relies on the assumption of joint normality of observed characteristics of workers and jobs. In our paper, we allow unrestricted distributions of characteristics and show identification of the production technology, and equilibrium wage and matching functions using tools from optimal transport theory. Given identification, we propose efficient, consistent, asymptotically normal sieve estimators. We revisit Lindenlaub's empirical application and show that, between 1990 and 2010, the U.S. economy experienced much larger technological progress favoring cognitive abilities than the original findings suggest. Furthermore, our flexible model specifications provide a significantly better fit for patterns in the evolution of wage inequality.

In this paper, we present a new framework how a PDE with constraints can be formulated into a sequence of PDEs with no constraints, whose solutions are convergent to the solution of the PDE with constraints. This framework is then used to build a novel finite neuron method to solve the 2nd order elliptic equations with the Dirichlet boundary condition. Our algorithm is the first algorithm, proven to lead to shallow neural network solutions with an optimal H1 norm error. We show that a widely used penalized PDE, which imposes the Dirichlet boundary condition weakly can be interpreted as the first element of the sequence of PDEs within our framework. Furthermore, numerically, we show that it may not lead to the solution with the optimal H1 norm error bound in general. On the other hand, we theoretically demonstrate that the second and later elements of a sequence of PDEs can lead to an adequate solution with the optimal H1 norm error bound. A number of sample tests are performed to confirm the effectiveness of the proposed algorithm and the relevant theory.

We introduce a new concept of the locally conservative flux and investigate its relationship with the compatible discretization pioneered by Dawson, Sun and Wheeler [11]. We then demonstrate how the new concept of the locally conservative flux can play a crucial role in obtaining the L2 norm stability of the discontinuous Galerkin finite element scheme for the transport in the coupled system with flow. In particular, the lowest order discontinuous Galerkin finite element for the transport is shown to inherit the positivity and maximum principle when the locally conservative flux is used, which has been elusive for many years in literature. The theoretical results established in this paper are based on the equivalence between Lesaint-Raviart discontinuous Galerkin scheme and Brezzi-Marini-Suli discontinuous Galerkin scheme for the linear hyperbolic system as well as the relationship between the Lesaint-Raviart discontinuous Galerkin scheme and the characteristic method along the streamline. Sample numerical experiments have also been performed to justify our theoretical findings

For $0

The Hawkes process is a model for counting the number of arrivals to a system which exhibits the self-exciting property - that one arrival creates a heightened chance of further arrivals in the near future. The model, and its generalizations, have been applied in a plethora of disparate domains, though two particularly developed applications are in seismology and in finance. As the original model is elegantly simple, generalizations have been proposed which: track marks for each arrival, are multivariate, have a spatial component, are driven by renewal processes, treat time as discrete, and so on. This paper creates a cohesive review of the traditional Hawkes model and the modern generalizations, providing details on their construction, simulation algorithms, and giving key references to the appropriate literature for a detailed treatment.

Absolute quantity imaging of biomolecules on a single cell level is critical for measurement assurance in biosciences and bioindustries. While infrared (IR) transmission microscopy is a powerful label-free imaging modality capable of chemical quantification, its applicability to hydrated biological samples remains challenging due to the strong water absorption. We overcome this challenge by applying a solvent absorption compensation (SAC) technique to a home-built quantum cascade laser IR microscope. SAC-IR microscopy improves the chemical sensitivity considerably by adjusting the incident light intensity to pre-compensate the IR absorption by water while retaining the full dynamic range. We demonstrate the label-free chemical imaging of key biomolecules of a cell, such as protein, fatty acid, and nucleic acid, with sub-cellular spatial resolution. By imaging live fibroblast cells over twelve hours, we monitor the mass change of the three molecular species of single cells at various phases, including cell division. While the current live-cell imaging demonstration involved three wavenumbers, more wavenumber images could measure more biomolecules in live cells with higher accuracy. As a label-free method to measure absolute quantities of various molecules in a cell, SAC-IR microscopy can potentially become a standard chemical characterization tool for live cells in biology, medicine, and biotechnology., Comment: Body: 19 pages, 5 figures. Supplemental: 11 pages, 6 figures

Chemical anomalies in planet-hosting stars (PHSs) are studied in order to assess how the planetary nature and multiplicity affect the atmospheric chemical abundances of their host stars. We employ APOGEE DR17 to select thin-disk stars of the Milky Way, and cross-match them with the Kepler Input Catalog to identify confirmed PHSs, which results in 227 PHSs with available chemical-abundance ratios for six refractory elements. We also examine an ensemble of stars without planet signals, which are equivalent to the selected PHSs in terms of evolutionary stage and stellar parameters, to correct for Galactic chemical-evolution effects, and derive the abundance gradient of refractory elements over the condensation temperature for the PHSs. Using the Galactic chemical-evolution corrected abundances, we found that PHSs do not show a significant difference in abundance slope from the stars without planets. Furthermore, we examine the depletion trends of refractory elements of PHSs depending on total number of planets and their types, and find that the PHSs with giant planets are more depleted in refractory elements than those with rocky planets. Among the PHSs with rocky planets, the refractory-depletion trends are potentially correlated with the terrestrial planets' radii and multiplicity. In the cases of PHSs with giant planets, sub-Jovian PHSs demonstrated more depleted refractory trends than stars hosting Jovian-mass planets, raising questions on different planetary-formation processes for Neptune-like and Jupiter-like planets., Comment: 14 pages, 6 figures

It is often desirable for Large Language Models (LLMs) to capture multiple objectives when providing a response. In document-grounded response generation, for example, agent responses are expected to be relevant to a user's query while also being grounded in a given document. In this paper, we introduce Proxy Metric-based Self-Refinement (ProMiSe), which enables an LLM to refine its own initial response along key dimensions of quality guided by external metrics feedback, yielding an overall better final response. ProMiSe leverages feedback on response quality through principle-specific proxy metrics, and iteratively refines its response one principle at a time. We apply ProMiSe to open source language models Flan-T5-XXL and Llama-2-13B-Chat, to evaluate its performance on document-grounded question answering datasets, MultiDoc2Dial and QuAC, demonstrating that self-refinement improves response quality. We further show that fine-tuning Llama-2-13B-Chat on the synthetic dialogue data generated by ProMiSe yields significant performance improvements over the zero-shot baseline as well as a supervised fine-tuned model on human annotated data.

Uncovering pathways to optically drive magnetic order-disorder transitions on ultrashort timescales can lead to the realization of novel out-of-equilibrium quantum phenomena. A long-sought pathway is to directly excite a highly non-thermal energy-momentum distribution of magnons, bypassing both charge and lattice degrees of freedom. However, this remains elusive owing to the weak coupling and large momentum mismatch between photons and magnons. Here we demonstrate strong parametric excitation of magnons across the entire Brillouin zone of the antiferromagnetic insulator Sr$_2$Cu$_3$O$_4$Cl$_2$ by periodically modulating the superexchange interaction with the electric field of light. The excitation efficiency is greatly enhanced by tuning to the van Hove singularity in the magnon spectrum, sufficient to transiently collapse the antiferromagnetic state using a pulsed laser field of 10$^9$ V/m. The order parameter recovery timescale increases by over 1000 times as a function of excitation density, reflecting a crossover from high- to low-energy magnon dominated decay dynamics. This electric-field induced parametric magnon pumping mechanism is applicable to a broad range of magnetic insulators and opens up the possibility of dynamically engineering magnon distributions by design., Comment: The submitter did not obtain approval from all authors to post this paper. Jun-Yi Shan does not approve of posting this paper

We consider the dispersion managed nonlinear Schr\"dinger equations with quintic and cubic nonlinearities in one and two dimensions, respectively. We prove the global well-posedness and scattering in $L_x^2$ for small initial data employing the $U^p$ and $V^p$ spaces., Comment: 14 pages