Search

Hand-crafting high quality prompts to optimize the performance of language models is a complicated and labor-intensive process. Furthermore, when migrating to newer, smaller, or weaker models (possibly due to latency or cost gains), prompts need to be updated to re-optimize the task performance. We propose Concept Distillation (CD), an automatic prompt optimization technique for enhancing weaker models on complex tasks. CD involves: (1) collecting mistakes made by weak models with a base prompt (initialization), (2) using a strong model to generate reasons for these mistakes and create rules/concepts for weak models (induction), and (3) filtering these rules based on validation set performance and integrating them into the base prompt (deduction/verification). We evaluated CD on NL2Code and mathematical reasoning tasks, observing significant performance boosts for small and weaker language models. Notably, Mistral-7B's accuracy on Multi-Arith increased by 20%, and Phi-3-mini-3.8B's accuracy on HumanEval rose by 34%. Compared to other automated methods, CD offers an effective, cost-efficient strategy for improving weak models' performance on complex tasks and enables seamless workload migration across different language models without compromising performance., Comment: 13 pages, 8 figures, conference

We introduce Imagen 3, a latent diffusion model that generates high quality images from text prompts. We describe our quality and responsibility evaluations. Imagen 3 is preferred over other state-of-the-art (SOTA) models at the time of evaluation. In addition, we discuss issues around safety and representation, as well as methods we used to minimize the potential harm of our models.

Over a century ago, Einstein formulated a precise mathematical model for describing Brownian motion. While this model adequately explains the diffusion of micron-sized particles in fluids, its limitations become apparent when applied to molecular self-diffusion in fluids. The foundational principles of Gaussianity and Markovianity, central to the Brownian diffusion paradigm, are insufficient for describing molecular diffusion, particularly in complex fluids characterized by intricate intermolecular interactions and hindered relaxation processes. This perspective delves into the nuanced behavior observed in diverse complex fluids, including molecular self-assembly, deep eutectic solvents, and ionic liquids, with a specific focus on modeling self-diffusion within these media. We explore the potential of extending diffusion models to incorporate non-Gaussian and non-Markovian effects by augmenting the Brownian model using non-local diffusion equations. Further, we validate the applicability of these models by utilizing them to describe results from quasielastic neutron scattering and MD simulations.

Multi-color solitons that are parametrically created in dual-pumped microresonators generate interleaved frequency combs that can be used to obtain combs at new frequencies and when synchronized can be used for low-noise microwave generation and potentially as an element in a chip-scale clockwork. Here, we first derive three-wave equations that describe multi-color solitons that appear in microresonators with a nearly quartic dispersion profile. These solitons are characterized by a single angular group velocity and multiple angular phase velocities. We then use these equations to explain the interleaved frequency combs that are observed at the output of the microresonator. Finally, we used these equations to describe the experimentally-observed soliton-OPO effect. In this effect, the pump frequency comb interacts nonlinearly with a signal frequency comb to create an idler frequency comb in a new frequency range, analogous to an optical parametric oscillation (OPO) process. We determine the conditions under which we expect this effect to occur. We anticipate that the three-wave equations and their extensions will be of use in designing new frequency comb systems and determining their stability and noise performance.

We consider the problem of independently, in a disentangled fashion, controlling the outputs of text-to-image diffusion models with color and style attributes of a user-supplied reference image. We present the first training-free, test-time-only method to disentangle and condition text-to-image models on color and style attributes from reference image. To realize this, we propose two key innovations. Our first contribution is to transform the latent codes at inference time using feature transformations that make the covariance matrix of current generation follow that of the reference image, helping meaningfully transfer color. Next, we observe that there exists a natural disentanglement between color and style in the LAB image space, which we exploit to transform the self-attention feature maps of the image being generated with respect to those of the reference computed from its L channel. Both these operations happen purely at test time and can be done independently or merged. This results in a flexible method where color and style information can come from the same reference image or two different sources, and a new generation can seamlessly fuse them in either scenario., Comment: 16 pages, 17 figures

The Prony method for approximating signals comprising sinusoidal/exponential components is known through the pioneering work of Prony in his seminal dissertation in the year 1795. However, the Prony method saw the light of real world application only upon the advent of the computational era, which made feasible the extensive numerical intricacies and labor which the method demands inherently. The Adaptive LMS Filter which has been the most pervasive method for signal filtration and approximation since its inception in 1965 does not provide a consistently assured level of highly precise results as the extended experiment in this work proves. As a remedy this study improvises upon the Prony method by observing that a better (more precise) computational approximation can be obtained under the premise that adjustment can be made for computational error , in the autoregressive model setup in the initial step of the Prony computation itself. This adjustment is in proportion to the deviation of the coefficients in the same autoregressive model. The results obtained by this improvisation live up to the expectations of obtaining consistency and higher value in the precision of the output (recovered signal) approximations as shown in this current work and as compared with the results obtained using the Adaptive LMS Filter.

We present Container Data Item (CDI), an abstract datatype that allows multiple containers to efficiently operate on a common data item while preserving their strong security and isolation semantics. Application developers can use CDIs to enable multiple containers to operate on the same data, synchronize execution among themselves, and control the ownership of the shared data item during runtime. These containers may reside on the same server or different servers. CDI is designed to support microservice based applications comprised of a set of interconnected microservices, each implemented by a separate dedicated container. CDI preserves the important isolation semantics of containers by ensuring that exactly one container owns a CDI object at any instant and the ownership of a CDI object may be transferred from one container to another only by the current CDI object owner. We present three different implementations of CDI that allow different containers residing on the same server as well containers residing on different servers to use CDI for efficiently operating on a common data item. The paper provides an extensive performance evaluation of CDI along with two representative applications, an augmented reality application and a decentralized workflow orchestrator.

We report the crystal structures and superconductivity (SC) of LaPt$_{x}$Si$_{2-x}$ ($0.5 \leq x \leq 1.0$) that are solid solutions of LaSi$_{2}$ and LaPtSi with centrosymmetric tetragonal ($I4_{1}/amd$, $D_{4h}^{19}$, \#141) and non-centrosymmetric tetragonal ($I4_{1}md$, $C_{4v}^{11}$, \#109) structures, respectively. It was found that at $0.86 \leq x \leq 1.00$, the non-centrosymmetric tetragonal symmetry is preserved, while partial disorder appears in alternating Pt and Si of the hyper-honeycomb network. The superconducting transition temperature $T_{\rm c}$ was drastically reduced from 3.9 K to 1.5 K as $x$ varies from 1.0 to 0.86. Additionally, a hexagonal phase with an AlB$_{2}$-type structure ($P6/mmm$, $D_{6h}^{1}$, \#191) has been discovered at $0.50 \leq x \leq 0.71$ with a honeycomb network of statistically distributed Pt and Si atoms. The hexagonal phase exhibited SC at $T_{\rm c} = 0.38$ K. This system provides an opportunity to investigate the relationship between topological electronic states, SC, and disorders

The United States has experienced a significant increase in violent extremism, prompting the need for automated tools to detect and limit the spread of extremist ideology online. This study evaluates the performance of Bidirectional Encoder Representations from Transformers (BERT) and Generative Pre-Trained Transformers (GPT) in detecting and classifying online domestic extremist posts. We collected social media posts containing "far-right" and "far-left" ideological keywords and manually labeled them as extremist or non-extremist. Extremist posts were further classified into one or more of five contributing elements of extremism based on a working definitional framework. The BERT model's performance was evaluated based on training data size and knowledge transfer between categories. We also compared the performance of GPT 3.5 and GPT 4 models using different prompts: na\"ive, layperson-definition, role-playing, and professional-definition. Results showed that the best performing GPT models outperformed the best performing BERT models, with more detailed prompts generally yielding better results. However, overly complex prompts may impair performance. Different versions of GPT have unique sensitives to what they consider extremist. GPT 3.5 performed better at classifying far-left extremist posts, while GPT 4 performed better at classifying far-right extremist posts. Large language models, represented by GPT models, hold significant potential for online extremism classification tasks, surpassing traditional BERT models in a zero-shot setting. Future research should explore human-computer interactions in optimizing GPT models for extremist detection and classification tasks to develop more efficient (e.g., quicker, less effort) and effective (e.g., fewer errors or mistakes) methods for identifying extremist content.

Together with EuGa4 and EuAl4, EuAl2Ga2 belongs to the BaAl4 structure type with space group symmetry I4/mmm. EuAl2Ga2 develops an incommensurate charge density wave (CDW) at temperatures below TCDW = 51 K. On the basis of temperature dependent single-crystal X-ray diffraction (SXRD) data, the incommensurately modulated CDW crystal structure of EuAl2Ga2 is determined to possess orthorhombic superspace symmetry Immm(00g)s00. This symmetry is different from the orthorhombic Fmmm based symmetry of the CDW state of EuAl4. Nevertheless, both symmetries Immm(00g)s00 and Fmmm(00g)s00 lead to the same conclusion, that the CDW is supported by the layers of Al1 type atoms, while the Eu and Al2 or Ga atoms are not directly involved in CDW formation. The different symmetries of the CDW states of EuAl4 and EuAl2Ga2, as well as the observation of negative thermal expansion in the CDW state of EuAl2Ga2 might be explained by the effects of Ga substitution in the latter compound., Comment: 24 pages, 6 figures

We propose a novel approach to investigate the brain mechanisms that support coordination of behavior between individuals. Brain states in single individuals defined by the patterns of functional connectivity between brain regions are used to create joint symbolic representations of the evolution of brain states in two or more individuals performing a task together. These symbolic dynamics can be analyzed to reveal aspects of the dynamics of joint brain states that are related to coordination or other interactive behaviors. We apply this approach to simultaneous electroencephalographic (EEG) data from pairs of subjects engaged in two different modes of finger-tapping coordination tasks (synchronization and syncopation) under different interaction conditions (Uncoupled, Leader-Follower, and Mutual) to explore the neural mechanisms of multi-person motor coordination. Our results reveal that the dyads exhibit mostly the same joint symbols in different interaction conditions - the most important differences are reflected in the symbolic dynamics. Recurrence analysis shows that interaction influences the dwell time in specific joint symbols and the structure of joint symbol sequences (motif length). In synchronization, increasing feedback promotes stability with longer dwell times and motif length. In syncopation, Leader-Follower interactions enhance stability (increase dwell time and motif length), but Mutual feedback dramatically reduces stability. Network analysis reveals distinct topological changes with task and feedback. In synchronization, stronger coupling stabilizes a few states restricting the pattern of flow between states, preserving a core-periphery structure of the joint brain states. In syncopation, a more distributed flow amongst a larger set of joint brain states reduces the dominance of core joint brain states., Comment: 9 pages, 4 figures

This is a point-by-point response to a non-peer-reviewed document titled The Miscalibration of the Honeybee Odometer [arXiv:2405.12998], authored by L. Luebbert and L. Pachter, that was published on arXiv on 8 May 2024 and subsequently publicised via social and mainstream media. The authors never contacted Srinivasan or Tautz personally with their queries, nor did they seek clarification. They do not work in this research area, and they have drawn several unjustified conclusions that reflect a limited understanding of the data they have examined., Comment: Comment on arXiv:2405.12998 16 pages, 2 figures, 1 table

We present a novel multiferroic double perovskite compound, CaZnFeOsO$_6$ (CZFOO), exhibiting combined ferroelectric and ferrimagnetic properties. Through ab initio density functional theory calculations, we predict CZFOO as a unique example of an A-site and B-site ordered double perovskite structure, AA'BB'O$_6$. In this compound, Fe$^{3+}$ and Os$^{5+}$ ions generate substantial magnetization, while Ca$^{2+}$ and Zn$^{2+}$ ions create a layerwise polar environment, resulting in a synergistic combination for multiferroicity. We determine the magnitude of the spontaneous polarization, $\vert P_s \vert$, to be 16.8 $\mu$ C/cm$^2$, and the magnetic moment is approximately 2 $\mu_B$ per formula unit. The remarkable ferroelectric and ferrimagnetic behaviors exhibited by CZFOO make it a promising candidate for various device applications. Despite the significant magnetization and polarization observed, surpassing those of other double perovskites, we find a weak spin-orbit coupling, leading to the absence of any significant magnetoelectric effect in CZFOO. Our findings shed light on the potential of CZFOO as a multiferroic material and provide insights into the intricate interplay between ferroelectricity and ferrimagnetism in double perovskite compounds.

Model-based reinforcement learning (MBRL) algorithms learn a dynamics model from collected data and apply it to generate synthetic trajectories to enable faster learning. This is an especially promising paradigm in offline reinforcement learning (RL) where data may be limited in quantity, in addition to being deficient in coverage and quality. Practical approaches to offline MBRL usually rely on ensembles of dynamics models to prevent exploitation of any individual model and to extract uncertainty estimates that penalize values in states far from the dataset support. Uncertainty estimates from ensembles can vary greatly in scale, making it challenging to generalize hyperparameters well across even similar tasks. In this paper, we present Morse Model-based offline RL (MoMo), which extends the anti-exploration paradigm found in offline model-free RL to the model-based space. We develop model-free and model-based variants of MoMo and show how the model-free version can be extended to detect and deal with out-of-distribution (OOD) states using explicit uncertainty estimation without the need for large ensembles. MoMo performs offline MBRL using an anti-exploration bonus to counteract value overestimation in combination with a policy constraint, as well as a truncation function to terminate synthetic rollouts that are excessively OOD. Experimentally, we find that both model-free and model-based MoMo perform well, and the latter outperforms prior model-based and model-free baselines on the majority of D4RL datasets tested.

Remote epitaxy has garnered considerable attention as a promising method that facilitates the growth of thin films that replicate the crystallographic characteristics of a substrate by utilizing two-dimensional (2D) material interlayers like graphene. The resulting film can be exfoliated to form a freestanding membrane, and the substrate, if expensive, can be reused. However, atomically thin 2-D materials are susceptible to damage before and during film growth in the chamber, leading to a poor epitaxy. Oxide remote epitaxy using graphene, the most commonly available 2D material, is particularly challenging because the conventional conditions employed for the growth of epitaxial oxides also degrade graphene. In this study, we show for the first time that a direct correlation exists between the microstructure of graphene, its getting defective on exposure to the pulsed laser deposition plume, and the crystalline quality of the barium titanate film deposited on top. A controlled aperture method was used to reduce graphene damage. Even so, the degree of damage is more at the graphene grain boundaries than within the grains. Large grain-sized greater than 300 microns, graphene suffered less damage and yielded a film comparable to that grown directly on a strontium titanate substrate with a rocking curve half width of 0.6 degrees. Using large grain-sized bi-layer graphene, 4 mm x 5 mm oxide layers were successfully exfoliated and transferred onto SiOx-Si. These insights pave the way for the heterogeneous integration of functional oxides on foreign substrates, holding significant implications for commercializing perovskite oxides by integrating them with Si-CMOS and flexible electronics., Comment: 36 pages, 18 figures

Temporal cavity solitons, or dissipative Kerr solitons (DKS) in integrated microresonators, are essential for deployable metrology technologies. Such applications favor the lowest noise state, typically the single-DKS state where one soliton is in the resonator. Other multi-DKS states can also be reached, offering better conversion efficiency and thermal stability, potentially simplifying DKS-based technologies. Yet they exhibit more noise due to relative soliton jitter, and are usually not compatible with targeted applications. We demonstrate that Kerr-induced synchronization, an all-optical trapping technique, can azimuthally pin the multi-DKS state to a common reference field. This method ensures repetition rate noise independent of the number of solitons, making a multi-DKS state indistinguishable from a single-DKS state in that regard, akin to trapped-soliton molecule behavior. Supported by theoretical analysis and experimental demonstration in an integrated microresonator, this approach provides metrological capacity regardless of the number of cavity solitons, benefiting numerous DKS-based metrology applications.

Reservoir computing (RC) is known as a powerful machine learning approach for learning complex dynamics from limited data. Here, we use RC to predict highly stochastic dynamics of cell shapes. We find that RC is able to predict the steady state climate from very limited data. Furthermore, the RC learns the timescale of transients from only four observations. We find that these capabilities of the RC to act as a dynamic twin allows us to also infer important statistics of cell shape dynamics of unobserved conditions.

$MHyPbBr_xCl_{3-x}$ exhibits an interesting temperature-induced phase diagram transitioning from monoclinic (Phase-II) to orthorhombic (Phase-I) and eventually to the high-temperature disordered cubic phase. However, experimental observations indicate the absence of either the cubic or orthorhombic phases in compositions with x=0 (chloride) and x=3 (bromide), respectively. We explain the composition dependence of the phase transition sequence in MHyPbX3 (X = Cl, Br) from the perspective of a host/guest framework for the system. We argue that the sequence of phase transitions in MHyPbX3 can be anticipated based on the competition between host distortion and host/guest coupling energies. A dominant coupling in MHyPbCl3 ensures the stabilization of the intermediate Phase-I while pushing the transition to cubic phase beyond its decomposition temperature. On the other hand, a balance of the energy scales in MHyPbBr3 suppresses Phase-I and stabilizes the cubic phase. Our expectations were supported by first-principles based estimates of the transition temperatures in both compounds, which yield trends in agreement with experimental observations. Furthermore, ab initio molecular dynamics simulations revealed that the cubic phase of MHyPbBr3 results from a disorder over locally orthorhombic structures, a clear manifestation of the balance of energy scales. We propose that the same concept can be employed to predict the stable phases in other hybrid perovskites.

We consider the following task: suppose an algorithm is given copies of an unknown $n$-qubit quantum state $|\psi\rangle$ promised $(i)$ $|\psi\rangle$ is $\varepsilon_1$-close to a stabilizer state in fidelity or $(ii)$ $|\psi\rangle$ is $\varepsilon_2$-far from all stabilizer states, decide which is the case. We give a $\textsf{poly}(1/\varepsilon_1)$-sample and $n\cdot \textsf{poly}(1/\varepsilon_1)$-time algorithm for this task for every $\varepsilon_1>0$ and $\varepsilon_2\leq 2^{-\textsf{poly}(1/\varepsilon_1)}$. Our proof includes a new definition of Gowers norm for quantum states, an inverse theorem for the Gowers-$3$ norm of states and new bounds on stabilizer covering for structured subsets of Paulis using results in additive combinatorics., Comment: 35 pages, 2 figures

Amorphous silicon nitride (a-SiN) is a material which has found wide application due to its excellent mechanical and electrical properties. Despite the significant effort devoted in understanding how the microscopic structure influences the material performance, many aspects still remain elusive. If on the one hand \textit{ab initio} calculations respresent the technique of election to study such a system, they present severe limitations in terms of the size of the system that can be simulated. Such an aspect plays a determinant role, particularly when amorphous structure are to be investigated, as often results depend dramatically on the size of the system. Here, we overcome this limitation by training a machine-learning (ML) interatomic model to \textit{ab initio} data. We show that molecular dynamics simulations using the ML model on much larger systems can reproduce experimental measurements of elastic properties, including elastic isotropy. Our study demonstrates the broader impact of machine-learning potentials for predicting structural and mechanical properties, even for complex amorphous structures., Comment: 12 pages, 7 figures, SI

To enable data-driven decision-making across organizations, data professionals need to share insights with their colleagues in context-appropriate communication channels. Many of their colleagues rely on data but are not themselves analysts; furthermore, their colleagues are reluctant or unable to use dedicated analytical applications or dashboards, and they expect communication to take place within threaded collaboration platforms such as Slack or Microsoft Teams. In this paper, we introduce a set of six strategies for adapting content from business intelligence (BI) dashboards into appropriate formats for sharing on collaboration platforms, formats that we refer to as dashboard snapshots. Informed by prior studies of enterprise communication around data, these strategies go beyond redesigning or restyling by considering varying levels of data literacy across an organization, introducing affordances for self-service question-answering, and anticipating the post-sharing lifecycle of data artifacts. These strategies involve the use of templates that are matched to common communicative intents, serving to reduce the workload of data professionals. We contribute a formal representation of these strategies and demonstrate their applicability in a comprehensive enterprise communication scenario featuring multiple stakeholders that unfolds over the span of months., Comment: 5 pages, 5 figures, accepted to IEEE VIS 2024 Short Paper

Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical evaluation of Llama 3. We find that Llama 3 delivers comparable quality to leading language models such as GPT-4 on a plethora of tasks. We publicly release Llama 3, including pre-trained and post-trained versions of the 405B parameter language model and our Llama Guard 3 model for input and output safety. The paper also presents the results of experiments in which we integrate image, video, and speech capabilities into Llama 3 via a compositional approach. We observe this approach performs competitively with the state-of-the-art on image, video, and speech recognition tasks. The resulting models are not yet being broadly released as they are still under development.

We introduce MoMa, a novel modality-aware mixture-of-experts (MoE) architecture designed for pre-training mixed-modal, early-fusion language models. MoMa processes images and text in arbitrary sequences by dividing expert modules into modality-specific groups. These groups exclusively process designated tokens while employing learned routing within each group to maintain semantically informed adaptivity. Our empirical results reveal substantial pre-training efficiency gains through this modality-specific parameter allocation. Under a 1-trillion-token training budget, the MoMa 1.4B model, featuring 4 text experts and 4 image experts, achieves impressive FLOPs savings: 3.7x overall, with 2.6x for text and 5.2x for image processing compared to a compute-equivalent dense baseline, measured by pre-training loss. This outperforms the standard expert-choice MoE with 8 mixed-modal experts, which achieves 3x overall FLOPs savings (3x for text, 2.8x for image). Combining MoMa with mixture-of-depths (MoD) further improves pre-training FLOPs savings to 4.2x overall (text: 3.4x, image: 5.3x), although this combination hurts performance in causal inference due to increased sensitivity to router accuracy. These results demonstrate MoMa's potential to significantly advance the efficiency of mixed-modal, early-fusion language model pre-training, paving the way for more resource-efficient and capable multimodal AI systems., Comment: v2 -> update related work section v3 -> fix spelling

Given a $k$-CNF formula and an integer $s$, we study algorithms that obtain $s$ solutions to the formula that are maximally dispersed. For $s=2$, the problem of computing the diameter of a $k$-CNF formula was initiated by Creszenzi and Rossi, who showed strong hardness results even for $k=2$. Assuming SETH, the current best upper bound [Angelsmark and Thapper '04] goes to $4^n$ as $k \rightarrow \infty$. As our first result, we give exact algorithms for using the Fast Fourier Transform and clique-finding that run in $O^*(2^{(s-1)n})$ and $O^*(s^2 |\Omega_{F}|^{\omega \lceil s/3 \rceil})$ respectively, where $|\Omega_{F}|$ is the size of the solution space of the formula $F$ and $\omega$ is the matrix multiplication exponent. As our main result, we re-analyze the popular PPZ (Paturi, Pudlak, Zane '97) and Sch\"{o}ning's ('02) algorithms (which find one solution in time $O^*(2^{\varepsilon_{k}n})$ for $\varepsilon_{k} \approx 1-\Theta(1/k)$), and show that in the same time, they can be used to approximate the diameter as well as the dispersion ($s>2$) problems. While we need to modify Sch\"{o}ning's original algorithm, we show that the PPZ algorithm, without any modification, samples solutions in a geometric sense. We believe that this property may be of independent interest. Finally, we present algorithms to output approximately diverse, approximately optimal solutions to NP-complete optimization problems running in time $\text{poly}(s)O^*(2^{\varepsilon n})$ with $\varepsilon<1$ for several problems such as Minimum Hitting Set and Feedback Vertex Set. For these problems, all existing exact methods for finding optimal diverse solutions have a runtime with at least an exponential dependence on the number of solutions $s$. Our methods find bi-approximations with polynomial dependence on $s$.

Neutron stars provide a powerful probe of axion dark matter, especially in higher frequency ranges where there remain fewer laboratory constraints. Populations of neutron stars near the Galactic Centre have been proposed as a means to place strong constraints on axion dark matter. One downside of this approach is that there are very few direct observations of neutron stars in this region, introducing uncertainties in the total number of neutron stars in this ``invisible" population at the Galactic Centre, whose size must be inferred through birth rate modelling. We suggest this number could also be reduced due to stellar dynamics carrying stars away from the Galactic Centre via large kick velocities at birth. We attempt to circumvent the uncertainty on the Galactic Centre population size by modelling the axion signal from better understood populations outside the Galactic Centre using {\tt PsrPopPy} which is normalised against pulsar observations. We consider lower-frequency, wider-angle searches for this signal via a range of instruments including MeerKAT and SKA-low but find that the sensitivity is not competitive with existing constraints. Finally, returning to the Galactic Centre, we compare populations to single objects as targets for axion detection. Using the latest modelling of axion-photon conversion in the Galactic Centre magnetar, we conclude that within astrophysical uncertainties, the Galactic Centre population and the magnetar could give comparable sensitivities to axion dark matter, suggesting one should continue to search for both signals in future surveys., Comment: 49 pages, 23 figures, comments are welcome

The exceptional physicochemical properties and versatile biological activities of ionic liquids (ILs) have propelled their potential applications in various industries, including pharmaceuticals and green chemistry. However, their widespread use is limited by concerns over toxicity, particularly due to interactions with cell membranes. This study examines the effects of imidazolium-based ILs on the microscopic structure and phase behavior of a model cell membrane composed of zwitterionic dipalmitoylphosphatidylcholine (DPPC) lipid. Small-angle neutron scattering and dynamic light scattering reveal that the shorter chain IL, 1-hexyl-3-methylimidazolium bromide (HMIM[Br]), induces aggregation of DPPC unilamellar vesicles. In contrast, this aggregation is absent with the longer alkyl chain IL, 1-decyl-3-methylimidazolium bromide (DMIM[Br]). Instead, DMIM[Br] incorporation leads to the formation of distinct IL-poor and IL-rich nanodomains within the DPPC membrane, as evidenced by X-ray reflectivity, differential scanning calorimetry, and molecular dynamics simulation. The less evident nanodomain formation with HMIM[Br] underscores the role of hydrophobic interactions between lipid alkyl tails and ILs. Our findings demonstrate that longer alkyl chains in ILs significantly enhance their propensity to form membrane nanodomains and increase membrane permeability, directly correlating with higher cytotoxicity. This crucial link between nanodomains and toxicity provides valuable insights for designing safer, more environmentally friendly ILs, and promoting their use in biomedical applications and sustainable industrial processes.

The relation between magnetic field strength B and gas density n in the interstellar medium is of fundamental importance to many areas of astrophysics, from protostellar disks to galaxy evolution. We present and compare Bayesian analyses of the B - n relation for a comprehensive observational data set, as well as a large body of numerical MHD simulations. We extend the original Zeeman relation of Crutcher et al. (2010) with a large body of magnetic data that includes 700 observations with the Davis-Chandrasekhar-Fermi method. By using a new multiparameter Bayesian analysis we present a new, more general, time-averaged observational relation: B \propto n^{0.27 \pm 0.017} for n \leq n_0 and B \propto n^{0.54 \pm 0.18} for n \geq n_0, with n_0 = 924^(+145-144) cm^-3. We perform a separate analysis on 19 numerical magnetohydrodynamics simulations that cover a wide range of scales, resolutions, initial conditions, and completed with a variety of codes: arepo, flash, pencil, and ramses. The power law exponents derived from the simulations depend on several physical factors including: dynamo effects, time scales, turbulence, and the initial seed field strength. In particular, early-time simulations where the density, velocity and magnetic fields are unevolved do not match the observational scalings. The simulations that trace the observed density range best, the evolved dwarf galaxy and Milky Way like galaxy simulations, settle into a near consistent exponent of = 0.5 in the dense gas, with variability in the diffuse gas exponent., Comment: 23 figures, 28 pages, submitted to MNRAS, Comments welcome

In a recent article "Projective geometries, $Q$-polynomial structures, and quantum groups" Terwilliger (arXiv:2407.14964) defined a certain weighted adjacency matrix, depending on a free (positive real) parameter, associated with the projective geometry, and showed (among many other results) that it is diagonalizable, with the eigenvalues and their multiplicities explicitly written down, and that it satisfies the $Q$-polynomial property (with respect to the zero subspace). In this note we (i) Write down an explicit eigenbasis for this matrix. (ii) Evaluate the adjacency matrix-eigenvector products, yielding a new proof for the eigenvalues and their multiplicities. (iii) Evaluate the dual adjacency matrix-eigenvector products and directly show that the action of the dual adjacency matrix on the eigenspaces of the adjacency matrix is block-tridiagonal, yielding a new proof of the $Q$-polynomial property., Comment: arXiv admin note: substantial text overlap with arXiv:2204.05540

Despite advancements in drug development strategies, 90% of clinical trials fail. This suggests overlooked aspects in target validation and drug optimization. In order to address this, we introduce HeCiX-KG, Hetionet-Clinicaltrials neXus Knowledge Graph, a novel fusion of data from ClinicalTrials.gov and Hetionet in a single knowledge graph. HeCiX-KG combines data on previously conducted clinical trials from ClinicalTrials.gov, and domain expertise on diseases and genes from Hetionet. This offers a thorough resource for clinical researchers. Further, we introduce HeCiX, a system that uses LangChain to integrate HeCiX-KG with GPT-4, and increase its usability. HeCiX shows high performance during evaluation against a range of clinically relevant issues, proving this model to be promising for enhancing the effectiveness of clinical research. Thus, this approach provides a more holistic view of clinical trials and existing biological data., Comment: 8 pages, 3 figures, under review

As the partons in a jet propagate through the quark-gluon plasma (QGP) produced in a heavy-ion collision, they lose energy to, kick, and are kicked by the medium. The resulting modifications to the parton shower encode information about the microscopic nature of QGP. The momentum and energy lost by the parton shower are gained by the medium and, since QGP is a strongly coupled liquid, this means that the jet excites a wake in the droplet of QGP. After freezeout, this wake becomes soft hadrons with net momentum in the jet direction meaning that reconstructed jets include hadrons originating from both the modified parton shower and its wake. This makes it challenging to find an unambiguous experimental view of the response of a droplet of QGP to a jet. Recent years have seen significant advances in the understanding of the substructure of jets using correlation functions of the energy flux operator. So far, such studies have focused primarily on the two-point correlator, which serves to identify the angular scale of the underlying dynamics. Higher-point correlators hold the promise of mapping out the dynamics themselves. We perform the first study of the shape-dependent three-point energy-energy-energy correlator in heavy-ion collisions. Using the Hybrid Model to simulate the interactions of high energy jets with QGP, we show that hadrons originating from wakes are the dominant contribution to the three-point correlator in the regime where the three points are well-separated in angle, forming a roughly equilateral triangle. This equilateral region of the correlator is far from the region populated by collinear vacuum emissions, making it a canvas on which jet wakes can be imaged. Our work is a key step towards the systematic use of energy correlators to image and unravel the dynamical response of a droplet of QGP to a passing jet, and motivates many experimental and theoretical studies., Comment: 35 pages, 19 glamorous figures, 2 practical appendices

Integrating epitaxial BaTiO$_3$ (BTO) with Si is essential for leveraging its ferroelectric, piezoelectric, and nonlinear optical properties in microelectronics. Recently, heterogeneous integration approaches that involve growth of BTO on ideal substrates followed by transfer to a desired substrate show promise of achieving excellent device-quality films. However, beyond simple demonstrations of the existence of ferroelectricity, robust devices with high endurance were not yet demonstrated on Si using the latter approach. Here, using a novel two-step approach to synthesize epitaxial BTO using pulsed laser deposition (PLD) on water soluble Sr3Al2O7 (SAO) (on SrTiO$_3$ (STO) substrates), we demonstrate successful integration of high-quality BTO capacitors on Si, with Pr of 7 uC/cm2, Ec 150 kV/cm, ferroelectric and electromechanical endurance of greater than $10^6$ cycles. We further address the challenge of cracking and disintegration of thicker films by first transferring a large area (5 mm x 5 mm) of the templated layer of BTO (~30 nm thick) on the desired substrate, followed by the growth of high-quality BTO on this substrate, as revealed by HRXRD and HRSTEM measurements. These templated Si substrates offer a versatile platform for integrating any epitaxial complex oxides with diverse functionalities onto any inorganic substrate., Comment: 29 pages, 12 figures

We discuss the use of angle of arrival (AoA) as an authentication measure in analog array multiple-input multiple-output (MIMO) systems. A base station equipped with an analog array authenticates users based on the AoA estimated from certified pilot transmissions, while active attackers manipulate their transmitted signals to mount impersonation attacks. We study several attacks of increasing intensity (captured through the availability of side information at the attackers) and assess the performance of AoA-based authentication using one-class classifiers. Our results show that some attack techniques with knowledge of the combiners at the verifier are effective in falsifying the AoA and compromising the security of the considered type of physical layer authentication., Comment: 25th IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC 2024)

We define a map from subspaces to Motzkin paths and show that the inverse image of every path is a disjoint union of symmetric Boolean subsets yielding an explicit symmetric Boolean decomposition of the subspace lattice.

The lateral diffusion of lipids within membrane is of paramount importance, serving as a central mechanism in numerous physiological processes including cell signaling, membrane trafficking, protein activity regulation, and energy transduction pathways. This review offers a comprehensive overview of lateral lipid diffusion in model biomembrane systems explored through the lens of neutron scattering techniques. We examine diverse models of lateral diffusion and explore the various factors influencing this fundamental process in membrane dynamics. Additionally, we offer a thorough summary of how different membrane-active compounds, including drugs, antioxidants, stimulants, and membrane proteins, affect lipid lateral diffusion. Our analysis unveils the intricate interplay between these additives and membranes, shedding light on their dynamic interactions. We elucidate that this interaction is governed by a complex combination of multiple factors including the physical state and charge of the membrane, the concentration of additives, the molecular architecture of the compounds, and their spatial distribution within the membrane. In conclusion, we briefly discuss the future directions and areas requiring further investigation in the realm of lateral lipid diffusion, highlighting the need to study more realistic membrane systems.

The rapid adoption of large language models (LLMs) has led to significant advances in natural language processing and text generation. However, the energy consumed through LLM model inference remains a major challenge for sustainable AI deployment. To address this problem, we model the workload-dependent energy consumption and runtime of LLM inference tasks on heterogeneous GPU-CPU systems. By conducting an extensive characterization study of several state-of-the-art LLMs and analyzing their energy and runtime behavior across different magnitudes of input prompts and output text, we develop accurate (R^2>0.96) energy and runtime models for each LLM. We employ these models to explore an offline, energy-optimal LLM workload scheduling framework. Through a case study, we demonstrate the advantages of energy and accuracy aware scheduling compared to existing best practices., Comment: 7 pages, appearing at HotCarbon 2024

We introduce a simple and efficient text-controllable high-fidelity music generation and editing model. It operates on sequences of continuous latent representations from a low frame rate 48 kHz stereo variational auto encoder codec that eliminates the information loss drawback of discrete representations. Based on a diffusion transformer architecture trained on a flow-matching objective the model can generate and edit diverse high quality stereo samples of variable duration, with simple text descriptions. We also explore a new regularized latent inversion method for zero-shot test-time text-guided editing and demonstrate its superior performance over naive denoising diffusion implicit model (DDIM) inversion for variety of music editing prompts. Evaluations are conducted on both objective and subjective metrics and demonstrate that the proposed model is not only competitive to the evaluated baselines on a standard text-to-music benchmark - quality and efficiency-wise - but also outperforms previous state of the art for music editing when combined with our proposed latent inversion. Samples are available at https://melodyflow.github.io.

Human evaluation of generated language through pairwise preference judgments is pervasive. However, under common scenarios, such as when generations from a model pair are very similar, or when stochastic decoding results in large variations in generations, it results in inconsistent preference ratings. We address these challenges by introducing a meta-evaluation measure, separability, which estimates how suitable a test instance is for pairwise preference evaluation. For a candidate test instance, separability samples multiple generations from a pair of models, and measures how distinguishable the two sets of generations are. Our experiments show that instances with high separability values yield more consistent preference ratings from both human- and auto-raters. Further, the distribution of separability allows insights into which test benchmarks are more valuable for comparing models. Finally, we incorporate separability into ELO ratings, accounting for how suitable each test instance might be for reliably ranking LLMs. Overall, separability has implications for consistent, efficient and robust preference evaluation of LLMs with both human- and auto-raters., Comment: Corrected description of reference in Related Work

This paper has two purposes. The first is to extend the theory of linearly distributive categories by considering the structures that emerge in a special case: the normal duoidal category $(\mathsf{Poly} ,\mathcal{y}, \otimes, \triangleleft )$ of polynomial functors under Dirichlet and substitution product. This is an isomix LDC which is neither $*$-autonomous nor fully symmetric. The additional structures of interest here are a closure for $\otimes$ and a co-closure for $\triangleleft$, making $\mathsf{Poly}$ a bi-closed LDC, which is a notion we introduce in this paper. The second purpose is to use $\mathsf{Poly}$ as a source of examples and intuition about various structures that can occur in the setting of LDCs, including duals, cores, linear monoids, and others, as well as how these generalize to the non-symmetric setting. To that end, we characterize the linearly dual objects in $\mathsf{Poly}$: every linear polynomial has a right dual which is a representable. It turns out that the linear and representable polynomials also form the left and right cores of $\mathsf{Poly}$. Finally, we provide examples of linear monoids, linear comonoids, and linear bialgebras in $\mathsf{Poly}$., Comment: 32 pages

Submillimeter and millimeter wavelengths provide a unique view of the Universe, from the gas and dust that fills and surrounds galaxies to the chromosphere of our own Sun. Current single-dish facilities have presented a tantalising view of the brightest (sub-)mm sources, and interferometers have provided the exquisite resolution necessary to analyse the details in small fields, but there are still many open questions that cannot be answered with current facilities. In this report we summarise the science that is guiding the design of the Atacama Large Aperture Submillimeter Telescope (AtLAST). We demonstrate how tranformational advances in topics including star formation in high redshift galaxies, the diffuse circumgalactic medium, Galactic ecology, cometary compositions and solar flares motivate the need for a 50m, single-dish telescope with a 1-2 degree field of view and a new generation of highly multiplexed continuum and spectral cameras. AtLAST will have the resolution to drastically lower the confusion limit compared to current single-dish facilities, whilst also being able to rapidly map large areas of the sky and detect extended, diffuse structures. Its high sensitivity and large field of view will open up the field of submillimeter transient science by increasing the probability of serendipitous detections. Finally, the science cases listed here motivate the need for a highly flexible operations model capable of short observations of individual targets, large surveys, monitoring programmes, target of opportunity observations and coordinated observations with other observatories. AtLAST aims to be a sustainable, upgradeable, multipurpose facility that will deliver orders of magnitude increases in sensitivity and mapping speeds over current and planned submillimeter observatories., Comment: 47 pages, 12 figures. For further details on AtLAST see https://atlast.uio.no

Utility-scale solar arrays require specialized inspection methods for detecting faulty panels. Photovoltaic (PV) panel faults caused by weather, ground leakage, circuit issues, temperature, environment, age, and other damage can take many forms but often symptomatically exhibit temperature differences. Included is a mini survey to review these common faults and PV array fault detection approaches. Among these, infrared thermography cameras are a powerful tool for improving solar panel inspection in the field. These can be combined with other technologies, including image processing and machine learning. This position paper examines several computer vision algorithms that automate thermal anomaly detection in infrared imagery. We demonstrate our infrared thermography data collection approach, the PV thermal imagery benchmark dataset, and the measured performance of image processing transformations, including the Hough Transform for PV segmentation. The results of this implementation are presented with a discussion of future work., Comment: Accepted to Information, Intelligence, Systems and Applications (IISA), July 2024

Global vegetation structure mapping is critical for understanding the global carbon cycle and maximizing the efficacy of nature-based carbon sequestration initiatives. Moreover, vegetation structure mapping can help reduce the impacts of climate change by, for example, guiding actions to improve water security, increase biodiversity and reduce flood risk. Global satellite measurements provide an important set of observations for monitoring and managing deforestation and degradation of existing forests, natural forest regeneration, reforestation, biodiversity restoration, and the implementation of sustainable agricultural practices. In this paper, we explore the effectiveness of fine-tuning of a geospatial foundation model to estimate above-ground biomass (AGB) using space-borne data collected across different eco-regions in Brazil. The fine-tuned model architecture consisted of a Swin-B transformer as the encoder (i.e., backbone) and a single convolutional layer for the decoder head. All results were compared to a U-Net which was trained as the baseline model Experimental results of this sparse-label prediction task demonstrate that the fine-tuned geospatial foundation model with a frozen encoder has comparable performance to a U-Net trained from scratch. This is despite the fine-tuned model having 13 times less parameters requiring optimization, which saves both time and compute resources. Further, we explore the transfer-learning capabilities of the geospatial foundation models by fine-tuning on satellite imagery with sparse labels from different eco-regions in Brazil.

Distributed Deep Neural Network (DNN) training is a technique to reduce the training overhead by distributing the training tasks into multiple accelerators, according to a parallelization strategy. However, high-performance compute and interconnects are needed for maximum speed-up and linear scaling of the system. Wafer-scale systems are a promising technology that allows for tightly integrating high-end accelerators with high-speed wafer-scale interconnects, making it an attractive platform for distributed training. However, the wafer-scale interconnect should offer high performance and flexibility for various parallelization strategies to enable maximum optimizations for compute and memory usage. In this paper, we propose FRED, a wafer-scale interconnect that is tailored for the high-BW requirements of wafer-scale networks and can efficiently execute communication patterns of different parallelization strategies. Furthermore, FRED supports in-switch collective communication execution that reduces the network traffic by approximately 2X. Our results show that FRED can improve the average end-to-end training time of ResNet-152, Transformer-17B, GPT-3, and Transformer-1T by 1.76X, 1.87X, 1.34X, and 1.4X, respectively when compared to a baseline waferscale 2D-Mesh fabric.

Deep neural networks (DNNs) have exhibited remarkable performance across various tasks, yet their susceptibility to spurious correlations poses a significant challenge for out-of-distribution (OOD) generalization. Spurious correlations refer to erroneous associations in data that do not reflect true underlying relationships but are instead artifacts of dataset characteristics or biases. These correlations can lead DNNs to learn patterns that are not robust across diverse datasets or real-world scenarios, hampering their ability to generalize beyond training data. In this paper, we propose an autoencoder-based approach to analyze the nature of spurious correlations that exist in the Global Wheat Head Detection (GWHD) 2021 dataset. We then use inpainting followed by Weighted Boxes Fusion (WBF) to achieve a 2% increase in the Average Domain Accuracy (ADA) over the YOLOv5 baseline and consistently show that our approach has the ability to suppress some of the spurious correlations in the GWHD 2021 dataset. The key advantage of our approach is that it is more suitable in scenarios where there is limited scope to adapt or fine-tune the trained model in unseen test environments.

We consider the problem of customizing text-to-image diffusion models with user-supplied reference images. Given new prompts, the existing methods can capture the key concept from the reference images but fail to align the generated image with the prompt. In this work, we seek to address this key issue by proposing new methods that can easily be used in conjunction with existing customization methods that optimize the embeddings/weights at various intermediate stages of the text encoding process. The first contribution of this paper is a dissection of the various stages of the text encoding process leading up to the conditioning vector for text-to-image models. We take a holistic view of existing customization methods and notice that key and value outputs from this process differs substantially from their corresponding baseline (non-customized) models (e.g., baseline stable diffusion). While this difference does not impact the concept being customized, it leads to other parts of the generated image not being aligned with the prompt. Further, we also observe that these keys and values allow independent control various aspects of the final generation, enabling semantic manipulation of the output. Taken together, the features spanning these keys and values, serve as the basis for our next contribution where we fix the aforementioned issues with existing methods. We propose a new post-processing algorithm, AlignIT, that infuses the keys and values for the concept of interest while ensuring the keys and values for all other tokens in the input prompt are unchanged. Our proposed method can be plugged in directly to existing customization methods, leading to a substantial performance improvement in the alignment of the final result with the input prompt while retaining the customization quality., Comment: 10 pages, 9 figures

End-to-end neural diarization (EEND) models offer significant improvements over traditional embedding-based Speaker Diarization (SD) approaches but falls short on generalizing to long-form audio with large number of speakers. EEND-vector-clustering method mitigates this by combining local EEND with global clustering of speaker embeddings from local windows, but this requires an additional speaker embedding framework alongside the EEND module. In this paper, we propose a novel framework applying EEND both locally and globally for long-form audio without separate speaker embeddings. This approach achieves significant relative DER reduction of 13% and 10% over the conventional 1-pass EEND on Callhome American English and RT03-CTS datasets respectively and marginal improvements over EEND-vector-clustering without the need for additional speaker embeddings. Furthermore, we discuss the computational complexity of our proposed framework and explore strategies for reducing processing times., Comment: Accepted at INTERSPEECH 2024

Speaker Diarization (SD) systems are typically audio-based and operate independently of the ASR system in traditional speech transcription pipelines and can have speaker errors due to SD and/or ASR reconciliation, especially around speaker turns and regions of speech overlap. To reduce these errors, a Lexical Speaker Error Correction (LSEC), in which an external language model provides lexical information to correct the speaker errors, was recently proposed. Though the approach achieves good Word Diarization error rate (WDER) improvements, it does not use any additional acoustic information and is prone to miscorrections. In this paper, we propose to enhance and acoustically ground the LSEC system with speaker scores directly derived from the existing SD pipeline. This approach achieves significant relative WDER reductions in the range of 25-40% over the audio-based SD, ASR system and beats the LSEC system by 15-25% relative on RT03-CTS, Callhome American English and Fisher datasets., Comment: Accepted at INTERSPEECH 2024

Question Answer Generation (QAG) is an effective data augmentation technique to improve the accuracy of question answering systems, especially in low-resource domains. While recent pretrained and large language model-based QAG methods have made substantial progress, they face the critical issue of redundant QA pair generation, affecting downstream QA systems. Implicit diversity techniques such as sampling and diverse beam search are proven effective solutions but often yield smaller diversity. We present explicit diversity conditions for QAG, focusing on spatial aspects, question types, and entities, substantially increasing diversity in QA generation. Our work emphasizes the need of explicit diversity conditions for generating diverse question-answer synthetic data by showing significant improvements in downstream QA task over existing widely adopted implicit diversity techniques. In particular, generated QA pairs from explicit diversity conditions when used to train the downstream QA model results in an average 4.1% exact match and 4.5% F1 improvement over QAG from implicit sampling techniques on SQuADDU. Our work emphasizes the need for explicit diversity conditions even more in low-resource datasets (SubjQA), where average downstream QA performance improvements are around 12% EM., Comment: Published at COLING 2024

Large language models (LLM) have achieved remarkable success in natural language generation but lesser focus has been given to their applicability in decision making tasks such as classification. We show that LLMs like LLaMa can achieve high performance on large multi-class classification tasks but still make classification errors and worse, generate out-of-vocabulary class labels. To address these critical issues, we introduce Paraphrase and AGgregate (PAG)-LLM approach wherein an LLM generates multiple paraphrases of the input query (parallel queries), performs multi-class classification for the original query and each paraphrase, and at the end aggregate all the classification labels based on their confidence scores. We evaluate PAG-LLM on two large multi-class classication datasets: CLINC, and Banking and show 22.7% and 15.1% error reduction. We show that PAG-LLM is especially effective for hard examples where LLM is uncertain, and reduces the critical misclassification and hallucinated label generation errors, Comment: Accepted at SIGIR 2024

In barter exchanges agents enter seeking to swap their items for other items on their wishlist. We consider a centralized barter exchange with a set of agents and items where each item has a positive value. The goal is to compute a (re)allocation of items maximizing the agents' collective utility subject to each agent's total received value being comparable to their total given value. Many such centralized barter exchanges exist and serve crucial roles; e.g., kidney exchange programs, which are often formulated as variants of directed cycle packing. We show finding a reallocation where each agent's total given and total received values are equal is NP-hard. On the other hand, we develop a randomized algorithm that achieves optimal utility in expectation and where, i) for any agent, with probability 1 their received value is at least their given value minus $v^*$ where $v^*$ is said agent's most valuable owned and wished-for item, and ii) each agent's given and received values are equal in expectation., Comment: A previous version of this work appeared in the proceedings of WWW '24

Retrieval Augmented Generation (RAG) enriches the ability of language models to reason using external context to augment responses for a given user prompt. This approach has risen in popularity due to practical applications in various applications of language models in search, question/answering, and chat-bots. However, the exact nature of how this approach works isn't clearly understood. In this paper, we mechanistically examine the RAG pipeline to highlight that language models take shortcut and have a strong bias towards utilizing only the context information to answer the question, while relying minimally on their parametric memory. We probe this mechanistic behavior in language models with: (i) Causal Mediation Analysis to show that the parametric memory is minimally utilized when answering a question and (ii) Attention Contributions and Knockouts to show that the last token residual stream do not get enriched from the subject token in the question, but gets enriched from other informative tokens in the context. We find this pronounced shortcut behaviour true across both LLaMa and Phi family of models.