Search

We use student-level data on elementary special education identification from Washington state to explore student identification rates in the months immediately after the onset of the COVID-19 pandemic and over 2 subsequent years. Special education identification rates dropped dramatically in March 2020 through the end of the 2019-20 school year and remained below historical norms through 2020-21 before returning to pre-pandemic levels early in 2021-22. The magnitude of these effects implies that over 8,000 fewer elementary students were identified for special education services during the pandemic in Washington than would have been expected based on prior trends.

In this work, we propose a Multiple Access Control (MAC) protocol for Light-based IoT (LIoT) networks, where the gateway node orchestrates and schedules batteryless nodes duty-cycles based on their location and sleep time. The LIoT concept represents a sustainable solution for massive indoor IoT applications, offering an alternative communication medium through Visible Light Communication (VLC). While most existing scheduling algorithms for intermittent batteryless IoT aim to maximize data collection and enhance dataset size, our solution is tailored for environmental sensing applications, such as temperature, humidity, and air quality monitoring, optimizing measurement distribution and minimizing blind spots to achieve comprehensive and uniform environmental sensing. We propose a Balanced Space and Time-based Time Division Multiple Access scheduling (BST-TDMA) algorithm, which addresses environmental sensing challenges by balancing spatial and temporal factors to improve the environmental sensing efficiency of batteryless LIoT nodes. Our measurement-based results show that BST-TDMA was able to efficiently schedule duty-cycles with given intervals.

The ability of large language models (LLMs) to execute complex instructions is essential for their real-world applications. However, several recent studies indicate that LLMs struggle with challenging instructions. In this paper, we propose Evolutionary Contrastive Distillation (ECD), a novel method for generating high-quality synthetic preference data designed to enhance the complex instruction-following capability of language models. ECD generates data that specifically illustrates the difference between a response that successfully follows a set of complex instructions and a response that is high-quality, but nevertheless makes some subtle mistakes. This is done by prompting LLMs to progressively evolve simple instructions to more complex instructions. When the complexity of an instruction is increased, the original successful response to the original instruction becomes a "hard negative" response for the new instruction, mostly meeting requirements of the new instruction, but barely missing one or two. By pairing a good response with such a hard negative response, and employing contrastive learning algorithms such as DPO, we improve language models' ability to follow complex instructions. Empirically, we observe that our method yields a 7B model that exceeds the complex instruction-following performance of current SOTA 7B models and is competitive even with open-source 70B models.

Nano-patterned magnetic materials have opened new venues on the investigation of strongly correlated phenomena including artificial spin-ice systems, geometric frustration, magnetic monopoles, for technologically important applications such as reconfigurable ferromagnetism. With the advent of atomically thin two-dimensional (2D) van der Waals (vdW) magnets a pertinent question is whether such compounds could make their way into this realm where interactions can be tailored so that unconventional states of matter could be assessed. Here we show that square islands of CrGeTe3 vdW ferromagnets distributed in a grid manifest antiferromagnetic correlations, essential to enable frustration resulting in an artificial spin-ice. By using a combination of SQUID-on-tip microscopy, focused ion beam lithography, and atomistic spin dynamic simulations, we show that pristine, isolated CGT flakes as small as 150*150*60 nm3 have tunable dipole-dipole interactions, which can be precisely controlled by their lateral spacing. There is a crossover between non-interacting islands and significant inter-island anticorrelation depending how they are spatially distributed allowing the creation of complex magnetic patterns not observable at the isolated flakes. Our findings suggest that the cross-talk between the nano-patterned magnets can be explored in the generation of even more complex spin configurations where exotic interactions may be manipulated in an unprecedent way., Comment: Main text: 12 pages, 5 figures. Supplementary information: 11 pages, 5 figures

There is an increasing body of work using Large Language Models (LLMs) as agents for orchestrating workflows and making decisions in domains that require planning and multi-step reasoning. As a result, it is imperative to evaluate LLMs on core skills required for planning. In this work, we present ACPBench, a benchmark for evaluating the reasoning tasks in the field of planning. The benchmark consists of 7 reasoning tasks over 13 planning domains. The collection is constructed from planning domains described in a formal language. This allows us to synthesize problems with provably correct solutions across many tasks and domains. Further, it allows us the luxury of scale without additional human effort, i.e., many additional problems can be created automatically. Our extensive evaluation of 22 open-sourced and frontier LLMs highlight the significant gap in the reasoning capability of the LLMs. The average accuracy of one of the best-performing frontier LLMs -- GPT-4o on these tasks can fall as low as 52.50% ACPBench collection is available at https://ibm.github.io/ACPBench.

While "complexity science" has achieved significant successes in several interdisciplinary fields such as economics and biology, it is only a very recent observation that legal systems -- from the way legal texts are drafted and connected to the rest of the corpus, up to the level of how judges and courts reach decisions under a variety of conflicting inputs -- share several features with standard Complex Adaptive Systems. This review is meant as a gentle introduction to the use of quantitative tools and techniques of complexity science to describe, analyse, and tame the complex web of human interactions that the Law is supposed to regulate. We offer an overview of the main directions of research undertaken so far as well as an outlook for future research, and we argue that statistical physicists and complexity scientists should not ignore the opportunities offered by the cross-fertilisation between legal scholarship and complex-systems modelling., Comment: 7 pages, 4 figures, 2 tables - submitted as EPL Perspective

Dwarf galaxies hold the key to crucial frontiers of astrophysics, however, their faintness renders spectroscopy challenging. Here we present the JWST Cycle 2 survey, All the Little Things (ALT, PID 3516), which is designed to seek late-forming Pop III stars and the drivers of reionization at $z\sim6-7$. ALT has acquired the deepest NIRCam grism spectroscopy yet (7-27 hr), at JWST's most sensitive wavelengths (3-4 $\mu$m), covering the powerful lensing cluster Abell 2744. Over the same 30 arcmin$^2$, ALT's ultra-deep F070W+F090W imaging ($\sim$30 mag) enables selection of very faint sources at $z>6$. We demonstrate the success of ALT's novel ``butterfly" mosaic to solve spectral confusion and contamination, and introduce the ``Allegro" method for emission line identification. By collecting spectra for every source in the field of view, ALT has measured precise ($R\sim1600$) redshifts for 1630 sources at $z=0.2-8.5$. This includes one of the largest samples of distant dwarf galaxies: [1015, 475, 50] sources less massive than the SMC, Fornax, and Sculptor with $\log(M_{*}/M_{\odot})<$[8.5, 7.5, 6.5]. We showcase ALT's discovery space with: (i) spatially resolved spectra of lensed clumps in galaxies as faint as $M_{\rm{UV}}\sim-15$; (ii) large-scale clustering -- overdensities at $z$=[2.50, 2.58, 3.97, 4.30, 5.66, 5.77, 6.33] hosting massive galaxies with striking Balmer breaks; (iii) small-scale clustering -- a system of satellites around a Milky Way analog at $z\sim6$; (iv) spectroscopically confirmed multiple images that help constrain the lensing model underlying all science in this legacy field; (v) sensitive star-formation maps based on dust-insensitive tracers such as Pa$\alpha$; (vi) direct spectroscopic discovery of rare sources such as AGN with ionized outflows. These results provide a powerful proof of concept for how grism surveys maximize the potential of strong lensing fields., Comment: Submitted to the Open Journal of Astrophysics. Figs. 6 and 10 illustrate the quality of the spectra and imaging, while Fig. 12 summarizes the yield of the survey. Comments warmly welcomed and greatly appreciated. The ALT DR1 catalog is available at https://zenodo.org/records/13871850

This paper aims to answer one central question: to what extent can open-source generative text models be used in a workflow to approximate thematic analysis in social science research? To answer this question, we present the Generative AI-enabled Theme Organization and Structuring (GATOS) workflow, which uses open-source machine learning techniques, natural language processing tools, and generative text models to facilitate thematic analysis. To establish validity of the method, we present three case studies applying the GATOS workflow, leveraging these models and techniques to inductively create codebooks similar to traditional procedures using thematic analysis. Specifically, we investigate the extent to which a workflow comprising open-source models and tools can inductively produce codebooks that approach the known space of themes and sub-themes. To address the challenge of gleaning insights from these texts, we combine open-source generative text models, retrieval-augmented generation, and prompt engineering to identify codes and themes in large volumes of text, i.e., generate a qualitative codebook. The process mimics an inductive coding process that researchers might use in traditional thematic analysis by reading text one unit of analysis at a time, considering existing codes already in the codebook, and then deciding whether or not to generate a new code based on whether the extant codebook provides adequate thematic coverage. We demonstrate this workflow using three synthetic datasets from hypothetical organizational research settings: a study of teammate feedback in teamwork settings, a study of organizational cultures of ethical behavior, and a study of employee perspectives about returning to their offices after the pandemic. We show that the GATOS workflow is able to identify themes in the text that were used to generate the original synthetic datasets.

Parametric Computer-Aided Design (CAD) is central to contemporary mechanical design. However, it encounters challenges in achieving precise parametric sketch modeling and lacks practical evaluation metrics suitable for mechanical design. We harness the capabilities of pre-trained foundation models, renowned for their successes in natural language processing and computer vision, to develop generative models specifically for CAD. These models are adept at understanding complex geometries and design reasoning, a crucial advancement in CAD technology. In this paper, we propose CadVLM, an end-to-end vision language model for CAD generation. Our approach involves adapting pre-trained foundation models to manipulate engineering sketches effectively, integrating both sketch primitive sequences and sketch images. Extensive experiments demonstrate superior performance on multiple CAD sketch generation tasks such as CAD autocompletion, CAD autoconstraint, and image conditional generation. To our knowledge, this is the first instance of a multimodal Large Language Model (LLM) being successfully applied to parametric CAD generation, representing a pioneering step in the field of computer-aided mechanical design.

We present some similarities between Leibnizian and Robinsonian calculi, and address some objections raised by historians. The comparison with NSA facilitates our appreciation of some Leibnizian procedures that may otherwise seem obscure. We argue that Leibniz used genuine infinitesimals and infinite quantities which are not merely stenography for Archimedean Exhaustion and that Leibniz's procedures therefore find better proxies in NSA than in modern Weierstrassian mathematics., Comment: 9 pages. Published in London Mathematical Society Newsletter

We present the Red Unknowns: Bright Infrared Extragalactic Survey (RUBIES), providing JWST/NIRSpec spectroscopy of red sources selected across ~150 arcmin$^2$ from public JWST/NIRCam imaging in the UDS and EGS fields. RUBIES novel observing strategy offers a well-quantified selection function: the survey is optimised to reach high (>70%) completeness for bright and red (F150W-F444W>2) sources that are very rare. To place these rare sources in context, we simultaneously observe a reference sample of the 23$ using only the G395M disperser. The RUBIES data reveal a highly diverse population of red sources that span a broad redshift range ($z_{spec}\sim1-9$), with photometric redshift scatter and outlier fraction that are 3 times higher than for similarly bright sources that are less red. This diversity is not apparent from the photometric SEDs. Only spectroscopy reveals that the SEDs encompass a mixture of galaxies with dust-obscured star formation, extreme line emission, a lack of star formation indicating early quenching, and luminous active galactic nuclei. As a first demonstration of our broader selection function we compare the stellar masses and rest-frame U-V colours of the red sources and our reference sample: red sources are typically more massive ($M_*\sim10^{10-11.5} M_\odot$) across all redshifts. However, we find that the most massive systems span a wide range in U-V colour. We describe our data reduction procedure and data quality, and publicly release the reduced RUBIES data and vetted spectroscopic redshifts of the first half of the survey through the DJA., Comment: 21 pages, 16 figures; submitted to A&A

This letter reports the first complete observation of magnetized collisionless shock precursors formed through the compression of Biermann-battery magnetic fields in laser produced plasmas. At OMEGA, lasers produce a supersonic CH plasma flow which is magnetized with Biermann-battery magnetic fields. The plasma flow collides with an unmagnetized hydrogen gas jet plasma to create a magnetized shock precursor. The situation where the flowing plasma carries the magnetic field is similar to the Venusian bow shock. Imaging 2$\omega$ Thomson scattering confirms that the interaction is collisionless and shows density and temperature jumps. Proton radiographs have regions of strong deflections and FLASH magnetohydrodynamic (MHD) simulations show the presence of Biermann fields in the Thomson scattering region. Electrons are accelerated to energies of up to 100 keV in a power-law spectrum. OSIRIS particle-in-cell (PIC) simulations, initialized with measured parameters, show the formation of a magnetized shock precursor and corroborate the experimental observables., Comment: 6 pages, 5 figures

We investigate the conformal algebra on the fuzzy sphere, and in particular the generators of translations and special conformal transformations which are emergent symmetries in the infinite IR but are broken along the RG flow. We show how to extract these generators using the energy momentum tensor, which is complicated by the fact that one does not have a priori access to the energy momentum tensor of the CFT limit but rather must construct it numerically. We discuss and quantitatively analyze the main sources of corrections to the conformal generators due to the breaking of scale-invariance at finite energy, and develop efficient methods for removing these corrections. The resulting generators have matrix elements that match CFT predictions with accuracy varying from sub-percent level for the lowest-lying states up to several percent accuracy for states with dimension $\sim 5$ with $N=16$ fermions. We show that the generators can be used to accurately identify primary operators vs descendant operators in energy ranges where the spectrum is too dense to do the identification solely based on the approximate integer spacing within conformal multiplets., Comment: 31 pages, 13 figures

In procedural content generation, modeling the generation task as a constraint satisfaction problem lets us define local and global constraints on the generated output. However, a generator's perceived quality often involves statistics rather than just hard constraints. For example, we may desire that generated outputs use design elements with a similar distribution to that of reference designs. However, such statistical properties cannot be expressed directly as a hard constraint on the generation of any one output. In contrast, methods which do not use a general-purpose constraint solver, such as Gumin's implementation of the WaveFunctionCollapse (WFC) algorithm, can control output statistics but have limited constraint propagation ability and cannot express non-local constraints. In this paper, we introduce You-Only-Randomize-Once (YORO) pre-rolling, a method for crafting a decision variable ordering for a constraint solver that encodes desired statistics in a constraint-based generator. Using a solver-based WFC as an example, we show that this technique effectively controls the statistics of tile-grid outputs generated by several off-the-shelf SAT solvers, while still enforcing global constraints on the outputs.1 Our approach is immediately applicable to WFC-like generation problems and it offers a conceptual starting point for controlling the design element statistics in other constraint-based generators., Comment: Published in Foundations of Digital Games (FDG) 2024. 10 pages, 6 figures

The exponential growth of scientific literature necessitates advanced tools for effective knowledge exploration. We present Knowledge Navigator, a system designed to enhance exploratory search abilities by organizing and structuring the retrieved documents from broad topical queries into a navigable, two-level hierarchy of named and descriptive scientific topics and subtopics. This structured organization provides an overall view of the research themes in a domain, while also enabling iterative search and deeper knowledge discovery within specific subtopics by allowing users to refine their focus and retrieve additional relevant documents. Knowledge Navigator combines LLM capabilities with cluster-based methods to enable an effective browsing method. We demonstrate our approach's effectiveness through automatic and manual evaluations on two novel benchmarks, CLUSTREC-COVID and SCITOC. Our code, prompts, and benchmarks are made publicly available.

Planning remains one of the last standing bastions for large language models (LLMs), which now turn their attention to search. Most of the literature uses the language models as world models to define the search space, forgoing soundness for the sake of flexibility. A recent work, Thought of Search (ToS), proposed defining the search space with code, having the language models produce that code. ToS requires a human in the loop, collaboratively producing a sound successor function and goal test. The result, however, is worth the effort: all the tested datasets were solved with 100% accuracy. At the same time LLMs have demonstrated significant progress in code generation and refinement for complex reasoning tasks. In this work, we automate ToS (AutoToS), completely taking the human out of the loop of solving planning problems. AutoToS guides the language model step by step towards the generation of sound and complete search components, through feedback from both generic and domain specific unit tests. We achieve 100% accuracy, with minimal feedback iterations, using LLMs of various sizes on all evaluated domains.

Identifying and characterizing multi-body interactions in quantum processes remains a significant challenge. This is partly because 2-body interactions can produce an arbitrary time evolution, a fundamental fact often called the universality of 2-local gates in the context of quantum computing. However, when an unknown Hamiltonian respects a U(1) symmetry such as charge or particle number conservation, N-body interactions exhibit a distinct symmetry-protected signature known as the N-body phase, which fewer-body interactions cannot mimic. We develop and demonstrate an efficient technique for the detection of 3-body interactions despite the presence of unknown 2-body interactions. This technique, which takes advantage of GHZ states for phase estimation, requires probing the unitary evolution and measuring its determinant in a small subspace that scales linearly with the system size, making it an efficient approach., Comment: Comments welcome! 11 pages + 4 pages of Supplementary Material

Motivated by the multi-reference alignment (MRA) problem and questions in equivariant neural networks we study the problem of recovering the generic orbit in a representation of a finite group from invariant tensors of degree at most three. We explore the similarities and differences between the descriptive power of low degree polynomial and unitary invariant tensors and provide evidence that in many cases of interest they have similar descriptive power. In particular we prove that for the regular representation of a finite group, polynomial invariants of degree at most three separate generic orbits answering a question posed in \cite{bandeira2017estimation}. This complements a previously known result for unitary invariants~\cite{smach2008generalized}. We also investigate these questions for subregular representations of finite groups and prove that for the defining representation of the dihedral group, polynomial invariants of degree at most three separate generic orbits. This answers a question posed in~\cite{bendory2022dihedral} and it implies that the sample complexity of the corresponding MRA problem is $\sim \sigma^6$. On the other hand we also show that for the groups $D_n$ and $A_4$ generic orbits in the {\em complete multiplicity-free} representation cannot be separated by invariants of degree at most three., Comment: 23 pages

Smart contracts are a major tool in Ethereum transactions. Therefore hackers can exploit them by adding code vulnerabilities to their sources and using these vulnerabilities for performing malicious transactions. This paper presents two successful approaches for detecting malicious contracts: one uses opcode and relies on GPT2 and the other uses the Solidity source and a LORA fine-tuned CodeLlama. Finally, we present an XGBOOST model that combines gas properties and Hexa-decimal signatures for detecting malicious transactions. This approach relies on early assumptions that maliciousness is manifested by the uncommon usage of the contracts' functions and the effort to pursue the transaction.

Prompts are how humans communicate with LLMs. Informative prompts are essential for guiding LLMs to produce the desired output. However, prompt engineering is often tedious and time-consuming, requiring significant expertise, limiting its widespread use. We propose Conversational Prompt Engineering (CPE), a user-friendly tool that helps users create personalized prompts for their specific tasks. CPE uses a chat model to briefly interact with users, helping them articulate their output preferences and integrating these into the prompt. The process includes two main stages: first, the model uses user-provided unlabeled data to generate data-driven questions and utilize user responses to shape the initial instruction. Then, the model shares the outputs generated by the instruction and uses user feedback to further refine the instruction and the outputs. The final result is a few-shot prompt, where the outputs approved by the user serve as few-shot examples. A user study on summarization tasks demonstrates the value of CPE in creating personalized, high-performing prompts. The results suggest that the zero-shot prompt obtained is comparable to its - much longer - few-shot counterpart, indicating significant savings in scenarios involving repetitive tasks with large text volumes.

The ability to interpret Machine Learning (ML) models is becoming increasingly essential. However, despite significant progress in the field, there remains a lack of rigorous characterization regarding the innate interpretability of different models. In an attempt to bridge this gap, recent work has demonstrated that it is possible to formally assess interpretability by studying the computational complexity of explaining the decisions of various models. In this setting, if explanations for a particular model can be obtained efficiently, the model is considered interpretable (since it can be explained ``easily''). However, if generating explanations over an ML model is computationally intractable, it is considered uninterpretable. Prior research identified two key factors that influence the complexity of interpreting an ML model: (i) the type of the model (e.g., neural networks, decision trees, etc.); and (ii) the form of explanation (e.g., contrastive explanations, Shapley values, etc.). In this work, we claim that a third, important factor must also be considered for this analysis -- the underlying distribution over which the explanation is obtained. Considering the underlying distribution is key in avoiding explanations that are socially misaligned, i.e., convey information that is biased and unhelpful to users. We demonstrate the significant influence of the underlying distribution on the resulting overall interpretation complexity, in two settings: (i) prediction models paired with an external out-of-distribution (OOD) detector; and (ii) prediction models designed to inherently generate socially aligned explanations. Our findings prove that the expressiveness of the distribution can significantly influence the overall complexity of interpretation, and identify essential prerequisites that a model must possess to generate socially aligned explanations., Comment: To appear in ECAI 2024

The vast majority of star-forming galaxies are surrounded by large reservoirs of gas ejected from the interstellar medium. Ultraviolet absorption and emission lines represent powerful diagnostics to constrain the cool phase of these outflows, through resonant transitions of hydrogen and metal ions. The interpretation of these observations is often remarkably difficult as it requires detailed modelling of the propagation of the continuum and emission lines in the gas. To this aim, we present a large public grid of about 20000 simulated spectra which includes HI Lyman-alpha (Lya) and five metal transitions associated with MgII, CII, SiII, and FeII that is accessible online at https://rascas.univ-lyon1.fr/app/idealised_models_grid/. The spectra have been computed with the RASCAS radiative transfer code for 5760 idealised spherical configurations surrounding a central point source emission, and characterised by their column density, Doppler parameter, dust opacity, wind velocity, as well as various density/velocity gradients. Designed to interpret Lya and metal line profiles, our grid exhibits a wide diversity of resonant absorption and emission features, as well as fluorescent lines. We illustrate how it can help better constrain wind properties by performing a joint modelling of observed Lya, CII, and SiII spectra. Using CLOUDY simulations and virial scaling relations, we show that Lya is expected to be a faithful tracer of the gas at T=10^4-10^5 K, even if the medium is highly-ionised. While CII is found to probe the same range of temperatures as Lya, other metal lines merely trace cooler phases (T=10^4 K). As their gas opacity strongly depends on gas temperature, incident radiation field, metallicity and dust depletion, we caution that optically thin metal lines do not necessarily originate from low HI column densities and may not accurately probe Lyman continuum leakage., Comment: 18 pages, 13 figures

The very long-term evolution of the hierarchical restricted three-body problem with a massive perturber is analyzed analytically in the high eccentricity regime. Perturbations on the time scale of the outer orbit can accumulate over long timescales and be comparable to the effect of the octupole term. These perturbations are described by Brown's Hamiltonian - having different forms in the literature. We show that at the high eccentricity regime - the effect of Brown's Hamiltonian is an azimuthal precesssion of the eccentricity vector and can be solved analytically. In fact, the dynamics are equivalent to a simple pendulum model allowing an explicit flip criterion., Comment: 5 pages, 4 figures

We study, from both a theoretical and observational perspective, the physical origin and spectroscopic impact of extreme nebular emission in high-redshift galaxies. The nebular continuum, which can appear during extreme starbursts, is of particular importance as it tends to redden UV slopes and has a significant contribution to the UV luminosities of galaxies. Furthermore, its shape can be used to infer the gas density and temperature of the ISM. First, we provide a theoretical background, showing how different stellar populations (SPS models, IMFs, and stellar temperatures) and nebular conditions impact observed galaxy spectra. We demonstrate that, for systems with strong nebular continuum emission, 1) UV fluxes can increase by up to 0.7~magnitudes (or more in the case of hot/massive stars) above the stellar continuum, which may help reconcile the surprising abundance of bright high-redshift galaxies and the elevated UV luminosity density at $z>10$, 2) at high gas densities, UV slopes can redden from $\beta\lesssim-2.5$ to $\beta\sim-1$, 3) observational measurements of $\xi_{ion}$ are grossly underestimated, and 4) UV downturns from two-photon emission can masquerade as DLAs. Second, we present a dataset of 58 galaxies observed with NIRSpec on JWST at $2.510$ galaxies, finding that UV slopes and UV downturns are in some cases redder or steeper than expected from SPS models, which may hint at more exotic (e.g. hotter/more massive stars or AGN) ionizing sources., Comment: 26 pages, 18 figures, submitted to The Open Journal of Astrophysics

The light of the first astrophysical objects is expected to leave an imprint on the global 21-cm signal as it heats, excites, and ionizes neutral hydrogen. This dependence on early astrophysics introduces significant uncertainties in modeling the 21-cm signal during Cosmic Dawn (CD). Here we show that a combination of observables including high-redshift UV luminosity functions, the cosmic X-ray background, the optical depth to reionization, and hydrogen absorption lines in quasar spectra, can be used to mitigate the astrophysical uncertainties assuming minimal modeling. Beyond its implications to standard astrophysics, we demonstrate how applying this procedure can improve sensitivity to new physics signatures in the global 21-cm signal. Taking the scenario of fractional millicharged dark matter (DM) as an example, we address astrophysical systematics to produce interesting predictions for upcoming experiments., Comment: Contribution to the 2024 Cosmology session of the 58th Rencontres de Moriond. 4 pages, 2 figures

Simulating non-equilibrium phenomena in strongly-interacting quantum many-body systems, including thermalization, is a promising application of near-term and future quantum computation. By performing experiments on a digital quantum computer consisting of fully-connected optically-controlled trapped ions, we study the role of entanglement in the thermalization dynamics of a $Z_2$ lattice gauge theory in 2+1 spacetime dimensions. Using randomized-measurement protocols, we efficiently learn a classical approximation of non-equilibrium states that yields the gap-ratio distribution and the spectral form factor of the entanglement Hamiltonian. These observables exhibit universal early-time signals for quantum chaos, a prerequisite for thermalization. Our work, therefore, establishes quantum computers as robust tools for studying universal features of thermalization in complex many-body systems, including in gauge theories., Comment: 20 pages, 15 figures

Fine-tuning Large Language Models (LLMs) is an effective method to enhance their performance on downstream tasks. However, choosing the appropriate setting of tuning hyperparameters (HPs) is a labor-intensive and computationally expensive process. Here, we provide recommended HP configurations for practical use-cases that represent a better starting point for practitioners, when considering two SOTA LLMs and two commonly used tuning methods. We describe Coverage-based Search (CBS), a process for ranking HP configurations based on an offline extensive grid search, such that the top ranked configurations collectively provide a practical robust recommendation for a wide range of datasets and domains. We focus our experiments on Llama-3-8B and Mistral-7B, as well as full fine-tuning and LoRa, conducting a total of > 10,000 tuning experiments. Our results suggest that, in general, Llama-3-8B and LoRA should be preferred, when possible. Moreover, we show that for both models and tuning methods, exploring only a few HP configurations, as recommended by our analysis, can provide excellent results in practice, making this work a valuable resource for practitioners.

This paper addresses the challenge of probabilistic parameter estimation given measurement uncertainty in real-time. We provide a general formulation and apply this to pose estimation for an autonomous visual landing system. We present three probabilistic parameter estimators: a least-squares sampling approach, a linear approximation method, and a probabilistic programming estimator. To evaluate these estimators, we introduce novel closed-form expressions for measuring calibration and sharpness specifically for multivariate normal distributions. Our experimental study compares the three estimators under various noise conditions. We demonstrate that the linear approximation estimator can produce sharp and well-calibrated pose predictions significantly faster than the other methods but may yield overconfident predictions in certain scenarios. Additionally, we demonstrate that these estimators can be integrated with a Kalman filter for continuous pose estimation during a runway approach where we observe a 50\% improvement in sharpness while maintaining marginal calibration. This work contributes to the integration of data-driven computer vision models into complex safety-critical aircraft systems and provides a foundation for developing rigorous certification guidelines for such systems., Comment: Accepted at DASC '24. 9 pages, 4 figures

This is a virtual dialog between Jeffrey C. Carver and Daniel S. Katz on how people learn programming languages. It's based on a talk Jeff gave at the first US-RSE Conference (US-RSE'23), which led Dan to think about human languages versus computer languages. Dan discussed this with Jeff at the conference, and this discussion continued asynchronous, with this column being a record of the discussion., Comment: submitted version of a Software Engineering Department column now published as: D. S. Katz and J. C. Carver, "Thoughts on Learning Human and Programming Languages," Computing in Science & Engineering, v.26(1), Jan.-Mar. 2024

To understand the impact of star formation models on galaxy evolution, we perform cosmological zoom-in radiation-hydrodynamic simulations of a dwarf dark matter halo with virial mass 1e9 Msun at z=6. Two different star formation models are compared, a model based on a local gravo-thermo-turbulent condition and a model based on a sink particle algorithm. Using idealized tests of collapsing isothermal spheres and giant molecular clouds with different turbulent structures, we determine the optimal accretion radius to be twice the cell size and the resolution required to achieve reasonable convergence in star formation efficiency to 0.3 pc for the sink algorithm. As a first study in this series, we use cosmological zoom-in simulations with different spatial resolutions and find that star formation is more bursty in the runs with the sink algorithm, generating stronger outflows than in the runs with the gravo-thermo-turbulent model. The main reason for the increased burstiness is that the gas accretion rates on the sinks are high enough to form stars on very short timescales, leading to more clustered star formation. As a result, the star-forming clumps are disrupted more quickly in the sink run due to more coherent radiation and supernova feedback. The difference in burstiness between the two star formation models becomes even more pronounced when the supernova explosion energy is artificially increased. Our results suggest that improving the modelling of star formation on small, sub-molecular cloud scales can significantly impact the global properties of simulated galaxies., Comment: 21 pages, 21 figures, submitted to A&A

Previous studies of the chemo-kinematic properties of stars in the Galactic bulge have revealed a puzzling trend. Along the bulge minor axis, and close to the Galactic plane, metal-rich stars display a higher line-of-sight velocity dispersion compared to metal-poor stars, while at higher latitudes metal-rich stars have lower velocity dispersions than metal-poor stars, similar to what is found in the Galactic disc. In this work, we re-examine this issue, by studying the dependence of line-of-sight velocity dispersions on metallicity and latitude in the latest APOGEE Data Release 17, confirming the results of previous works. We then analyse an N-body simulation of a Milky Way-like galaxy, also taking into account observational biases introduced by the APOGEE selection function. We show that the inversion in the line-of-sight velocity dispersion-latitude relation observed in the Galactic bulge can be reproduced by our model. We show that this inversion is a natural consequence of a scenario in which the bulge is a boxy/peanut-shaped structure, whose metal-rich and metal-poor stars mainly originate from the thin and thick disc of the Milky Way, respectively. Due to their cold kinematics, metal-rich, thin disc stars, are efficiently trapped in the boxy/peanut bulge, and, at low latitudes, show a strong barred morphology, which results in high velocity dispersions which are larger than those attained by the metal-poor populations. Extremely metal-rich stars in the Galactic bulge, which have received renewed attention in the literature, do follow the same trends as those of the metal-rich populations. The line-of-sight velocity-latitude relation observed in the Galactic bulge for metal-poor and metal-rich stars are thus both an effect of the intrinsic nature of the Galactic bulge and of the angle at which we observe it from the Sun., Comment: 12 pages, 9 figures

While JWST has observed galaxies assembling as early as $z\sim14$, evidence of galaxies with significant old stellar populations in the Epoch of Reionisation (EoR) -- the descendants of these earliest galaxies -- are few and far between. Bursty star-formation histories (SFHs) have been invoked to explain the detectability of the earliest UV-bright galaxies, but also to interpret galaxies showing Balmer breaks without nebular emission lines. We present the first spectroscopic evidence of a $z\sim7.9$ galaxy, A2744-YD4, which shows a Balmer break and emission lines, indicating the presence of both a mature and young stellar population. The spectrum of A2744-YD4 shows peculiar emission line ratios suggesting a relatively low ionisation parameter and high gas-phase metallicity. A median stack of galaxies with similar emission line ratios reveals a clear Balmer break in their stacked spectrum. This suggests that a mature stellar population ($\sim 80$ Myr old) has produced a chemically enriched, disrupted interstellar medium. Based on SED-fitting and comparison to simulations, we conclude that the observed young stellar population is in fact the result of a rejuvenation event following a lull in star formation lasting $\sim 20$ Myr, making A2744-YD4 and our stack the first spectroscopic confirmation of galaxies that have rejuvenated following a mini-quenched phase. These rejuvenating galaxies appear to be in an exceptional evolutionary moment where they can be identified. Our analysis shows that a young stellar population of just $\sim 30 \%$ of the total stellar mass would erase the Balmer break. Hence, 'outshining' through bursty SFHs of galaxies in the early Universe is likely plaguing attempts to measure their stellar ages and masses accurately., Comment: 14 pages, 12 figures, 1 table. Submitted to MNRAS. Comments are welcome

The gradual evolution of the restricted hierarchical three body problem is analyzed analytically, focusing on conditions of Kozai-Lidov Cycles that may lead to orbital flips from prograde to retrograde motion due to the octupole (third order) term which are associated with extremely high eccentricities. We revisit the approach described by Katz, Dong and Malhotra (\href{https://doi.org/10.1103/PhysRevLett.107.181101}{Phys. Rev. Lett. 107, 181101 (2011)}) and show that for most initial conditions, to an excellent approximation, the analytic derivation can be greatly simplified and reduces to a simple pendulum model allowing an explicit flip criterion. The resulting flip criterion is much simpler than the previous one but the latter is still needed in a small fraction of phase space. We identify a logical error in the earlier derivation but clarify why it does not affect the final results., Comment: 4 pages, 4 figures

In recent years, deep reinforcement learning (DRL) approaches have generated highly successful controllers for a myriad of complex domains. However, the opaque nature of these models limits their applicability in aerospace systems and safety-critical domains, in which a single mistake can have dire consequences. In this paper, we present novel advancements in both the training and verification of DRL controllers, which can help ensure their safe behavior. We showcase a design-for-verification approach utilizing k-induction and demonstrate its use in verifying liveness properties. In addition, we also give a brief overview of neural Lyapunov Barrier certificates and summarize their capabilities on a case study. Finally, we describe several other novel reachability-based approaches which, despite failing to provide guarantees of interest, could be effective for verification of other DRL systems, and could be of further interest to the community., Comment: 10 pages, 3 figures

Control of microscopic physical systems is a prerequisite for experimental quantum science and its applications. Neutral atomic and molecular systems can be controlled using tunable scattering resonances. However, the resonant control of effective interactions has so far been limited to the ultracold regime, where quantum effects become manifest. Ultracold temperatures are still out of reach for most hybrid trapped ion-atom systems, a prospective platform for quantum technologies and fundamental research. Here we show that magnetically tunable Feshbach resonances can be used to control inelastic collisions between a single trapped Sr${}^+$ ion and Rb atoms high above the ultracold regime. We measure inelastic collision probabilities and use the results to calibrate a comprehensive theoretical model of ion-atom collisions. The observed collision dynamics show signatures of quantum interference, resulting in the pronounced state and mass dependence of the collision rates in the multiple-partial-wave regime. With our model, we discover multiple measurable Feshbach resonances for magnetic fields from 0 to 400 G, which allow significant enhancement of spin-exchange rates at temperatures as high as 1 mK. Future observation of the predicted resonances should allow precise calibration and control of the short-range dynamics in the ${\text{Sr}^++\text{Rb}}$ collisions under unprecedentedly warm conditions., Comment: 10 pages, 3 figures, and Supplementary information (including 1 supplementary figure)

The existence of nontrivial cup products or Massey products in the cohomology of a manifold leads to inequalities of systolic type, but in general such inequalities are not optimal (tight). Gromov proved an {optimal} systolic inequality for complex projective space. We provide a natural extension of Gromov's inequality to manifolds whose fundamental cohomology class is a cup product of 2-dimensional classes., Comment: 8 pages, published in Journal of Geometry

More than thirty years ago, Brooks and Buser-Sarnak constructed sequences of closed hyperbolic surfaces with logarithmic systolic growth in the genus. Recently, Liu and Petri showed that such logarithmic systolic lower bound holds for every genus (not merely for genera in some infinite sequence) using random surfaces. In this article, we show a similar result through a more direct approach relying on the original Brooks/Buser-Sarnak surfaces., Comment: 8 pages. To appear in Proceedings of the American Mathematical Society

Active Galactic Nuclei (AGN) are prime candidate sources of the high-energy, astrophysical neutrinos detected by IceCube. This is demonstrated by the real-time multi-messenger detection of the blazar TXS 0506+056 and the recent evidence of neutrino emission from NGC 1068 from a separate time-averaged study. However, the production mechanism of the astrophysical neutrinos in AGN is not well established which can be resolved via correlation studies with photon observations. For neutrinos produced due to photohadronic interactions in AGN, in addition to a correlation of neutrinos with high-energy photons, there would also be a correlation of neutrinos with photons emitted at radio wavelengths. In this work, we perform an in-depth stacking study of the correlation between 15 GHz radio observations of AGN reported in the MOJAVE XV catalog, and ten years of neutrino data from IceCube. We also use a time-dependent approach which improves the statistical power of the stacking analysis. No significant correlation was found for both analyses and upper limits are reported. When compared to the IceCube diffuse flux, at 100 TeV and for a spectral index of 2.5, the upper limits derived are $\sim3\%$ and $\sim9\%$ for the time-averaged and time-dependent case, respectively., Comment: 14 Pages 7 Figures

We present a search for an eV-scale sterile neutrino using 7.5 years of data from the IceCube DeepCore detector. The analysis uses a sample of 21,914 events with energies between 5 and 150 GeV to search for sterile neutrinos through atmospheric muon neutrino disappearance. Improvements in event selection and treatment of systematic uncertainties provide greater statistical power compared to previous DeepCore sterile neutrino searches. Our results are compatible with the absence of mixing between active and sterile neutrino states, and we place constraints on the mixing matrix elements $|U_{\mu 4}|^2 < 0.0534$ and $|U_{\tau 4}|^2 < 0.0574$ at 90% CL under the assumption that $\Delta m^2_{41}\geq 1\;\mathrm{eV^2}$. These null results add to the growing tension between anomalous appearance results and constraints from disappearance searches in the 3+1 sterile neutrino landscape., Comment: 11 pages, 5 figures. Version accepted by Physical Review D for publication

Deep Neural Networks (DNNs) are ubiquitous in real-world applications, yet they remain vulnerable to errors and adversarial attacks. This work tackles the challenge of applying formal verification to ensure the safety of computer vision models, extending verification beyond image classification to object detection. We propose a general formulation for certifying the robustness of object detection models using formal verification and outline implementation strategies compatible with state-of-the-art verification tools. Our approach enables the application of these tools, originally designed for verifying classification models, to object detection. We define various attacks for object detection, illustrating the diverse ways adversarial inputs can compromise neural network outputs. Our experiments, conducted on several common datasets and networks, reveal potential errors in object detection models, highlighting system vulnerabilities and emphasizing the need for expanding formal verification to these new domains. This work paves the way for further research in integrating formal verification across a broader range of computer vision applications.

High-significance evidences of the existence of a high-energy diffuse flux of cosmic neutrinos have emerged in the last decade from several observations by the IceCube Collaboration. The ANTARES neutrino telescope took data for 15 years in the Mediterranean Sea, from 2007 to 2022, and collected a high-purity all-flavour neutrino sample. The search for a diffuse cosmic neutrino signal using this dataset is presented in this article. This final analysis did not provide a statistically significant observation of the cosmic diffuse flux. However, this is converted into limits on the properties of the cosmic neutrino spectrum. In particular, given the sensitivity of the ANTARES neutrino telescope between 1 and 50 TeV, constraints on single-power-law hypotheses are derived for the cosmic diffuse flux below 20 TeV, especially for power-law fits of the IceCube data with spectral index softer than 2.8.

The flow of a $k$-cooperative system maps the set of vectors with up to~$(k-1)$ sign variations to itself. In particular, $1$-cooperative systems are just cooperative systems. Strongly $2$-cooperative systems satisfy a strong \Poincare-Bendixson property: any bounded solution that evolves in a compact set containing no equilibria converges to a periodic orbit. For $3$-dimensional strongly $2$-cooperative nonlinear systems, we provide a sufficient condition that guarantees the existence of an invariant compact set in the state space that includes an attracting periodic orbit. We show that our theoretical results unify and generalize known results on the existence of a periodic solution in two well-known models in biochemistry, a 3D Goodwin oscillator model and the 3D Field-Noyes ordinary-differential-equation (ODE) model for the Belousov-Zhabotinskii reaction, while simplifying the proofs.

Large language models (LLMs) have shown remarkable potential for problem solving, with open source models achieving increasingly impressive performance on benchmarks measuring areas from logical reasoning to mathematical ability. Ensembling models can further improve capabilities across a variety of domains. However, conventional methods of combining models at inference time such as shallow fusion necessitate a shared vocabulary and tokenization, and alternatives like fine-tuning for domain-specific performance are both time consuming and computationally expensive. We therefore present an inference-time ensembling algorithm aimed at "averaging" outputs from multiple LLMs and illustrate its improved performance across multiple domains compared to its constituent models alone. Character-wise ensemble decoding, CharED, finds the marginal distribution of each character for an individual model and performs a weighted average to generate an output, character by character. In coding, math, and toxicity benchmarks, we find our proposed model able to combine complimentary strengths of multiple LLMs, regardless of vocabulary, tokenization, or model size., Comment: 9 pages, 4 figures