Search

The Elementary and Secondary School Emergency Relief Fund (ESSER) was the largest onetime federal investment in K-12 schools in history, funneling almost $200 billion to states and school districts. We use novel data from Washington State to investigate the extent to which ESSER funding causally influenced spending on school personnel. We argue one cannot infer this directly from ESSER claims data because of the fungibility of school budgets. Thus, we rely on a more direct signal of district hiring decisions: public education job postings scraped from district hiring websites. To address endogeneity concerns, our preferred approach employs an instrumental variables strategy that exploits a formula mechanism used to determine Title I funding for 2020-21 (and thus ESSER allocations in 2022) based on the number of Title I formula-eligible children. We find strong, arguably causal, evidence that public school hiring increased in response to the availability of ESSER funding. Specifically, we estimate that each $1,000 in ESSER allocations caused districts to seek to hire $206 in additional staff, disproportionately teachers. These estimates suggest that roughly 12,000 new staff (including 5,100 teachers) were hired in Washington because of ESSER. In the absence of new funding, school staffing budgets will likely need to contract substantially following the sunset of ESSER.

The standardization of an interface for dense linear algebra operations in the BLAS standard has enabled interoperability between different linear algebra libraries, thereby boosting the success of scientific computing, in particular in scientific HPC. Despite numerous efforts in the past, the community has not yet agreed on a standardization for sparse linear algebra operations due to numerous reasons. One is the fact that sparse linear algebra objects allow for many different storage formats, and different hardware may favor different storage formats. This makes the definition of a FORTRAN-style all-circumventing interface extremely challenging. Another reason is that opposed to dense linear algebra functionality, in sparse linear algebra, the size of the sparse data structure for the operation result is not always known prior to the information. Furthermore, as opposed to the standardization effort for dense linear algebra, we are late in the technology readiness cycle, and many production-ready software libraries using sparse linear algebra routines have implemented and committed to their own sparse BLAS interface. At the same time, there exists a demand for standardization that would improve interoperability, and sustainability, and allow for easier integration of building blocks. In an inclusive, cross-institutional effort involving numerous academic institutions, US National Labs, and industry, we spent two years designing a hardware-portable interface for basic sparse linear algebra functionality that serves the user needs and is compatible with the different interfaces currently used by different vendors. In this paper, we present a C++ API for sparse linear algebra functionality, discuss the design choices, and detail how software developers preserve a lot of freedom in terms of how to implement functionality behind this API., Comment: 43 pages

Tree species classification plays an important role in nature conservation, forest inventories, forest management, and the protection of endangered species. Over the past four decades, remote sensing technologies have been extensively utilized for tree species classification, with Synthetic Aperture Radar (SAR) emerging as a key technique. In this study, we employed TomoSense, a 3D tomographic dataset, which utilizes a stack of single-look complex (SLC) images, a byproduct of SAR, captured at different incidence angles to generate a three-dimensional representation of the terrain. Our research focuses on evaluating multiple tabular machine-learning models using the height information derived from the tomographic image intensities to classify eight distinct tree species. The SLC data and tomographic imagery were analyzed across different polarimetric configurations and geosplit configurations. We investigated the impact of these variations on classification accuracy, comparing the performance of various tabular machine-learning models and optimizing them using Bayesian optimization. Additionally, we incorporated a proxy for actual tree height using point cloud data from Light Detection and Ranging (LiDAR) to provide height statistics associated with the model's predictions. This comparison offers insights into the reliability of tomographic data in predicting tree species classification based on height.

The increasing use of large language models (LLMs) in causal discovery as a substitute for human domain experts highlights the need for optimal model selection. This paper presents the first hallucination survey of popular LLMs for causal discovery. We show that hallucinations exist when using LLMs in causal discovery so the choice of LLM is important. We propose using Retrieval Augmented Generation (RAG) to reduce hallucinations when quality data is available. Additionally, we introduce a novel method employing multiple LLMs with an arbiter in a debate to audit edges in causal graphs, achieving a comparable reduction in hallucinations to RAG.

In the span of four decades, quantum computation has evolved from an intellectual curiosity to a potentially realizable technology. Today, small-scale demonstrations have become possible for quantum algorithmic primitives on hundreds of physical qubits and proof-of-principle error-correction on a single logical qubit. Nevertheless, despite significant progress and excitement, the path toward a full-stack scalable technology is largely unknown. There are significant outstanding quantum hardware, fabrication, software architecture, and algorithmic challenges that are either unresolved or overlooked. These issues could seriously undermine the arrival of utility-scale quantum computers for the foreseeable future. Here, we provide a comprehensive review of these scaling challenges. We show how the road to scaling could be paved by adopting existing semiconductor technology to build much higher-quality qubits, employing system engineering approaches, and performing distributed quantum computation within heterogeneous high-performance computing infrastructures. These opportunities for research and development could unlock certain promising applications, in particular, efficient quantum simulation/learning of quantum data generated by natural or engineered quantum systems. To estimate the true cost of such promises, we provide a detailed resource and sensitivity analysis for classically hard quantum chemistry calculations on surface-code error-corrected quantum computers given current, target, and desired hardware specifications based on superconducting qubits, accounting for a realistic distribution of errors. Furthermore, we argue that, to tackle industry-scale classical optimization and machine learning problems in a cost-effective manner, distributed quantum-assisted probabilistic computing with custom-designed accelerators should be considered as a complementary path toward scalability., Comment: 50 pages, 42 figures

Given a source image of a clothed person (an image subject), AI-based nudification applications can produce nude (undressed) images of that person. Moreover, not only do such applications exist, but there is ample evidence of the use of such applications in the real world and without the consent of an image subject. Still, despite the growing awareness of the existence of such applications and their potential to violate the rights of image subjects and cause downstream harms, there has been no systematic study of the nudification application ecosystem across multiple applications. We conduct such a study here, focusing on 20 popular and easy-to-find nudification websites. We study the positioning of these web applications (e.g., finding that most sites explicitly target the nudification of women, not all people), the features that they advertise (e.g., ranging from undressing-in-place to the rendering of image subjects in sexual positions, as well as differing user-privacy options), and their underlying monetization infrastructure (e.g., credit cards and cryptocurrencies). We believe this work will empower future, data-informed conversations -- within the scientific, technical, and policy communities -- on how to better protect individuals' rights and minimize harm in the face of modern (and future) AI-based nudification applications. Content warning: This paper includes descriptions of web applications that can be used to create synthetic non-consensual explicit AI-created imagery (SNEACI). This paper also includes an artistic rendering of a user interface for such an application., Comment: 22 pages, 5 figures, 2 tables

Functional simulation is an essential step in digital hardware design. Recently, there has been a growing interest in leveraging Large Language Models (LLMs) for hardware testbench generation tasks. However, the inherent instability associated with LLMs often leads to functional errors in the generated testbenches. Previous methods do not incorporate automatic functional correction mechanisms without human intervention and still suffer from low success rates, especially for sequential tasks. To address this issue, we propose CorrectBench, an automatic testbench generation framework with functional self-validation and self-correction. Utilizing only the RTL specification in natural language, the proposed approach can validate the correctness of the generated testbenches with a success rate of 88.85%. Furthermore, the proposed LLM-based corrector employs bug information obtained during the self-validation process to perform functional self-correction on the generated testbenches. The comparative analysis demonstrates that our method achieves a pass ratio of 70.13% across all evaluated tasks, compared with the previous LLM-based testbench generation framework's 52.18% and a direct LLM-based generation method's 33.33%. Specifically in sequential circuits, our work's performance is 62.18% higher than previous work in sequential tasks and almost 5 times the pass ratio of the direct method. The codes and experimental results are open-sourced at the link: https://github.com/AutoBench/CorrectBench

The Simons Observatory is a ground-based telescope array located at an elevation of 5200 meters, in the Atacama Desert in Chile, designed to measure the temperature and polarization of the cosmic microwave background. It comprises four telescopes: three 0.42-meter small aperture telescopes (SATs), focused on searching for primordial gravitational waves, and one 6-meter large aperture telescope, focused on studying small-scale perturbations. Each of the SATs will field over 12,000 TES bolometers, with two SATs sensitive to both 90 and 150GHz frequency bands (SAT-MF1, and SAT-MF2), while the third SAT is sensitive to 220 and 280GHz frequency bands. Prior to its deployment in 2023, the optical properties of SAT-MF1 were characterized in the laboratory. We report on measurements of near-field beam maps acquired using a thermal source along with measurements using a holographic method that enables characterization of the amplitude and phase of the beam response, yielding an estimate of the far-field radiation pattern received by SAT-MF1. We find that the near-field half-width-half-maximum (HWHM) requirements are met across the focal plane array for the 90GHz frequency band, and through most of the focal plane array for the 150GHz frequency band. The mean of the bandpass averaged HWHM of the edge-detector focal plane modules match the simulated HWHM to 10.4%, with the discrepancy caused by fringing in the simulation. The measured beam profiles match simulations to within 2dB from the beam center to at least the -10dB level. Holography estimates of the far-field 90GHz beams match the full-width-half-maximum from simulation within 1%, and the beam profiles deviate by less than 2dB inside the central lobe. The success of the holography and thermal beam map experiments confirmed the optical performance was sufficient to meet the science requirements. On-site observations are currently underway., Comment: 16 pages, 10 figures, Event: SPIE Astronomical Telescopes + Instrumentation, 2024, Yokohama, Japan

We introduce Edify Image, a family of diffusion models capable of generating photorealistic image content with pixel-perfect accuracy. Edify Image utilizes cascaded pixel-space diffusion models trained using a novel Laplacian diffusion process, in which image signals at different frequency bands are attenuated at varying rates. Edify Image supports a wide range of applications, including text-to-image synthesis, 4K upsampling, ControlNets, 360 HDR panorama generation, and finetuning for image customization.

In the seminal work of Culler and Shalen from 1983, essential surfaces in 3-manifolds are associated to ideal points of their $\text{SL}_2(\mathbb{C})$-character varieties, and connections between the algebraic geometry of the character variety and the topology of the 3-manifold are established via group actions on trees. Here, we lay a general foundation for this theory in arbitrary characteristic by using the same approach instead over an arbitrary algebraically closed field. Examples include a change in the $A$-polynomial in characteristic 2, a closed Haken hyperbolic 3-manifold with no detected essential surface, and a closed Haken hyperbolic 3-manifold with an essential surface only detected in characteristic 2., Comment: 47 pages

Off-road environments pose significant perception challenges for high-speed autonomous navigation due to unstructured terrain, degraded sensing conditions, and domain-shifts among biomes. Learning semantic information across these conditions and biomes can be challenging when a large amount of ground truth data is required. In this work, we propose an approach that leverages a pre-trained Vision Transformer (ViT) with fine-tuning on a small (<500 images), sparse and coarsely labeled (<30% pixels) multi-biome dataset to predict 2D semantic segmentation classes. These classes are fused over time via a novel range-based metric and aggregated into a 3D semantic voxel map. We demonstrate zero-shot out-of-biome 2D semantic segmentation on the Yamaha (52.9 mIoU) and Rellis (55.5 mIoU) datasets along with few-shot coarse sparse labeling with existing data for improved segmentation performance on Yamaha (66.6 mIoU) and Rellis (67.2 mIoU). We further illustrate the feasibility of using a voxel map with a range-based semantic fusion approach to handle common off-road hazards like pop-up hazards, overhangs, and water features., Comment: Accepted to Australasian Conference on Robotics and Automation (ACRA 2024)

Recent regulatory proposals for artificial intelligence emphasize fairness requirements for machine learning models. However, precisely defining the appropriate measure of fairness is challenging due to philosophical, cultural and political contexts. Biases can infiltrate machine learning models in complex ways depending on the model's context, rendering a single common metric of fairness insufficient. This ambiguity highlights the need for criteria to guide the selection of context-aware measures, an issue of increasing importance given the proliferation of ever tighter regulatory requirements. To address this, we developed a flowchart to guide the selection of contextually appropriate fairness measures. Twelve criteria were used to formulate the flowchart. This included consideration of model assessment criteria, model selection criteria, and data bias. We also review fairness literature in the context of machine learning and link it to core regulatory instruments to assist policymakers, AI developers, researchers, and other stakeholders in appropriately addressing fairness concerns and complying with relevant regulatory requirements., Comment: 15 pages, 4 figures, 1 table

Inductive qualitative methods have been a mainstay of education research for decades, yet it takes much time and effort to conduct rigorously. Recent advances in artificial intelligence, particularly with generative AI (GAI), have led to initial success in generating inductive coding results. Like human coders, GAI tools rely on instructions to work, and how to instruct it may matter. To understand how ML/GAI approaches could contribute to qualitative coding processes, this study applied two known and two theory-informed novel approaches to an online community dataset and evaluated the resulting coding results. Our findings show significant discrepancies between ML/GAI approaches and demonstrate the advantage of our approaches, which introduce human coding processes into GAI prompts., Comment: Accepted by AERA 2025 Annual Meeting

Modern AI agents, driven by advances in large foundation models, promise to enhance our productivity and transform our lives by augmenting our knowledge and capabilities. To achieve this vision, AI agents must effectively plan, perform multi-step reasoning and actions, respond to novel observations, and recover from errors, to successfully complete complex tasks across a wide range of scenarios. In this work, we introduce Magentic-One, a high-performing open-source agentic system for solving such tasks. Magentic-One uses a multi-agent architecture where a lead agent, the Orchestrator, plans, tracks progress, and re-plans to recover from errors. Throughout task execution, the Orchestrator directs other specialized agents to perform tasks as needed, such as operating a web browser, navigating local files, or writing and executing Python code. We show that Magentic-One achieves statistically competitive performance to the state-of-the-art on three diverse and challenging agentic benchmarks: GAIA, AssistantBench, and WebArena. Magentic-One achieves these results without modification to core agent capabilities or to how they collaborate, demonstrating progress towards generalist agentic systems. Moreover, Magentic-One's modular design allows agents to be added or removed from the team without additional prompt tuning or training, easing development and making it extensible to future scenarios. We provide an open-source implementation of Magentic-One, and we include AutoGenBench, a standalone tool for agentic evaluation. AutoGenBench provides built-in controls for repetition and isolation to run agentic benchmarks in a rigorous and contained manner -- which is important when agents' actions have side-effects. Magentic-One, AutoGenBench and detailed empirical performance evaluations of Magentic-One, including ablations and error analysis are available at https://aka.ms/magentic-one

Zero forcing is a process on a graph $G = (V,E)$ in which a set of initially colored vertices,$B_0(G) \subset V(G)$, can color their neighbors according to the color change rule. The color change rule states that if a vertex $v$ can color a neighbor $u$ if $u$ is the only uncolored neighbor of $v$. If a vertex $v$ colors its neighbor, $u$, $v$ is said to force $u$. Leaky forcing is a recently introduced variant of zero forcing in which some vertices cannot force their neighbors, even if they satisfy the color change rule. This variation has been studied for limited families of graphs with particular structure, such as products of paths and discrete hypercubes. A concept closely related to $\ell$-leaky forcing is $\ell$-resilience. A graph is said to be $\ell$-resilient if its $\ell$-leaky forcing number equals its zero forcing number. In this paper, we prove direct products of $K_n$ with $P_t$ and $K_n$ with $C_t$ is 1-resilient and conjecture the former is not 2-resilient.

Space has emerged as an exciting new application area for machine learning, with several missions equipping deep learning capabilities on-board spacecraft. Pre-processing satellite data through on-board training is necessary to address the satellite downlink deficit, as not enough transmission opportunities are available to match the high rates of data generation. To scale this effort across entire constellations, collaborated training in orbit has been enabled through federated learning (FL). While current explorations of FL in this context have successfully adapted FL algorithms for scenario-specific constraints, these theoretical FL implementations face several limitations that prevent progress towards real-world deployment. To address this gap, we provide a holistic exploration of the FL in space domain on several fronts. 1) We develop a method for space-ification of existing FL algorithms, evaluated on 2) FLySTacK, our novel satellite constellation design and hardware aware testing platform where we perform rigorous algorithm evaluations. Finally we introduce 3) AutoFLSat, a generalized, hierarchical, autonomous FL algorithm for space that provides a 12.5% to 37.5% reduction in model training time than leading alternatives.

Vision Language Models (VLMs) have been successful at many chart comprehension tasks that require attending to both the images of charts and their accompanying textual descriptions. However, it is not well established how VLM performance profiles map to human-like behaviors. If VLMs can be shown to have human-like chart comprehension abilities, they can then be applied to a broader range of tasks, such as designing and evaluating visualizations for human readers. This paper lays the foundations for such applications by evaluating the accuracy of zero-shot prompting of VLMs on graphical perception tasks with established human performance profiles. Our findings reveal that VLMs perform similarly to humans under specific task and style combinations, suggesting that they have the potential to be used for modeling human performance. Additionally, variations to the input stimuli show that VLM accuracy is sensitive to stylistic changes such as fill color and chart contiguity, even when the underlying data and data mappings are the same.

Holographic displays hold the promise of providing authentic depth cues, resulting in enhanced immersive visual experiences for near-eye applications. However, current holographic displays are hindered by speckle noise, which limits accurate reproduction of color and texture in displayed images. We present HoloChrome, a polychromatic holographic display framework designed to mitigate these limitations. HoloChrome utilizes an ultrafast, wavelength-adjustable laser and a dual-Spatial Light Modulator (SLM) architecture, enabling the multiplexing of a large set of discrete wavelengths across the visible spectrum. By leveraging spatial separation in our dual-SLM setup, we independently manipulate speckle patterns across multiple wavelengths. This novel approach effectively reduces speckle noise through incoherent averaging achieved by wavelength multiplexing. Our method is complementary to existing speckle reduction techniques, offering a new pathway to address this challenge. Furthermore, the use of polychromatic illumination broadens the achievable color gamut compared to traditional three-color primary holographic displays. Our simulations and tabletop experiments validate that HoloChrome significantly reduces speckle noise and expands the color gamut. These advancements enhance the performance of holographic near-eye displays, moving us closer to practical, immersive next-generation visual experiences.

We present images of the Vega planetary debris disk obtained at 15.5, 23, and 25.5 microns with the Mid-Infrared Instrument (MIRI) on JWST. The debris system is remarkably symmetric and smooth, and centered accurately on the star. There is a broad Kuiper-belt-analog ring at 80 to 170 au that coincides with the planetesimal belt detected with ALMA at 1.34 mm. The interior of the broad belt is filled with warm debris that shines most efficiently at mid-infrared along with a shallow flux dip/gap at 60 au from the star. These qualitative characteristics argue against any Saturn-mass planets orbiting the star outside of about 10 au assuming the unseen planet would be embedded in the very broad planetesimal disk from a few to hundred au. We find that the distribution of dust detected interior to the broad outer belt is consistent with grains being dragged inward by the Poynting-Robertson effect. Tighter constraints can be derived for planets in specific locations, for example any planet shepherding the inner edge of the outer belt is likely to be less than 6 Earth masses. The disk surface brightness profile along with the available infrared photometry suggest a disk inner edge near 3-5 au, disconnected from the sub-au region that gives rise to the hot near-infrared excess. The gap between the hot, sub-au zone and the inner edge of the warm debris might be shepherded by a modest mass, Neptune-size planet., Comment: accepted for publication in ApJ

This paper aims to review the radical role of AI and deep learning in various functional areas of the business, such as marketing, finance, operations, human resources and customer service. Thus, based on the overview of the latest research and practices focusing on AI technologies in different industries, the possibilities of improving organizational efficiency by personalized AI for making decisions based on big data and personalizing clients' interactions with organizations are presented and discussed. Several operational issues, ethical concerns, and regulatory concerns have also been discussed in the review of the literature. Moreover, it covers material applications in the healthcare sector, the retail and manufacturing industry, agriculture and farming, and finance before considering possible future developments and themes for further investigation. Drawing from this revolutionary ethnographic review, organizations aiming to implement strategic and responsible optimization benefit from detailed guides., Comment: 8 pages

We investigate the internal representations of vision-and-language models (VLMs) and how they encode task representations. We consider tasks specified through examples or instructions, using either text or image inputs. Surprisingly, we find that conceptually similar tasks are mapped to similar task vector representations, regardless of how they are specified. Our findings suggest that to output answers, tokens in VLMs undergo three distinct phases: input, task, and answer, a process which is consistent across different modalities and specifications. The task vectors we identify in VLMs are general enough to be derived in one modality (e.g., text) and transferred to another (e.g., image). Additionally, we find that ensembling exemplar and instruction based task vectors produce better task representations. Taken together, these insights shed light on the underlying mechanisms of VLMs, particularly their ability to represent tasks in a shared manner across different modalities and task specifications. Project page: https://task-vectors-are-cross-modal.github.io.

The James Webb Space Telescope (JWST) has revealed unexpectedly rapid galaxy assembly in the early universe, in tension with models of star and galaxy formation. In the gas conditions typical of early galaxies, particularly their low abundances of heavy elements (metals) and dust, the star-formation process is poorly understood. Some models predict that stars form in atomic gas at low metallicity, in contrast to forming in molecular gas as observed in higher-metallicity galaxies. To understand the very high star-formation rates at early epochs, it is necessary to determine whether molecular gas formation represents a bottleneck to star formation, or if it is plentiful even at extremely low metallicity. Despite repeated searches, star-forming molecular gas has not yet been observed in any galaxy below 7% of the Solar metallicity, leaving the question of how stars form at lower metallicities unresolved. Here, we report the detection of rotationally excited emission from molecular hydrogen in the star-forming region of the nearby, 3% Solar metallicity galaxy Leo P with the MIRI-MRS instrument onboard JWST. These observations place a lower limit on the molecular gas content of Leo P and, combined with our upper limit on carbon monoxide emission from a deep search of this galaxy, demonstrate that MIRI-MRS is sensitive to much smaller molecular gas masses at extremely low metallicity compared to the traditional observational tracer. This discovery pushes the maximum metallicity at which purely atomic gas may fuel star formation a factor of two lower, providing crucial empirical guidance for models of star formation in the early universe., Comment: Under review

Holographic displays are a promising technology for immersive visual experiences, and their potential for compact form factor makes them a strong candidate for head-mounted displays. However, at the short propagation distances needed for a compact, head-mounted architecture, image contrast is low when using a traditional phase-only spatial light modulator (SLM). Although a complex SLM could restore contrast, these modulators require bulky lenses to optically co-locate the amplitude and phase components, making them poorly suited for a compact head-mounted design. In this work, we introduce a novel architecture to improve contrast: by adding a low resolution amplitude SLM a short distance away from the phase modulator, we demonstrate peak signal-to-noise ratio improvement up to 31 dB in simulation compared to phase-only, even when the amplitude modulator is 60$\times$ lower resolution than its phase counterpart. We analyze the relationship between diffraction angle and amplitude modulator pixel size, and validate the concept with a benchtop experimental prototype. By showing that low resolution modulation is sufficient to improve contrast, we pave the way towards practical high-contrast holography in a compact form factor., Comment: 19 pages, 17 figures

With the rapidly increasing complexity of modern chips, hardware engineers are required to invest more effort in tasks such as circuit design, verification, and physical implementation. These workflows often involve continuous modifications, which are labor-intensive and prone to errors. Therefore, there is an increasing need for more efficient and cost-effective Electronic Design Automation (EDA) solutions to accelerate new hardware development. Recently, large language models (LLMs) have made significant advancements in contextual understanding, logical reasoning, and response generation. Since hardware designs and intermediate scripts can be expressed in text format, it is reasonable to explore whether integrating LLMs into EDA could simplify and fully automate the entire workflow. Accordingly, this paper discusses such possibilities in several aspects, covering hardware description language (HDL) generation, code debugging, design verification, and physical implementation. Two case studies, along with their future outlook, are introduced to highlight the capabilities of LLMs in code repair and testbench generation. Finally, future directions and challenges are highlighted to further explore the potential of LLMs in shaping the next-generation EDA

We present the results of a search for gravitational-wave transients associated with core-collapse supernova SN 2023ixf, which was observed in the galaxy Messier 101 via optical emission on 2023 May 19th, during the LIGO-Virgo-KAGRA 15th Engineering Run. We define a five-day on-source window during which an accompanying gravitational-wave signal may have occurred. No gravitational waves have been identified in data when at least two gravitational-wave observatories were operating, which covered $\sim 14\%$ of this five-day window. We report the search detection efficiency for various possible gravitational-wave emission models. Considering the distance to M101 (6.7 Mpc), we derive constraints on the gravitational-wave emission mechanism of core-collapse supernovae across a broad frequency spectrum, ranging from 50 Hz to 2 kHz where we assume the GW emission occurred when coincident data are available in the on-source window. Considering an ellipsoid model for a rotating proto-neutron star, our search is sensitive to gravitational-wave energy $1 \times 10^{-5} M_{\odot} c^2$ and luminosity $4 \times 10^{-5} M_{\odot} c^2/\text{s}$ for a source emitting at 50 Hz. These constraints are around an order of magnitude more stringent than those obtained so far with gravitational-wave data. The constraint on the ellipticity of the proto-neutron star that is formed is as low as $1.04$, at frequencies above $1200$ Hz, surpassing results from SN 2019ejj., Comment: Main paper: 6 pages, 4 figures and 1 table. Total with appendices: 20 pages, 4 figures, and 1 table

The first few cycles of JWST have identified an overabundance of UV-bright galaxies and a general excess of UV luminosity density at $z\gtrsim10$ compared to expectations from most (pre-JWST) theoretical models. Moreover, some of the brightest high-redshift spectroscopically confirmed galaxies exhibit peculiar chemical abundance patterns, most notably extremely high N/O ratios. Since N/O has been empirically shown to scale strongly with He/H, as expected for hot hydrogen burning, these same bright high-redshift galaxies are likely also helium-enhanced. Under simplistic assumptions for stellar evolution, the bolometric luminosity of a star scales as $L\propto (4-\frac{9}{2}Y+\frac{5}{4}Y^{2})^{-1}$ -- hence a higher He/H leads to brighter stars. In this Letter, we evolve a series of MESA models to the zero-age main-sequence and highlight that the helium enhancements at the levels measured and inferred for high-redshift galaxies can boost the 1500 $\mathring{\rm A}$ UV luminosity by up to $\sim50\%$, while simultaneously increasing the stellar effective temperature. The combination of helium enhancements with nebular continuum emission expected for intense bursts of star formation have the potential to help reduce the tension between JWST observations and certain galaxy formation models., Comment: 4 pages, 3 figures, Accepted by The Open Journal of Astrophysics

Quasar feedback may play a key role in the evolution of massive galaxies. The dust-reddened quasar, F2M110648.35$+$480712 at $z = 0.4352$ is one of the few cases at its redshift that exhibits powerful quasar feedback through bipolar outflows. Our new observation with the integral field unit mode of Near-infrared Spectrograph onboard JWST opens a new window to examine this spectacular outflow through Pa$\alpha$ emission line with $\sim$3$\times$ better spatial resolution than previous work. The morphology and kinematics of the Pa$\alpha$ nebula confirm the existence of a bipolar outflow extending on a scale of $\sim$17$\times$14 kpc and with a velocity reaching $\sim$1100 km s$^{-1}$. The higher spatial resolution of our new observation leads to more reliable measurements of outflow kinematics. Considering only the spatially resolved outflow and assuming an electron density of 100 cm$^{-2}$, the mass, momentum and kinetic energy outflow rates are $\sim$50-210 M$_{\odot}$ yr$^{-1}$, $\sim$0.3-1.7$\times$10$^{36}$ dynes ($\sim$14-78\% of the quasar photon momentum flux) and $\sim$0.16-1.27$\times$10$^{44}$ erg s$^{-1}$ ($\sim$0.02-0.20\% of the quasar bolometric luminosity), respectively. The local instantaneous outflow rates generally decrease radially. We infer that the quasar is powerful enough to drive the outflow, while stellar processes cannot be overlooked as a contributing energy source. The mass outflow rate is $\sim$0.4-1.5 times the star formation rate, and the ratio of kinetic energy outflow rate to the quasar bolometric luminosity is comparable to the minimum value required for negative quasar feedback in simulations. This outflow may help regulate the star formation activity within the system to some extent., Comment: 14 pages, 6 figures, 1 table, ApJ in review

In this paper, we study a theoretical math problem of game theory and calculus of variations in which we minimize a functional involving two players. A general relationship between the optimal strategies for both players is presented, followed by computer analysis as well as polynomial approximation. Nash equilibrium strategies are determined through algebraic manipulation and linear programming. Lastly, a variation of the game is also investigated., Comment: 29 pages, 17 figures

Understanding uncertainty plays a critical role in achieving common ground (Clark et al.,1983). This is especially important for multimodal AI systems that collaborate with users to solve a problem or guide the user through a challenging concept. In this work, for the first time, we present a dataset annotated in collaboration with developmental and cognitive psychologists for the purpose of studying nonverbal cues of uncertainty. We then present an analysis of the data, studying different roles of uncertainty and its relationship with task difficulty and performance. Lastly, we present a multimodal machine learning model that can predict uncertainty given a real-time video clip of a participant, which we find improves upon a baseline multimodal transformer model. This work informs research on cognitive coordination between human-human and human-AI and has broad implications for gesture understanding and generation. The anonymized version of our data and code will be publicly available upon the completion of the required consent forms and data sheets., Comment: SIGDIAL 2023

Named entity recognition (NER) is a crucial task that aims to identify structured information, which is often replete with complex, technical terms and a high degree of variability. Accurate and reliable NER can facilitate the extraction and analysis of important information. However, NER for other than English is challenging due to limited data availability, as the high expertise, time, and expenses are required to annotate its data. In this paper, by using the limited data, we explore various factors including model structure, corpus annotation scheme and data augmentation techniques to improve the performance of a NER model for French. Our experiments demonstrate that these approaches can significantly improve the model's F1 score from original CRF score of 62.41 to 79.39. Our findings suggest that considering different extrinsic factors and combining these techniques is a promising approach for improving NER performance where the size of data is limited.

The proximity of the Large and Small Magellanic Clouds (LMC and SMC) provides the opportunity to study the impact of dwarf-dwarf interactions on their mass assembly with a unique level of detail. To this end, we analyze two-filter broadband imaging of 83 Hubble Space Telescope (HST) pointings covering 0.203 deg$^2$ towards the SMC, extending out to $\sim$3.5 kpc in projection from its optical center. Lifetime star formation histories (SFHs) fit to each pointing independently reveal an outside-in age gradient such that fields in the SMC outskirts are older on average. We measure radial gradients of the lookback time to form 90%, 75% and 50% of the cumulative stellar mass for the first time, finding $\delta$($\tau_{90}$, $\tau_{75}$, $\tau_{50}$)/$\delta$R = (0.61$^{+0.08}_{-0.07}$, 0.65$^{+0.09}_{-0.08}$, 0.82$^{+0.12}_{-0.16}$) Gyr/kpc assuming PARSEC evolutionary models and a commonly used elliptical geometry of the SMC, although our results are robust to these assumptions. The wing of the SMC deviates from this trend, forming 25\% of its cumulative mass over the most recent 3 Gyr due to a best-fit star formation rate that remains approximately constant. Our results are consistent with chemodynamical evidence of a tidally stripped SMC component in the foreground, and imply contributions to the observed SFH from multiple previous LMC-SMC interactions. We also compare our SMC SFH with results from a companion study of the LMC, finding that while the two galaxies present different internal, spatially resolved SFH trends, both the LMC and SMC have similar near-constant lifetime SFHs when viewed globally., Comment: ApJ in press. 40 pages, 18 figures, 5 tables including Appendices

The proximity of the Magellanic Clouds provides the opportunity to study interacting dwarf galaxies near a massive host, and spatial trends in their stellar population properties in particular, with a unique level of detail. The Scylla pure parallel program has obtained deep (80% complete to >1 mag below the ancient main sequence turnoff), homogeneous two-filter Hubble Space Telescope (HST) imaging sampling the inner star-forming disk of the Large Magellanic Cloud (LMC), the perfect complement to shallower, contiguous ground-based surveys. We harness this imaging together with extant archival data and fit lifetime star formation histories (SFHs) to resolved color-magnitude diagrams (CMDs) of 111 individual fields, using three different stellar evolutionary libraries. We validate per-field recovered distances and extinctions as well as the combined global LMC age-metallicity relation and SFH against independent estimates. We find that the present-day radial age gradient reverses from an inside-out gradient in the inner disk to an outside-in gradient beyond $\sim$2 disk scalelengths, supported by ground-based measurements. The gradients become relatively flatter at earlier lookback times, while the location of the inversion remains constant over an order of magnitude in lookback time, from $\sim$1$-$10 Gyr. This suggests at least one mechanism that predates the recent intense LMC-SMC interaction. We compare observed radial age trends to other late-type galaxies at fixed stellar mass and discuss similarities and differences in the context of potential drivers, implying strong radial migration in the LMC., Comment: ApJ in press. 45 pages, 17 figures, 9 tables including Appendices

The magnetar SGR 1935+2154 is the only known Galactic source of fast radio bursts (FRBs). FRBs from SGR 1935+2154 were first detected by CHIME/FRB and STARE2 in 2020 April, after the conclusion of the LIGO, Virgo, and KAGRA Collaborations' O3 observing run. Here we analyze four periods of gravitational wave (GW) data from the GEO600 detector coincident with four periods of FRB activity detected by CHIME/FRB, as well as X-ray glitches and X-ray bursts detected by NICER and NuSTAR close to the time of one of the FRBs. We do not detect any significant GW emission from any of the events. Instead, using a short-duration GW search (for bursts $\leq$ 1 s) we derive 50\% (90\%) upper limits of $10^{48}$ ($10^{49}$) erg for GWs at 300 Hz and $10^{49}$ ($10^{50}$) erg at 2 kHz, and constrain the GW-to-radio energy ratio to $\leq 10^{14} - 10^{16}$. We also derive upper limits from a long-duration search for bursts with durations between 1 and 10 s. These represent the strictest upper limits on concurrent GW emission from FRBs., Comment: 15 pages of text including references, 4 figures, 5 tables

We test whether replacing crowdsource workers with LLMs to write Natural Language Inference (NLI) hypotheses similarly results in annotation artifacts. We recreate a portion of the Stanford NLI corpus using GPT-4, Llama-2 and Mistral 7b, and train hypothesis-only classifiers to determine whether LLM-elicited hypotheses contain annotation artifacts. On our LLM-elicited NLI datasets, BERT-based hypothesis-only classifiers achieve between 86-96% accuracy, indicating these datasets contain hypothesis-only artifacts. We also find frequent "give-aways" in LLM-generated hypotheses, e.g. the phrase "swimming in a pool" appears in more than 10,000 contradictions generated by GPT-4. Our analysis provides empirical evidence that well-attested biases in NLI can persist in LLM-generated data.

Despite significant advancements in deep probabilistic models, learning low-dimensional discrete latent representations remains a challenging task. In this paper, we introduce a novel method that enhances variational inference in discrete latent variable models by leveraging Error Correcting Codes (ECCs) to introduce redundancy in the latent representations. This redundancy is then exploited by the variational posterior to yield more accurate estimates, thereby narrowing the variational gap. Inspired by ECCs commonly used in digital communications and data storage, we demonstrate proof-of-concept using a Discrete Variational Autoencoder (DVAE) with binary latent variables and block repetition codes. We further extend this idea to a hierarchical structure based on polar codes, where certain latent bits are more robustly protected. Our method improves generation quality, data reconstruction, and uncertainty calibration compared to the uncoded DVAE, even when trained with tighter bounds such as the Importance Weighted Autoencoder (IWAE) objective. In particular, we demonstrate superior performance on MNIST, FMNIST, CIFAR10, and Tiny ImageNet datasets. The general approach of integrating ECCs into variational inference is compatible with existing techniques to boost variational inference, such as importance sampling or Hamiltonian Monte Carlo. We also outline the key properties ECCs must have to effectively enhance discrete variational inference.

Wearable devices like smartwatches, wristbands, and fitness trackers are designed to be lightweight devices to be worn on the human body. With the increased connectivity of wearable devices, they will become integral to remote healthcare solutions. For example, a smartwatch can measure and upload a patient's vital signs to the cloud through a network which is monitored by software backed with Artificial Intelligence. When an anomaly of a patient is detected, it will be alerted to healthcare professionals for proper intervention. Remote healthcare offers substantial benefits for both patients and healthcare providers as patients may avoid expensive in-patient care by choosing the comfort of staying at home while being monitored after a surgery and healthcare providers can resolve challenges between limited resources and a growing population. While remote healthcare through wearable devices is ubiquitous and affordable, it raises concerns about patient privacy. Patients may wonder: Is my data stored in the cloud safe? Can anyone access and manipulate my data for blackmailing? Hence, securing patient private information end-to-end becomes crucial. This paper explores solutions for applying modern cryptography to secure wearable apps and ensure patient data is protected with confidentiality, integrity, and authenticity from wearable edge to cloud.

Learning-based approaches to quadruped locomotion commonly adopt generic policy architectures like fully connected MLPs. As such architectures contain few inductive biases, it is common in practice to incorporate priors in the form of rewards, training curricula, imitation data, or trajectory generators. In nature, animals are born with priors in the form of their nervous system's architecture, which has been shaped by evolution to confer innate ability and efficient learning. For instance, a horse can walk within hours of birth and can quickly improve with practice. Such architectural priors can also be useful in ANN architectures for AI. In this work, we explore the advantages of a biologically inspired ANN architecture for quadruped locomotion based on neural circuits in the limbs and spinal cord of mammals. Our architecture achieves good initial performance and comparable final performance to MLPs, while using less data and orders of magnitude fewer parameters. Our architecture also exhibits better generalization to task variations, even admitting deployment on a physical robot without standard sim-to-real methods. This work shows that neural circuits can provide valuable architectural priors for locomotion and encourages future work in other sensorimotor skills.

We propose a bit-flip descent method for optimizing binary spreading codes with large family sizes and long lengths, addressing the challenges of large-scale code design in GNSS and emerging PNT applications. The method iteratively flips code bits to improve the codes' auto- and cross-correlation properties. In our proposed method, bits are selected by sampling a small set of candidate bits and choosing the one that offers the best improvement in performance. The method leverages the fact that incremental impact of a bit flip on the auto- and cross-correlation may be efficiently computed without recalculating the entire function. We apply this method to two code design problems modeled after the GPS L1 C/A and Galileo E1 codes, demonstrating rapid convergence to low-correlation codes. The proposed approach offers a powerful tool for developing spreading codes that meet the demanding requirements of modern and future satellite navigation systems.

Text-to-image (T2I) models are increasingly used in impactful real-life applications. As such, there is a growing need to audit these models to ensure that they generate desirable, task-appropriate images. However, systematically inspecting the associations between prompts and generated content in a human-understandable way remains challenging. To address this, we propose \emph{Concept2Concept}, a framework where we characterize conditional distributions of vision language models using interpretable concepts and metrics that can be defined in terms of these concepts. This characterization allows us to use our framework to audit models and prompt-datasets. To demonstrate, we investigate several case studies of conditional distributions of prompts, such as user defined distributions or empirical, real world distributions. Lastly, we implement Concept2Concept as an open-source interactive visualization tool facilitating use by non-technical end-users. Warning: This paper contains discussions of harmful content, including CSAM and NSFW material, which may be disturbing to some readers.

Language models (LMs) can exhibit human-like behaviour, but it is unclear how to describe this behaviour without undue anthropomorphism. We formalise a behaviourist view of LM character traits: qualities such as truthfulness, sycophancy, or coherent beliefs and intentions, which may manifest as consistent patterns of behaviour. Our theory is grounded in empirical demonstrations of LMs exhibiting different character traits, such as accurate and logically coherent beliefs, and helpful and harmless intentions. We find that the consistency with which LMs exhibit certain character traits varies with model size, fine-tuning, and prompting. In addition to characterising LM character traits, we evaluate how these traits develop over the course of an interaction. We find that traits such as truthfulness and harmfulness can be stationary, i.e., consistent over an interaction, in certain contexts, but may be reflective in different contexts, meaning they mirror the LM's behavior in the preceding interaction. Our formalism enables us to describe LM behaviour precisely in intuitive language, without undue anthropomorphism., Comment: accepted as Findings of EMNLP2024

Alzheimer's disease (AD) is a progressive neurodegenerative disorder with increasing prevalence among the aging population, necessitating early and accurate diagnosis for effective disease management. In this study, we present a novel hybrid deep learning framework that integrates both 2D Convolutional Neural Networks (2D-CNN) and 3D Convolutional Neural Networks (3D-CNN), along with a custom loss function and volumetric data augmentation, to enhance feature extraction and improve classification performance in AD diagnosis. According to extensive experiments, AlzhiNet outperforms standalone 2D and 3D models, highlighting the importance of combining these complementary representations of data. The depth and quality of 3D volumes derived from the augmented 2D slices also significantly influence the model's performance. The results indicate that carefully selecting weighting factors in hybrid predictions is imperative for achieving optimal results. Our framework has been validated on the Magnetic Resonance Imaging (MRI) from Kaggle and MIRIAD datasets, obtaining accuracies of 98.9% and 99.99%, respectively, with an AUC of 100%. Furthermore, AlzhiNet was studied under a variety of perturbation scenarios on the Alzheimer's Kaggle dataset, including Gaussian noise, brightness, contrast, salt and pepper noise, color jitter, and occlusion. The results obtained show that AlzhiNet is more robust to perturbations than ResNet-18, making it an excellent choice for real-world applications. This approach represents a promising advancement in the early diagnosis and treatment planning for Alzheimer's disease.

Large Language Models (LLMs) have achieved remarkable breakthroughs. However, the huge number of parameters in LLMs require significant amount of memory storage in inference, which prevents their practical deployment in many applications. To reduce memory storage of LLMs, singular value decomposition (SVD) provides a promising solution to approximate weight matrices for compressing LLMs. In this paper, we take a step further to explore parameter sharing across different layers with SVD to achieve more effective compression for LLMs. Specifically, weight matrices in different layers are decomposed and represented as a linear combination of a set of shared basis vectors and unique coefficients. The types of weight matrices and the layer selection for basis sharing are examined when compressing LLMs to maintain the performance. Comprehensive experiments demonstrate that Basis Sharing outperforms state-of-the-art SVD-based compression approaches and parameter sharing techniques, especially under large compression ratios. Code is available at: https://github.com/TUDa-HWAI/Basis_Sharing

The geotechnical evaluation of seabed sediments is important for engineering projects and naval applications, offering valuable insights into sediment properties, behavior, and strength. Obtaining high-quality seabed samples can be a challenging task, making in-situ testing an essential part of site characterization. Free Fall Penetrometers (FFP) have emerged as robust tools for rapidly profiling seabed surface sediments, even in energetic nearshore or estuarine conditions and shallow as well as deep depths. While methods for interpretation of traditional offshore Cone Penetration Testing (CPT) data are well-established, their adaptation to FFP data is still an area of research. In this study, we introduce an innovative approach that utilizes machine learning algorithms to create a sediment behavior classification system based on portable free fall penetrometer (PFFP) data. The proposed model leverages PFFP measurements obtained from locations such as Sequim Bay (Washington), the Potomac River, and the York River (Virginia). The result shows 91.1\% accuracy in the class prediction, with the classes representing cohesionless sediment with little to no plasticity, cohesionless sediment with some plasticity, cohesive sediment with low plasticity, and cohesive sediment with high plasticity. The model prediction not only provides the predicted class but also yields an estimate of inherent uncertainty associated with the prediction, which can provide valuable insight about different sediment behaviors. These uncertainties typically range from very low to very high, with lower uncertainties being more common, but they can increase significantly dpending on variations in sediment composition, environmental conditions, and operational techniques. By quantifying uncertainty, the model offers a more comprehensive and informed approach to sediment classification.

This paper challenges fixed orientations towards the self in human-AI entanglements. It offers queering as a strategy to subvert the individuation and fixing of identities within algorithmic systems and the loss of futurity that it brings about. By exploring queerness, the paper examines how one's sense of self and futurity are interpellated within the algorithmic borderlands of human-AI entanglements. The study discusses an embodied experiment called "Undoing Gracia," a Digital Twin simulation where the first author Grace and their AI twins (Lex and Tortugi) interact within the fictional world of Gracia. The experiment probes into Grace's multifaceted subjectivities by conceiving themselves as interdependent entities evolving through their interactions within Gracia. The paper outlines the process of creating and implementing the simulation and examines how the agents co-perform and become-with alongside Gracia's making. The findings illuminate queer gestures for navigating human-AI entanglements in HCI research and practice, highlighting the importance of fluid identities in shaping human-AI relations.

Isolated, low-mass galaxies provide the opportunity to assess the impact of reionization on their star formation histories (SFHs) without the ambiguity of environmental processes associated with massive host galaxies. There are very few isolated, low-mass galaxies that are close enough to determine their SFHs from resolved star photometry reaching below the oldest main sequence turnoff. JWST has increased the volume for which this is possible, and here we report on JWST observations of the low-mass, isolated galaxy Leo P. From NIRCam imaging in F090W, F150W, and F277W, we derive a SFH which shows early star formation followed by a pause subsequent to the epoch of reionization which is then later followed by a re-ignition of star formation. This is very similar to the SFHs from previous studies of other dwarf galaxies in the ``transition zone'' between quenched very low-mass galaxies and the more massive galaxies which show no evidence of the impact of reionization on their SFHs; this pattern is rarely produced in simulations of SFHs. The lifetime SFH reveals that Leo P's stellar mass at the epoch of reionization was in the range that is normally associated with being totally quenched. The extended pause in star formation from z~5-1 has important implications for the contribution of low-mass galaxies to the UV photon budget at intermediate redshifts. We also demonstrate that, due to higher sensitivity and angular resolution, observing in two NIRCam short wavelength filters is superior to observing in a combination of a short and a long wavelength filter., Comment: 24 pages, 9 figures, 3 tables

Colorectal cancer (CRC) remains a leading cause of cancer-related mortality worldwide, highlighting the urgent need for advanced therapeutic strategies. Nanoparticle-based drug delivery systems have emerged as a promising approach to improve the specificity and efficacy of anticancer treatments. This review examines three cutting-edge mesoporous silica nanoparticle (MSN)-based drug delivery to introduce novel CRC therapy, each utilizing unique functionalization strategies for targeted drug release. The first system, hyaluronidase-responsive MSN-HA/DOX, employs biotin-modified hyaluronic acid to facilitate dual-stimulus drug release in the tumor microenvironment, exhibiting enhanced in vivo tumor inhibition. The DOX/SLN-PEG-Biotin utilizes polyethylene glycol and biotin to improve drug stability and target biotin-overexpressing CRC cells, demonstrating superior anti-cancer efficacy in vitro and in vivo. Lastly, galactosylated chitosan-functionalized MSNs enable targeted delivery through asialoglycoprotein receptors, providing controlled drug release and strong therapeutic potential. Collectively, these systems highlight the advancements in nanoparticle functionalization for CRC treatment, offering a pathway to overcome the limitations of conventional chemotherapy. Further research is required to translate these innovations into clinical practice, ensuring safety and scalability.