Search

Ternary Deep Neural Networks (DNN) have shown a large potential for highly energy-constrained systems by virtue of their low power operation (due to ultra-low precision) with only a mild degradation in accuracy. To enable an energy-efficient hardware substrate for such systems, we propose a compute-enabled memory design, referred to as SiTe-CiM, which features computing-in-memory (CiM) of dot products between signed ternary (SiTe) inputs and weights. SiTe CiM is based on cross-coupling of two bit cells to enable CiM of dot products in the signed ternary regime. We explore SiTe CiM with 8T-SRAM, 3T-embedded DRAM (3T-eDRAM) and 3T-ferroelectric metal FET (FEMFET) memories. We propose two flavors of this technique, namely SiTe CiM I/II. In SiTe CiM I, we employ two additional transistors per cell for cross-coupling, achieving fast CiM operations, albeit incurring an area overhead ranging from 18% to 34% (compared to standard ternary memories). In SiTe CiM II, four extra transistors are utilized for every 16 cells in a column, thereby incurring only 6% area cost (but leading to slower CiM than SiTe CiM I). Based on the array analysis, our designs achieve up to 88% lower CiM latency and 78% CiM energy savings across various technologies considered, as compared to their respective near-memory computing counterparts. Further, we perform system level analysis by incorporating SiTe CiM I/II arrays in a ternary DNN accelerator and show up to 7X throughput boost and up to 2.5X energy reduction compared to the near-memory ternary DNN accelerators.

Concrete manufacturing projects are one of the most common ones for consulting agencies. Because of the highly non-linear dependency of input materials like ash, water, cement, superplastic, etc; with the resultant strength of concrete, it gets difficult for machine learning models to successfully capture this relation and perform cost optimizations. This paper highlights how PINNs (Physics Informed Neural Networks) can be useful in the given situation. This state-of-the-art model shall also get compared with traditional models like Linear Regression, Random Forest, Gradient Boosting, and Deep Neural Network. Results of the research highlights how well PINNs performed even with reduced dataset, thus resolving one of the biggest issues of limited data availability for ML models. On an average, PINN got the loss value reduced by 26.3% even with 40% lesser data compared to the Deep Neural Network. In addition to predicting strength of the concrete given the quantity of raw materials, the paper also highlights the use of heuristic optimization method like Particle Swarm Optimization (PSO) in predicting quantity of raw materials required to manufacture concrete of given strength with least cost.

High-coherence cavity resonators are excellent resources for encoding quantum information in higher-dimensional Hilbert spaces, moving beyond traditional qubit-based platforms. A natural strategy is to use the Fock basis to encode information in qudits. One can perform quantum operations on the cavity mode qudit by coupling the system to a non-linear ancillary transmon qubit. However, the performance of the cavity-transmon device is limited by the noisy transmons. It is, therefore, important to develop practical benchmarking tools for these qudit systems in an algorithm-agnostic manner. We gauge the performance of these qudit platforms using sampling tests such as the Heavy Output Generation (HOG) test as well as the linear Cross-Entropy Benchmark (XEB), by way of simulations of such a system subject to realistic dominant noise channels. We use selective number-dependent arbitrary phase and unconditional displacement gates as our universal gateset. Our results show that contemporary transmons comfortably enable controlling a few tens of Fock levels of a cavity mode. This framework allows benchmarking even higher dimensional qudits as those become accessible with improved transmons., Comment: 21 pages, 8 figures

We investigate numerically the identification of relevant structural features that contribute to the dynamical heterogeneity in a model glass-forming liquid. By employing the recently proposed information imbalance technique, we select these features from a range of physically motivated descriptors. This selection process is performed in a supervised manner (using both dynamical and structural data) and an unsupervised manner (using only structural data). We then apply the selected features to predict future dynamics using a machine learning technique. Finally, we discuss the potential applications of this approach in identifying the dominant mechanisms governing the glassy slow dynamics.

JWST provides new opportunities to cross-check the HST Cepheid/SNeIa distance ladder, which yields the most precise local measure of H0. We analyze early JWST subsamples (~1/4 of the HST sample) from the SH0ES and CCHP groups, calibrated by a single anchor (N4258). We find HST Cepheid distances agree well (~1 sigma) with all 8 combinations of methods, samples, and telescopes: JWST Cepheids, TRGB, and JAGB by either group, plus HST TRGB and Miras. The comparisons explicitly include the measurement uncertainty of each method in N4258, an oft-neglected but dominant term. Mean differences are ~0.03 mag, far smaller than the 0.18 mag "Hubble tension." Combining all measures produces the strongest constraint yet on the linearity of HST Cepheid distances, 0.994+-0.010, ruling out distance-dependent bias or offset as the source of the tension at ~7 sigma. Yet, measurements of H0 from current JWST subsamples produce large sampling differences whose size and direction we can directly estimate from the full HST set. We show that Delta(H0)~2.5 km/s/Mpc between the CCHP JWST program and the full HST sample is entirely consistent with differences in sample selection. Combining all JWST samples produces a new, distance-limited set of 16 SNeIa at D<25 Mpc and more closely resembles the full sample thanks to "reversion to the mean" of larger samples. Using JWST Cepheids, JAGB, and TRGB, we find 73.4+-2.1, 72.2+-2.2, and 72.1+-2.2 km/s/Mpc, respectively. Explicitly accounting for SNe in common, the combined-sample three-method result from JWST is H0=72.6+-2.0, similar to H0=72.8 expected from HST Cepheids in the same galaxies. The small JWST sample trivially lowers the Hubble tension significance due to small-sample statistics and is not yet competitive with the HST set (42 SNeIa and 4 anchors), which yields 73.2+-0.9. Still, the joint JWST sample provides important crosschecks which the HST data passes., Comment: submitted to ApJ, comments welcome and appreciated

The construction of high-quality numerical features is critical to any quantitative data analysis. Feature engineering has been historically addressed by carefully hand-crafting data representations based on domain expertise. This work views the internal representations of modern deep neural networks (DNNs), called embeddings, as an automated form of traditional feature engineering. For trained DNNs, we show that these embeddings can reveal interpretable, high-level concepts in unstructured sample data. We use these embeddings in natural language and computer vision tasks to uncover both inherent heterogeneity in the underlying data and human-understandable explanations for it. In particular, we find empirical evidence that there is inherent separability between real data and that generated from AI models.

Central Venous Lines (C-Lines) and Arterial Lines (A-Lines) are routinely used in the Critical Care Unit (CCU) for blood sampling, medication administration, and high-frequency blood pressure measurement. Judiciously accessing these lines is important, as over-utilization is associated with significant in-hospital morbidity and mortality. Documenting the frequency of line-access is an important step in reducing these adverse outcomes. Unfortunately, the current gold-standard for documentation is manual and subject to error, omission, and bias. The high-frequency blood pressure waveform data from sensors in these lines are often noisy and full of artifacts. Standard approaches in signal processing remove noise artifacts before meaningful analysis. However, from bedside observations, we characterized a distinct artifact that occurs during each instance of C-Line or A-Line use. These artifacts are buried amongst physiological waveform and extraneous noise. We focus on Machine Learning (ML) models that can detect these artifacts from waveform data in real-time - finding needles in needle stacks, in order to automate the documentation of line-access. We built and evaluated ML classifiers running in real-time at a major children's hospital to achieve this goal. We demonstrate the utility of these tools for reducing documentation burden, increasing available information for bedside clinicians, and informing unit-level initiatives to improve patient safety., Comment: Machine Learning For Health Care 2024 (MLHC)

Unbreakable decomposition, introduced by Cygan et al. (SICOMP'19) and Cygan et al. (TALG'20), has proven to be one of the most powerful tools for parameterized graph cut problems in recent years. Unfortunately, all known constructions require at least $\Omega_k\left(mn^2\right)$ time, given an undirected graph with $n$ vertices, $m$ edges, and cut-size parameter $k$. In this work, we show the first close-to-linear time parameterized algorithm that computes an unbreakable decomposition. More precisely, for any $0<\epsilon\leq 1$, our algorithm runs in time $2^{O(\frac{k}{\epsilon} \log \frac{k}{\epsilon})}m^{1 + \epsilon}$ and computes a $(O(k/\epsilon), k)$ unbreakable tree decomposition of $G$, where each bag has adhesion at most $O(k/\epsilon)$. This immediately opens up possibilities for obtaining close-to-linear time algorithms for numerous problems whose only known solution is based on unbreakable decomposition., Comment: 37 pages

With the second quantum revolution underway, quantum-enhanced sensors are moving from laboratory demonstrations to field deployments, providing enhanced and even new capabilities. Signal processing and operational software is becoming integral parts of these emerging sensing systems to reap the benefits of this progress. This paper looks into widefield Nitrogen Vacancy Center-based magnetometry and focuses on estimating the magnetic field from the Optically Detected Magnetic Resonances (ODMR) signal, a crucial output for various applications. Mapping the shifts of ODMR signals to phase estimation, a computationally efficient approaches are proposed. Involving Fourier Transform and Filtering as pre-processing steps, the suggested approaches involve linear curve fit or complex frequency estimation based on well-known super-resolution technique Estimation of Signal Parameters via Rotational Invariant Techniques (ESPRIT). The existing methods in the quantum sensing literature take different routes based on Lorentzian fitting for determining magnetic field maps. To showcase the functionality and effectiveness of the suggested techniques, relevant results, based on experimental data are provided, which shows a significant reduction in computational time with the proposed method over existing methods, Comment: 4 pages, 3 figures, typos corrected

We study a robust online convex optimization framework, where an adversary can introduce outliers by corrupting loss functions in an arbitrary number of rounds k, unknown to the learner. Our focus is on a novel setting allowing unbounded domains and large gradients for the losses without relying on a Lipschitz assumption. We introduce the Log Exponential Adjusted Robust and iNvex (LEARN) loss, a non-convex (invex) robust loss function to mitigate the effects of outliers and develop a robust variant of the online gradient descent algorithm by leveraging the LEARN loss. We establish tight regret guarantees (up to constants), in a dynamic setting, with respect to the uncorrupted rounds and conduct experiments to validate our theory. Furthermore, we present a unified analysis framework for developing online optimization algorithms for non-convex (invex) losses, utilizing it to provide regret bounds with respect to the LEARN loss, which may be of independent interest.

Classical chaos arises from the inherent non-linearity of dynamical systems. However, quantum maps are linear; therefore, the definition of chaos is not straightforward. To address this, we study a quantum system that exhibits chaotic behavior in its classical limit: the kicked top model, whose classical dynamics are governed by Hamilton's equations on phase space, whereas its quantum dynamics are described by the Schr\"odinger equation in Hilbert space. We explore the critical degree of non-linearity signifying the onset of chaos in the kicked top by modifying the original Hamiltonian so that the non-linearity is parametrized by a quantity $p$. We find two distinct behaviors of the modified kicked top depending on the value of $p$. Chaos intensifies as $p$ varies within the range of $1\leq p \leq 2$, whereas it diminishes for $p > 2$, eventually transitioning to a purely regular oscillating system as $p$ tends to infinity. We also comment on the complicated phase space structure for non-chaotic dynamics. Our investigation sheds light on the relationship between non-linearity and chaos in classical systems, offering insights into their dynamic behavior.

Fully understanding performance is a growing challenge when building next-generation cloud systems. Often these systems build on next-generation hardware, and evaluation in realistic physical testbeds is out of reach. Even when physical testbeds are available, visibility into essential system aspects is a challenge in modern systems where system performance depends on often sub-$\mu s$ interactions between HW and SW components. Existing tools such as performance counters, logging, and distributed tracing provide aggregate or sampled information, but remain insufficient for understanding individual requests in-depth. In this paper, we explore a fundamentally different approach to enable in-depth understanding of cloud system behavior at the software and hardware level, with (almost) arbitrarily fine-grained visibility. Our proposal is to run cloud systems in detailed full-system simulations, configure the simulators to collect detailed events without affecting the system, and finally assemble these events into end-to-end system traces that can be analyzed by existing distributed tracing tools.

We propose using natural language outlines as a novel modality and interaction surface for providing AI assistance to developers throughout the software development process. An NL outline for a code function comprises multiple statements written in concise prose, which partition the code and summarize its main ideas in the style of literate programming. Crucially, we find that modern LLMs can generate accurate and high-quality NL outlines in practice. Moreover, NL outlines enable a bidirectional sync between code and NL, allowing changes in one to be automatically reflected in the other. We discuss many use cases for NL outlines: they can accelerate understanding and navigation of code and diffs, simplify code maintenance, augment code search, steer code generation, and more. We then propose and compare multiple LLM prompting techniques for generating outlines and ask professional developers to judge outline quality. Finally, we present two case studies applying NL outlines toward code review and the difficult task of malware detection.

Transformers have made significant strides across various artificial intelligence domains, including natural language processing, computer vision, and audio processing. This success has naturally garnered considerable interest from both academic and industry researchers. Consequently, numerous Transformer variants (often referred to as X-formers) have been developed for these fields. However, a thorough and systematic review of these modality-specific conversions remains lacking. Modality Conversion involves the transformation of data from one form of representation to another, mimicking the way humans integrate and interpret sensory information. This paper provides a comprehensive review of transformer-based models applied to the primary modalities of text, vision, and speech, discussing their architectures, conversion methodologies, and applications. By synthesizing the literature on modality conversion, this survey aims to underline the versatility and scalability of transformers in advancing AI-driven content generation and understanding., Comment: Submitted to ACM Computing Surveys (CSUR)

Since the recent discovery of polar topologies, a recurrent question has been in the way to remotely tune them. Many efforts have focused on the pumping of polar optical phonons from optical methods but with limited success, as only switching between specific phases has been achieved so far. Additionally, the correlation between optical pulse characteristics and the resulting phase remains poorly understood. Here, we propose an alternative approach and demonstrate the deterministic and dynamical tailoring of polar topologies using instead acoustic phonon pumping. Our second-principles simulations reveal that by pumping specific longitudinal and transverse acoustic phonons, various topological textures can be induced in materials like BaTiO$_\mathrm{3}$ or PbTiO$_\mathrm{3}$. This method leverages the strong coupling between polarization and strain in these materials, enabling predictable and dynamical control of polar patterns. Our findings open up an alternative possibility for the manipulation of polar textures, inaugurating a promising research direction.

Galaxy scaling relations provide insights into the processes that drive galaxy evolution. The extension of these scaling relations into the dwarf galaxy regime is of particular interest. This is because dwarf galaxies represent a crucial stage in galaxy evolution, and understanding them could also shed light on their role in reionising the early Universe. There is currently no consensus on the processes that dominate the evolution of dwarfs. In this work we constrain the atomic gas sequence (stellar mass vs. atomic gas fraction) and mass-metallicity relation (stellar mass vs. gas phase metallicity) from dwarf ($10^{6.5}$ $\textrm{M}_{\odot}$) to massive ($10^{11.5}$ $\textrm{M}_{\odot}$) galaxies in the local Universe. The combined optical and 21-cm spectroscopic observations of the DESI and ALFALFA surveys allow us to simultaneously constrain both scaling relations. We find a slope change of the atomic gas sequence at a stellar mass of $\sim 10^{9} ~\textrm{M}_{\odot}$. We also find that the shape and scatter of the atomic gas sequence and mass-metallicity relation are strongly linked for both dwarfs and more massive galaxies. Consequently, the low mass slope change of the atomic gas sequence is imprinted onto the mass-metallicity relation of dwarf galaxies. The mass scale of the measured slope change is consistent with a predicted escape velocity threshold below which low mass galaxies experience significant supernova-driven gas loss, as well as with a reduction in cold gas accretion onto more massive galaxies., Comment: 16 pages, 10 figures, submitted to MNRAS

We demonstrate a micropatterned directional emitter ({\mu}DE) with an ultrabroadband, azimuthally selective and tailorable emittance across the thermal wavelengths and over wide angles. The {\mu}DE can enable a novel and passive seasonal thermoregulation of buildings by reducing summertime terrestrial radiative heat gain, and wintertime loss. We show several types of {\mu}DE, such as metallic and white variants, made using low-cost materials and scalable manufacturing techniques that are already in large-scale use. Furthermore, we show that its directional emittance can be geometrically tailored to sky-view factors in different urban scenarios. Outdoor experiments show that {\mu}DEs stay up to 1.53{\deg}C cooler than traditional building envelopes when exposed to direct sunlight on summer days and up to 0.46{\deg}C warmer during winter nights. Additionally, {\mu}DEs demonstrate significant cooling powers of up to 40 Wm-2 in warm conditions and heating powers of up to 30 Wm-2 in cool conditions, relative to typical building envelopes. Building energy models show that {\mu}DEs can achieve all-season energy savings similar to or higher than those of cool roofs. Collectively, our findings show {\mu}DEs as highly promising for thermoregulating buildings.

Large angular scale surveys in the absence of atmosphere are essential for measuring the primordial $B$-mode power spectrum of the Cosmic Microwave Background (CMB). Since this proposed measurement is about three to four orders of magnitude fainter than the temperature anisotropies of the CMB, in-flight calibration of the instruments and active suppression of systematic effects are crucial. We investigate the effect of changing the parameters of the scanning strategy on the in-flight calibration effectiveness, the suppression of the systematic effects themselves, and the ability to distinguish systematic effects by null-tests. Next-generation missions such as LiteBIRD, modulated by a Half-Wave Plate (HWP), will be able to observe polarisation using a single detector, eliminating the need to combine several detectors to measure polarisation, as done in many previous experiments and hence avoiding the consequent systematic effects. While the HWP is expected to suppress many systematic effects, some of them will remain. We use an analytical approach to comprehensively address the mitigation of these systematic effects and identify the characteristics of scanning strategies that are the most effective for implementing a variety of calibration strategies in the multi-dimensional space of common spacecraft scan parameters. We also present Falcons, a fast spacecraft scanning simulator that we developed to investigate this scanning parameter space.

The metadata involved in integrating code, data, configuration, and feedback into predictive models is varied and complex. This complexity is further compounded by the agile development practices favored by data scientists and machine learning engineers. These practices emphasize high experimentation velocity and frequent deployments, which can make it challenging to keep track of all the relevant metadata. The iterative nature of agile methods means that models, datasets, and configurations are constantly evolving. Each experiment might involve tweaks to the data preprocessing steps, changes in model hyperparameters, or updates to the deployment environment. The need for rapid iteration can lead to shortcuts or oversights in documentation and metadata management. Effective metadata management requires robust yet flexible tools and practices that can integrate and organize this information without slowing down the development process. Traditional context management often emphasizes a ``metadata first'' approach, which can introduce significant friction for developers. FlorDB reduces this friction through multiversion hindsight logging and incremental context maintenance, allowing developers to add and refine metadata after the fact. This ``metadata later'' approach enables a more flexible and incremental development process, allowing data scientists to focus on model creation and refinement without the burden of documentation upfront. As shown in a demo, FlorDB can be used to build AI/ML applications with integrated train-infer pipelines and managed feedback loops. Ultimately, the goal of FlorDB is to ensure that critical metadata is maintained accurately and efficiently, even in fast-paced agile workflows.

This paper utilizes video analytics to study pedestrian and vehicle traffic behavior, focusing on analyzing traffic patterns during football gamedays. The University of Florida (UF) hosts six to seven home football games on Saturdays during the college football season, attracting significant pedestrian activity. Through video analytics, this study provides valuable insights into the impact of these events on traffic volumes and safety at intersections. Comparing pedestrian and vehicle activities on gamedays versus non-gamedays reveals differing patterns. For example, pedestrian volume substantially increases during gamedays, which is positively correlated with the probability of the away team winning. This correlation is likely because fans of the home team enjoy watching difficult games. Win probabilities as an early predictor of pedestrian volumes at intersections can be a tool to help traffic professionals anticipate traffic management needs. Pedestrian-to-vehicle (P2V) conflicts notably increase on gamedays, particularly a few hours before games start. Addressing this, a "Barnes Dance" movement phase within the intersection is recommended. Law enforcement presence during high-activity gamedays can help ensure pedestrian compliance and enhance safety. In contrast, we identified that vehicle-to-vehicle (V2V) conflicts generally do not increase on gamedays and may even decrease due to heightened driver caution.

TeNPy (short for 'Tensor Network Python') is a python library for the simulation of strongly correlated quantum systems with tensor networks. The philosophy of this library is to achieve a balance of readability and usability for new-comers, while at the same time providing powerful algorithms for experts. The focus is on MPS algorithms for 1D and 2D lattices, such as DMRG ground state search, as well as dynamics using TEBD, TDVP, or MPO evolution. This article is a companion to the recent version 1.0 release of TeNPy and gives a brief overview of the package., Comment: v2: updated funding acknowledgement

This study aims to learn a translation from visible to infrared imagery, bridging the domain gap between the two modalities so as to improve accuracy on downstream tasks including object detection. Previous approaches attempt to perform bi-domain feature fusion through iterative optimization or end-to-end deep convolutional networks. However, we pose the problem as similar to that of image translation, adopting a two-stage training strategy with a Generative Adversarial Network and an object detection model. The translation model learns a conversion that preserves the structural detail of visible images while preserving the texture and other characteristics of infrared images. Images so generated are used to train standard object detection frameworks including Yolov5, Mask and Faster RCNN. We also investigate the usefulness of integrating a super-resolution step into our pipeline to further improve model accuracy, and achieve an improvement of as high as 5.3% mAP.

A plasma scenario with negative triangularity (NT) shaping is achieved on MAST-U for the first time. While edge localized modes (ELMs) are eventually suppressed as the triangularity is decreased below $\delta$ < -0.06, an extended period of H-mode operation with Type-III ELMs is sustained at less negative $\delta$ even through access to the second stability region for ideal ballooning modes is closed. This documents a qualitative difference from the ELM-free access conditions documented in NT scenarios on conventional aspect ratio machines. The electron temperature at the pedestal top drops across the transition to ELM-free operation, but a steady rise in core temperature as $\delta$ is decreased allows for similar normalized beta in the ELM-free NT and H-mode positive triangularity shapes.

In this work, we introduce Gemma 2, a new addition to the Gemma family of lightweight, state-of-the-art open models, ranging in scale from 2 billion to 27 billion parameters. In this new version, we apply several known technical modifications to the Transformer architecture, such as interleaving local-global attentions (Beltagy et al., 2020a) and group-query attention (Ainslie et al., 2023). We also train the 2B and 9B models with knowledge distillation (Hinton et al., 2015) instead of next token prediction. The resulting models deliver the best performance for their size, and even offer competitive alternatives to models that are 2-3 times bigger. We release all our models to the community.

Cataclysmic variables (CVs) are compact binary systems in which a white dwarf accretes matter from a Roche-lobe-filling companion star. In this study, we searched for new CVs in the Milky Way in the Chandra Source Catalog v2.0, cross-matched with Gaia Data Release 3 (DR3). We identified new CV candidates by combining X-ray and optical data in a color-color diagram called the ``X-ray Main Sequence". We used two different cuts in this diagram to compile pure and optically variable samples of CV candidates. We undertook optical spectroscopic follow-up observations with the Keck and Palomar Observatories to confirm the nature of these sources. We assembled a sample of 25,887 Galactic X-ray sources and found 14 new CV candidates. Seven objects show X-ray and/or optical variability. All sources show X-ray luminosity in the $\rm 10^{29}-10^{32}$ $\rm erg\ s^{-1}$ range, and their X-ray spectra can be approximated by a power-law model with photon indices in the $\rm \Gamma \sim 1-3$ range or an optically thin thermal emission model in the $\rm kT \sim 1-70$ keV range. We spectroscopically confirmed four CVs, discovering two new polars, one low accretion rate polar and a WZ~Sge-like low accretion rate CV. X-ray and optical properties of the other 9 objects suggest that they are also CVs (likely magnetic or dwarf novae), and one other object could be an eclipsing binary, but revealing their true nature requires further observations. These results show that a joint X-ray and optical analysis can be a powerful tool for finding new CVs in large X-ray and optical catalogs. X-ray observations such as those by Chandra are particularly efficient at discovering magnetic and low accretion rate CVs, which could be missed by purely optical surveys., Comment: 20 pages, 15 figures and 8 tables. Accepted for publication in Astronomy & Astrophysics

The Hubble Tension, a >5 sigma discrepancy between direct and indirect measurements of the Hubble constant (H0), has persisted for a decade and motivated intense scrutiny of the paths used to infer H0. Comparing independently-derived distances for a set of galaxies with different standard candles, such as the tip of the red giant branch (TRGB) and Cepheid variables, can test for systematics in the middle rung of the distance ladder. The I band is the preferred filter for measuring the TRGB due to constancy with color, a result of low sensitivity to population differences in age and metallicity supported by stellar models. We use James Webb Space Telescope (JWST) observations with the maser host NGC 4258 as our geometric anchor to measure I-band (F090W vs F090W-F150W) TRGB distances to 8 hosts of 10 Type Ia supernovae (SNe Ia) within 28 Mpc: NGC 1448, NGC 1559, NGC 2525, NGC 3370, NGC 3447, NGC 5584, NGC 5643, and NGC 5861. We compare these with Hubble Space Telescope (HST) Cepheid-based relative distance moduli for the same galaxies and anchor. We find no evidence of a difference between their weighted means, 0.01 +/- 0.04 (stat) +/- 0.04 (sys) mag. We produce fourteen variants of the TRGB analysis, altering the smoothing level and color range used to measure the tips to explore their impact. For some hosts, this changes the identification of the strongest peak, but this causes little change to the sample mean difference producing a full range of 0.01 to 0.03 mag, all consistent at 1 sigma with no difference. The result matches past comparisons of I-band TRGB and Cepheids when both use HST. SNe and anchor samples observed with JWST are too small to yield a measure of H0 that is competitive with the HST sample of 42 SNe Ia and 4 anchors; however, they already provide a vital systematic crosscheck to HST measurements of the distance ladder., Comment: 15 pages, 5 figures, 4 tables, submitted to ApJ, comments welcome

The SSPACE Astrobiology Payload (SAP) series, starting with the SAP-1 project is designed to conduct in-situ microbiology experiments in low earth orbit. This payload series aims to understand the behaviour of microbial organisms in space, particularly those critical for human health, and the corresponding effects due to microgravity and solar/galactic radiation. SAP-1 focuses on studying Bacillus clausii and Bacillus coagulans, bacteria beneficial to humans. It aims to provide a space laboratory for astrobiology experiments under microgravity conditions. The hardware developed for these experiments is indigenous and tailored to meet the unique requirements of autonomous microbiology experiments by controlling pressure, temperature, and nutrition flow to bacteria. A rotating platform, which forms the core design, is innovatively utilised to regulate the flow and mixing of nutrients with dormant bacteria. The technology demonstration models developed at SSPACE have yielded promising results, with ongoing efforts to refine, adapt for space conditions, and prepare for integration with nanosatellites or space modules. The anticipated payload will be compact, approximately 1U in size (10cm x 10cm x 10cm), consume less than 5W power, and offer flexibility for various microbiological studies., Comment: 20 Pages, Submitted to Advances in Space Research

The rapid evolution of large language models (LLMs) has opened up new possibilities for applications such as context-driven product recommendations. However, the effectiveness of these models in this context is heavily reliant on their comprehensive understanding of the product inventory. This paper presents a novel approach to equipping LLMs with product knowledge by training them to respond contextually to synthetic search queries that include product IDs. We delve into an extensive analysis of this method, evaluating its effectiveness, outlining its benefits, and highlighting its constraints. The paper also discusses the potential improvements and future directions for this approach, providing a comprehensive understanding of the role of LLMs in product recommendations.

Training with larger mini-batches improves the performance and convergence rate of training machine learning models. However, training with large mini-batches becomes prohibitive for Large Language Models (LLMs) with billions of parameters, due to the large GPU memory requirement. To address this problem, we propose finding small mini-batches that simulate the dynamics of training with larger mini-batches. Specifically, we formulate selecting smaller mini-batches of examples that closely capture gradients of large mini-batches as a submodular maximization problem. Nevertheless, the very large dimensionality of the gradients makes the problem very challenging to solve. To address this, we leverage ideas from zeroth-order optimization and neural network pruning to find lower-dimensional gradient estimates that allow finding high-quality subsets effectively with a limited amount of memory. We prove the superior convergence rate of training on the small mini-batches found by our method and empirically show its effectiveness. Our method can effectively reduce the memory requirement by 2x and speed up training by 1.3x, as we confirm for fine-tuning Phi-2 on MathInstruct. Our method can be easily stacked with LoRA and other memory-efficient methods to further reduce the memory requirements of training LLMs., Comment: 15 pages, 2 figures, 4 tables

We present a measurement of the mean absorption of cool gas traced by Mg II (${\lambda\lambda 2796, 2803}$) around emission line galaxies (ELGs), spanning spatial scales from 20 kpc to 10 Mpc. The measurement is based on cross-matching the positions of about 2.5 million ELGs at $z = 0.75-1.65$ and the metal absorption in the spectra of 1.4 million background quasars with data provided by the Year 1 sample of the Dark Energy Spectroscopic Instrument (DESI). The ELGs are divided into two redshift intervals: $0.75 < z < 1.0$ and $1.0 < z < 1.65$. We find that the composite spectra constructed by stacking the ELG-QSO pairs show evolution with redshift, with $z>1$ having a systematically higher signal of Mg II absorption. Within 1 Mpc, the covering fraction of the cool gas at $z > 1$ is higher than that of $z < 1$. The enhancement becomes less apparent especially if the projected distance $r_{p}>$1 Mpc. Also, ELGs with higher stellar mass and star formation rate (SFR) yield higher clustering of Mg II absorbers at $z<1$. For $z>1$, the covering fractions with different SFRs show little difference. The higher Mg II absorption at higher redshift also supports the observations of higher star formation at cosmic noon. Besides, the profile of Mg II absorption reveals a change of slope on scales of about 1 Mpc, consistent with the expected transition from a dark matter halo-dominated environment to a regime where clustering is dominated by halo-halo correlations. We estimate the cool gas density profile and derive the metal abundance at different redshifts. The growth of metal abundance suggests an increased presence of cool gas in the intergalactic medium (IGM) towards higher redshifts.

We assess the capabilities of the LiteBIRD mission to map the hot gas distribution in the Universe through the thermal Sunyaev-Zeldovich (SZ) effect. Our analysis relies on comprehensive simulations incorporating various sources of Galactic and extragalactic foreground emission, while accounting for specific instrumental characteristics of LiteBIRD, such as detector sensitivities, frequency-dependent beam convolution, inhomogeneous sky scanning, and $1/f$ noise. We implement a tailored component-separation pipeline to map the thermal SZ Compton $y$-parameter over 98% of the sky. Despite lower angular resolution for galaxy cluster science, LiteBIRD provides full-sky coverage and, compared to the Planck satellite, enhanced sensitivity, as well as more frequency bands to enable the construction of an all-sky $y$-map, with reduced foreground contamination at large and intermediate angular scales. By combining LiteBIRD and Planck channels in the component-separation pipeline, we obtain an optimal $y$-map that leverages the advantages of both experiments, with the higher angular resolution of the Planck channels enabling the recovery of compact clusters beyond the LiteBIRD beam limitations, and the numerous sensitive LiteBIRD channels further mitigating foregrounds. The added value of LiteBIRD is highlighted through the examination of maps, power spectra, and one-point statistics of the various sky components. After component separation, the $1/f$ noise from LiteBIRD is effectively mitigated below the thermal SZ signal at all multipoles. Cosmological constraints on $S_8=\sigma_8\left(\Omega_{\rm m}/0.3\right)^{0.5}$ obtained from the LiteBIRD-Planck combined $y$-map power spectrum exhibits a 15% reduction in uncertainty compared to constraints from Planck alone. This improvement can be attributed to the increased portion of uncontaminated sky available in the LiteBIRD-Planck combined $y$-map., Comment: 38 pages, 13 figures, abstract shortened, submitted to JCAP

Markov Decision Processes (MDPs) offer a fairly generic and powerful framework to discuss the notion of optimal policies for dynamic systems, in particular when the dynamics are stochastic. However, computing the optimal policy of an MDP can be very difficult due to the curse of dimensionality present in solving the underlying Bellman equations. Model Predictive Control (MPC) is a very popular technique for building control policies for complex dynamic systems. Historically, MPC has focused on constraint satisfaction and steering dynamic systems towards a user-defined reference. More recently, Economic MPC was proposed as a computationally tractable way of building optimal policies for dynamic systems. When stochsaticity is present, economic MPC is close to the MDP framework. In that context, Economic MPC can be construed as attractable heuristic to provide approximate solutions to MDPs. However, there is arguably a knowledge gap in the literature regarding these approximate solutions and the conditions for an MPC scheme to achieve closed-loop optimality. This chapter aims to clarify this approximation pedagogically, to provide the conditions for MPC to deliver optimal policies, and to explore some of their consequences.

Wi-Fi-based indoor localization has been extensively studied for context-aware services. As a result, the accurate Wi-Fi-based indoor localization introduces a great location privacy threat. However, the existing solutions for location privacy protection are hard to implement on current devices. They require extra hardware deployment in the environment or hardware modifications at the transmitter or receiver side. To this end, we propose DOLOS, a system that can protect the location privacy of the Wi-Fi user with a novel signal obfuscation approach. DOLOSis a software-only solution that can be deployed on existing protocol-compliant Wi-Fi user devices. We provide this obfuscation by invalidating a simple assumption made by most localization systems -- "direct path signal arrives earlier than all the reflections to distinguish this direct path prior to estimating the location". However, DOLOS creates a novel software fix that allows the user to transmit the signal wherein this direct path arrives later, creating ambiguity in the location estimates. Our experimental results demonstrate DOLOS can degrade the localization accuracy of state-of-art systems by 6x for a single AP and 2.5x for multiple AP scenarios, thereby protecting the Wi-Fi user's location privacy without compromising the Wi-Fi communication performance.

A macroscopic hydrodynamic system that couples a particle and a wave has recently renewed interest in the question as to what extent a classical system may reproduce quantum phenomena. Here we investigate single-particle diffraction with a pilot-wave model originally developed to describe the hydrodynamic system. We study single-particle interactions with a barrier and slits of increasing width by focusing on the near field. We find single-particle diffraction arising as wavelike patterns in the particles' position statistics, which we compare to the predictions of quantum mechanics. We provide a mechanism that rationalizes the diffractive behavior in our system.

Publicly available TTS datasets for low-resource languages like Hindi and Tamil typically contain 10-20 hours of data, leading to poor vocabulary coverage. This limitation becomes evident in downstream applications where domain-specific vocabulary coupled with frequent code-mixing with English, results in many OOV words. To highlight this problem, we create a benchmark containing OOV words from several real-world applications. Indeed, state-of-the-art Hindi and Tamil TTS systems perform poorly on this OOV benchmark, as indicated by intelligibility tests. To improve the model's OOV performance, we propose a low-effort and economically viable strategy to obtain more training data. Specifically, we propose using volunteers as opposed to high quality voice artists to record words containing character bigrams unseen in the training data. We show that using such inexpensive data, the model's performance improves on OOV words, while not affecting voice quality and in-domain performance., Comment: Accepted at INTERSPEECH 2024

We investigate the question of when free structures of infinite rank (in a variety) possess model-theoretic properties like categoricity in higher power, saturation, or universality. Concentrating on left $R$-modules we show, among other things, that the free module of infinite rank $R^{(\kappa)}$ embeds every $\kappa$-generated flat left $R$-module iff $R$ is left perfect. Using a Bass module corresponding to a descending chain of principal right ideals, we construct a model of the theory $T$ of $R^{(\kappa)}$ whose projectivity is equivalent to left perfectness, which allows to add a "stronger" equivalent condition: $R^{(\kappa)}$ embeds every $\kappa$-generated flat left $R$-module which is a model of $T$. In addition, we extend the model-theoretic construction of this Bass module to arbitrary descending chains of pp formulas, resulting in a `Bass theory' of pure-projective modules. We put this new theory to use by reproving an old result of Daniel Simson about pure-semisimple rings and Mittag-Leffler modules., Comment: 19 pages

Local feature selection in machine learning provides instance-specific explanations by focusing on the most relevant features for each prediction, enhancing the interpretability of complex models. However, such methods tend to produce misleading explanations by encoding additional information in their selections. In this work, we attribute the problem of misleading selections by formalizing the concepts of label and feature leakage. We rigorously derive the necessary and sufficient conditions under which we can guarantee no leakage, and show existing methods do not meet these conditions. Furthermore, we propose the first local feature selection method that is proven to have no leakage called SUWR. Our experimental results indicate that SUWR is less prone to overfitting and combines state-of-the-art predictive performance with high feature-selection sparsity. Our generic and easily extendable formal approach provides a strong theoretical basis for future work on interpretability with reliable explanations., Comment: Published at ICML 2024

We present results from a search for X-ray/gamma-ray counterparts of gravitational-wave (GW) candidates from the third observing run (O3) of the LIGO-Virgo-KAGRA (LVK) network using the Swift Burst Alert Telescope (Swift-BAT). The search includes 636 GW candidates received in low latency, 86 of which have been confirmed by the offline analysis and included in the third cumulative Gravitational-Wave Transient Catalogs (GWTC-3). Targeted searches were carried out on the entire GW sample using the maximum--likelihood NITRATES pipeline on the BAT data made available via the GUANO infrastructure. We do not detect any significant electromagnetic emission that is temporally and spatially coincident with any of the GW candidates. We report flux upper limits in the 15-350 keV band as a function of sky position for all the catalog candidates. For GW candidates where the Swift-BAT false alarm rate is less than 10$^{-3}$ Hz, we compute the GW--BAT joint false alarm rate. Finally, the derived Swift-BAT upper limits are used to infer constraints on the putative electromagnetic emission associated with binary black hole mergers., Comment: 50 pages, 10 figures, 4 tables

We study new identities related to the sums of adjacent terms in the Pell sequence, defined by $P_{n} := 2P_{n-1}+P_{n-2}$ for $ n\geq 2$ and $P_{0}=0, P_{1}=1$, and generalize these identities for many similar sequences. We prove that the sum of $N>1$ consecutive Pell numbers is a fixed integer multiple of another Pell number if and only if $4\mid N$. We consider the generalized Pell $(k,i)$-numbers defined by $p(n) :=\ 2p(n-1)+p(n-k-1) $ for $n\geq k+1$, with $p(0)=p(1)=\cdots =p(i)=0$ and $p(i+1)=\cdots = p(k)=1$ for $0\leq i\leq k-1$, and prove that the sum of $N=2k+2$ consecutive terms is a fixed integer multiple of another term in the sequence. We also prove that for the generalized Pell $(k,k-1)$-numbers such a relation does not exist when $N$ and $k$ are odd. We give analogous results for the Fibonacci and other related second-order recursive sequences., Comment: 33 Pages. Comments welcome!

We present results from a systematic infrared (IR) census of R Coronae Borealis (RCB) stars in the Milky Way, using data from the Palomar Gattini IR (PGIR) survey. R Coronae Borealis stars are dusty, erratic variable stars presumably formed from the merger of a He-core and a CO-core white dwarf (WD). PGIR is a 30 cm $J$-band telescope with a 25 deg$^{2}$ camera that surveys 18000 deg$^{2}$ of the northern sky ($\delta>-28^{o}$) at a cadence of 2 days. Using PGIR J-band lightcurves for $\sim$60 million stars together with mid-IR colors from WISE, we selected a sample of 530 candidate RCB stars. We obtained near-IR spectra for these candidates and identified 53 RCB stars in our sample. Accounting for our selection criteria, we find that there are a total of $\approx350^{+150}_{-100}$ RCB stars in the Milky Way. Assuming typical RCB lifetimes, this corresponds to an RCB formation rate of 0.8 - 5 $\times$ 10$^{-3}$ yr$^{-1}$, consistent with observational and theoretical estimates of the He-CO WD merger rate. We searched for quasi-periodic pulsations in the PGIR lightcurves of RCB stars and present pulsation periods for 16 RCB stars. We also examined high-cadenced TESS lightcurves for RCB and the chemically similar, but dustless hydrogen-deficient carbon (dLHdC) stars. We find that dLHdC stars show variations on timescales shorter than RCB stars, suggesting that they may have lower masses than RCB stars. Finally, we identified 3 new spectroscopically confirmed and 12 candidate Galactic DY Per type stars - believed to be colder cousins of RCB stars - doubling the sample of Galactic DY Per type stars., Comment: accepted for publication in PASP

Retrieval Augmented Generation (RAG) techniques aim to mitigate hallucinations in Large Language Models (LLMs). However, LLMs can still produce information that is unsupported or contradictory to the retrieved contexts. We introduce LYNX, a SOTA hallucination detection LLM that is capable of advanced reasoning on challenging real-world hallucination scenarios. To evaluate LYNX, we present HaluBench, a comprehensive hallucination evaluation benchmark, consisting of 15k samples sourced from various real-world domains. Our experiment results show that LYNX outperforms GPT-4o, Claude-3-Sonnet, and closed and open-source LLM-as-a-judge models on HaluBench. We release LYNX, HaluBench and our evaluation code for public access.

Assessing different material properties to predict specific attributes, such as band gap, resistivity, young modulus, work function, and refractive index, is a fundamental requirement for materials science-based applications. However, the process is time-consuming and often requires extensive literature reviews and numerous experiments. Our study addresses these challenges by leveraging machine learning to analyze material properties with greater precision and efficiency. By automating the data extraction process and using the extracted information to train machine learning models, our developed model, SciQu, optimizes material properties. As a proof of concept, we predicted the refractive index of materials using data extracted from numerous research articles with SciQu, considering input descriptors such as space group, volume, and bandgap with Root Mean Square Error (RMSE) 0.068 and R2 0.94. Thus, SciQu not only predicts the properties of materials but also plays a key role in self-driving laboratories by optimizing the synthesis parameters to achieve precise shape, size, and phase of the materials subjected to the input parameters.

Depression has proven to be a significant public health issue, profoundly affecting the psychological well-being of individuals. If it remains undiagnosed, depression can lead to severe health issues, which can manifest physically and even lead to suicide. Generally, Diagnosing depression or any other mental disorder involves conducting semi-structured interviews alongside supplementary questionnaires, including variants of the Patient Health Questionnaire (PHQ) by Clinicians and mental health professionals. This approach places significant reliance on the experience and judgment of trained physicians, making the diagnosis susceptible to personal biases. Given that the underlying mechanisms causing depression are still being actively researched, physicians often face challenges in diagnosing and treating the condition, particularly in its early stages of clinical presentation. Recently, significant strides have been made in Artificial neural computing to solve problems involving text, image, and speech in various domains. Our analysis has aimed to leverage these state-of-the-art (SOTA) models in our experiments to achieve optimal outcomes leveraging multiple modalities. The experiments were performed on the Extended Distress Analysis Interview Corpus Wizard of Oz dataset (E-DAIC) corpus presented in the Audio/Visual Emotion Challenge (AVEC) 2019 Challenge. The proposed solutions demonstrate better results achieved by Proprietary and Open-source Large Language Models (LLMs), which achieved a Root Mean Square Error (RMSE) score of 3.98 on Textual Modality, beating the AVEC 2019 challenge baseline results and current SOTA regression analysis architectures. Additionally, the proposed solution achieved an accuracy of 71.43% in the classification task. The paper also includes a novel audio-visual multi-modal network that predicts PHQ-8 scores with an RMSE of 6.51., Comment: 12 pages, 9 figures, 9 tables

Co-optimizing placement with congestion is integral to achieving high-quality designs. This paper presents GOALPlace, a new learning-based general approach to improving placement congestion by controlling cell density. Our method efficiently learns from an EDA tool's post-route optimized results and uses an empirical Bayes technique to adapt this goal/target to a specific placer's solutions, effectively beginning with the end in mind. It enhances correlation with the long-running heuristics of the tool's router and timing-opt engine -- while solving placement globally without expensive incremental congestion estimation and mitigation methods. A statistical analysis with a new hierarchical netlist clustering establishes the importance of density and the potential for an adequate cell density target across placements. Our experiments show that our method, integrated as a demonstration inside an academic GPU-accelerated global placer, consistently produces macro and standard cell placements of superior or comparable quality to commercial tools. Our empirical Bayes methodology also allows a substantial quality improvement over state-of-the-art academic mixed-size placers, achieving up to 10x fewer design rule check (DRC) violations, a 5% decrease in wirelength, and a 30% and 60% reduction in worst and total negative slack (WNS/TNS)., Comment: 10 pages, 7 figures, preprint

Purpose: We aimed to develop a data-driven multiomics approach integrating radiomics, dosiomics, and delta features to predict treatment response at an earlier stage (intra-treatment) for brain metastases (BMs) patients treated with PULSAR. Methods: We conducted a retrospective study of 39 patients with 69 BMs treated with PULSAR. Radiomics, dosiomics, and delta features were extracted from pretreatment and intra-treatment MRI scans and dose distributions. Six individual models and an ensemble feature selection (EFS) model were constructed using SVM and evaluated via stratified 5-fold cross-validation. The classification task distinguished lesions with >20% volume reduction at follow-up. We assessed performance metrics including sensitivity, specificity, accuracy, precision, F1 score, and AUC. Various feature extraction and ensemble selection scenarios were explored to enhance model robustness and reduce overfitting. Results: The EFS model, integrating features from pre-treatment radiomics and dosiomics, intra-treatment radiomics, and delta-radiomics, outperformed six individual models. It achieved an AUC of 0.979, accuracy of 0.917, and F1 score of 0.821. Among the top 9 features, six were derived from post-wavelet transformation, and three from original images. The discrete wavelet transform decomposes volumetric images into multi-resolution components, offering a more comprehensive characterization of underlying structures. Conclusion: Our study demonstrated the feasibility of employing a data-driven multiomics approach to predict tumor volume changes in BMs patients with PULSAR. The EFS model demonstrates enhanced performance compared with six individual models, emphasizing the importance of integrating both pretreatment and intra-treatment data. This application holds promise for optimizing BMs management, potentially mitigating risks associated with under- or over-treatment.

Quantum imaginary-time evolution (QITE) is a promising tool to prepare thermal or ground states of Hamiltonians, as convergence is guaranteed when the evolved state overlaps with the ground state. However, its implementation using a parameterized quantum circuit is impractical as the number of parameters $m$ increases, since each step in the evolution takes $\Theta(m^2)$ state preparations to calculate the quantum Fisher information matrix (QFIM). In this work, we accelerate QITE by rapid estimation of the QFIM, while conserving the convergence guarantees to the extent possible. To this end, we prove that if a parameterized state is rotated by a 2-design and measured in the computational basis, then the QFIM can be inferred from partial derivative cross correlations of the probability outcomes. One sample estimate costs only $\Theta(m)$ state preparations, leading to rapid QFIM estimation when a few samples suffice. The second family of estimators take greater liberties and replace QFIMs with averaged classical Fisher information matrices (CFIMs). In an extreme special case optimized for rapid (over accurate) descent, just one CFIM sample is drawn. We justify the second estimator family by proving rapid descent. Guided by these results, we propose the random-measurement imaginary-time evolution (RMITE) algorithm, which we showcase and test in several molecular systems, with the goal of preparing ground states., Comment: 18 pages, 7 figures

Rapidly increasing model scales coupled with steering methods such as chain-of-thought prompting have led to drastic improvements in language model reasoning. At the same time, models struggle with compositional generalization and are far from human performance on many reasoning-based benchmarks. Leveraging the success of chain-of-thought prompting, and also taking inspiration from context-aware decoding (CAD), we explore input-based contrasting methods to further encourage the type of reasoning induced by chain-of-thought prompting. While work remains to stabilize these results across datasets and models, the improvements we find warrant further investigation into input-based steering methods for context-aware reasoning.

TRAPPIST-1e is a tidally locked rocky exoplanet orbiting the habitable zone of an M dwarf star. Upcoming observations are expected to reveal new rocky exoplanets and their atmospheres around M dwarf stars. To interpret these future observations we need to model the atmospheres of such exoplanets. We configured CESM2-WACCM6, a chemistry climate model, for the orbit and stellar irradiance of TRAPPIST-1e assuming an initial Earth-like atmospheric composition. Our aim is to characterize the possible ozone (O$_3$) distribution and explore how this is influenced by the atmospheric circulation shaped by orography, using the Helmholtz wind decomposition and meridional mass streamfunction. The model included Earth-like orography and the substellar point was located over the Pacific Ocean. For such a scenario, our analysis reveals a North-South asymmetry in the simulated O$_3$ distribution. The O$_3$ concentration is highest below 10 hPa level (below $\sim$30 km) near the South pole. This asymmetry results from the presence of land masses on the night side that cause drag in near-surface flows and lead to an asymmetric meridional overturning circulation. Catalytic species were roughly symmetrically distributed and were not found to be primary driver for the O$_3$ asymmetry. The total ozone column (TOC) density was higher for TRAPPIST-1e compared to Earth, with 8000 Dobson Units (DU) near the South pole and 2000 DU near the North pole. The results emphasize the sensitivity of O$_3$ to model parameters, illustrating how incorporating Earth-like orography can affect atmospheric dynamics and O$_3$ distribution. This link between surface features and atmospheric dynamics underlines the importance of how changing model parameters used to study exoplanet atmospheres can influence the interpretation of observations., Comment: Submitted to ApJ