Search

Fast Radio Bursts (FRBs) are millisecond-duration events detected from beyond the Milky Way. FRB emission characteristics favor highly magnetized neutron stars, or magnetars, as the sources, as evidenced by FRB-like bursts from a galactic magnetar, and the star-forming nature of FRB host galaxies. However, the processes that produce FRB sources remain unknown. Although galactic magnetars are often linked to core-collapse supernovae (CCSNe), it's uncertain what determines which supernovae result in magnetars. The galactic environments of FRB sources can be harnessed to probe their progenitors. Here, we present the stellar population properties of 30 FRB host galaxies discovered by the Deep Synoptic Array. Our analysis shows a significant deficit of low-mass FRB hosts compared to the occurrence of star-formation in the universe, implying that FRBs are a biased tracer of star-formation, preferentially selecting massive star-forming galaxies. This bias may be driven by galaxy metallicity, which is positively correlated with stellar mass. Metal-rich environments may favor the formation of magnetar progenitors through stellar mergers, as higher metallicity stars are less compact and more likely to fill their Roche lobes, leading to unstable mass transfer. Although massive stars do not have convective interiors to generate strong magnetic fields by dynamo, merger remnants are thought to have the requisite internal magnetic-field strengths to result in magnetars. The preferential occurrence of FRBs in massive star-forming galaxies suggests that CCSN of merger remnants preferentially forms magnetars., Comment: Accepted for publication in Nature. The final version will be published by the journal

Approximately half of the Universe's dark matter resides in collapsed halos; significantly less than half of the baryonic matter (protons and neutrons) remains confined to halos. A small fraction of baryons are in stars and the interstellar medium within galaxies. The lion's share are diffuse (less than $10^{-3}$ cm$^{-3}$) and ionized (neutral fraction less than $10^{-4}$), located in the intergalactic medium (IGM) and in the halos of galaxy clusters, groups, and galaxies. The quantity and spatial distribution of this diffuse ionized gas is notoriously difficult to measure, but has wide implications for galaxy formation, astrophysical feedback, and precision cosmology. Recently, the dispersion of extragalactic Fast Radio Bursts (FRBs) has been used to measure the total content of cosmic baryons. However, past efforts had modest samples and methods that cannot discriminate between IGM and halo gas, which is critical for studying feedback and for observational cosmology. Here, we present a large cosmological sample of FRB sources localized to their host galaxies. We have robustly partitioned the missing baryons into the IGM, galaxy clusters, and galaxies, providing a late-Universe measurement of the total baryon density of $\Omega_b h_{70}$=0.049$\pm$0.003. Our results indicate efficient feedback processes that can expel gas from galaxy halos and into the intergalactic medium, agreeing with the enriched cosmic web scenario seen in cosmological simulations. The large diffuse baryon fraction that we have measured disfavours bottom-heavy stellar initial mass functions, which predict a large total stellar density, $\Omega_*$.

We derive a minimax distributionally robust inverse reinforcement learning (IRL) algorithm to reconstruct the utility functions of a multi-agent sensing system. Specifically, we construct utility estimators which minimize the worst-case prediction error over a Wasserstein ambiguity set centered at noisy signal observations. We prove the equivalence between this robust estimation and a semi-infinite optimization reformulation, and we propose a consistent algorithm to compute solutions. We illustrate the efficacy of this robust IRL scheme in numerical studies to reconstruct the utility functions of a cognitive radar network from observed tracking signals.

We present constraints on the $f(R)$ gravity model using a sample of 1,005 galaxy clusters in the redshift range $0.25 - 1.78$ that have been selected through the thermal Sunyaev-Zel'dovich effect (tSZE) from South Pole Telescope (SPT) data and subjected to optical and near-infrared confirmation with the Multi-component Matched Filter (MCMF) algorithm. We employ weak gravitational lensing mass calibration from the Dark Energy Survey (DES) Year 3 data for 688 clusters at $z < 0.95$ and from the Hubble Space Telescope (HST) for 39 clusters with $0.6 < z < 1.7$. Our cluster sample is a powerful probe of $f(R)$ gravity, because this model predicts a scale-dependent enhancement in the growth of structure, which impacts the halo mass function (HMF) at cluster mass scales. To account for these modified gravity effects on the HMF, our analysis employs a semi-analytical approach calibrated with numerical simulations. Combining calibrated cluster counts with primary cosmic microwave background (CMB) temperature and polarization anisotropy measurements from the Planck2018 release, we derive robust constraints on the $f(R)$ parameter $f_{R0}$. Our results, $\log_{10} |f_{R0}| < -5.32$ at the 95 % credible level, are the tightest current constraints on $f(R)$ gravity from cosmological scales. This upper limit rules out $f(R)$-like deviations from general relativity that result in more than a $\sim$20 % enhancement of the cluster population on mass scales $M_\mathrm{200c}>3\times10^{14}M_\odot$., Comment: 21 pages, 6 figures, submitted to Phys. Rev. D

The advent of 3D printing has transformed the pharmaceutical industry, enabling precision drug manufacturing with controlled release profiles, dosing, and structural complexity. Additive manufacturing (AM) addresses the growing demand for personalized medicine, overcoming limitations of traditional methods. This technology facilitates tailored dosage forms, complex geometries, and real-time quality control. Recent advancements in drop-on-demand printing, UV curable inks, material science, and regulatory frameworks are discussed. Despite opportunities for cost reduction, flexibility, and decentralized manufacturing, challenges persist in scalability, reproducibility, and regulatory adaptation. This review provides an in-depth analysis of the current state of AM in pharmaceutical manufacturing, exploring recent developments, challenges, and future directions for mainstream integration., Comment: submitted to IMECE 2024

Scholastic Aptitude Test (SAT) is crucial for college admissions but its effectiveness and relevance are increasingly questioned. This paper enhances Synthetic Control methods by introducing "Transformed Control", a novel method that employs Large Language Models (LLMs) powered by Artificial Intelligence to generate control groups. We utilize OpenAI's API to generate a control group where GPT-4, or ChatGPT, takes multiple SATs annually from 2008 to 2023. This control group helps analyze shifts in SAT math difficulty over time, starting from the baseline year of 2008. Using parallel trends, we calculate the Average Difference in Scores (ADS) to assess changes in high school students' math performance. Our results indicate a significant decrease in the difficulty of the SAT math section over time, alongside a decline in students' math performance. The analysis shows a 71-point drop in the rigor of SAT math from 2008 to 2023, with student performance decreasing by 36 points, resulting in a 107-point total divergence in average student math performance. We investigate possible mechanisms for this decline in math proficiency, such as changing university selection criteria, increased screen time, grade inflation, and worsening adolescent mental health. Disparities among demographic groups show a 104-point drop for White students, 84 points for Black students, and 53 points for Asian students. Male students saw a 117-point reduction, while female students had a 100-point decrease.

Clustering artworks based on style has many potential real-world applications like art recommendations, style-based search and retrieval, and the study of artistic style evolution in an artwork corpus. However, clustering artworks based on style is largely an unaddressed problem. A few present methods for clustering artworks principally rely on generic image feature representations derived from deep neural networks and do not specifically deal with the artistic style. In this paper, we introduce and deliberate over the notion of style-based clustering of visual artworks. Our main objective is to explore neural feature representations and architectures that can be used for style-based clustering and observe their impact and effectiveness. We develop different methods and assess their relative efficacy for style-based clustering through qualitative and quantitative analysis by applying them to four artwork corpora and four curated synthetically styled datasets. Our analysis provides some key novel insights on architectures, feature representations, and evaluation methods suitable for style-based clustering., Comment: 29 pages

Finding accurate exchange-correlation (XC) functionals remains the defining challenge in density functional theory (DFT). Despite 40 years of active development, the desired chemical accuracy is still elusive with existing functionals. We present a data-driven pathway to learn the XC functionals by utilizing the exact density, XC energy, and XC potential. While the exact densities are obtained from accurate configuration interaction (CI), the exact XC energies and XC potentials are obtained via inverse DFT calculations on the CI densities. We demonstrate how simple neural network (NN) based local density approximation (LDA) and generalized gradient approximation (GGA), trained on just five atoms and two molecules, provide remarkable improvement in total energies, densities, atomization energies, and barrier heights for hundreds of molecules outside the training set. Particularly, the NN-based GGA functional attains similar accuracy as the higher rung SCAN meta-GGA, highlighting the promise of using the XC potential in modeling XC functionals. We expect this approach to pave the way for systematic learning of increasingly accurate and sophisticated XC functionals.

Recent research has seen significant interest in methods for concept removal and targeted forgetting in diffusion models. In this paper, we conduct a comprehensive white-box analysis to expose significant vulnerabilities in existing diffusion model unlearning methods. We show that the objective functions used for unlearning in the existing methods lead to decoupling of the targeted concepts (meant to be forgotten) for the corresponding prompts. This is concealment and not actual unlearning, which was the original goal. The ineffectiveness of current methods stems primarily from their narrow focus on reducing generation probabilities for specific prompt sets, neglecting the diverse modalities of intermediate guidance employed during the inference process. The paper presents a rigorous theoretical and empirical examination of four commonly used techniques for unlearning in diffusion models. We introduce two new evaluation metrics: Concept Retrieval Score (CRS) and Concept Confidence Score (CCS). These metrics are based on a successful adversarial attack setup that can recover forgotten concepts from unlearned diffusion models. The CRS measures the similarity between the latent representations of the unlearned and fully trained models after unlearning. It reports the extent of retrieval of the forgotten concepts with increasing amount of guidance. The CCS quantifies the confidence of the model in assigning the target concept to the manipulated data. It reports the probability of the unlearned model's generations to be aligned with the original domain knowledge with increasing amount of guidance. Evaluating existing unlearning methods with our proposed stringent metrics for diffusion models reveals significant shortcomings in their ability to truly unlearn concepts. Source Code: https://respailab.github.io/unlearning-or-concealment

We report on the analysis of a multiphase Lyman limit system (LLS) at $z=0.39047$ identified towards the background quasar FBQS J0209-0438. The O VI doublet lines associated with this absorber have a different profile from the low ionization metals and the H I. The Ly$\alpha$ has a very broad H I ($b \approx 150$ km s$^{-1}$) component well-aligned with one of the O VI components. The Doppler $b$-parameters for the broad H I and O VI indicate gas with $T= (0.8-2.0)\times 10^6$ K, and a total hydrogen column density that is an order of magnitude larger than the cooler phase of gas responsible for the LLS. Observations by VLT/MUSE show two moderately star-forming galaxies within $\rho \lesssim 105$ kpc, and $|\Delta v|\lesssim 130$ km s$^{-1}$ of the absorber, one of them a dwarf galaxy ($M_*\approx 10^6$ M$_\odot$) overlapping with the quasar PSF, and the other a larger galaxy ($R_{1/2}\approx 4$ kpc) with $M_*\approx 3\times 10^{10}$ M$_\odot$ and $M_h\approx 7\times 10^{11}$ M$_\odot$, and the dwarf galaxy within its virial radius. Though the absorption is aligned with the extended major axis of the larger galaxy, the line-of-sight velocity of the absorbing gas is inconsistent with corotating accretion. The metallicity inferred for the LLS is lower than the gas phase [O/H] of the two galaxies. The mixture of cool and warm/hot gas phases for the absorbing gas and its proximity and orientation to the galaxy pair points to the LLS being a high-velocity gas in the combined halo environment of both galaxies., Comment: 18 pages, 10 figures, 5 tables, accepted to be published in ApJ

Using a sample of 2800 galaxy clusters identified in the Dark Energy Survey across the redshift range $0.20 < z < 0.60$, we characterize the hierarchical assembly of Bright Central Galaxies (BCGs) and the surrounding intracluster light (ICL). To quantify hierarchical formation we use the stellar mass - halo mass (SMHM) relation for the BCG+ICL system and incorporate the magnitude gap (M14), the difference in brightness between the BCG (measured within 30kpc) and 4th brightest cluster member galaxy within 0.5 $R_{200,c}$. The inclusion of M14, which traces BCG hierarchical growth, increases the slope and decreases the intrinsic scatter in the SMHM relation, highlighting that it is a latent variable within the BCG+ICL SMHM relation. Moreover, the correlation with M14 decreases at large radii from the BCG's centre. However, the stellar light within the BCG+ICL transition region (30kpc - 80kpc) most strongly correlates with the dark matter halo mass and has a statistically significant correlation with M14. As the light in the transition region and M14 are independent measurements, the transition region may grow as a result of the BCG's hierarchical two-phase formation. Additionally, as M14 and ICL result from hierarchical growth, we use a stacked sample and find that clusters with large M14 values are characterized by larger ICL and BCG+ICL fractions, which illustrates that the merger processes that build the BCG stellar mass also grow the ICL. Furthermore, this may suggest that M14 combined with the ICL fraction can be used as a method to identify dynamically relaxed clusters., Comment: 16 pages, 5 Figures, submitted to MNRAS on 8/30/2024

Previously, using forward-flux sampling (FFS) and machine learning (ML), we developed multivariate alarm systems to counter rare un-postulated abnormal events. Our alarm systems utilized ML-based predictive models to quantify committer probabilities as functions of key process variables (e.g., temperature, concentrations, and the like), with these data obtained in FFS simulations. Herein, we introduce a novel and comprehensive benchmark framework for rare-event prediction, comparing ML algorithms of varying complexity, including Linear Support-Vector Regressor and k-Nearest Neighbors, to more sophisticated algorithms, such as Random Forests, XGBoost, LightGBM, CatBoost, Dense Neural Networks, and TabNet. This evaluation uses comprehensive performance metrics, such as: $\textit{RMSE}$, model training, testing, hyperparameter tuning and deployment times, and number and efficiency of alarms. These balance model accuracy, computational efficiency, and alarm-system efficiency, identifying optimal ML strategies for predicting abnormal rare events, enabling operators to obtain safer and more reliable plant operations., Comment: This is a preprint for our manuscript to be submitted for publication in Computers and Chemical Engineering Journal. Pages: 22 (including Appendix and References). Figures: 9 (main) + 3 (Appendix). Tables: 3 (main) + 3 (Appendix)

We present high-pressure (2 GPa) $^7$Li nuclear magnetic resonance (NMR) measurements on single crystals of the hyper-honeycomb Kitaev magnet $\beta$-Li$_2$IrO$_3$. The spectra show evidence for a structural phase transition around 200 K and a coexistence of phases, consistent with the results of other measurement techniques. The NMR spectra and line shift measurements demonstrate a strong suppression of the local magnetic susceptibility at high pressure. However, the spin-lattice relaxation ($1/T_1$) shows a clear power-law temperature dependence. This is inconsistent with a gapped singlet ground state of dimers and tetramers, as was previously proposed, and is instead evocative of a more exotic quantum spin liquid-like ground state.

We study the problem of approximately recovering a probability distribution given noisy measurements of its Chebyshev polynomial moments. We sharpen prior work, proving that accurate recovery in the Wasserstein distance is possible with more noise than previously known. As a main application, our result yields a simple "linear query" algorithm for constructing a differentially private synthetic data distribution with Wasserstein-1 error $\tilde{O}(1/n)$ based on a dataset of $n$ points in $[-1,1]$. This bound is optimal up to log factors and matches a recent breakthrough of Boedihardjo, Strohmer, and Vershynin [Probab. Theory. Rel., 2024], which uses a more complex "superregular random walk" method to beat an $O(1/\sqrt{n})$ accuracy barrier inherent to earlier approaches. We illustrate a second application of our new moment-based recovery bound in numerical linear algebra: by improving an approach of Braverman, Krishnan, and Musco [STOC 2022], our result yields a faster algorithm for estimating the spectral density of a symmetric matrix up to small error in the Wasserstein distance.

Continual learning and machine unlearning are crucial challenges in machine learning, typically addressed separately. Continual learning focuses on adapting to new knowledge while preserving past information, whereas unlearning involves selectively forgetting specific subsets of data. In this paper, we introduce a novel framework that jointly tackles both tasks by leveraging controlled knowledge distillation. Our approach enables efficient learning with minimal forgetting and effective targeted unlearning. By incorporating a fixed memory buffer, the system supports learning new concepts while retaining prior knowledge. The distillation process is carefully managed to ensure a balance between acquiring new information and forgetting specific data as needed. Experimental results on benchmark datasets show that our method matches or exceeds the performance of existing approaches in both continual learning and machine unlearning. This unified framework is the first to address both challenges simultaneously, paving the way for adaptable models capable of dynamic learning and forgetting while maintaining strong overall performance.

The growth rate of the GPU memory capacity has not been able to keep up with that of the size of large language models (LLMs), hindering the model training process. In particular, activations -- the intermediate tensors produced during forward propagation and reused in backward propagation -- dominate the GPU memory use. To address this challenge, we propose TBA to efficiently offload activations to high-capacity NVMe SSDs. This approach reduces GPU memory usage without impacting performance by adaptively overlapping data transfers with computation. TBA is compatible with popular deep learning frameworks like PyTorch, Megatron, and DeepSpeed, and it employs techniques such as tensor deduplication, forwarding, and adaptive offloading to further enhance efficiency. We conduct extensive experiments on GPT, BERT, and T5. Results demonstrate that TBA effectively reduces 47% of the activation peak memory usage. At the same time, TBA perfectly overlaps the I/O with the computation and incurs negligible performance overhead. We introduce the recompute-offload-keep (ROK) curve to compare the TBA offloading with other two tensor placement strategies, keeping activations in memory and layerwise full recomputation. We find that TBA achieves better memory savings than layerwise full recomputation while retaining the performance of keeping the activations in memory.

Language Model (LM) agents for cybersecurity that are capable of autonomously identifying vulnerabilities and executing exploits have the potential to cause real-world impact. Policymakers, model providers, and other researchers in the AI and cybersecurity communities are interested in quantifying the capabilities of such agents to help mitigate cyberrisk and investigate opportunities for penetration testing. Toward that end, we introduce Cybench, a framework for specifying cybersecurity tasks and evaluating agents on those tasks. We include 40 professional-level Capture the Flag (CTF) tasks from 4 distinct CTF competitions, chosen to be recent, meaningful, and spanning a wide range of difficulties. Each task includes its own description, starter files, and is initialized in an environment where an agent can execute bash commands and observe outputs. Since many tasks are beyond the capabilities of existing LM agents, we introduce subtasks, which break down a task into intermediary steps for more gradated evaluation; we add subtasks for 17 of the 40 tasks. To evaluate agent capabilities, we construct a cybersecurity agent and evaluate 7 models: GPT-4o, Claude 3 Opus, Claude 3.5 Sonnet, Mixtral 8x22b Instruct, Gemini 1.5 Pro, Llama 3 70B Chat, and Llama 3.1 405B Instruct. Without guidance, we find that agents are able to solve only the easiest complete tasks that took human teams up to 11 minutes to solve, with Claude 3.5 Sonnet and GPT-4o having the highest success rates. Finally, subtasks provide more signal for measuring performance compared to unguided runs, with models achieving a 3.2\% higher success rate on complete tasks with subtask-guidance than without subtask-guidance. All code and data are publicly available at https://cybench.github.io, Comment: 86 pages, 7 figures

While many capabilities of language models (LMs) improve with increased training budget, the influence of scale on hallucinations is not yet fully understood. Hallucinations come in many forms, and there is no universally accepted definition. We thus focus on studying only those hallucinations where a correct answer appears verbatim in the training set. To fully control the training data content, we construct a knowledge graph (KG)-based dataset, and use it to train a set of increasingly large LMs. We find that for a fixed dataset, larger and longer-trained LMs hallucinate less. However, hallucinating on $\leq5$% of the training data requires an order of magnitude larger model, and thus an order of magnitude more compute, than Hoffmann et al. (2022) reported was optimal. Given this costliness, we study how hallucination detectors depend on scale. While we see detector size improves performance on fixed LM's outputs, we find an inverse relationship between the scale of the LM and the detectability of its hallucinations., Comment: Published at COLM 2024. 16 pages, 11 figures

This paper explores humor detection through a linguistic lens, prioritizing syntactic, semantic, and contextual features over computational methods in Natural Language Processing. We categorize features into syntactic, semantic, and contextual dimensions, including lexicons, structural statistics, Word2Vec, WordNet, and phonetic style. Our proposed model, Colbert, utilizes BERT embeddings and parallel hidden layers to capture sentence congruity. By combining syntactic, semantic, and contextual features, we train Colbert for humor detection. Feature engineering examines essential syntactic and semantic features alongside BERT embeddings. SHAP interpretations and decision trees identify influential features, revealing that a holistic approach improves humor detection accuracy on unseen data. Integrating linguistic cues from different dimensions enhances the model's ability to understand humor complexity beyond traditional computational methods.

Using 1533 type Ia supernovae (SNe Ia) from the five-year sample of the Dark Energy Survey (DES), we investigate the effects of projected galactocentric separation between the SNe and their host galaxies on their light curves and standardization. We show, for the first time, that the difference in SN Ia post-standardization brightnesses between high and low-mass hosts reduces from $0.078\pm0.011$ mag in the full sample to $0.036 \pm 0.018$ mag for SNe Ia located in the outer regions of their host galaxies, while increasing to $0.100 \pm 0.014$ mag for SNe in the inner regions. In these inner regions, the step can be reduced (but not removed) using a model where the $R_V$ of dust along the line-of-sight to the SN changes as a function of galaxy properties. To explain the remaining difference, we use the distributions of the SN Ia stretch parameter to test whether the inferred age of SN progenitors are more varied in the inner regions of galaxies. We find that the proportion of high-stretch SNe Ia in red (older) environments is more prominent in outer regions and that the outer regions stretch distributions are overall more homogeneous compared to inner regions, but conclude that this effect cannot explain the reduction in significance of any Hubble residual step in outer regions. We conclude that the standardized distances of SNe Ia located in the outer regions of galaxies are less affected by their global host galaxy properties than those in the inner regions., Comment: 17 pages, 13 figures

The Ryabinkin-Kohut-Staroverov (RKS) and Kanungo-Zimmerman-Gavini (KZG) methods offer two approaches to find exchange-correlation (XC) potentials from ground state densities. The RKS method utilizes the one- and two-particle reduced density matrices to alleviate any numerical artifacts stemming from a finite basis (e.g., Gaussian- or Slater-type orbitals). The KZG approach relies solely on the density to find the XC potential, by combining a systematically convergent finite-element basis with appropriate asymptotic correction on the target density. The RKS method, being designed for a finite basis, offers computational efficiency. The KZG method, using a complete basis, provides higher accuracy. In this work, we combine both the methods to simultaneously afford accuracy and efficiency. In particular, we use the RKS solution as initial guess to the KZG method to attain a significant $3-11\times$ speedup. This work also presents a direct comparison of the XC potentials from the RKS and the KZG method and their relative accuracy on various weakly and strongly correlated molecules, using their ground state solutions from accurate configuration interaction calculations solved in a Slater orbital basis.

The present state of cosmology is facing a crisis where there is a fundamental disagreement in measurements of the Hubble constant ($H_{0}$), with significant tension between the early and late universe methods. Type Ia supernovae (SNe Ia) are important to measuring $H_{0}$ through the astronomical distance ladder. However, there remains potential to better standardise SN Ia light curves by using known dependencies on host galaxy properties after the standard light curve width and colour corrections have been applied to the peak SN Ia luminosities. To explore this, we use the 5-year photometrically identified SNe Ia sample obtained by the Dark Energy Survey, along with host galaxy spectra obtained by the Australian Dark Energy Survey. Using host galaxy spectroscopy, we find a significant trend with the equivalent width (EW) of the [OII] $\lambda\lambda$ 3727, 29 doublet, a proxy for specific star formation rate, and Hubble residuals. We find that the correlation with [OII] EW is a powerful alternative to the commonly used mass step after initial light curve corrections. We applied our [OII] EW correction to a sample of 20 SN Ia hosted by calibrator galaxies observed using WiFeS, and examined the impact on both the SN Ia absolute magnitude and $H_{0}$. We then explored different [OII] EW corrections and found $H_{0}$ values ranging between $72.80$ to $73.28~\mathrm{km} \mathrm{s}^{-1} \mathrm{Mpc}^{-1}$. Notably, even after using an additional [OII] EW correction, the impact of host galaxy properties in standardising SNe Ia appears limited in reducing the current tension ($\sim$5$\sigma$) with the Cosmic Microwave Background result for $H_{0}$., Comment: 16 pages, 13 figures. Submitting to MNRAS

Characterization of the redshift distribution of ensembles of galaxies is pivotal for large scale structure cosmological studies. In this work, we focus on improving the Self-Organizing Map (SOM) methodology for photometric redshift estimation (SOMPZ), specifically in anticipation of the Dark Energy Survey Year 6 (DES Y6) data. This data set, featuring deeper and fainter galaxies than DES Year 3 (DES Y3), demands adapted techniques to ensure accurate recovery of the underlying redshift distribution. We investigate three strategies for enhancing the existing SOM-based approach used in DES Y3: 1) Replacing the Y3 SOM algorithm with one tailored for redshift estimation challenges; 2) Incorporating $\textit{g}$-band flux information to refine redshift estimates (i.e. using $\textit{griz}$ fluxes as opposed to only $\textit{riz}$); 3) Augmenting redshift data for galaxies where available. These methods are applied to DES Y3 data, and results are compared to the Y3 fiducial ones. Our analysis indicates significant improvements with the first two strategies, notably reducing the overlap between redshift bins. By combining strategies 1 and 2, we have successfully managed to reduce redshift bin overlap in DES Y3 by up to 66$\%$. Conversely, the third strategy, involving the addition of redshift data for selected galaxies as an additional feature in the method, yields inferior results and is abandoned. Our findings contribute to the advancement of weak lensing redshift characterization and lay the groundwork for better redshift characterization in DES Year 6 and future stage IV surveys, like the Rubin Observatory.

This paper investigates the frequency of transiting planetary systems around metal-polluted white dwarfs using high-cadence photometry from ULTRACAM and ULTRASPEC on the ground, and space-based observations with TESS. Within a sample of 313 metal-polluted white dwarfs with available TESS light curves, two systems known to have irregular transits are blindly recovered by box-least-squares and Lomb-Scargle analyses, with no new detections, yielding a transit fraction of 0.8 (-0.4, +0.6) per cent. Planet detection sensitivities are determined using simulated transit injection and recovery for all light curves, producing upper limit occurrences over radii from dwarf to Kronian planets, with periods from 1 h to 27 d. The dearth of short-period, transiting planets orbiting polluted white dwarfs is consistent with engulfment during the giant phases of stellar evolution, and modestly constrains dynamical re-injection of planets to the shortest orbital periods. Based on simple predictions of transit probability, where (R + Rp)/a ~ 0.01, the findings here are nominally consistent with a model where 100 per cent of polluted white dwarfs have circumstellar debris near the Roche limit; however, the small sample size precludes statistical confidence in this result. Single transits are also ruled out in all light curves using a search for correlated outliers, providing weak constraints on the role of Oort-like comet clouds in white dwarf pollution., Comment: 10 pages, 5 figures and 1 table. Accepted for publication in MNRAS

The SSPACE Astrobiology Payload (SAP) series, starting with the SAP-1 project is designed to conduct in-situ microbiology experiments in low earth orbit. This payload series aims to understand the behaviour of microbial organisms in space, particularly those critical for human health, and the corresponding effects due to microgravity and solar/galactic radiation. SAP-1 focuses on studying Bacillus clausii and Bacillus coagulans, bacteria beneficial to humans. It aims to provide a space laboratory for astrobiology experiments under microgravity conditions. The hardware developed for these experiments is indigenous and tailored to meet the unique requirements of autonomous microbiology experiments by controlling pressure, temperature, and nutrition flow to bacteria. A rotating platform, which forms the core design, is innovatively utilised to regulate the flow and mixing of nutrients with dormant bacteria. The technology demonstration models developed at SSPACE have yielded promising results, with ongoing efforts to refine, adapt for space conditions, and prepare for integration with nanosatellites or space modules. The anticipated payload will be compact, approximately 1U in size (10cm x 10cm x 10cm), consume less than 5W power, and offer flexibility for various microbiological studies., Comment: 20 Pages, Submitted to Advances in Space Research

We present galaxy-galaxy lensing measurements using a sample of low surface brightness galaxies (LSBGs) drawn from the Dark Energy Survey Year 3 (Y3) data as lenses. LSBGs are diffuse galaxies with a surface brightness dimmer than the ambient night sky. These dark-matter-dominated objects are intriguing due to potentially unusual formation channels that lead to their diffuse stellar component. Given the faintness of LSBGs, using standard observational techniques to characterize their total masses proves challenging. Weak gravitational lensing, which is less sensitive to the stellar component of galaxies, could be a promising avenue to estimate the masses of LSBGs. Our LSBG sample consists of 23,790 galaxies separated into red and blue color types at $g-i\ge 0.60$ and $g-i< 0.60$, respectively. Combined with the DES Y3 shear catalog, we measure the tangential shear around these LSBGs and find signal-to-noise ratios of 6.67 for the red sample, 2.17 for the blue sample, and 5.30 for the full sample. We use the clustering redshifts method to obtain redshift distributions for the red and blue LSBG samples. Assuming all red LSBGs are satellites, we fit a simple model to the measurements and estimate the host halo mass of these LSBGs to be $\log(M_{\rm host}/M_{\odot}) = 12.98 ^{+0.10}_{-0.11}$. We place a 95% upper bound on the subhalo mass at $\log(M_{\rm sub}/M_{\odot})<11.51$. By contrast, we assume the blue LSBGs are centrals, and place a 95% upper bound on the halo mass at $\log(M_\mathrm{host}/M_\odot) < 11.84$. We find that the stellar-to-halo mass ratio of the LSBG samples is consistent with that of the general galaxy population. This work illustrates the viability of using weak gravitational lensing to constrain the halo masses of LSBGs., Comment: 16 pages, 15 figures

We present Stable Video 4D (SV4D), a latent video diffusion model for multi-frame and multi-view consistent dynamic 3D content generation. Unlike previous methods that rely on separately trained generative models for video generation and novel view synthesis, we design a unified diffusion model to generate novel view videos of dynamic 3D objects. Specifically, given a monocular reference video, SV4D generates novel views for each video frame that are temporally consistent. We then use the generated novel view videos to optimize an implicit 4D representation (dynamic NeRF) efficiently, without the need for cumbersome SDS-based optimization used in most prior works. To train our unified novel view video generation model, we curated a dynamic 3D object dataset from the existing Objaverse dataset. Extensive experimental results on multiple datasets and user studies demonstrate SV4D's state-of-the-art performance on novel-view video synthesis as well as 4D generation compared to prior works., Comment: Project page: https://sv4d.github.io/

Cosmological analyses with Type Ia Supernovae (SNe Ia) have traditionally been reliant on spectroscopy for both classifying the type of supernova and obtaining reliable redshifts to measure the distance-redshift relation. While obtaining a host-galaxy spectroscopic redshift for most SNe is feasible for small-area transient surveys, it will be too resource intensive for upcoming large-area surveys such as the Vera Rubin Observatory Legacy Survey of Space and Time, which will observe on the order of millions of SNe. Here we use data from the Dark Energy Survey (DES) to address this problem with photometric redshifts (photo-z) inferred directly from the SN light-curve in combination with Gaussian and full p(z) priors from host-galaxy photo-z estimates. Using the DES 5-year photometrically-classified SN sample, we consider several photo-z algorithms as host-galaxy photo-z priors, including the Self-Organizing Map redshifts (SOMPZ), Bayesian Photometric Redshifts (BPZ), and Directional-Neighbourhood Fitting (DNF) redshift estimates employed in the DES 3x2 point analyses. With detailed catalog-level simulations of the DES 5-year sample, we find that the simulated w can be recovered within $\pm$0.02 when using SN+SOMPZ or DNF prior photo-z, smaller than the average statistical uncertainty for these samples of 0.03. With data, we obtain biases in w consistent with simulations within ~1$\sigma$ for three of the five photo-z variants. We further evaluate how photo-z systematics interplay with photometric classification and find classification introduces a subdominant systematic component. This work lays the foundation for next-generation fully photometric SNe Ia cosmological analyses., Comment: 19 pages, 9 figures. Submitting to MNRAS, comments welcome

Graph Neural Networks (GNNs) are widely used today in recommendation systems, fraud detection, and node/link classification tasks. Real world GNNs continue to scale in size and require a large memory footprint for storing graphs and embeddings that often exceed the memory capacities of the target GPUs used for training. To address limited memory capacities, traditional GNN training approaches use graph partitioning and sharding techniques to scale up across multiple GPUs within a node and/or scale out across multiple nodes. However, this approach suffers from the high computational costs of graph partitioning algorithms and inefficient communication across GPUs. To address these overheads, we propose Large-scale Storage-based Multi-GPU GNN framework (LSM-GNN), a storagebased approach to train GNN models that utilizes a novel communication layer enabling GPU software caches to function as a system-wide shared cache with low overheads.LSM-GNN incorporates a hybrid eviction policy that intelligently manages cache space by using both static and dynamic node information to significantly enhance cache performance. Furthermore, we introduce the Preemptive Victim-buffer Prefetcher (PVP), a mechanism for prefetching node feature data from a Victim Buffer located in CPU pinned-memory to further reduce the pressure on the storage devices. Experimental results show that despite the lower compute capabilities and memory capacities, LSM-GNN in a single node with two GPUs offers superior performance over two-node-four-GPU Dist-DGL baseline and provides up to 3.75x speed up on end-to-end epoch time while running large-scale GNN training

We consider the inhomogeneous (or density dependent) incompressible Euler equations in a three-dimensional periodic domain. We construct density $\varrho$ and velocity $u$ such that, for any $\alpha<1/7$, both of them are $\alpha $-H\"older continuous and $(\varrho, u)$ is a weak solution to the underlying equations. The proof is based on typical convex integration techniques using Mikado flows as building blocks. As a main novelty with respect to the related literature, our result produces a H\"older continuous density., Comment: 41 pages. arXiv admin note: text overlap with arXiv:2006.06482, arXiv:2101.09278 by other authors

The seminal Erd\H{o}s--Ko--Rado (EKR) theorem states that if $\mathcal{F}$ is a family of $k$-subsets of an $n$-element set $X$ for $k\leq n/2$ such that every pair of subsets in $\mathcal{F}$ has a nonempty intersection, then $\mathcal{F}$ can be no bigger than the trivially intersecting family obtained by including all $k$-subsets of $X$ that contain a fixed element $x\in X$. This family is called the star centered at $x$. In this paper, we formulate and prove an EKR theorem for intersecting families of subgraphs of the perfect matching graph, the graph consisting of $n$ disjoint edges. This can be considered a generalization not only of the aforementioned EKR theorem but also of a signed variant of it, first stated by Meyer (1974), and proved separately by Deza--Frankl (1983) and Bollob\'as--Leader (1997). The proof of our main theorem relies on a novel extension of Katona's beautiful cycle method., Comment: 10 pages, 2 figures

We present a study of the weak lensing matter profiles of 698 South Pole Telescope (SPT) thermal Sunyaev-Zel'dovich effect (tSZE) selected galaxy clusters in the redshift range $0.25

The companion to PSR J1622-0315, one of the most compact known redback millisecond pulsars, shows extremely low irradiation despite its short orbital period. We model this system to determine the binary parameters, combining optical observations from NTT in 2017 and NOT in 2022 with the binary modeling code ICARUS. We find a best-fit neutron star mass of $2.3 \pm 0.4\,\text{M}_\odot $, and a companion mass of $0.15 \pm 0.02\,\text{M}_\odot$. We detect for the first time low-level irradiation from asymmetry in the minima as well as a change in the asymmetry of the maxima of its light curves over five years. Using star spot models, we find better fits than those from symmetric direct heating models, with consistent orbital parameters. We discuss an alternative scenario where the changing asymmetry is produced by a variable intrabinary shock. In summary, we find that PSR J1622-0315 combines low irradiation with variable light curve asymmetry, and a relatively high neutron star mass., Comment: 18 pages, 11 figures

Haystack and Owens Valley Radio Observatory (OVRO) observations recently revealed strong sinusoidal total flux density variations that maintained coherence between 1975 and 2021 in the blazar PKS 2131-021 ($z=1.283)$. This was interpreted as possible evidence of a supermassive black hole binary (SMBHB). Extended observations through 2023 show coherence over 47.9~years, with an observed period $P_\textrm{15 GHz}=(1739.3 \pm 1.2) \, {\rm days}$. We reject, with $p$-value = $5.3 \times 10^{-7}$, the hypothesis that the variations are due to random fluctuations in the red noise tail of the power spectral density. There is clearly a constant-period physical phenomenon in PKS 2131-021 producing coherent intermittent sinusoidal flux density variations. We find the coherent sinusoidal intensity variations extend from below 2.7 GHz to optical frequencies, from which we derive an observed period $P_\textrm{optical}=(1764 \pm 36)$ days. Across this broad frequency range there is a monotonic phase shift in the sinusoidal variations with frequency. The same coherent periodicity is possibly also observed at $\gamma$-ray energies. The importance of well-vetted SMBHB candidates to searches for gravitational waves is pointed out. We estimate the fraction of blazars that are SMBHB candidates to be $>1$ in 100. Thus monitoring programs covering tens of thousands of blazars could discover hundreds of SMBHB candidates., Comment: 23 pages, 17 figures, 5 tables, submitted to ApJ

From ride-hailing to car rentals, consumers are often presented with eco-friendly options. Beyond highlighting a "green" vehicle and CO2 emissions, CO2 equivalencies have been designed to provide understandable amounts; we ask which equivalencies will lead to eco-friendly decisions. We conducted five ride-hailing scenario surveys where participants picked between regular and eco-friendly options, testing equivalencies, social features, and valence-based interventions. Further, we tested a car-rental embodiment to gauge how an individual (needing a car for several days) might behave versus the immediate ride-hailing context. We find that participants are more likely to choose green rides when presented with additional information about emissions; CO2 by weight was found to be the most effective. Further, we found that information framing - be it individual or collective footprint, positive or negative valence - had an impact on participants' choices. Finally, we discuss how our findings inform the design of effective interventions for reducing car-based carbon-emissions., Comment: 24 Pages, published in ACM CHI 2023

Self-attention performs well in long context but has quadratic complexity. Existing RNN layers have linear complexity, but their performance in long context is limited by the expressive power of their hidden state. We propose a new class of sequence modeling layers with linear complexity and an expressive hidden state. The key idea is to make the hidden state a machine learning model itself, and the update rule a step of self-supervised learning. Since the hidden state is updated by training even on test sequences, our layers are called Test-Time Training (TTT) layers. We consider two instantiations: TTT-Linear and TTT-MLP, whose hidden state is a linear model and a two-layer MLP respectively. We evaluate our instantiations at the scale of 125M to 1.3B parameters, comparing with a strong Transformer and Mamba, a modern RNN. Both TTT-Linear and TTT-MLP match or exceed the baselines. Similar to Transformer, they can keep reducing perplexity by conditioning on more tokens, while Mamba cannot after 16k context. With preliminary systems optimization, TTT-Linear is already faster than Transformer at 8k context and matches Mamba in wall-clock time. TTT-MLP still faces challenges in memory I/O, but shows larger potential in long context, pointing to a promising direction for future research.

We construct non-trivial weak solutions $\theta\in C_t^0C_x^{0-}$ to the surface quasi-geostrophic (SQG) equations, which have compact support in time and, thus, violate the conservation of the Hamiltonian. The result is sharp in view of the fact that such a conservation law holds for all weak solutions in the class $C_{t,x}^0 \subset L_{t,x}^3$ (Isett-Vicol, 2015) and resolves the Onsager conjecture for SQG. The construction is achieved by means of a Nash iteration together with the linear decoupling method recently introduced in Giri-Radu (2023).

We report on Chandra X-ray observations of SN 2016jae and SN 2018cqj, both low luminosity Type Ia supernova that showed the presence of a H line in their early optical spectrum. No X-ray emission is detected at the location of either SN. Upper limits to the luminosity of up to 2 $\times 10^{40}\,$ erg s$^{-1}$ are calculated for each SN, depending on the assumed spectral model, temperature and column density. This luminosity is comparable to that of another low-luminosity Type Ia SN, SN 2018fhw, that was observed with Chandra. It is generally lower than upper limits calculated for Type Ia-CSM SNe observed in X-rays, and also below that of SN 2012ca, the only Type Ia-CSM SN to have been detected in X-rays. Comparisons are made to other Type Ia SN with a H line observed in X-rays. The observations suggest that while the density into which the SN is expanding may have been high at the time the H$\alpha$ line was detected, it had decreased considerably by the time of X-ray observations., Comment: 9 pages, 4 figures and 3 Tables. Accepted to MNRAS. arXiv admin note: text overlap with arXiv:2211.09274

Task-specific functional MRI (fMRI) images provide excellent modalities for studying the neuronal basis of cognitive processes. We use fMRI data to formulate and solve the problem of deconvolving task-specific aggregate neuronal networks into a set of basic building blocks called canonical networks, to use these networks for functional characterization, and to characterize the physiological basis of these responses by mapping them to regions of the brain. Our results show excellent task-specificity of canonical networks, i.e., the expression of a small number of canonical networks can be used to accurately predict tasks; generalizability across cohorts, i.e., canonical networks are conserved across diverse populations, studies, and acquisition protocols; and that canonical networks have strong anatomical and physiological basis. From a methods perspective, the problem of identifying these canonical networks poses challenges rooted in the high dimensionality, small sample size, acquisition variability, and noise. Our deconvolution technique is based on non-negative matrix factorization (NMF) that identifies canonical networks as factors of a suitably constructed matrix. We demonstrate that our method scales to large datasets, yields stable and accurate factors, and is robust to noise., Comment: 9 pages, 5 figures

We introduce HouseCrafter, a novel approach that can lift a floorplan into a complete large 3D indoor scene (e.g., a house). Our key insight is to adapt a 2D diffusion model, which is trained on web-scale images, to generate consistent multi-view color (RGB) and depth (D) images across different locations of the scene. Specifically, the RGB-D images are generated autoregressively in a batch-wise manner along sampled locations based on the floorplan, where previously generated images are used as condition to the diffusion model to produce images at nearby locations. The global floorplan and attention design in the diffusion model ensures the consistency of the generated images, from which a 3D scene can be reconstructed. Through extensive evaluation on the 3D-Front dataset, we demonstrate that HouseCraft can generate high-quality house-scale 3D scenes. Ablation studies also validate the effectiveness of different design choices. We will release our code and model weights. Project page: https://neu-vi.github.io/houseCrafter/

We present a versatile transit simulator aimed at generating light curves for arbitrarily shaped objects transiting stars. Utilizing a Monte Carlo algorithm, it accurately models the stellar flux blocked by these objects, producing precise light curves. The simulator adeptly handles realistic background stars, integrating effects such as tidal distortions and limb darkening, alongside the rotational dynamics of transiting objects of arbitrary geometries. We showcase its wide-ranging utility through successful simulations of light curves for single and multi-planet systems, tidally distorted planets, eclipsing binaries and exocomets. Additionally, our simulator can simulate light curves for hypothetical alien megastructures of any conceivable shape, providing avenues to identify interesting candidates for follow-up studies. We demonstrate applications of the simulator in modeling a Dyson Swarm in construction, Dyson rings and Dyson disks, discussing how tidally locked Dyson disks can be distinguished from planetary light curves., Comment: 20 pages, 13 figures

We prove a comparison result between two duality statements - Takai duality, which is implemented by the crossed product functor $- \rtimes G: KK^{G} \to KK^{\hat G}$ on equivariant Kasparov categories; and Treumann duality, which asserts the existence of an exotic equivalence of stable $\infty$-categories $\text{Mod}(KU_p[G])^{ft} \simeq \text{Mod}(KU_p[\hat G])^{ft}$ given by tensoring with a particular $(G,\hat G)$-bimodule $M_E$ and $p$-completing., Comment: 35 pages

Severe convective weather events, such as hail, tornadoes, and thunderstorms, often occur quickly yet cause significant damage, costing billions of dollars every year. This highlights the importance of forecasting severe weather threats hours in advance to better prepare meteorologists and residents in at-risk areas. Can modern large foundation models perform such forecasting? Existing weather benchmarks typically focus only on predicting time-series changes in certain weather parameters (e.g., temperature, moisture) with text-only features. In this work, we introduce WeatherQA, the first multimodal dataset designed for machines to reason about complex combinations of weather parameters (a.k.a., ingredients) and predict severe weather in real-world scenarios. The dataset includes over 8,000 (multi-images, text) pairs for diverse severe weather events. Each pair contains rich information crucial for forecasting -- the images describe the ingredients capturing environmental instability, surface observations, and radar reflectivity, and the text contains forecast analyses written by human experts. With WeatherQA, we evaluate state-of-the-art vision language models, including GPT4, Claude3.5, Gemini-1.5, and a fine-tuned Llama3-based VLM, by designing two challenging tasks: (1) multi-choice QA for predicting affected area and (2) classification of the development potential of severe convection. These tasks require deep understanding of domain knowledge (e.g., atmospheric dynamics) and complex reasoning over multimodal data (e.g., interactions between weather parameters). We show a substantial gap between the strongest VLM, GPT4o, and human reasoning. Our comprehensive case study with meteorologists further reveals the weaknesses of the models, suggesting that better training and data integration are necessary to bridge this gap. WeatherQA link: https://github.com/chengqianma/WeatherQA., Comment: 26 pages, 9 figures

We consider the problem of estimating the spectral density of the normalized adjacency matrix of an $n$-node undirected graph. We provide a randomized algorithm that, with $O(n\epsilon^{-2})$ queries to a degree and neighbor oracle and in $O(n\epsilon^{-3})$ time, estimates the spectrum up to $\epsilon$ accuracy in the Wasserstein-1 metric. This improves on previous state-of-the-art methods, including an $O(n\epsilon^{-7})$ time algorithm from [Braverman et al., STOC 2022] and, for sufficiently small $\epsilon$, a $2^{O(\epsilon^{-1})}$ time method from [Cohen-Steiner et al., KDD 2018]. To achieve this result, we introduce a new notion of graph sparsification, which we call nuclear sparsification. We provide an $O(n\epsilon^{-2})$-query and $O(n\epsilon^{-2})$-time algorithm for computing $O(n\epsilon^{-2})$-sparse nuclear sparsifiers. We show that this bound is optimal in both its sparsity and query complexity, and we separate our results from the related notion of additive spectral sparsification. Of independent interest, we show that our sparsification method also yields the first deterministic algorithm for spectral density estimation that scales linearly with $n$ (sublinear in the representation size of the graph)., Comment: Accepted for presentation at the Conference on Learning Theory (COLT) 2024

We present $griz$ photometric light curves for the full 5 years of the Dark Energy Survey Supernova program (DES-SN), obtained with both forced Point Spread Function (PSF) photometry on Difference Images (DIFFIMG) performed during survey operations, and Scene Modelling Photometry (SMP) on search images processed after the survey. This release contains $31,636$ DIFFIMG and $19,706$ high-quality SMP light curves, the latter of which contains $1635$ photometrically-classified supernovae that pass cosmology quality cuts. This sample spans the largest redshift ($z$) range ever covered by a single SN survey ($0.1

Type Ia Supernovae (SNe Ia) are a critical tool in measuring the accelerating expansion of the universe. Recent efforts to improve these standard candles have focused on incorporating the effects of dust on distance measurements with SNe Ia. In this paper, we use the state-of-the-art Dark Energy Survey 5 year sample to evaluate two different families of dust models: empirical extinction models derived from SNe Ia data, and physical attenuation models from the spectra of galaxies. Among the SNe Ia-derived models, we find that a logistic function of the total-to-selective extinction RV best recreates the correlations between supernova distance measurements and host galaxy properties, though an additional 0.02 magnitudes of grey scatter are needed to fully explain the scatter in SNIa brightness in all cases. These empirically-derived extinction distributions are highly incompatible with the physical attenuation models from galactic spectral measurements. From these results, we conclude that SNe Ia must either preferentially select extreme ends of galactic dust distributions, or that the characterisation of dust along the SNe Ia line-of-sight is incompatible with that of galactic dust distributions.

Employing language models to generate explanations for an incoming implicit hate post is an active area of research. The explanation is intended to make explicit the underlying stereotype and aid content moderators. The training often combines top-k relevant knowledge graph (KG) tuples to provide world knowledge and improve performance on standard metrics. Interestingly, our study presents conflicting evidence for the role of the quality of KG tuples in generating implicit explanations. Consequently, simpler models incorporating external toxicity signals outperform KG-infused models. Compared to the KG-based setup, we observe a comparable performance for SBIC (LatentHatred) datasets with a performance variation of +0.44 (+0.49), +1.83 (-1.56), and -4.59 (+0.77) in BLEU, ROUGE-L, and BERTScore. Further human evaluation and error analysis reveal that our proposed setup produces more precise explanations than zero-shot GPT-3.5, highlighting the intricate nature of the task., Comment: 17 Pages, 5 Figures, 13 Tables, ACL Findings 2024