Search

We perform the first direct cosmological and astrophysical parameter inference from the combination of galaxy luminosity functions and colours using a simulation based inference approach. Using the Synthesizer code we simulate the dust attenuated ultraviolet--near infrared stellar emission from galaxies in thousands of cosmological hydrodynamic simulations from the CAMELS suite, including the Swift-EAGLE, Illustris-TNG, Simba & Astrid galaxy formation models. For each galaxy we calculate the rest-frame luminosity in a number of photometric bands, including the SDSS $\textit{ugriz}$ and GALEX FUV & NUV filters; this dataset represents the largest catalogue of synthetic photometry based on hydrodynamic galaxy formation simulations produced to date, totalling >200 million sources. From these we compile luminosity functions and colour distributions, and find clear dependencies on both cosmology and feedback. We then perform simulation based (likelihood-free) inference using these distributions, and obtain constraints on both cosmological and astrophysical parameters. Both colour distributions and luminosity functions provide complementary information on certain parameters when performing inference. Most interestingly we achieve constraints on $\sigma_8$, describing the clustering of matter. This is attributable to the fact that the photometry encodes the star formation--metal enrichment history of each galaxy; galaxies in a universe with a higher $\sigma_8$ tend to form earlier and have higher metallicities, which leads to redder colours. We find that a model trained on one galaxy formation simulation generalises poorly when applied to another, and attribute this to differences in the subgrid prescriptions, and lack of flexibility in our emission modelling. The photometric catalogues are publicly available at: https://camels.readthedocs.io/ ., Comment: 28 pages, 20 figures, submitted to MNRAS. Comments and feedback welcome!

The marked power spectrum - a two-point correlation function of a transformed density field - has emerged as a promising tool for extracting cosmological information from the large-scale structure of the Universe. In this work, we present the first comprehensive analytical study of the marked power spectrum's sensitivity to primordial non-Gaussianity (PNG) of the non-local type. We extend previous effective field theory frameworks to incorporate PNG, developing a complete theoretical model that we validate against the Quijote simulation suite. Through a systematic Fisher analysis, we compare the constraining power of the marked power spectrum against traditional approaches combining the power spectrum and bispectrum (P+B). We explore different choices of mark parameters to evaluate their impact on parameter constraints, particularly focusing on equilateral and orthogonal PNG as well as neutrino masses. Our analysis shows that while marking up underdense regions yields optimal constraints in the low shot-noise regime, the marked power spectrum's performance for discrete tracers with BOSS-like number densities does not surpass that of P+B analysis at mildly non-linear scales ($k \lesssim 0.25 \,h/\text{Mpc}$). However, the marked approach offers several practical advantages, including simpler estimation procedures and potentially more manageable systematic effects. Our theoretical framework reveals how the marked power spectrum incorporates higher-order correlation information through terms resembling tree-level bispectra and power spectrum convolutions. This work establishes a robust foundation for applying marked statistics to future large-volume surveys., Comment: 18 pages, 7 figures

After reionization, neutral hydrogen (HI) traces the large-scale structure (LSS) of the Universe, enabling HI intensity mapping (IM) to capture the LSS in 3D and constrain key cosmological parameters. We present a new framework utilizing higher-order cross-correlations to study HI clustering around galaxies, tested using real-space data from the IllustrisTNG300 simulation. This approach computes the joint distributions of $k$-nearest neighbor ($k$NN) optical galaxies and the HI brightness temperature field smoothed at relevant scales (the $k$NN-field framework), providing sensitivity to all higher-order cross-correlations, unlike two-point statistics. To simulate HI data from actual surveys, we add random thermal noise and apply a simple foreground cleaning model, filtering out Fourier modes of the brightness temperature field with $k_\parallel < k_{\rm min,\parallel}$. Under current levels of thermal noise and foreground cleaning, typical of a Canadian Hydrogen Intensity Mapping Experiment (CHIME)-like survey, the HI-galaxy cross-correlation signal in our simulations, using the $k$NN-field framework, is detectable at $>30\sigma$ across $r = [3,12] \, h^{-1}$Mpc. In contrast, the detectability of the standard two-point correlation function (2PCF) over the same scales depends strongly on the foreground filter: a sharp $k_\parallel$ filter can spuriously boost detection to $8\sigma$ due to position-space ringing, whereas a less sharp filter yields no detection. Nonetheless, we conclude that $k$NN-field cross-correlations are robustly detectable across a broad range of foreground filtering and thermal noise conditions, suggesting their potential for enhanced constraining power over 2PCFs., Comment: 14 pages, 9 figures (with 2 figures included in the appendix), 2 tables. Comments are welcome

The baryonic physics shaping galaxy formation and evolution are complex, spanning a vast range of scales and making them challenging to model. Cosmological simulations rely on subgrid models that produce significantly different predictions. Understanding how models of stellar and active galactic nuclei (AGN) feedback affect baryon behavior across different halo masses and redshifts is essential. Using the SIMBA and IllustrisTNG suites from the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) project, we explore the effect of parameters governing the subgrid implementation of stellar and AGN feedback. We find that while IllustrisTNG shows higher cumulative feedback energy across all halos, SIMBA demonstrates a greater spread of baryons, quantified by the closure radius and circumgalactic medium (CGM) gas fraction. This suggests that feedback in SIMBA couples more effectively to baryons and drives them more efficiently within the host halo. There is evidence that different feedback modes are highly interrelated in these subgrid models. Parameters controlling stellar feedback efficiency significantly impact AGN feedback, as seen in the suppression of black hole mass growth and delayed activation of AGN feedback to higher mass halos with increasing stellar feedback efficiency in both simulations. Additionally, AGN feedback efficiency parameters affect the CGM gas fraction at low halo masses in SIMBA, hinting at complex, non-linear interactions between AGN and SNe feedback modes. Overall, we demonstrate that stellar and AGN feedback are intimately interwoven, especially at low redshift, due to subgrid implementation, resulting in halo property effects that might initially seem counterintuitive., Comment: 28 pages, 8 figures, submitted to ApJ

We present a study on the inference of cosmological and astrophysical parameters using stacked galaxy cluster profiles. Utilizing the CAMELS-zoomGZ simulations, we explore how various cluster properties--such as X-ray surface brightness, gas density, temperature, metallicity, and Compton-y profiles--can be used to predict parameters within the 28-dimensional parameter space of the IllustrisTNG model. Through neural networks, we achieve a high correlation coefficient of 0.97 or above for all cosmological parameters, including $\Omega_{\rm m}$, $H_0$, and $\sigma_8$, and over 0.90 for the remaining astrophysical parameters, showcasing the effectiveness of these profiles for parameter inference. We investigate the impact of different radial cuts, with bins ranging from $0.1R_{200c}$ to $0.7R_{200c}$, to simulate current observational constraints. Additionally, we perform a noise sensitivity analysis, adding up to 40\% Gaussian noise (corresponding to signal-to-noise ratios as low as 2.5), revealing that key parameters such as $\Omega_{\rm m}$, $H_0$, and the IMF slope remain robust even under extreme noise conditions. We also compare the performance of full radial profiles against integrated quantities, finding that profiles generally lead to more accurate parameter inferences. Our results demonstrate that stacked galaxy cluster profiles contain crucial information on both astrophysical processes within groups and clusters and the underlying cosmology of the universe. This underscores their significance for interpreting the complex data expected from next-generation surveys and reveals, for the first time, their potential as a powerful tool for parameter inference., Comment: Submitted to ApJ

We test the robustness of simulation-based inference (SBI) in the context of cosmological parameter estimation from galaxy cluster counts and masses in simulated optical datasets. We construct ``simulations'' using analytical models for the galaxy cluster halo mass function (HMF) and for the observed richness (number of observed member galaxies) to train and test the SBI method. We compare the SBI parameter posterior samples to those from an MCMC analysis that uses the same analytical models to construct predictions of the observed data vector. The two methods exhibit comparable performance, with reliable constraints derived for the primary cosmological parameters, ($\Omega_m$ and $\sigma_8$), and richness-mass relation parameters. We also perform out-of-domain tests with observables constructed from galaxy cluster-sized halos in the Quijote simulations. Again, the SBI and MCMC results have comparable posteriors, with similar uncertainties and biases. Unsurprisingly, upon evaluating the SBI method on thousands of simulated data vectors that span the parameter space, SBI exhibits worsened posterior calibration metrics in the out-of-domain application. We note that such calibration tests with MCMC is less computationally feasible and highlight the potential use of SBI to stress-test limitations of analytical models, such as in the use for constructing models for inference with MCMC.

To maximize the amount of information extracted from cosmological datasets, simulations that accurately represent these observations are necessary. However, traditional simulations that evolve particles under gravity by estimating particle-particle interactions (N-body simulations) are computationally expensive and prohibitive to scale to the large volumes and resolutions necessary for the upcoming datasets. Moreover, modeling the distribution of galaxies typically involves identifying virialized dark matter halos, which is also a time- and memory-consuming process for large N-body simulations, further exacerbating the computational cost. In this study, we introduce CHARM, a novel method for creating mock halo catalogs by matching the spatial, mass, and velocity statistics of halos directly from the large-scale distribution of the dark matter density field. We develop multi-stage neural spline flow-based networks to learn this mapping at redshift z=0.5 directly with computationally cheaper low-resolution particle mesh simulations instead of relying on the high-resolution N-body simulations. We show that the mock halo catalogs and painted galaxy catalogs have the same statistical properties as obtained from $N$-body simulations in both real space and redshift space. Finally, we use these mock catalogs for cosmological inference using redshift-space galaxy power spectrum, bispectrum, and wavelet-based statistics using simulation-based inference, performing the first inference with accelerated forward model simulations and finding unbiased cosmological constraints with well-calibrated posteriors. The code was developed as part of the Simons Collaboration on Learning the Universe and is publicly available at \url{https://github.com/shivampcosmo/CHARM}., Comment: 12 pages and 8 figures. This is a Learning the Universe Publication

The connection between galaxies and their host dark matter (DM) halos is critical to our understanding of cosmology, galaxy formation, and DM physics. To maximize the return of upcoming cosmological surveys, we need an accurate way to model this complex relationship. Many techniques have been developed to model this connection, from Halo Occupation Distribution (HOD) to empirical and semi-analytic models to hydrodynamic. Hydrodynamic simulations can incorporate more detailed astrophysical processes but are computationally expensive; HODs, on the other hand, are computationally cheap but have limited accuracy. In this work, we present NeHOD, a generative framework based on variational diffusion model and Transformer, for painting galaxies/subhalos on top of DM with an accuracy of hydrodynamic simulations but at a computational cost similar to HOD. By modeling galaxies/subhalos as point clouds, instead of binning or voxelization, we can resolve small spatial scales down to the resolution of the simulations. For each halo, NeHOD predicts the positions, velocities, masses, and concentrations of its central and satellite galaxies. We train NeHOD on the TNG-Warm DM suite of the DREAMS project, which consists of 1024 high-resolution zoom-in hydrodynamic simulations of Milky Way-mass halos with varying warm DM mass and astrophysical parameters. We show that our model captures the complex relationships between subhalo properties as a function of the simulation parameters, including the mass functions, stellar-halo mass relations, concentration-mass relations, and spatial clustering. Our method can be used for a large variety of downstream applications, from galaxy clustering to strong lensing studies., Comment: Submitted to ApJ; 30 + 6 pages; 11 + 4 figures; Comments welcomed

We present a field-level emulator for large-scale structure, capturing the cosmology dependence and the time evolution of cosmic structure formation. The emulator maps linear displacement fields to their corresponding nonlinear displacements from N-body simulations at specific redshifts. Designed as a neural network, the emulator incorporates style parameters that encode dependencies on $\Omega_{\rm m}$ and the linear growth factor $D(z)$ at redshift $z$. We train our model on the six-dimensional N-body phase space, predicting particle velocities as the time derivative of the model's displacement outputs. This innovation results in significant improvements in training efficiency and model accuracy. Tested on diverse cosmologies and redshifts not seen during training, the emulator achieves percent-level accuracy on scales of $k\sim~1~{\rm Mpc}^{-1}~h$ at $z=0$, with improved performance at higher redshifts. We compare predicted structure formation histories with N-body simulations via merger trees, finding consistent merger event sequences and statistical properties.

We present the first application of the Wavelet Scattering Transform (WST) in order to constrain the nature of gravity using the three-dimensional (3D) large-scale structure of the universe. Utilizing the Quijote-MG N-body simulations, we can reliably model the 3D matter overdensity field for the f(R) Hu-Sawicki modified gravity (MG) model down to $k_{\rm max}=0.5$ h/Mpc. Combining these simulations with the Quijote $\nu$CDM collection, we then conduct a Fisher forecast of the marginalized constraints obtained on gravity using the WST coefficients and the matter power spectrum at redshift z=0. Our results demonstrate that the WST substantially improves upon the 1$\sigma$ error obtained on the parameter that captures deviations from standard General Relativity (GR), yielding a tenfold improvement compared to the corresponding matter power spectrum result. At the same time, the WST also enhances the precision on the $\Lambda$CDM parameters and the sum of neutrino masses, by factors of 1.2-3.4 compared to the matter power spectrum, respectively. Despite the overall reduction in the WST performance when we focus on larger scales, it still provides a relatively $4.5\times$ tighter 1$\sigma$ error for the MG parameter at $k_{\rm max}=0.2$ h/Mpc, highlighting its great sensitivity to the underlying gravity theory. This first proof-of-concept study reaffirms the constraining properties of the WST technique and paves the way for exciting future applications in order to perform precise large-scale tests of gravity with the new generation of cutting-edge cosmological data., Comment: 19 pages, 15 figures, 1 table

We present the results of a set of cosmological N-body simulations with standard $\Lambda$CDM cosmology but characterized by a scale-dependent primordial non-Gaussianity of the local type featuring a power-law dependence of the $f_{\rm NL}^{\rm loc}(k)$ at large scales followed by a saturation to a constant value at smaller scales where non-linear growth leads to the formation of collapsed cosmic structures. Such models are built to ensure consistency with current Cosmic Microwave Background bounds on primordial non-Gaussianity yet allowing for large effects of the non-Gaussian statistics on the properties of non-linear structure formation. We show the impact of such scale-dependent non-Gaussian scenarios on a wide range of properties of the resulting cosmic structures, such as the non-linear matter power spectrum, the halo and sub-halo mass functions, the concentration-mass relation, the halo and void density profiles, and we highlight for the first time that some of these models might mimic the effects of Warm Dark Matter for several of such observables, Comment: 21 pages, 9 figures, 2 tables; to be submitted to JCAP

Whilst current observational evidence favors a close-to-Gaussian spectrum of primordial perturbations, there exist many models of the early Universe that predict this distribution to have exponentially enhanced or suppressed tails. In this work, we generate realizations of the primordial potential with non-Gaussian tails via a phenomenological model; these are then evolved numerically to obtain maps of the cosmic microwave background (CMB) and large-scale structure (LSS). In the CMB maps, our added non-Gaussianity manifests as a localized enhancement of hot and cold spots, which would be expected to contribute to $N$-point functions up to large $N$. Such models are indirectly constrained by \textit{Planck} trispectrum bounds, which restrict the changes in the temperature fluctuations to $O(10\mu\mathrm{K})$. In the late-time Universe, we find that tailed cosmologies lead to a halo mass function enhanced at high masses, as expected. Furthermore, significant scale-dependent bias in the halo-halo and halo-matter power spectrum is also sourced, which arises from the squeezed limit of large $N$-point functions that are implicitly generated through the enhancement of the tails. These results underscore that a detection of scale-dependent bias alone cannot be used to rule out single field inflation, but can be used together with other statistics to probe a wide range of primordial processes., Comment: Comments welcome!

We train a novel deep learning architecture to perform likelihood-free inference on the value of the cosmological parameters from halo catalogs of the Quijote N-body simulations. Our model takes as input a halo catalog where each halo is characterized by its position, mass, and velocity moduli. By construction, our model is E(3) invariant and is designed to extract information hierarchically. Unlike graph neural networks, it does not require the transformation of the input halo (or galaxy) catalog into a graph. Given its simplicity, our model can process point clouds with large numbers of points. We discuss the advantages of this class of methods but also point out its limitations and potential ways to improve them for cosmological data., Comment: Submitted to ApJ

Optimal extraction of cosmological information from observations of the Cosmic Microwave Background critically relies on our ability to accurately undo the distortions caused by weak gravitational lensing. In this work, we demonstrate the use of denoising diffusion models in performing Bayesian lensing reconstruction. We show that score-based generative models can produce accurate, uncorrelated samples from the CMB lensing convergence map posterior, given noisy CMB observations. To validate our approach, we compare the samples of our model to those obtained using established Hamiltonian Monte Carlo methods, which assume a Gaussian lensing potential. We then go beyond this assumption of Gaussianity, and train and validate our model on non-Gaussian lensing data, obtained by ray-tracing N-body simulations. We demonstrate that in this case, samples from our model have accurate non-Gaussian statistics beyond the power spectrum. The method provides an avenue towards more efficient and accurate lensing reconstruction, that does not rely on an approximate analytic description of the posterior probability. The reconstructed lensing maps can be used as an unbiased tracer of the matter distribution, and to improve delensing of the CMB, resulting in more precise cosmological parameter inference., Comment: 12 pages, 10 figures. v2: typo in one of the equations fixed, references added

We introduce the DREAMS project, an innovative approach to understanding the astrophysical implications of alternative dark matter models and their effects on galaxy formation and evolution. The DREAMS project will ultimately comprise thousands of cosmological hydrodynamic simulations that simultaneously vary over dark matter physics, astrophysics, and cosmology in modeling a range of systems -- from galaxy clusters to ultra-faint satellites. Such extensive simulation suites can provide adequate training sets for machine-learning-based analyses. This paper introduces two new cosmological hydrodynamical suites of Warm Dark Matter, each comprised of 1024 simulations generated using the Arepo code. One suite consists of uniform-box simulations covering a $(25~h^{-1}~{\rm M}_\odot)^3$ volume, while the other consists of Milky Way zoom-ins with sufficient resolution to capture the properties of classical satellites. For each simulation, the Warm Dark Matter particle mass is varied along with the initial density field and several parameters controlling the strength of baryonic feedback within the IllustrisTNG model. We provide two examples, separately utilizing emulators and Convolutional Neural Networks, to demonstrate how such simulation suites can be used to disentangle the effects of dark matter and baryonic physics on galactic properties. The DREAMS project can be extended further to include different dark matter models, galaxy formation physics, and astrophysical targets. In this way, it will provide an unparalleled opportunity to characterize uncertainties on predictions for small-scale observables, leading to robust predictions for testing the particle physics nature of dark matter on these scales., Comment: 28 pages, 8 figures, DREAMS website: https://www.dreams-project.org

Galaxies are biased tracers of the underlying cosmic web, which is dominated by dark matter components that cannot be directly observed. Galaxy formation simulations can be used to study the relationship between dark matter density fields and galaxy distributions. However, this relationship can be sensitive to assumptions in cosmology and astrophysical processes embedded in the galaxy formation models, that remain uncertain in many aspects. In this work, we develop a diffusion generative model to reconstruct dark matter fields from galaxies. The diffusion model is trained on the CAMELS simulation suite that contains thousands of state-of-the-art galaxy formation simulations with varying cosmological parameters and sub-grid astrophysics. We demonstrate that the diffusion model can predict the unbiased posterior distribution of the underlying dark matter fields from the given stellar mass fields, while being able to marginalize over uncertainties in cosmological and astrophysical models. Interestingly, the model generalizes to simulation volumes approximately 500 times larger than those it was trained on, and across different galaxy formation models. Code for reproducing these results can be found at https://github.com/victoriaono/variational-diffusion-cdm

Galaxy formation models within cosmological hydrodynamical simulations contain numerous parameters with non-trivial influences over the resulting properties of simulated cosmic structures and galaxy populations. It is computationally challenging to sample these high dimensional parameter spaces with simulations, particularly for halos in the high-mass end of the mass function. In this work, we develop a novel sampling and reduced variance regression method, CARPoolGP, which leverages built-in correlations between samples in different locations of high dimensional parameter spaces to provide an efficient way to explore parameter space and generate low variance emulations of summary statistics. We use this method to extend the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) to include a set of 768 zoom-in simulations of halos in the mass range of $10^{13} - 10^{14.5} M_\odot\,h^{-1}$ that span a 28-dimensional parameter space in the IllustrisTNG model. With these simulations and the CARPoolGP emulation method, we explore parameter trends in the Compton $Y-M$, black hole mass-halo mass, and metallicity-mass relations, as well as thermodynamic profiles and quenched fractions of satellite galaxies. We use these emulations to provide a physical picture of the complex interplay between supernova and active galactic nuclei feedback. We then use emulations of the $Y-M$ relation of massive halos to perform Fisher forecasts on astrophysical parameters for future Sunyaev-Zeldovich observations and find a significant improvement in forecasted constraints. We publicly release both the simulation suite and CARPoolGP software package., Comment: The manuscript was submitted to arxiv after receiving and responding to comments from the first referee report

Most diffuse baryons, including the circumgalactic medium (CGM) surrounding galaxies and the intergalactic medium (IGM) in the cosmic web, remain unmeasured and unconstrained. Fast Radio Bursts (FRBs) offer an unparalleled method to measure the electron dispersion measures (DMs) of ionized baryons. Their distribution can resolve the missing baryon problem, and constrain the history of feedback theorized to impart significant energy to the CGM and IGM. We analyze the Cosmology and Astrophysics in Machine Learning (CAMEL) Simulations, using three suites: IllustrisTNG, SIMBA, and Astrid, each varying 6 parameters (2 cosmological & 4 astrophysical feedback), for a total of 183 distinct simulation models. We find significantly different predictions between the fiducial models of the suites, owing to their different implementations of feedback. SIMBA exhibits the strongest feedback, leading to the smoothest distribution of baryons, reducing the sightline-to-sightline variance in DMs between z=0-1. Astrid has the weakest feedback and the largest variance. We calculate FRB CGM measurements as a function of galaxy impact parameter, with SIMBA showing the weakest DMs due to aggressive AGN feedback and Astrid the strongest. Within each suite, the largest differences are due to varying AGN feedback. IllustrisTNG shows the most sensitivity to supernova feedback, but this is due to the change in the AGN feedback strengths, demonstrating that black holes, not stars, are most capable of redistributing baryons in the IGM and CGM. We compare our statistics directly to recent observations, paving the way for the use of FRBs to constrain the physics of galaxy formation and evolution., Comment: 15 pages, 7 figures, Accepted to ApJ

We apply a suite of different estimators to the Quijote-PNG halo catalogues to find the best approach to constrain Primordial non-Gaussianity (PNG) at non-linear cosmological scales, up to $k_{\rm max} = 0.5 \, h\,{\rm Mpc}^{-1}$. The set of summary statistics considered in our analysis includes the power spectrum, bispectrum, halo mass function, marked power spectrum, and marked modal bispectrum. Marked statistics are used here for the first time in the context of PNG study. We perform a Fisher analysis to estimate their cosmological information content, showing substantial improvements when marked observables are added to the analysis. Starting from these summaries, we train deep neural networks (NN) to perform likelihood-free inference of cosmological and PNG parameters. We assess the performance of different subsets of summary statistics; in the case of $f_\mathrm{NL}^\mathrm{equil}$, we find that a combination of the power spectrum and a suitable marked power spectrum outperforms the combination of power spectrum and bispectrum, the baseline statistics usually employed in PNG analysis. A minimal pipeline to analyse the statistics we identified can be implemented either with our ML algorithm or via more traditional estimators, if these are deemed more reliable., Comment: 13 pages, 10 figures

We demonstrate the use of deep network to learn the distribution of data from state-of-the-art hydrodynamic simulations of the CAMELS project. To this end, we train a generative adversarial network to generate images composed of three different channels that represent gas density (Mgas), neutral hydrogen density (HI), and magnetic field amplitudes (B). We consider an unconstrained model and another scenario where the model is conditioned on the matter density $\Omega_{\rm m}$ and the amplitude of density fluctuations $\sigma_{8}$. We find that the generated images exhibit great quality which is on a par with that of data, visually. Quantitatively, we find that our model generates maps whose statistical properties, quantified by probability distribution function of pixel values and auto-power spectra, agree reasonably well with those of the real maps. Moreover, the cross-correlations between fields in all maps produced by the emulator are in good agreement with those of the real images, which indicates that our model generates instances whose maps in all three channels describe the same physical region. Furthermore, a CNN regressor, which has been trained to extract $\Omega_{\rm m}$ and $\sigma_{8}$ from CAMELS multifield dataset, recovers the cosmology from the maps generated by our conditional model, achieving $R^{2}$ = 0.96 and 0.83 corresponding to $\Omega_{\rm m}$ and $\sigma_{8}$ respectively. This further demonstrates the great capability of the model to mimic CAMELS data. Our model can be useful for generating data that are required to analyze the information from upcoming multi-wavelength cosmological surveys., Comment: 18 pages, 10 figures, 1 table

We study the impact of warm dark matter mass on the internal properties of individual galaxies using a large suite of 1,024 state-of-the-art cosmological hydrodynamic simulations from the DREAMS project. We take individual galaxies' properties from the simulations, which have different cosmologies, astrophysics, and warm dark matter masses, and train normalizing flows to learn the posterior of the parameters. We find that our models cannot infer the value of the warm dark matter mass, even when the values of the cosmological and astrophysical parameters are given explicitly. This result holds for galaxies with stellar mass larger than $2\times10^8 M_\odot/h$ at both low and high redshifts. We calculate the mutual information and find no significant dependence between the WDM mass and galaxy properties. On the other hand, our models can infer the value of $\Omega_{\rm m}$ with a $\sim10\%$ accuracy from the properties of individual galaxies while marginalizing astrophysics and warm dark matter masses., Comment: 13 pages, 8 figures

We develop a new and simple method to model baryonic effects at the field level relevant for weak lensing analyses. We analyze thousands of state-of-the-art hydrodynamic simulations from the CAMELS project, each with different cosmology and strength of feedback, and we find that the cross-correlation coefficient between full hydrodynamic and N-body simulations is very close to 1 down to $k\sim10~h{\rm Mpc}^{-1}$. This suggests that modeling baryonic effects at the field level down to these scales only requires N-body simulations plus a correction to the mode's amplitude given by: $\sqrt{P_{\rm hydro}(k)/P_{\rm nbody}(k)}$. In this paper, we build an emulator for this quantity, using Gaussian processes, that is flexible enough to reproduce results from thousands of hydrodynamic simulations that have different cosmologies, astrophysics, subgrid physics, volumes, resolutions, and at different redshifts. Our emulator is accurate at the percent level and exhibits a range of validation superior to previous studies. This method and our emulator enable field-level simulation-based inference analyses and accounting for baryonic effects in weak lensing analyses., Comment: 12 pages, 9 figures. Comments welcome

Primordial non-Gaussianity of the local type induces a strong scale-dependent bias on the clustering of halos in the late-time Universe. This signature is particularly promising to provide constraints on the non-Gaussianity parameter $f_{\rm NL}$ from galaxy surveys, as the bias amplitude grows with scale and becomes important on large, linear scales. However, there is a well-known degeneracy between the real prize, the $f_{\rm NL}$ parameter, and the (non-Gaussian) assembly bias i.e., the halo formation history-dependent contribution to the amplitude of the signal, which could seriously compromise the ability of large-scale structure surveys to constrain $f_{\rm NL}$. We show how the assembly bias can be modeled and constrained, thus almost completely recovering the power of galaxy surveys to competitively constrain primordial non-Gaussianity. In particular, studying hydrodynamical simulations, we find that a proxy for the halo properties that determine assembly bias can be constructed from photometric properties of galaxies. Using a prior on the assembly bias guided by this proxy degrades the statistical errors on $f_{\rm NL}$ only mildly compared to an ideal case where the assembly bias is perfectly known. The systematic error on $f_{\rm NL}$ that the proxy induces can be safely kept under control., Comment: 30 pages, 13 figures. v2: minor updates to match accepted version

Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics implementation and numerical approximations across different simulation suites, models trained on data from one cosmological simulation show a drop in performance when tested on another. Similarly, models trained on any of the simulations would also likely experience a drop in performance when applied to observational data. Training on data from two different suites of the CAMELS hydrodynamic cosmological simulations, we examine the generalization capabilities of Domain Adaptive Graph Neural Networks (DA-GNNs). By utilizing GNNs, we capitalize on their capacity to capture structured scale-free cosmological information from galaxy distributions. Moreover, by including unsupervised domain adaptation via Maximum Mean Discrepancy (MMD), we enable our models to extract domain-invariant features. We demonstrate that DA-GNN achieves higher accuracy and robustness on cross-dataset tasks (up to $28\%$ better relative error and up to almost an order of magnitude better $\chi^2$). Using data visualizations, we show the effects of domain adaptation on proper latent space data alignment. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information, a vital step toward robust deep learning for real cosmic survey data., Comment: Accepted in Machine Learning and the Physical Sciences Workshop at NeurIPS 2023; 9 pages, 2 figures, 1 table

Intensity mapping experiments are beginning to measure the spatial distribution of neutral atomic hydrogen (HI) to constrain cosmological parameters and the large-scale distribution of matter. However, models of the behaviour of HI as a tracer of matter are complicated by galaxy evolution. In this work, we examine the clustering of HI in relation to galaxy colour, stellar mass, and HI mass in IllustrisTNG at $z$ = 0, 0.5, and 1. We compare the HI-red and HI-blue galaxy cross-power spectra, finding that HI-red has an amplitude 1.5 times higher than HI-blue at large scales. The cross-power spectra intersect at $\approx 3$ Mpc in real space and $\approx 10$ Mpc in redshift space, consistent with $z \approx 0$ observations. We show that HI clustering increases with galaxy HI mass and depends weakly on detection limits in the range $M_{\mathrm{HI}} \leq 10^8 M_\odot$. In terms of $M_\star$, we find blue galaxies in the greatest stellar mass bin cluster more than blue galaxies in other stellar mass bins. Red galaxies in the greatest stellar mass bin, however, cluster the weakest amongst red galaxies. These trends arise due to central-satellite compositions. Centrals correlate less with HI for increasing stellar mass, whereas satellites correlate more, irrespective of colour. Despite the clustering relationships with stellar mass, we find that the cross-power spectra are largely insensitive to detection limits in HI and galaxy surveys. Counter-intuitively, all auto and cross-power spectra for red and blue galaxies and HI decrease with time at all scales in IllustrisTNG. We demonstrate that processes associated with quenching contribute to this trend. The complex interplay between HI and galaxies underscores the importance of understanding baryonic effects when interpreting the large-scale clustering of HI, blue, and red galaxies at $z \leq 1$., Comment: 16 pages, 11 figures

It has been recently shown that a powerful way to constrain cosmological parameters from galaxy redshift surveys is to train graph neural networks to perform field-level likelihood-free inference without imposing cuts on scale. In particular, de Santi et al. (2023) developed models that could accurately infer the value of $\Omega_{\rm m}$ from catalogs that only contain the positions and radial velocities of galaxies that are robust to uncertainties in astrophysics and subgrid models. However, observations are affected by many effects, including 1) masking, 2) uncertainties in peculiar velocities and radial distances, and 3) different galaxy selections. Moreover, observations only allow us to measure redshift, intertwining galaxies' radial positions and velocities. In this paper we train and test our models on galaxy catalogs, created from thousands of state-of-the-art hydrodynamic simulations run with different codes from the CAMELS project, that incorporate these observational effects. We find that, although the presence of these effects degrades the precision and accuracy of the models, and increases the fraction of catalogs where the model breaks down, the fraction of galaxy catalogs where the model performs well is over 90 %, demonstrating the potential of these models to constrain cosmological parameters even when applied to real data., Comment: 39 pages, 25 figures. For the reference in the abstract (de Santi et al. 2023) see arXiv:2302.14101

We present the first cosmological constraints using only the observed photometry of galaxies. Villaescusa-Navarro et al. (2022; arXiv:2201.02202) recently demonstrated that the internal physical properties of a single simulated galaxy contain a significant amount of cosmological information. These physical properties, however, cannot be directly measured from observations. In this work, we present how we can go beyond theoretical demonstrations to infer cosmological constraints from actual galaxy observables (e.g. optical photometry) using neural density estimation and the CAMELS suite of hydrodynamical simulations. We find that the cosmological information in the photometry of a single galaxy is limited. However, we combine the constraining power of photometry from many galaxies using hierarchical population inference and place significant cosmological constraints. With the observed photometry of $\sim$20,000 NASA-Sloan Atlas galaxies, we constrain $\Omega_m = 0.323^{+0.075}_{-0.095}$ and $\sigma_8 = 0.799^{+0.088}_{-0.085}$., Comment: 15 pages, 7 figures, submitted to ApJL, comments welcome

Recent works have discovered a relatively tight correlation between $\Omega_{\rm m}$ and properties of individual simulated galaxies. Because of this, it has been shown that constraints on $\Omega_{\rm m}$ can be placed using the properties of individual galaxies while accounting for uncertainties on astrophysical processes such as feedback from supernova and active galactic nuclei. In this work, we quantify whether using the properties of multiple galaxies simultaneously can tighten those constraints. For this, we train neural networks to perform likelihood-free inference on the value of two cosmological parameters ($\Omega_{\rm m}$ and $\sigma_8$) and four astrophysical parameters using the properties of several galaxies from thousands of hydrodynamic simulations of the CAMELS project. We find that using properties of more than one galaxy increases the precision of the $\Omega_{\rm m}$ inference. Furthermore, using multiple galaxies enables the inference of other parameters that were poorly constrained with one single galaxy. We show that the same subset of galaxy properties are responsible for the constraints on $\Omega_{\rm m}$ from one and multiple galaxies. Finally, we quantify the robustness of the model and find that without identifying the model range of validity, the model does not perform well when tested on galaxies from other galaxy formation models., Comment: 13 pages, 7 figures

The circum-galactic medium (CGM) can feasibly be mapped by multiwavelength surveys covering broad swaths of the sky. With multiple large datasets becoming available in the near future, we develop a likelihood-free Deep Learning technique using convolutional neural networks (CNNs) to infer broad-scale physical properties of a galaxy's CGM and its halo mass for the first time. Using CAMELS (Cosmology and Astrophysics with MachinE Learning Simulations) data, including IllustrisTNG, SIMBA, and Astrid models, we train CNNs on Soft X-ray and 21-cm (HI) radio 2D maps to trace hot and cool gas, respectively, around galaxies, groups, and clusters. Our CNNs offer the unique ability to train and test on ''multifield'' datasets comprised of both HI and X-ray maps, providing complementary information about physical CGM properties and improved inferences. Applying eRASS:4 survey limits shows that X-ray is not powerful enough to infer individual halos with masses $\log(M_{\rm{halo}}/M_{\odot}) < 12.5$. The multifield improves the inference for all halo masses. Generally, the CNN trained and tested on Astrid (SIMBA) can most (least) accurately infer CGM properties. Cross-simulation analysis -- training on one galaxy formation model and testing on another -- highlights the challenges of developing CNNs trained on a single model to marginalize over astrophysical uncertainties and perform robust inferences on real data. The next crucial step in improving the resulting inferences on physical CGM properties hinges on our ability to interpret these deep-learning models.

Upcoming emission-line spectroscopic surveys, such as Euclid and the Roman Space Telescope, will be affected by systematic effects due to the presence of interlopers: galaxies whose redshift and distance from us are miscalculated due to line confusion in their emission spectra. Particularly pernicious are interlopers involving the confusion between two lines with close emitted wavelengths, like H$\beta$ emitters confused as \oiii, since those are strongly spatially correlated with the target galaxies. They introduce a particular pattern in the 3D distribution of the observed galaxy catalog that can shift the position of the BAO peak in the galaxy correlation function and bias any cosmological analysis performed with that sample. Here we present a novel method to predict the fraction of interlopers in a galaxy catalog, using Graph Neural Networks (GNNs) to learn the posterior distribution of the interloper fraction while marginalizing over cosmology and galaxy bias. The method is developed using simulations with halos acting as a proxy for galaxies. The GNN can infer the mean and standard deviation of the posterior distribution of interloper fraction using small-scale information that is usually not considered in cosmological analyses. The injection of large-scale information into the graph as a global attribute improves the performance of the GNN when marginalizing over cosmology., Comment: 19 pages, 7 figures

Forward-modeling observables from galaxy simulations enables direct comparisons between theory and observations. To generate synthetic spectral energy distributions (SEDs) that include dust absorption, re-emission, and scattering, Monte Carlo radiative transfer is often used in post-processing on a galaxy-by-galaxy basis. However, this is computationally expensive, especially if one wants to make predictions for suites of many cosmological simulations. To alleviate this computational burden, we have developed a radiative transfer emulator using an artificial neural network (ANN), ANNgelina, that can reliably predict SEDs of simulated galaxies using a small number of integrated properties of the simulated galaxies: star formation rate, stellar and dust masses, and mass-weighted metallicities of all star particles and of only star particles with age <10 Myr. Here, we present the methodology and quantify the accuracy of the predictions. We train the ANN on SEDs computed for galaxies from the IllustrisTNG project's TNG50 cosmological magnetohydrodynamical simulation. ANNgelina is able to predict the SEDs of TNG50 galaxies in the ultraviolet (UV) to millimetre regime with a typical median absolute error of ~7 per cent. The prediction error is the greatest in the UV, possibly due to the viewing-angle dependence being greatest in this wavelength regime. Our results demonstrate that our ANN-based emulator is a promising computationally inexpensive alternative for forward-modeling galaxy SEDs from cosmological simulations.

We quantify the cosmological spread of baryons relative to their initial neighboring dark matter distribution using thousands of state-of-the-art simulations from the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) project. We show that dark matter particles spread relative to their initial neighboring distribution owing to chaotic gravitational dynamics on spatial scales comparable to their host dark matter halo. In contrast, gas in hydrodynamic simulations spreads much further from the initial neighboring dark matter owing to feedback from supernovae (SNe) and Active Galactic Nuclei (AGN). We show that large-scale baryon spread is very sensitive to model implementation details, with the fiducial \textsc{SIMBA} model spreading $\sim$40\% of baryons $>$1\,Mpc away compared to $\sim$10\% for the IllustrisTNG and \textsc{ASTRID} models. Increasing the efficiency of AGN-driven outflows greatly increases baryon spread while increasing the strength of SNe-driven winds can decrease spreading due to non-linear coupling of stellar and AGN feedback. We compare total matter power spectra between hydrodynamic and paired $N$-body simulations and demonstrate that the baryonic spread metric broadly captures the global impact of feedback on matter clustering over variations of cosmological and astrophysical parameters, initial conditions, and galaxy formation models. Using symbolic regression, we find a function that reproduces the suppression of power by feedback as a function of wave number ($k$) and baryonic spread up to $k \sim 10\,h$\,Mpc$^{-1}$ while highlighting the challenge of developing models robust to variations in galaxy formation physics implementation., Comment: 17 pages, 15 figures

Using a large sample of galaxies taken from the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) project, a suite of hydrodynamic simulations varying both cosmological and astrophysical parameters, we train a normalizing flow (NF) to map the probability of various galaxy and halo properties conditioned on astrophysical and cosmological parameters. By leveraging the learnt conditional relationships we can explore a wide range of interesting questions, whilst enabling simple marginalisation over nuisance parameters. We demonstrate how the model can be used as a generative model for arbitrary values of our conditional parameters; we generate halo masses and matched galaxy properties, and produce realisations of the halo mass function as well as a number of galaxy scaling relations and distribution functions. The model represents a unique and flexible approach to modelling the galaxy-halo relationship., Comment: 8 pages, 2 figures, accepted for ICML 2023 Workshop on Machine Learning for Astrophysics

What would a parity-violating universe look like? We present a numerical and theoretical study of mirror asymmetries in the late universe, using a new suite of $N$-body simulations: QUIJOTE-Odd. These feature parity-violating initial conditions, injected via a simple ansatz for the imaginary primordial trispectrum and evolved into the non-linear regime. We find that the realization-averaged power spectrum, bispectrum, halo mass function, and matter PDF are not affected by our modifications to the initial conditions, deep into the non-linear regime, which we argue arises from rotational and translational invariance. In contrast, the parity-odd trispectrum of matter (measured using a new estimator), shows distinct signatures proportional to the parity-violating parameter, $p_{\rm NL}$, which sets the amplitude of the primordial trispectrum. We additionally find intriguing signatures in the angular momentum of halos, with the primordial trispectrum inducing a non-zero correlation between angular momentum and smoothed velocity field, proportional to $p_{\rm NL}$. Our simulation suite has been made public to facilitate future analyses., Comment: 19 pages, 9 figures. Simulations available at https://quijote-simulations.readthedocs.io/en/latest/odd.html

We study signatures of primordial non-Gaussianity (PNG) in the redshift-space halo field on non-linear scales, using a combination of three summary statistics, namely the halo mass function (HMF), power spectrum, and bispectrum. The choice of adding the HMF to our previous joint analysis of power spectrum and bispectrum is driven by a preliminary field-level analysis, in which we train graph neural networks on halo catalogues to infer the PNG $f_\mathrm{NL}$ parameter. The covariance matrix and the responses of our summaries to changes in model parameters are extracted from a suite of halo catalogues constructed from the Quijote-PNG N-body simulations. We consider the three main types of PNG: local, equilateral and orthogonal. Adding the HMF to our previous joint analysis of power spectrum and bispectrum produces two main effects. First, it reduces the equilateral $f_\mathrm{NL}$ predicted errors by roughly a factor $2$, while also producing notable, although smaller, improvements for orthogonal PNG. Second, it helps break the degeneracy between the local PNG amplitude, $f_\mathrm{NL}^\mathrm{local}$, and assembly bias, $b_{\phi}$, without relying on any external prior assumption. Our final forecasts for PNG parameters are $\Delta f_\mathrm{NL}^\mathrm{local} = 40$, $\Delta f_\mathrm{NL}^\mathrm{equil} = 210$, $\Delta f_\mathrm{NL}^\mathrm{ortho} = 91$, on a cubic volume of $1 \left(h^{-1}{\rm Gpc}\right)^3$, with a halo number density of $\bar{n}\sim 5.1 \times 10^{-5}~h^3\mathrm{Mpc}^{-3}$, at $z = 1$, and considering scales up to $k_\mathrm{max} = 0.5~h\,\mathrm{Mpc}^{-1}$., Comment: 17 pages, 11 figures. v3 (minor caption fix)

We present a new suite of over 1,500 cosmological N-body simulations with varied Warm Dark Matter (WDM) models ranging from 2.5 to 30 keV. We use these simulations to train Convolutional Neural Networks (CNNs) to infer WDM particle masses from images of DM field data. Our fiducial setup can make accurate predictions of the WDM particle mass up to 7.5 keV at a 95% confidence level from small maps that cover an area of (25 h$^{-1}$ Mpc)$^2$. We vary the image resolution, simulation resolution, redshift, and cosmology of our fiducial setup to better understand how our model is making predictions. Using these variations, we find that our models are most dependent on simulation resolution, minimally dependent on image resolution, not systematically dependent on redshift, and robust to varied cosmologies. We also find that an important feature to distinguish between WDM models is present with a linear size between 100 and 200 h$^{-1}$ kpc. We compare our fiducial model to one trained on the power spectrum alone and find that our field-level model can make 2x more precise predictions and can make accurate predictions to 2x as massive WDM particle masses when used on the same data. Overall, we find that the field-level data can be used to accurately differentiate between WDM models and contain more information than is captured by the power spectrum. This technique can be extended to more complex DM models and opens up new opportunities to explore alternative DM models in a cosmological environment., Comment: 16 pages, 12 figures

Recent work has pointed out the potential existence of a tight relation between the cosmological parameter $\Omega_{\rm m}$, at fixed $\Omega_{\rm b}$, and the properties of individual galaxies in state-of-the-art cosmological hydrodynamic simulations. In this paper, we investigate whether such a relation also holds for galaxies from simulations run with a different code that made use of a distinct subgrid physics: Astrid. We find that also in this case, neural networks are able to infer the value of $\Omega_{\rm m}$ with a $\sim10\%$ precision from the properties of individual galaxies while accounting for astrophysics uncertainties as modeled in CAMELS. This tight relationship is present at all considered redshifts, $z\leq3$, and the stellar mass, the stellar metallicity, and the maximum circular velocity are among the most important galaxy properties behind the relation. In order to use this method with real galaxies, one needs to quantify its robustness: the accuracy of the model when tested on galaxies generated by codes different from the one used for training. We quantify the robustness of the models by testing them on galaxies from four different codes: IllustrisTNG, SIMBA, Astrid, and Magneticum. We show that the models perform well on a large fraction of the galaxies, but fail dramatically on a small fraction of them. Removing these outliers significantly improves the accuracy of the models across simulation codes., Comment: 16 pages, 12 figures

We present CAMELS-ASTRID, the third suite of hydrodynamical simulations in the Cosmology and Astrophysics with MachinE Learning (CAMELS) project, along with new simulation sets that extend the model parameter space based on the previous frameworks of CAMELS-TNG and CAMELS-SIMBA, to provide broader training sets and testing grounds for machine-learning algorithms designed for cosmological studies. CAMELS-ASTRID employs the galaxy formation model following the ASTRID simulation and contains 2,124 hydrodynamic simulation runs that vary 3 cosmological parameters ($\Omega_m$, $\sigma_8$, $\Omega_b$) and 4 parameters controlling stellar and AGN feedback. Compared to the existing TNG and SIMBA simulation suites in CAMELS, the fiducial model of ASTRID features the mildest AGN feedback and predicts the least baryonic effect on the matter power spectrum. The training set of ASTRID covers a broader variation in the galaxy populations and the baryonic impact on the matter power spectrum compared to its TNG and SIMBA counterparts, which can make machine-learning models trained on the ASTRID suite exhibit better extrapolation performance when tested on other hydrodynamic simulation sets. We also introduce extension simulation sets in CAMELS that widely explore 28 parameters in the TNG and SIMBA models, demonstrating the enormity of the overall galaxy formation model parameter space and the complex non-linear interplay between cosmology and astrophysical processes. With the new simulation suites, we show that building robust machine-learning models favors training and testing on the largest possible diversity of galaxy formation models. We also demonstrate that it is possible to train accurate neural networks to infer cosmological parameters using the high-dimensional TNG-SB28 simulation set.

We build a bijective mapping between different physical fields from hydrodynamic CAMELS simulations. We train a CycleGAN on three different setups: translating dark matter to neutral hydrogen (Mcdm-HI), mapping between dark matter and magnetic fields magnitude (Mcdm-B), and finally predicting magnetic fields magnitude from neutral hydrogen (HI-B). We assess the performance of the models using various summary statistics, such as the probability distribution function (PDF) of the pixel values and 2D power spectrum ($P(k)$). Results suggest that in all setups, the model is capable of predicting the target field from the source field and vice versa, and the predicted maps exhibit statistical properties which are consistent with those of the target maps. This is indicated by the fact that the mean and standard deviation of the PDF of maps from the test set is in good agreement with those of the generated maps. The mean and variance of $P(k)$ of the real maps agree well with those of generated ones. The consistency tests on the model suggest that the source field can be recovered reasonably well by a forward mapping (source to target) followed by a backward mapping (target to source). This is demonstrated by the agreement between the statistical properties of the source images and those of the recovered ones., Comment: 5 pages, 3 figures, Accepted at the ICLR 2023 Workshop on Physics for Machine Learning (Camera-ready version)

We discover analytic equations that can infer the value of $\Omega_{\rm m}$ from the positions and velocity moduli of halo and galaxy catalogues. The equations are derived by combining a tailored graph neural network (GNN) architecture with symbolic regression. We first train the GNN on dark matter halos from Gadget N-body simulations to perform field-level likelihood-free inference, and show that our model can infer $\Omega_{\rm m}$ with $\sim6\%$ accuracy from halo catalogues of thousands of N-body simulations run with six different codes: Abacus, CUBEP$^3$M, Gadget, Enzo, PKDGrav3, and Ramses. By applying symbolic regression to the different parts comprising the GNN, we derive equations that can predict $\Omega_{\rm m}$ from halo catalogues of simulations run with all of the above codes with accuracies similar to those of the GNN. We show that by tuning a single free parameter, our equations can also infer the value of $\Omega_{\rm m}$ from galaxy catalogues of thousands of state-of-the-art hydrodynamic simulations of the CAMELS project, each with a different astrophysics model, run with five distinct codes that employ different subgrid physics: IllustrisTNG, SIMBA, Astrid, Magneticum, SWIFT-EAGLE. Furthermore, the equations also perform well when tested on galaxy catalogues from simulations covering a vast region in parameter space that samples variations in 5 cosmological and 23 astrophysical parameters. We speculate that the equations may reflect the existence of a fundamental physics relation between the phase-space distribution of generic tracers and $\Omega_{\rm m}$, one that is not affected by galaxy formation physics down to scales as small as $10~h^{-1}{\rm kpc}$., Comment: 32 pages, 13 figures, summary video: https://youtu.be/STZHvDHkVgo

We train graph neural networks to perform field-level likelihood-free inference using galaxy catalogs from state-of-the-art hydrodynamic simulations of the CAMELS project. Our models are rotational, translational, and permutation invariant and do not impose any cut on scale. From galaxy catalogs that only contain $3$D positions and radial velocities of $\sim 1, 000$ galaxies in tiny $(25~h^{-1}{\rm Mpc})^3$ volumes our models can infer the value of $\Omega_{\rm m}$ with approximately $12$ % precision. More importantly, by testing the models on galaxy catalogs from thousands of hydrodynamic simulations, each having a different efficiency of supernova and AGN feedback, run with five different codes and subgrid models - IllustrisTNG, SIMBA, Astrid, Magneticum, SWIFT-EAGLE -, we find that our models are robust to changes in astrophysics, subgrid physics, and subhalo/galaxy finder. Furthermore, we test our models on $1,024$ simulations that cover a vast region in parameter space - variations in $5$ cosmological and $23$ astrophysical parameters - finding that the model extrapolates really well. Our results indicate that the key to building a robust model is the use of both galaxy positions and velocities, suggesting that the network have likely learned an underlying physical relation that does not depend on galaxy formation and is valid on scales larger than $\sim10~h^{-1}{\rm kpc}$., Comment: 34 pages, 12 figures. For a video summarizing the results, see https://youtu.be/b59ep7cyPOs

Extracting information from the total matter power spectrum with the precision needed for upcoming cosmological surveys requires unraveling the complex effects of galaxy formation processes on the distribution of matter. We investigate the impact of baryonic physics on matter clustering at $z=0$ using a library of power spectra from the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) project, containing thousands of $(25\,h^{-1}{\rm Mpc})^3$ volume realizations with varying cosmology, initial random field, stellar and AGN feedback strength and sub-grid model implementation methods. We show that baryonic physics affects matter clustering on scales $k \gtrsim 0.4\,h\,\mathrm{Mpc}^{-1}$ and the magnitude of this effect is dependent on the details of the galaxy formation implementation and variations of cosmological and astrophysical parameters. Increasing AGN feedback strength decreases halo baryon fractions and yields stronger suppression of power relative to N-body simulations, while stronger stellar feedback often results in weaker effects by suppressing black hole growth and therefore the impact of AGN feedback. We find a broad correlation between mean baryon fraction of massive halos ($M_{\rm 200c} > 10^{13.5}$\,\Msun) and suppression of matter clustering but with significant scatter compared to previous work owing to wider exploration of feedback parameters and cosmic variance effects. We show that a random forest regressor trained on the baryon content and abundance of halos across the full mass range $10^{10} \leq M_\mathrm{halo}/$\Msun$< 10^{15}$ can predict the effect of galaxy formation on the matter power spectrum on scales $k = 1.0$--20.0\,$h\,\mathrm{Mpc}^{-1}$.

Feedback from active galactic nuclei and stellar processes changes the matter distribution on small scales, leading to significant systematic uncertainty in weak lensing constraints on cosmology. We investigate how the observable properties of group-scale halos can constrain feedback's impact on the matter distribution using Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS). Extending the results of previous work to smaller halo masses and higher wavenumber, $k$, we find that the baryon fraction in halos contains significant information about the impact of feedback on the matter power spectrum. We explore how the thermal Sunyaev Zel'dovich (tSZ) signal from group-scale halos contains similar information. Using recent Dark Energy Survey (DES) weak lensing and Atacama Cosmology Telescope (ACT) tSZ cross-correlation measurements and models trained on CAMELS, we obtain $10\%$ constraints on feedback effects on the power spectrum at $k \sim 5\, h/{\rm Mpc}$. We show that with future surveys, it will be possible to constrain baryonic effects on the power spectrum to $\mathcal{O}(<1\%)$ at $k = 1\, h/{\rm Mpc}$ and $\mathcal{O}(3\%)$ at $k = 5\, h/{\rm Mpc}$ using the methods that we introduce here. Finally, we investigate the impact of feedback on the matter bispectrum, finding that tSZ observables are highly informative in this case., Comment: 18 pages, 15 figures. Comments are welcome

Cosmic voids are the largest and most underdense structures in the Universe. Their properties have been shown to encode precious information about the laws and constituents of the Universe. We show that machine learning techniques can unlock the information in void features for cosmological parameter inference. We rely on thousands of void catalogs from the GIGANTES dataset, where every catalog contains an average of 11,000 voids from a volume of $1~(h^{-1}{\rm Gpc})^3$. We focus on three properties of cosmic voids: ellipticity, density contrast, and radius. We train 1) fully connected neural networks on histograms from individual void properties and 2) deep sets from void catalogs, to perform likelihood-free inference on the value of cosmological parameters. We find that our best models are able to constrain the value of $\Omega_{\rm m}$, $\sigma_8$, and $n_s$ with mean relative errors of $10\%$, $4\%$, and $3\%$, respectively, without using any spatial information from the void catalogs. Our results provide an illustration for the use of machine learning to constrain cosmology with voids., Comment: 13 pages, 8 figures, 1 table, published on ApJ

In a novel approach employing implicit likelihood inference (ILI), also known as likelihood-free inference, we calibrate the parameters of cosmological hydrodynamic simulations against observations, which has previously been unfeasible due to the high computational cost of these simulations. For computational efficiency, we train neural networks as emulators on ~1000 cosmological simulations from the CAMELS project to estimate simulated observables, taking as input the cosmological and astrophysical parameters, and use these emulators as surrogates to the cosmological simulations. Using the cosmic star formation rate density (SFRD) and, separately, stellar mass functions (SMFs) at different redshifts, we perform ILI on selected cosmological and astrophysical parameters (Omega_m, sigma_8, stellar wind feedback, and kinetic black hole feedback) and obtain full 6-dimensional posterior distributions. In the performance test, the ILI from the emulated SFRD (SMFs) can recover the target observables with a relative error of 0.17% (0.4%). We find that degeneracies exist between the parameters inferred from the emulated SFRD, confirmed with new full cosmological simulations. We also find that the SMFs can break the degeneracy in the SFRD, which indicates that the SMFs provide complementary constraints for the parameters. Further, we find that the parameter combination inferred from an observationally-inferred SFRD reproduces the target observed SFRD very well, whereas, in the case of the SMFs, the inferred and observed SMFs show significant discrepancies that indicate potential limitations of the current galaxy formation modeling and calibration framework, and/or systematic differences and inconsistencies between observations of the stellar mass function., Comment: This is the revised version from the reviewer's report (submitted to ApJ)

We study primordial non-Gaussian signatures in the redshift-space halo field on non-linear scales, using a quasi-maximum likelihood estimator based on optimally compressed power spectrum and modal bispectrum statistics. We train and validate the estimator on a suite of halo catalogues constructed from the Quijote-PNG N-body simulations, which we release to accompany this paper. We verify its unbiasedness and near optimality, for the three main types of primordial non-Gaussianity (PNG): local, equilateral, and orthogonal. We compare the modal bispectrum expansion with a $k$-binning approach, showing that the former allows for faster convergence of numerical derivatives in the computation of the score-function, thus leading to better final constraints. We find, in agreement with previous studies, that the local PNG signal in the halo-field is dominated by the scale-dependent bias signature on large scales and saturates at $k \sim 0.2~h\,\mathrm{Mpc}^{-1}$, whereas the small-scale bispectrum is the main source of information for equilateral and orthogonal PNG. Combining power spectrum and bispectrum on non-linear scales plays an important role in breaking degeneracies between cosmological and PNG parameters; such degeneracies remain however strong for equilateral PNG. We forecast that PNG parameters can be constrained with $\Delta f_\mathrm{NL}^\mathrm{local} = 45$, $\Delta f_\mathrm{NL}^\mathrm{equil} = 570$, $\Delta f_\mathrm{NL}^\mathrm{ortho} = 110$, on a cubic volume of $1 \left({ {\rm Gpc}/{ {\rm h}}} \right)^3$, at $z = 1$, considering scales up to $k_\mathrm{max} = 0.5~h\,\mathrm{Mpc}^{-1}$., Comment: 17 pages, 10 figures. v2: minor updates to match published version

We explore the possibility of using deep learning to generate multifield images from state-of-the-art hydrodynamic simulations of the CAMELS project. We use a generative adversarial network to generate images with three different channels that represent gas density (Mgas), neutral hydrogen density (HI), and magnetic field amplitudes (B). The quality of each map in each example generated by the model looks very promising. The GAN considered in this study is able to generate maps whose mean and standard deviation of the probability density distribution of the pixels are consistent with those of the maps from the training data. The mean and standard deviation of the auto power spectra of the generated maps of each field agree well with those computed from the maps of IllustrisTNG. Moreover, the cross-correlations between fields in all instances produced by the emulator are in good agreement with those of the dataset. This implies that all three maps in each output of the generator encode the same underlying cosmology and astrophysics., Comment: 6 pages, 3 figures, Accepted at the Workshop on Machine Learning and the Physical Sciences, Neural Information Processing Systems (NeurIPS) 2022

We train graph neural networks on halo catalogues from Gadget N-body simulations to perform field-level likelihood-free inference of cosmological parameters. The catalogues contain $\lesssim$5,000 halos with masses $\gtrsim 10^{10}~h^{-1}M_\odot$ in a periodic volume of $(25~h^{-1}{\rm Mpc})^3$; every halo in the catalogue is characterized by several properties such as position, mass, velocity, concentration, and maximum circular velocity. Our models, built to be permutationally, translationally, and rotationally invariant, do not impose a minimum scale on which to extract information and are able to infer the values of $\Omega_{\rm m}$ and $\sigma_8$ with a mean relative error of $\sim6\%$, when using positions plus velocities and positions plus masses, respectively. More importantly, we find that our models are very robust: they can infer the value of $\Omega_{\rm m}$ and $\sigma_8$ when tested using halo catalogues from thousands of N-body simulations run with five different N-body codes: Abacus, CUBEP$^3$M, Enzo, PKDGrav3, and Ramses. Surprisingly, the model trained to infer $\Omega_{\rm m}$ also works when tested on thousands of state-of-the-art CAMELS hydrodynamic simulations run with four different codes and subgrid physics implementations. Using halo properties such as concentration and maximum circular velocity allow our models to extract more information, at the expense of breaking the robustness of the models. This may happen because the different N-body codes are not converged on the relevant scales corresponding to these parameters., Comment: 25 pages, 11 figures, summary video: https://youtu.be/qkw92Z6owJU

Feedback from active galactic nuclei (AGN) and supernovae can affect measurements of integrated SZ flux of halos ($Y_\mathrm{SZ}$) from CMB surveys, and cause its relation with the halo mass ($Y_\mathrm{SZ}-M$) to deviate from the self-similar power-law prediction of the virial theorem. We perform a comprehensive study of such deviations using CAMELS, a suite of hydrodynamic simulations with extensive variations in feedback prescriptions. We use a combination of two machine learning tools (random forest and symbolic regression) to search for analogues of the $Y-M$ relation which are more robust to feedback processes for low masses ($M\lesssim 10^{14}\, h^{-1} \, M_\odot$); we find that simply replacing $Y\rightarrow Y(1+M_*/M_\mathrm{gas})$ in the relation makes it remarkably self-similar. This could serve as a robust multiwavelength mass proxy for low-mass clusters and galaxy groups. Our methodology can also be generally useful to improve the domain of validity of other astrophysical scaling relations. We also forecast that measurements of the $Y-M$ relation could provide percent-level constraints on certain combinations of feedback parameters and/or rule out a major part of the parameter space of supernova and AGN feedback models used in current state-of-the-art hydrodynamic simulations. Our results can be useful for using upcoming SZ surveys (e.g., SO, CMB-S4) and galaxy surveys (e.g., DESI and Rubin) to constrain the nature of baryonic feedback. Finally, we find that the an alternative relation, $Y-M_*$, provides complementary information on feedback than $Y-M$, Comment: Version appearing in MNRAS. Minor change to Fig.6 and added Fig. A5 compared to the previous version. 7+5 pages. The code and data associated with this paper are available at https://github.com/JayWadekar/ScalingRelations_ML

We investigate how much can be learnt about four types of primordial non-Gaussianity (PNG) from small-scale measurements of the halo field. Using the QUIJOTE-PNG simulations, we quantify the information content accessible with measurements of the halo power spectrum monopole and quadrupole, the matter power spectrum, the halo-matter cross spectrum and the halo bispectrum monopole. This analysis is the first to include small, non-linear scales, up to $k_\mathrm{max}=0.5 \mathrm{h/Mpc}$, and to explore whether these scales can break degeneracies with cosmological and nuisance parameters making use of thousands of N-body simulations. We perform all the halo measurements in redshift space with a single sample comprised of all halos with mass $>3.2 \times 10^{13}~h^{-1}M_\odot$. For local PNG, measurements of the scale dependent bias effect from the power spectrum using sample variance cancellation provide significantly tighter constraints than measurements of the halo bispectrum. In this case measurements of the small scales add minimal additional constraining power. In contrast, the information on equilateral and orthogonal PNG is primarily accessible through the bispectrum. For these shapes, small scale measurements increase the constraining power of the halo bispectrum by up to $\times4$, though the addition of scales beyond $k\approx 0.3 \mathrm{h/Mpc}$ improves constraints largely through reducing degeneracies between PNG and the other parameters. These degeneracies are even more powerfully mitigated through combining power spectrum and bispectrum measurements. However even with combined measurements and small scale information, equilateral non-Gaussianity remains highly degenerate with $\sigma_8$ and our bias model., Comment: Updated to accepted version