Search

We discuss the cold dark matter plus massive neutrinos simulations of the MillenniumTNG (MTNG) project, which aim to improve understanding of how well ongoing and future large-scale galaxy surveys will measure neutrino masses. Our largest simulations, $3000\,{\rm Mpc}$ on a side, use $10240^3$ particles of mass $m_{p} = 6.66\times 10^{8}\,h^{-1}{\rm M}_\odot$ to represent cold dark matter, and $2560^3$ to represent a population of neutrinos with summed mass $M_\nu = 100\,{\rm meV}$. Smaller volume runs with $\sim 630\,{\rm Mpc}$ also include cases with $M_\nu = 0\,\textrm{and}\, 300\,{\rm meV}$. All simulations are carried out twice using the paired-and-fixed technique for cosmic variance reduction. We evolve the neutrino component using the particle-based $\delta f$ importance sampling method, which greatly reduces shot noise in the neutrino density field. In addition, we modify the GADGET-4 code to account both for the influence of relativistic and mildly relativistic components on the expansion rate and for non-Newtonian effects on the largest represented simulation scales. This allows us to quantify accurately the impact of neutrinos on basic statistical measures of nonlinear structure formation, such as the matter power spectrum and the halo mass function. We use semi-analytic models of galaxy formation to predict the galaxy population and its clustering properties as a function of summed neutrino mass, finding significant ($\sim 10\%$) impacts on the cosmic star formation rate history, the galaxy mass function, and the clustering strength. This offers the prospect of identifying combinations of summary statistics that are optimally sensitive to the neutrino mass., Comment: 19 pages, 15 figures

Weak gravitational lensing is a powerful tool for precision tests of cosmology. As the expected deflection angles are small, predictions based on non-linear N-body simulations are commonly computed with the Born approximation. Here we examine this assumption using ${\small DORIAN}$, a newly developed full-sky ray-tracing scheme applied to high-resolution mass-shell outputs of the two largest simulations in the MillenniumTNG suite, each with a 3000 Mpc box containing almost 1.1 trillion cold dark matter particles in addition to 16.7 billion particles representing massive neutrinos. We examine simple two-point statistics like the angular power spectrum of the convergence field, as well as statistics sensitive to higher order correlations such as peak and minimum statistics, void statistics, and Minkowski functionals of the convergence maps. Overall, we find only small differences between the Born approximation and a full ray-tracing treatment. While these are negligibly small at power-spectrum level, some higher order statistics show more sizable effects; ray-tracing is necessary to achieve percent level precision. At the resolution reached here, full-sky maps with 0.8 billion pixels and an angular resolution of 0.43 arcmin, we find that interpolation accuracy can introduce appreciable errors in ray-tracing results. We therefore implemented an interpolation method based on nonuniform fast Fourier transforms (NUFFT) along with more traditional methods. Bilinear interpolation introduces significant smoothing, while nearest grid point sampling agrees well with NUFFT, at least for our fiducial source redshift, $z_s=1.0$, and for the 1 arcmin smoothing we use for higher-order statistics., Comment: 13 pages, 7 figures, submitted to MNRAS

Galaxy formation models within cosmological hydrodynamical simulations contain numerous parameters with non-trivial influences over the resulting properties of simulated cosmic structures and galaxy populations. It is computationally challenging to sample these high dimensional parameter spaces with simulations, particularly for halos in the high-mass end of the mass function. In this work, we develop a novel sampling and reduced variance regression method, CARPoolGP, which leverages built-in correlations between samples in different locations of high dimensional parameter spaces to provide an efficient way to explore parameter space and generate low variance emulations of summary statistics. We use this method to extend the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) to include a set of 768 zoom-in simulations of halos in the mass range of $10^{13} - 10^{14.5} M_\odot\,h^{-1}$ that span a 28-dimensional parameter space in the IllustrisTNG model. With these simulations and the CARPoolGP emulation method, we explore parameter trends in the Compton $Y-M$, black hole mass-halo mass, and metallicity-mass relations, as well as thermodynamic profiles and quenched fractions of satellite galaxies. We use these emulations to provide a physical picture of the complex interplay between supernova and active galactic nuclei feedback. We then use emulations of the $Y-M$ relation of massive halos to perform Fisher forecasts on astrophysical parameters for future Sunyaev-Zeldovich observations and find a significant improvement in forecasted constraints. We publicly release both the simulation suite and CARPoolGP software package., Comment: The manuscript was submitted to arxiv after receiving and responding to comments from the first referee report

We present a study of the evolution of cosmic filaments across redshift with an emphasis on some important properties: filament lengths, growth rates, and radial profiles of galaxy densities. Following an observation-driven approach, we build cosmic filament catalogues at z=0,1,2,3, and 4 from the galaxy distributions of the large hydro-dynamical run of the MilleniumTNG project. We employ the extensively used DisPerSE cosmic web finder code, for which we provide a user-friendly guide, including the details of a physics-driven calibration procedure, with the hope of helping future users. We perform the first statistical measurements of the evolution of connectivity in a large-scale simulation, finding that the connectivity of cosmic nodes (defined as the number of filaments attached) globally decreases from early to late times. The study of cosmic filaments in proper coordinates reveals that filaments grow in length and radial extent, as expected from large-scale structures in an expanding Universe. But the most interesting results arise once the Hubble flow is factored out. We find remarkably stable comoving filament length functions and over-density profiles, showing only little evolution of the total population of filaments in the past ~12.25 Gyrs. However, by tracking the spatial evolution of individual structures, we demonstrate that filaments of different lengths actually follow different evolutionary paths. While short filaments preferentially contract, long filaments expand along their longitudinal direction with growth rates that are the highest in the early, matter-dominated Universe. Filament diversity at fixed redshift is also shown by the different (~$5 \sigma$) density values between the shortest and longest filaments. Our results hint that cosmic filaments can be used as additional probes for dark energy, but further theoretical work is still needed., Comment: 17 pages, accepted in Astronomy & Astrophysics

In the coming years, Sunyaev-Zel'dovich (SZ) measurements can dramatically improve our understanding of the Intergalactic Medium (IGM) and the role of feedback processes on galaxy formation, allowing us to calibrate important astrophysical systematics in cosmological constraints from weak lensing galaxy clustering surveys. However, the signal is only measured in a two-dimensional projection, and its correct interpretation relies on understanding the connection between observable quantities and the underlying intrinsic properties of the gas, in addition to the relation between the gas and the underlying matter distribution. One way to address these challenges is through the use of hydrodynamical simulations such as the high-resolution, large-volume MillenniumTNG suite. We find that measurements of the optical depth, $\tau$, and the Compton-y parameter, $Y$, receive large line-of-sight contributions which can be removed effectively by applying a Compensated Aperture Photometry (CAP) filter. In contrast with other $\tau$ probes (e.g., X-rays and Fast Radio Bursts), the kSZ-inferred $\tau$ receives most of its signal from a confined cylindrical region around the halo due to the velocity decorrelation along the line-of-sight. Additionally, we perform fits to the $Y-M$ and $\tau-M$ scaling relations and report best-fit parameters adopting the smoothly broken power law (SBPL) formalism. We note that subgrid physics modeling can broaden the error bar on these by 30\% for intermediate-mass halos ($\sim$$10^{13} \, {\rm M}_{\odot}$). The scatter of the scaling relations can be captured by an intrinsic dependence on concentration, and an extrinsic dependence on tidal shear. Finally, we comment on the effect of using galaxies rather than halos in real observations, which can bias the inferred SZ profiles by $\sim$20\% for $L_\ast$-galaxies., Comment: 14 pages, 6 figures

The intrinsic alignment (IA) of observed galaxy shapes with the underlying cosmic web is a source of contamination in weak lensing surveys. Sensitive methods to identify the IA signal will therefore need to be included in the upcoming weak lensing analysis pipelines. Hydrodynamical cosmological simulations allow us to directly measure the intrinsic ellipticities of galaxies and thus provide a powerful approach to predict and understand the IA signal. Here we employ the novel, large-volume hydrodynamical simulation MTNG740, a product of the MillenniumTNG (MTNG) project, to study the IA of galaxies. We measure the projected correlation functions between the intrinsic shape/shear of galaxies and various tracers of large-scale structure, $w_{+g},\ w_{+m},\ w_{++}$ over the radial range $r_{\rm p} \in [0.02 , 200]\,h^{-1}{\rm Mpc}$ and at redshifts $z=0.0$, $0.5$ and $1.0$. We detect significant signal-to-noise IA signals with the density field for both elliptical and spiral galaxies. We also find significant intrinsic shear-shear correlations for ellipticals. We further examine correlations of the intrinsic shape of galaxies with the local tidal field. Here we find a significant IA signal for elliptical galaxies assuming a linear model. We also detect a weak IA signal for spiral galaxies under a quadratic tidal torquing model. Lastly, we measure the alignment between central galaxies and their host dark-matter halos, finding small to moderate misalignments between their principal axes that decline with halo mass., Comment: 16 pages, 14 figures

We study weak gravitational lensing convergence maps produced from the MillenniumTNG (MTNG) simulations by direct projection of the mass distribution on the past backwards lightcone of a fiducial observer. We explore the lensing maps over a large dynamic range in simulation mass and angular resolution, allowing us to establish a clear assessment of numerical convergence. By comparing full physics hydrodynamical simulations with corresponding dark-matter-only runs we quantify the impact of baryonic physics on the most important weak lensing statistics. Likewise, we predict the impact of massive neutrinos reliably far into the non-linear regime. We also demonstrate that the "fixed & paired" variance suppression technique increases the statistical robustness of the simulation predictions on large scales not only for time slices but also for continuously output lightcone data. We find that both baryonic and neutrino effects substantially impact weak lensing shear measurements, with the latter dominating over the former on large angular scales. Thus, both effects must explicitly be included to obtain sufficiently accurate predictions for stage IV lensing surveys. Reassuringly, our results agree accurately with other simulation results where available, supporting the promise of simulation modelling for precision cosmology far into the non-linear regime., Comment: 15 pages, 10 figures, comments welcome

Extracting information from the total matter power spectrum with the precision needed for upcoming cosmological surveys requires unraveling the complex effects of galaxy formation processes on the distribution of matter. We investigate the impact of baryonic physics on matter clustering at $z=0$ using a library of power spectra from the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) project, containing thousands of $(25\,h^{-1}{\rm Mpc})^3$ volume realizations with varying cosmology, initial random field, stellar and AGN feedback strength and sub-grid model implementation methods. We show that baryonic physics affects matter clustering on scales $k \gtrsim 0.4\,h\,\mathrm{Mpc}^{-1}$ and the magnitude of this effect is dependent on the details of the galaxy formation implementation and variations of cosmological and astrophysical parameters. Increasing AGN feedback strength decreases halo baryon fractions and yields stronger suppression of power relative to N-body simulations, while stronger stellar feedback often results in weaker effects by suppressing black hole growth and therefore the impact of AGN feedback. We find a broad correlation between mean baryon fraction of massive halos ($M_{\rm 200c} > 10^{13.5}$\,\Msun) and suppression of matter clustering but with significant scatter compared to previous work owing to wider exploration of feedback parameters and cosmic variance effects. We show that a random forest regressor trained on the baryon content and abundance of halos across the full mass range $10^{10} \leq M_\mathrm{halo}/$\Msun$< 10^{15}$ can predict the effect of galaxy formation on the matter power spectrum on scales $k = 1.0$--20.0\,$h\,\mathrm{Mpc}^{-1}$.

Feedback from active galactic nuclei and stellar processes changes the matter distribution on small scales, leading to significant systematic uncertainty in weak lensing constraints on cosmology. We investigate how the observable properties of group-scale halos can constrain feedback's impact on the matter distribution using Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS). Extending the results of previous work to smaller halo masses and higher wavenumber, $k$, we find that the baryon fraction in halos contains significant information about the impact of feedback on the matter power spectrum. We explore how the thermal Sunyaev Zel'dovich (tSZ) signal from group-scale halos contains similar information. Using recent Dark Energy Survey (DES) weak lensing and Atacama Cosmology Telescope (ACT) tSZ cross-correlation measurements and models trained on CAMELS, we obtain $10\%$ constraints on feedback effects on the power spectrum at $k \sim 5\, h/{\rm Mpc}$. We show that with future surveys, it will be possible to constrain baryonic effects on the power spectrum to $\mathcal{O}(<1\%)$ at $k = 1\, h/{\rm Mpc}$ and $\mathcal{O}(3\%)$ at $k = 5\, h/{\rm Mpc}$ using the methods that we introduce here. Finally, we investigate the impact of feedback on the matter bispectrum, finding that tSZ observables are highly informative in this case., Comment: 18 pages, 15 figures. Comments are welcome

Upcoming large galaxy surveys will subject the standard cosmological model, $\Lambda$CDM, to new precision tests. These can be tightened considerably if theoretical models of galaxy formation are available that can predict galaxy clustering and galaxy-galaxy lensing on the full range of measurable scales throughout volumes as large as those of the surveys and with sufficient flexibility that uncertain aspects of the underlying astrophysics can be marginalised over. This, in particular, requires mock galaxy catalogues in large cosmological volumes that can be directly compared to observation, and can be optimised empirically by Monte Carlo Markov Chains or other similar schemes to eliminate or estimate astrophysical parameters related to galaxy formation when constraining cosmology. Semi-analytic galaxy formation methods implemented on top of cosmological dark matter simulations offer a computationally efficient approach to construct physically based and flexibly parametrised galaxy formation models, and as such they are more potent than still faster, but purely empirical models. Here we introduce an updated methodology for the semi-analytic L-GALAXIES code, allowing it to be applied to simulations of the new MillenniumTNG project, producing galaxies directly on fully continuous past lightcones, potentially over the full sky, out to high redshift, and for all galaxies more massive than $\sim 10^8\,{\rm M}_\odot$. We investigate the numerical convergence of the resulting predictions, and study the projected galaxy clustering signals of different samples. The new methodology can be viewed as an important step towards more faithful forward-modelling of observational data, helping to reduce systematic distortions in the comparison of theory to observations., Comment: 24 pages, 18 figures, published in MNRAS

We introduce a novel technique for constraining cosmological parameters and galaxy assembly bias using non-linear redshift-space clustering of galaxies. We scale cosmological N-body simulations and insert galaxies with the SubHalo Abundance Matching extended (SHAMe) empirical model to generate over 175,000 clustering measurements spanning all relevant cosmological and SHAMe parameter values. We then build an emulator capable of reproducing the projected galaxy correlation function at the monopole, quadrupole and hexadecapole level for separations between $0.1\,h^{-1}{\rm Mpc}$ and $25\,h^{-1}{\rm Mpc}$. We test this approach by using the emulator and Monte Carlo Markov Chain (MCMC) inference to jointly estimate cosmology and assembly bias parameters both for the MTNG740 hydrodynamic simulation and for a semi-analytical galaxy formation model (SAM) built on the MTNG740-DM dark matter-only simulation, obtaining unbiased results for all cosmological parameters. For instance, for MTNG740 and a galaxy number density of $n\sim 0.01 h^{3}{\rm Mpc}^{-3}$, we obtain $\sigma_{8}=0.799^{+0.039}_{-0.044}$ ($\sigma_{8,{\rm MTNG}} =$ 0.8159), and $\Omega_\mathrm{M}h^2= 0.138^{+ 0.025}_{- 0.018}$ ($\Omega_{\mathrm{M}} h^2_{\rm MTNG} =$ 0.142). For fixed Hubble parameter ($h$), the constraint becomes $\Omega_\mathrm{M}h^2= 0.137^{+ 0.011}_{- 0.012}$. Our method performs similarly well for the SAM and for other tested sample densities. We almost always recover the true amount of galaxy assembly bias within one sigma. The best constraints are obtained when scales smaller than $2\,h^{-1}{\rm Mpc}$ are included, as well as when at least the projected correlation function and the monopole are incorporated. These methods offer a powerful way to constrain cosmological parameters using galaxy surveys., Comment: 18 pages, 12 figures, accepted by MNRAS

Approximate methods to populate dark matter halos with galaxies are of great utility to large galaxy surveys. However, the limitations of simple halo occupation models (HODs) preclude a full use of small-scale galaxy clustering data and call for more sophisticated models. We study two galaxy populations, luminous red galaxies (LRGs) and star-forming emission-line galaxies (ELGs), at two epochs, $z=1$ and $z=0$, in the large volume, high-resolution hydrodynamical simulation of the MillenniumTNG project. In a partner study we concentrated on the small-scale, one-halo regime down to $r\sim 0.1{\rm Mpc}/h$, while here we focus on modeling galaxy assembly bias in the two-halo regime, $r\gtrsim 1{\rm Mpc}/h$. Interestingly, the ELG signal exhibits scale dependence out to relatively large scales ($r\sim 20{\rm Mpc}/h$), implying that the linear bias approximation for this tracer is invalid on these scales, contrary to common assumptions. The 10-15\% discrepancy present in the standard halo model prescription is only reconciled when we augment our halo occupation model with a dependence on extrinsic halo properties ("shear" being the best-performing one) rather than intrinsic ones (e.g., concentration, peak mass). We argue that this fact constitutes evidence for two-halo galaxy conformity. Including tertiary assembly bias (i.e. a property beyond mass and "shear") is not an essential requirement for reconciling the galaxy assembly bias signal of LRGs, but the combination of external and internal properties is beneficial for recovering ELG the clustering. We find that centrals in low-mass haloes dominate the assembly bias signal of both populations. Finally, we explore the predictions of our model for higher-order statistics such as nearest-neighbor counts. The latter supplies additional information about galaxy assembly bias and can be used to break degeneracies between halo model parameters., Comment: 16 pages, 8 figures; submitted to MNRAS

Luminous red galaxies (LRGs) and blue star-forming emission-line galaxies (ELGs) are key tracers of large-scale structure used by cosmological surveys. Theoretical predictions for such data are often done via simplistic models for the galaxy-halo connection. In this work, we use the large, high-fidelity hydrodynamical simulation of the MillenniumTNG project (MTNG) to inform a new phenomenological approach for obtaining an accurate and flexible galaxy-halo model on small scales. Our aim is to study LRGs and ELGs at two distinct epochs, $z = 1$ and $z = 0$, and recover their clustering down to very small scales, $r \sim 0.1 \ {\rm Mpc}/h$, i.e. the one-halo regime, while a companion paper extends this to a two-halo model for larger distances. The occupation statistics of ELGs in MTNG inform us that: (1) the satellite occupations exhibit a slightly super-Poisson distribution, contrary to commonly made assumptions, and (2) that haloes containing at least one ELG satellite are twice as likely to host a central ELG. We propose simple recipes for modeling these effects, each of which calls for the addition of a single free parameter to simpler halo occupation models. To construct a reliable satellite population model, we explore the LRG and ELG satellite radial and velocity distributions and compare them with those of subhalos and particles in the simulation. We find that ELGs are anisotropically distributed within halos, which together with our occupation results provides strong evidence for cooperative galaxy formation (manifesting itself as one-halo galaxy conformity); i.e.~galaxies with similar properties form in close proximity to each other. Our refined galaxy-halo model represents a useful improvement of commonly used analysis tools and thus can be of help to increase the constraining power of large-scale structure surveys., Comment: 14 pages, 10 figures; submitted to MNRAS

The early release science results from $\textit{JWST}$ have yielded an unexpected abundance of high-redshift luminous galaxies that seems to be in tension with current theories of galaxy formation. However, it is currently difficult to draw definitive conclusions form these results as the sources have not yet been spectroscopically confirmed. It is in any case important to establish baseline predictions from current state-of-the-art galaxy formation models that can be compared and contrasted with these new measurements. In this work, we use the new large-volume ($L_\mathrm{box}\sim 740 \, \mathrm{cMpc}$) hydrodynamic simulation of the MillenniumTNG project, suitably scaled to match results from higher resolution - smaller volume simulations, to make predictions for the high-redshift ($z\gtrsim8$) galaxy population and compare them to recent $\textit{JWST}$ observations. We show that the simulated galaxy population is broadly consistent with observations until $z\sim10$. From $z\approx10-12$, the observations indicate a preference for a galaxy population that is largely dust-free, but is still consistent with the simulations. Beyond $z\gtrsim12$, however, our simulation results underpredict the abundance of luminous galaxies and their star-formation rates by almost an order of magnitude. This indicates either an incomplete understanding of the new $\textit{JWST}$ data or a need for more sophisticated galaxy formation models that account for additional physical processes such as Population~III stars, variable stellar initial mass functions, or even deviations from the standard $\Lambda$CDM model. We emphasise that any new process invoked to explain this tension should only significantly influence the galaxy population beyond $z\gtrsim10$, while leaving the successful galaxy formation predictions of the fiducial model intact below this redshift., Comment: Accepted for publication in MNRAS -- Part of the initial set of papers introducing the MillenniumTNG project. Visit www.mtng-project.org for more details

Modern redshift surveys are tasked with mapping out the galaxy distribution over enormous distance scales. Existing hydrodynamical simulations, however, do not reach the volumes needed to match upcoming surveys. We present results for the clustering of galaxies using a new, large volume hydrodynamical simulation as part of the MillenniumTNG (MTNG) project. With a computational volume that is $\approx15$ times larger than the next largest such simulation currently available, we show that MTNG is able to accurately reproduce the observed clustering of galaxies as a function of stellar mass. When separated by colour, there are some discrepancies with respect to the observed population, which can be attributed to the quenching of satellite galaxies in our model. We combine MTNG galaxies with those generated using a semi-analytic model to emulate the sample selection of luminous red galaxies (LRGs) and emission line galaxies (ELGs), and show that although the bias of these populations is approximately (but not exactly) constant on scales larger than $\approx10$ Mpc, there is significant scale-dependent bias on smaller scales. The amplitude of this effect varies between the two galaxy types, and also between the semi-analytic model and MTNG. We show that this is related to the distribution of haloes hosting LRGs and ELGs. Using mock SDSS-like catalogues generated on MTNG lightcones, we demonstrate the existence of prominent baryonic acoustic features in the large-scale galaxy clustering. We also demonstrate the presence of realistic redshift space distortions in our mocks, finding excellent agreement with the multipoles of the redshift-space clustering measured in SDSS data., Comment: 15 pages, 11 figures. Accepted for publication in MNRAS

Cosmological simulations are an important theoretical pillar for understanding nonlinear structure formation in our Universe and for relating it to observations on large scales. In several papers, we introduce our MillenniumTNG (MTNG) project that provides a comprehensive set of high-resolution, large volume simulations of cosmic structure formation aiming to better understand physical processes on large scales and to help interpreting upcoming large-scale galaxy surveys. We here focus on the full physics box MTNG740 that computes a volume of $(740\,\mathrm{Mpc})^3$ with a baryonic mass resolution of $3.1\times~10^7\,\mathrm{M_\odot}$ using \textsc{arepo} with $80.6$~billion cells and the IllustrisTNG galaxy formation model. We verify that the galaxy properties produced by MTNG740 are consistent with the TNG simulations, including more recent observations. We focus on galaxy clusters and analyse cluster scaling relations and radial profiles. We show that both are broadly consistent with various observational constraints. We demonstrate that the SZ-signal on a deep lightcone is consistent with Planck limits. Finally, we compare MTNG740 clusters with galaxy clusters found in Planck and the SDSS-8 RedMaPPer richness catalogue in observational space, finding very good agreement as well. However, {\it simultaneously} matching cluster masses, richness, and Compton-$y$ requires us to assume that the SZ mass estimates for Planck clusters are underestimated by $0.2$~dex on average. Thanks to its unprecedented volume for a high-resolution hydrodynamical calculation, the MTNG740 simulation offers rich possibilities to study baryons in galaxies, galaxy clusters, and in large scale structure, and in particular their impact on upcoming large cosmological surveys., Comment: 18 pages, 14 figures, accepted for publication by MNRAS, comments welcome

Cosmological inference with large galaxy surveys requires theoretical models that combine precise predictions for large-scale structure with robust and flexible galaxy formation modelling throughout a sufficiently large cosmic volume. Here, we introduce the MillenniumTNG (MTNG) project which combines the hydrodynamical galaxy formation model of IllustrisTNG with the large volume of the Millennium simulation. Our largest hydrodynamic simulation, covering (500 Mpc/h)^3 = (740 Mpc)^3, is complemented by a suite of dark-matter-only simulations with up to 4320^3 dark matter particles (a mass resolution of 1.32 x 10^8 Msun/h) using the fixed-and-paired technique to reduce large-scale cosmic variance. The hydro simulation adds 4320^3 gas cells, achieving a baryonic mass resolution of 2 x 10^7 Msun/h. High time-resolution merger trees and direct lightcone outputs facilitate the construction of a new generation of semi-analytic galaxy formation models that can be calibrated against both the hydro simulation and observation, and then applied to even larger volumes - MTNG includes a flagship simulation with 1.1 trillion dark matter particles and massive neutrinos in a volume of (3000 Mpc)^3. In this introductory analysis we carry out convergence tests on basic measures of non-linear clustering such as the matter power spectrum, the halo mass function and halo clustering, and we compare simulation predictions to those from current cosmological emulators. We also use our simulations to study matter and halo statistics, such as halo bias and clustering at the baryonic acoustic oscillation scale. Finally we measure the impact of baryonic physics on the matter and halo distributions., Comment: submitted to MNRAS, 23 pages, 19 figures, for future public data release, see https://www.mtng-project.org

The Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) project was developed to combine cosmology with astrophysics through thousands of cosmological hydrodynamic simulations and machine learning. CAMELS contains 4,233 cosmological simulations, 2,049 N-body and 2,184 state-of-the-art hydrodynamic simulations that sample a vast volume in parameter space. In this paper we present the CAMELS public data release, describing the characteristics of the CAMELS simulations and a variety of data products generated from them, including halo, subhalo, galaxy, and void catalogues, power spectra, bispectra, Lyman-$\alpha$ spectra, probability distribution functions, halo radial profiles, and X-rays photon lists. We also release over one thousand catalogues that contain billions of galaxies from CAMELS-SAM: a large collection of N-body simulations that have been combined with the Santa Cruz Semi-Analytic Model. We release all the data, comprising more than 350 terabytes and containing 143,922 snapshots, millions of halos, galaxies and summary statistics. We provide further technical details on how to access, download, read, and process the data at \url{https://camels.readthedocs.io}., Comment: 18 pages, 3 figures. More than 350 Tb of data from thousands of simulations publicly available at https://www.camel-simulations.org

To extract information from the clustering of galaxies on non-linear scales, we need to model the connection between galaxies and halos accurately and in a flexible manner. Standard halo occupation distribution (HOD) models make the assumption that the galaxy occupation in a halo is a function of only its mass, however, in reality, the occupation can depend on various other parameters including halo concentration, assembly history, environment, spin, etc. Using the IllustrisTNG hydrodynamic simulation as our target, we show that machine learning tools can be used to capture this high-dimensional dependence and provide more accurate galaxy occupation models. Specifically, we use a random forest regressor to identify which secondary halo parameters best model the galaxy-halo connection and symbolic regression to augment the standard HOD model with simple equations capturing the dependence on those parameters, namely the local environmental overdensity and shear, at the location of a halo. This not only provides insights into the galaxy-formation relationship but, more importantly, improves the clustering statistics of the modeled galaxies significantly. Our approach demonstrates that machine learning tools can help us better understand and model the galaxy-halo connection, and are therefore useful for galaxy formation and cosmology studies from upcoming galaxy surveys.

We present the Cosmology and Astrophysics with MachinE Learning Simulations --CAMELS-- project. CAMELS is a suite of 4,233 cosmological simulations of $(25~h^{-1}{\rm Mpc})^3$ volume each: 2,184 state-of-the-art (magneto-)hydrodynamic simulations run with the AREPO and GIZMO codes, employing the same baryonic subgrid physics as the IllustrisTNG and SIMBA simulations, and 2,049 N-body simulations. The goal of the CAMELS project is to provide theory predictions for different observables as a function of cosmology and astrophysics, and it is the largest suite of cosmological (magneto-)hydrodynamic simulations designed to train machine learning algorithms. CAMELS contains thousands of different cosmological and astrophysical models by way of varying $\Omega_m$, $\sigma_8$, and four parameters controlling stellar and AGN feedback, following the evolution of more than 100 billion particles and fluid elements over a combined volume of $(400~h^{-1}{\rm Mpc})^3$. We describe the simulations in detail and characterize the large range of conditions represented in terms of the matter power spectrum, cosmic star formation rate density, galaxy stellar mass function, halo baryon fractions, and several galaxy scaling relations. We show that the IllustrisTNG and SIMBA suites produce roughly similar distributions of galaxy properties over the full parameter space but significantly different halo baryon fractions and baryonic effects on the matter power spectrum. This emphasizes the need for marginalizing over baryonic effects to extract the maximum amount of information from cosmological surveys. We illustrate the unique potential of CAMELS using several machine learning applications, including non-linear interpolation, parameter estimation, symbolic regression, data generation with Generative Adversarial Networks (GANs), dimensionality reduction, and anomaly detection., Comment: 34 pages, 19 figures, Matches published version. CAMELS webpage at https://www.camel-simulations.org

The Quijote simulations are a set of 44,100 full N-body simulations spanning more than 7,000 cosmological models in the $\{\Omega_{\rm m}, \Omega_{\rm b}, h, n_s, \sigma_8, M_\nu, w \}$ hyperplane. At a single redshift the simulations contain more than 8.5 trillions of particles over a combined volume of 44,100 $(h^{-1}{\rm Gpc})^3$; each simulation follow the evolution of $256^3$, $512^3$ or $1024^3$ particles in a box of $1~h^{-1}{\rm Gpc}$ length. Billions of dark matter halos and cosmic voids have been identified in the simulations, whose runs required more than 35 million core hours. The Quijote simulations have been designed for two main purposes: 1) to quantify the information content on cosmological observables, and 2) to provide enough data to train machine learning algorithms. In this paper we describe the simulations and show a few of their applications. We also release the Petabyte of data generated, comprising hundreds of thousands of simulation snapshots at multiple redshifts, halo and void catalogs, together with millions of summary statistics such as power spectra, bispectra, correlation functions, marked power spectra, and estimated probability density functions., Comment: 20 pages, 15 figures. Matches published version. Simulations publicly available at https://github.com/franciscovillaescusa/Quijote-simulations