Search

Large Language Models (LLMs) have been profusely evaluated on their ability to answer questions on many topics and their performance on different natural language understanding tasks. Those tests are usually conducted in English, but most LLM users are not native English speakers. Therefore, it is of interest to analyze how LLMs understand other languages at different levels: from paragraphs to morphems. In this paper, we evaluate the performance of state-of-the-art LLMs in TELEIA, a recently released benchmark with similar questions to those of Spanish exams for foreign students, covering topics such as reading comprehension, word formation, meaning and compositional semantics, and grammar. The results show that LLMs perform well at understanding Spanish but are still far from achieving the level of a native speaker in terms of grammatical competence.

When measuring the Baryon Acoustic Oscillations (BAO) scale from galaxy surveys, one typically assumes a fiducial cosmology when converting redshift measurements into comoving distances and also when defining input parameters for the reconstruction algorithm. A parameterised template for the model to be fitted is also created based on a (possibly different) fiducial cosmology. This model reliance can be considered a form of data compression, and the data is then analysed allowing that the true answer is different from the fiducial cosmology assumed. In this study, we evaluate the impact of the fiducial cosmology assumed in the BAO analysis of the Dark Energy Spectroscopic Instrument (DESI) survey Data Release 1 (DR1) on the final measurements in DESI 2024 III. We utilise a suite of mock galaxy catalogues with survey realism that mirrors the DESI DR1 tracers: the bright galaxy sample (BGS), the luminous red galaxies (LRG), the emission line galaxies (ELG) and the quasars (QSO), spanning a redshift range from 0.1 to 2.1. We compare the four secondary AbacusSummit cosmologies against DESI's fiducial cosmology (Planck 2018). The secondary cosmologies explored include a lower cold dark matter density, a thawing dark energy universe, a higher number of effective species, and a lower amplitude of matter clustering. The mocks are processed through the BAO pipeline by consistently iterating the grid, template, and reconstruction reference cosmologies. We determine a conservative systematic contribution to the error of $0.1\%$ for both the isotropic and anisotropic dilation parameters $\alpha_{\rm iso}$ and $\alpha_{\rm AP}$. We then directly test the impact of the fiducial cosmology on DESI DR1 data., Comment: Supporting publication of DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasars

The evaluation of Large Language Models (LLMs) is a key element in their continuous improvement process and many benchmarks have been developed to assess the performance of LLMs in different tasks and topics. As LLMs become adopted worldwide, evaluating them in languages other than English is increasingly important. However, most LLM benchmarks are simply translated using an automated tool and then run in the target language. This means that the results depend not only on the LLM performance in that language but also on the quality of the translation. In this paper, we consider the case of the well-known Massive Multitask Language Understanding (MMLU) benchmark. Selected categories of the benchmark are translated into Spanish using Azure Translator and ChatGPT4 and run on ChatGPT4. Next, the results are processed to identify the test items that produce different answers in Spanish and English. Those are then analyzed manually to understand if the automatic translation caused the change. The results show that a significant fraction of the failing items can be attributed to mistakes in the translation of the benchmark. These results make a strong case for improving benchmarks in languages other than English by at least revising the translations of the items and preferably by adapting the tests to the target language by experts.

Dark Energy Spectroscopic Instrument (DESI) uses more than 2.4 million Emission Line Galaxies (ELGs) for 3D large-scale structure (LSS) analyses in its Data Release 1 (DR1). Such large statistics enable thorough research on systematic uncertainties. In this study, we focus on spectroscopic systematics of ELGs. The redshift success rate ($f_{\rm goodz}$) is the relative fraction of secure redshifts among all measurements. It depends on observing conditions, thus introduces non-cosmological variations to the LSS. We, therefore, develop the redshift failure weight ($w_{\rm zfail}$) and a per-fibre correction ($\eta_{\rm zfail}$) to mitigate these dependences. They have minor influences on the galaxy clustering. For ELGs with a secure redshift, there are two subtypes of systematics: 1) catastrophics (large) that only occur in a few samples; 2) redshift uncertainty (small) that exists for all samples. The catastrophics represent 0.26\% of the total DR1 ELGs, composed of the confusion between O\,\textsc{ii} and sky residuals, double objects, total catastrophics and others. We simulate the realistic 0.26\% catastrophics of DR1 ELGs, the hypothetical 1\% catastrophics, and the truncation of the contaminated $1.31

The proliferation of applications using artificial intelligence (AI) systems has led to a growing number of users interacting with these systems through sophisticated interfaces. Human-computer interaction research has long shown that interfaces shape both user behavior and user perception of technical capabilities and risks. Yet, practitioners and researchers evaluating the social and ethical risks of AI systems tend to overlook the impact of anthropomorphic, deceptive, and immersive interfaces on human-AI interactions. Here, we argue that design features of interfaces with adaptive AI systems can have cascading impacts, driven by feedback loops, which extend beyond those previously considered. We first conduct a scoping review of AI interface designs and their negative impact to extract salient themes of potentially harmful design patterns in AI interfaces. Then, we propose Design-Enhanced Control of AI systems (DECAI), a conceptual model to structure and facilitate impact assessments of AI interface designs. DECAI draws on principles from control systems theory -- a theory for the analysis and design of dynamic physical systems -- to dissect the role of the interface in human-AI systems. Through two case studies on recommendation systems and conversational language model systems, we show how DECAI can be used to evaluate AI interface designs., Comment: Fixed issue with subsection titles

In anticipation of forthcoming data releases of current and future spectroscopic surveys, we present the validation tests and analysis of systematic effects within \texttt{velocileptors} modeling pipeline when fitting mock data from the \texttt{AbacusSummit} N-body simulations. We compare the constraints obtained from parameter compression methods to the direct fitting (Full-Modeling) approaches of modeling the galaxy power spectra, and show that the ShapeFit extension to the traditional template method is consistent with the Full-Modeling method within the standard $\Lambda$CDM parameter space. We show the dependence on scale cuts when fitting the different redshift bins using the ShapeFit and Full-Modeling methods. We test the ability to jointly fit data from multiple redshift bins as well as joint analysis of the pre-reconstruction power spectrum with the post-reconstruction BAO correlation function signal. We further demonstrate the behavior of the model when opening up the parameter space beyond $\Lambda$CDM and also when combining likelihoods with external datasets, namely the Planck CMB priors. Finally, we describe different parametrization options for the galaxy bias, counterterm, and stochastic parameters, and employ the halo model in order to physically motivate suitable priors that are necessary to ensure the stability of the perturbation theory., Comment: 56 pages, 23 figures. Supporting publication of DESI 2024 V: Analysis of the full shape of two-point clustering statistics from galaxies and quasars

In preparation for the next generation of galaxy redshift surveys, and in particular the year-one data release from the Dark Energy Spectroscopic Instrument (DESI), we investigate the consistency of a variety of effective field theory models that describe the galaxy-galaxy power spectra in redshift space into the quasi-linear regime using 1-loop perturbation theory. These models are employed in the pipelines \texttt{velocileptors}, \texttt{PyBird}, and \texttt{Folps$\nu$}. While these models have been validated independently, a detailed comparison with consistent choices has not been attempted. After briefly discussing the theoretical differences between the models we describe how to provide a more apples-to-apples comparison between them. We present the results of fitting mock spectra from the \texttt{AbacusSummit} suite of N-body simulations provided in three redshift bins to mimic the types of dark time tracers targeted by the DESI survey. We show that the theories behave similarly and give consistent constraints in both the forward-modeling and ShapeFit compressed fitting approaches. We additionally generate (noiseless) synthetic data from each pipeline to be fit by the others, varying the scale cuts in order to show that the models agree within the range of scales for which we expect 1-loop perturbation theory to be applicable. This work lays the foundation of Full-Shape analysis with DESI Y1 galaxy samples where in the tests we performed, we found no systematic error associated with the modeling of the galaxy redshift space power spectrum for this volume., Comment: 33 pages, 12 figures. Supporting publication of DESI 2024 V: Analysis of the full shape of two-point clustering statistics from galaxies and quasars

The Dark Energy Spectroscopic Instrument (DESI) will provide unprecedented information about the large-scale structure of our Universe. In this work, we study the robustness of the theoretical modelling of the power spectrum of FOLPS, a novel effective field theory-based package for evaluating the redshift space power spectrum in the presence of massive neutrinos. We perform this validation by fitting the AbacusSummit high-accuracy $N$-body simulations for Luminous Red Galaxies, Emission Line Galaxies and Quasar tracers, calibrated to describe DESI observations. We quantify the potential systematic error budget of FOLPS, finding that the modelling errors are fully sub-dominant for the DESI statistical precision within the studied range of scales. Additionally, we study two complementary approaches to fit and analyse the power spectrum data, one based on direct Full-Modelling fits and the other on the ShapeFit compression variables, both resulting in very good agreement in precision and accuracy. In each of these approaches, we study a set of potential systematic errors induced by several assumptions, such as the choice of template cosmology, the effect of prior choice in the nuisance parameters of the model, or the range of scales used in the analysis. Furthermore, we show how opening up the parameter space beyond the vanilla $\Lambda$CDM model affects the DESI observables. These studies include the addition of massive neutrinos, spatial curvature, and dark energy equation of state. We also examine how relaxing the usual Cosmic Microwave Background and Big Bang Nucleosynthesis priors on the primordial spectral index and the baryonic matter abundance, respectively, impacts the inference on the rest of the parameters of interest. This paper pathways towards performing a robust and reliable analysis of the shape of the power spectrum of DESI galaxy and quasar clustering using FOLPS., Comment: Supporting publication of DESI 2024 VII: Cosmological constraints from full-shape analyses of the two-point clustering statistics measurements, in preparation (2024)

The Dark Energy Spectroscopic Instrument (DESI) will provide precise measurements of Baryon Acoustic Oscillations (BAO) to constrain the expansion history of the Universe and set stringent constraints on dark energy. Therefore, precise control of the global error budget due to various systematic effects is required for the DESI 2024 BAO analysis. In this work, we focus on the robustness of the BAO analysis against the Halo Occupation Distribution (HOD) modeling for the Emission Line Galaxy (ELG) tracer. Based on a common dark matter simulation, our analysis relies on HOD mocks tuned to early DESI data, namely the One-Percent survey data. To build the mocks, we use several HOD models for the ELG tracer as well as extensions to the baseline HOD models. Among these extensions, we consider distinct recipes for galactic conformity and assembly bias. We perform two independent analyses in the Fourier space and in the configuration space. We recover the BAO signal from two-point measurements after performing reconstruction on our mocks. Additionally, we also apply the control variates technique to reduce sample variance noise. Our BAO analysis can recover the isotropic BAO parameter $\alpha_\text{iso}$ within 0.1\% and the Alcock Paczynski parameter $\alpha_\text{AP}$ within 0.3\%. Overall, we find that our systematic error due to the HOD dependence is below 0.17\%, with the Fourier space analysis being more robust against the HOD systematics. We conclude that our analysis pipeline is robust enough against the HOD systematics for the ELG tracer in the DESI 2024 BAO analysis., Comment: Supporting publication of DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasars

In this paper, we present the estimation of systematics related to the halo occupation distribution (HOD) modeling in the baryon acoustic oscillations (BAO) distance measurement of the Dark Energy Spectroscopic Instrument (DESI) 2024 analysis. This paper focuses on the study of HOD systematics for luminous red galaxies (LRG). We consider three different HOD models for LRGs, including the base 5-parameter vanilla model and two extensions to it, that we refer to as baseline and extended models. The baseline model is described by the 5 vanilla HOD parameters, an incompleteness factor and a velocity bias parameter, whereas the extended one also includes a galaxy assembly bias and a satellite profile parameter. We utilize the 25 dark matter simulations available in the AbacusSummit simulation suite at $z=$ 0.8 and generate mock catalogs for our different HOD models. To test the impact of the HOD modeling in the position of the BAO peak, we run BAO fits for all these sets of simulations and compare the best-fit BAO-scaling parameters $\alpha_{\rm iso}$ and $\alpha_{\rm AP}$ between every pair of HOD models. We do this for both Fourier and configuration spaces independently, using post-reconstruction measurements. We find a 3.3$\sigma$ detection of HOD systematic for $\alpha_{\rm AP}$ in configuration space with an amplitude of 0.19%. For the other cases, we did not find a 3$\sigma$ detection, and we decided to compute a conservative estimation of the systematic using the ensemble of shifts between all pairs of HOD models. By doing this, we quote a systematic with an amplitude of 0.07% in $\alpha_{\rm iso}$ for both Fourier and configuration spaces; and of 0.09% in $\alpha_{\rm AP}$ for Fourier space., Comment: 36 pages, 9 figures. Supporting publication of DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasars

We present cosmological results from the measurement of baryon acoustic oscillations (BAO) in galaxy, quasar and Lyman-$\alpha$ forest tracers from the first year of observations from the Dark Energy Spectroscopic Instrument (DESI), to be released in the DESI Data Release 1. DESI BAO provide robust measurements of the transverse comoving distance and Hubble rate, or their combination, relative to the sound horizon, in seven redshift bins from over 6 million extragalactic objects in the redshift range $0.1-1$ and $w_a<0$. This preference is 2.6$\sigma$ for the DESI+CMB combination, and persists or grows when SN~Ia are added in, giving results discrepant with the $\Lambda$CDM model at the $2.5\sigma$, $3.5\sigma$ or $3.9\sigma$ levels for the addition of Pantheon+, Union3, or DES-SN5YR datasets respectively. For the flat $\Lambda$CDM model with the sum of neutrino mass $\sum m_\nu$ free, combining the DESI and CMB data yields an upper limit $\sum m_\nu < 0.072$ $(0.113)$ eV at 95% confidence for a $\sum m_\nu>0$ $(\sum m_\nu>0.059)$ eV prior. These neutrino-mass constraints are substantially relaxed in models beyond $\Lambda$CDM. [Abridged.], Comment: This DESI Collaboration Key Publication is part of the 2024 publication series using the first year of observations (see https://data.desi.lbl.gov/doc/papers). Typos corrected and a new figure and discussion added to Appendix A

We present the measurement of Baryon Acoustic Oscillations (BAO) from the Lyman-$\alpha$ (Ly$\alpha$) forest of high-redshift quasars with the first-year dataset of the Dark Energy Spectroscopic Instrument (DESI). Our analysis uses over $420\,000$ Ly$\alpha$ forest spectra and their correlation with the spatial distribution of more than $700\,000$ quasars. An essential facet of this work is the development of a new analysis methodology on a blinded dataset. We conducted rigorous tests using synthetic data to ensure the reliability of our methodology and findings before unblinding. Additionally, we conducted multiple data splits to assess the consistency of the results and scrutinized various analysis approaches to confirm their robustness. For a given value of the sound horizon ($r_d$), we measure the expansion at $z_{\rm eff}=2.33$ with 2\% precision, $H(z_{\rm eff}) = (239.2 \pm 4.8) (147.09~{\rm Mpc} /r_d)$ km/s/Mpc. Similarly, we present a 2.4\% measurement of the transverse comoving distance to the same redshift, $D_M(z_{\rm eff}) = (5.84 \pm 0.14) (r_d/147.09~{\rm Mpc})$ Gpc. Together with other DESI BAO measurements at lower redshifts, these results are used in a companion paper to constrain cosmological parameters., Comment: This DESI Collaboration Key Publication is part of the 2024 publication series using the first year of observations (see https://data.desi.lbl.gov/doc/papers). Minor changes in v4, version accepted for publication in JCAP

We present the DESI 2024 galaxy and quasar baryon acoustic oscillations (BAO) measurements using over 5.7 million unique galaxy and quasar redshifts in the range 0.1

The Wide-field Spectroscopic Telescope (WST) is proposed as a new facility dedicated to the efficient delivery of spectroscopic surveys. This white paper summarises the initial concept as well as the corresponding science cases. WST will feature simultaneous operation of a large field-of-view (3 sq. degree), a high multiplex (20,000) multi-object spectrograph (MOS) and a giant 3x3 sq. arcmin integral field spectrograph (IFS). In scientific capability these requirements place WST far ahead of existing and planned facilities. Given the current investment in deep imaging surveys and noting the diagnostic power of spectroscopy, WST will fill a crucial gap in astronomical capability and work synergistically with future ground and space-based facilities. This white paper shows that WST can address outstanding scientific questions in the areas of cosmology; galaxy assembly, evolution, and enrichment, including our own Milky Way; origin of stars and planets; time domain and multi-messenger astrophysics. WST's uniquely rich dataset will deliver unforeseen discoveries in many of these areas. The WST Science Team (already including more than 500 scientists worldwide) is open to the all astronomical community. To register in the WST Science Team please visit https://www.wstelescope.com/for-scientists/participate, Comment: 194 pages, 66 figures. Comments are welcome (wstelescope@gmail.com)

Analytical models of galaxy-halo connection such as the Halo Occupation Distribution (HOD) model have been widely used over the past decades as a means to intensively test perturbative models on quasi-linear scales. However, these models fail to reproduce the galaxy-galaxy lensing signal on non-linear scales, over-predicting the observed signal up to 40%. With ongoing Stage-IV galaxy surveys such as DESI and EUCLID, it is now crucial to accurately model the galaxy-halo connection up to intra-halo scales to accurately estimate theoretical uncertainties of perturbative models. This paper compares the standard HOD model to an extended HOD framework that incorporates as additional features galaxy assembly bias and local environmental dependencies on halo occupation. These models have been calibrated against the observed clustering and galaxy-galaxy lensing signal of eBOSS Luminous Red Galaxies (LRG) and Emission Lines Galaxies (ELG) in the range 0.6 < z < 1.1. A combined clustering-lensing cosmological analysis is then performed on the simulated galaxy samples of both standard and extended HOD frameworks to quantify the systematic budget of perturbative models. The extended HOD model offers a more comprehensive understanding of the connection between galaxies and their surroundings. In particular, we found that the LRGs preferentially occupy denser and more anisotropic environments. Our results highlight the importance of considering environmental factors in galaxy formation models, with an extended HOD framework that reproduces the observed signal within 20% on scales below 10 Mpc/h. Our cosmological analysis reveals that our perturbative model yields similar constraints regardless of the galaxy population, with a better goodness of fit for the extended HOD. These results suggest that the extended HOD framework should be used to quantify modeling systematics., Comment: 17 pages

Gun violence is a pressing and growing human rights issue that affects nearly every dimension of the social fabric, from healthcare and education to psychology and the economy. Reliable data on firearm events is paramount to developing more effective public policy and emergency responses. However, the lack of comprehensive databases and the risks of in-person surveys prevent human rights organizations from collecting needed data in most countries. Here, we partner with a Brazilian human rights organization to conduct a systematic evaluation of language models to assist with monitoring real-world firearm events from social media data. We propose a fine-tuned BERT-based model trained on Twitter (now X) texts to distinguish gun violence reports from ordinary Portuguese texts. Our model achieves a high AUC score of 0.97. We then incorporate our model into a web application and test it in a live intervention. We study and interview Brazilian analysts who continuously fact-check social media texts to identify new gun violence events. Qualitative assessments show that our solution helped all analysts use their time more efficiently and expanded their search capacities. Quantitative assessments show that the use of our model was associated with more analysts' interactions with online users reporting gun violence. Taken together, our findings suggest that modern Natural Language Processing techniques can help support the work of human rights organizations.

Let G = (V, E) be a directed and weighted graph with vertex set V of size n and edge set E of size m, such that each edge (u, v) \in E has a real-valued weight w(u, c). An arborescence in G is a subgraph T = (V, E') such that for a vertex u \in V, the root, there is a unique path in T from u to any other vertex v \in V. The weight of T is the sum of the weights of its edges. In this paper, given G, we are interested in finding an arborescence in G with minimum weight, i.e., an optimal arborescence. Furthermore, when G is subject to changes, namely edge insertions and deletions, we are interested in efficiently maintaining a dynamic arborescence in G. This is a well known problem with applications in several domains such as network design optimization and in phylogenetic inference. In this paper we revisit algorithmic ideas proposed by several authors for this problem, we provide detailed pseudo-code as well as implementation details, and we present experimental results on large scale-free networks and on phylogenetic inference. Our implementation is publicly available at \url{https://gitlab.com/espadas/optimal-arborescences}.

Emission line galaxies (ELGs) are now the preeminent tracers of large-scale structure at z>0.8 due to their high density and strong emission lines, which enable accurate redshift measurements. However, relatively little is known about ELG evolution and the ELG-halo connection, exposing us to potential modeling systematics in cosmology inference using these sources. In this paper, we propose a physical picture of ELGs and improve ELG-halo connection modeling using a variety of observations and simulated galaxy models. We investigate DESI-selected ELGs in COSMOS data, and infer that ELGs are rapidly star-forming galaxies with a large fraction exhibiting disturbed morphology, implying that many of them are likely to be merger-driven starbursts. We further postulate that the tidal interactions from mergers lead to correlated star formation in central-satellite ELG pairs, a phenomenon dubbed "conformity." We argue for the need to include conformity in the ELG-halo connection using galaxy models such as IllustrisTNG, and by combining observations such as the DESI ELG auto-correlation, ELG cross-correlation with Luminous Red Galaxies (LRGs), and ELG-cluster cross-correlation. We also explore the origin of conformity using the UniverseMachine model and elucidate the difference between conformity and the well-known galaxy assembly bias effect., Comment: 25 pages, 20 figures, submitted to MNRAS, comments welcome

The One-Percent survey of the Dark Energy Spectroscopic Instrument collected ~ 270k emission line galaxies (ELGs) at 0.8 < z < 1.6. The high completeness of the sample allowed the clustering to be measured down to scales never probed before, 0.04 Mpc/h in rp for the projected 2-point correlation function (2PCF) and 0.17 Mpc/h in galaxy pair separation s for the 2PCF monopole and quadrupole. The most striking feature of the measurements is a strong signal at the smallest scales, below 0.2 Mpc/h in rp and 1 Mpc/h in s. We analyze these data in the halo occupation distribution framework. We consider different distributions for central galaxies, a standard power law for satellites with no condition on the presence of a central galaxy and explore several extensions of these models. For all considered models, the mean halo mass of the sample is found to be log10 ~ 11.9. We obtain a satellite mean occupation function which agrees with physically motivated ELG models only if we introduce central-satellite conformity, meaning that the satellite occupation is conditioned by the presence of central galaxies of the same type. To achieve in addition a good modeling of the clustering between 0.1 and 1 Mpc/h in rp, we allow for ELG positioning outside of the halo virial radius and find 0.5% of ELGs residing in the outskirts of halos. Furthermore, the satellite velocity dispersion inside halos is found to be ~ 30% larger than that of the halo dark matter particles. These are the main findings of our work. We investigate assembly bias as a function of halo concentration, local density or local density anisotropies and observe no significant change in our results. We split the data sample in two redshift bins and report no significant evolution with redshift. Lastly, changing the cosmology in the modeling impacts only slightly our results.

We present the first comprehensive Halo Occupation Distribution (HOD) analysis of the DESI One-Percent survey Luminous Red Galaxy (LRG) and Quasi-Stellar Object (QSO) samples. We constrain the HOD of each sample and test possible HOD extensions by fitting the redshift-space galaxy 2-point correlation functions in 0.15 < r < 32 Mpc/h in a set of fiducial redshift bins. We use AbacusSummit cubic boxes at Planck 2018 cosmology as model templates and forward model galaxy clustering with the AbacusHOD package. We achieve good fits with a standard HOD model with velocity bias, and we find no evidence for galaxy assembly bias or satellite profile modulation at the current level of statistical uncertainty. For LRGs in 0.4 < z < 0.6, we infer a satellite fraction of fsat = 11+-1%, a mean halo mass of log10 Mh = 13.40+0.02-0.02, and a linear bias of blin = 1.93+0.06-0.04. For LRGs in 0.6 < z < 0.8, we find fsat = 14+-1%, log10 Mh = 13.24+0.02-0.02, and blin = 2.08+0.03-0.03. For QSOs, we infer fsat = 3+8-2%, log10 Mh = 12.65+0.09-0.04, and blin = 2.63+0.37-0.26 in redshift range 0.8 < z < 2.1. Using these fits, we generate a large suite of high-fidelity galaxy mocks. We also study the redshift-evolution of the DESI LRG sample from z = 0.4 up to z = 1.1, revealing significant and interesting trends in mean halo mass, linear bias, and satellite fraction., Comment: Submitted to MNRAS, comments welcome

The Dark Energy Spectroscopic Instrument (DESI) completed its five-month Survey Validation in May 2021. Spectra of stellar and extragalactic targets from Survey Validation constitute the first major data sample from the DESI survey. This paper describes the public release of those spectra, the catalogs of derived properties, and the intermediate data products. In total, the public release includes good-quality spectral information from 466,447 objects targeted as part of the Milky Way Survey, 428,758 as part of the Bright Galaxy Survey, 227,318 as part of the Luminous Red Galaxy sample, 437,664 as part of the Emission Line Galaxy sample, and 76,079 as part of the Quasar sample. In addition, the release includes spectral information from 137,148 objects that expand the scope beyond the primary samples as part of a series of secondary programs. Here, we describe the spectral data, data quality, data products, Large-Scale Structure science catalogs, access to the data, and references that provide relevant background to using these spectra., Comment: 43 pages, 7 figures, 17 tables, submitted to AJ, DESI EDR references added

The Dark Energy Spectroscopic Instrument (DESI) was designed to conduct a survey covering 14,000 deg$^2$ over five years to constrain the cosmic expansion history through precise measurements of Baryon Acoustic Oscillations (BAO). The scientific program for DESI was evaluated during a five month Survey Validation (SV) campaign before beginning full operations. This program produced deep spectra of tens of thousands of objects from each of the stellar (MWS), bright galaxy (BGS), luminous red galaxy (LRG), emission line galaxy (ELG), and quasar target classes. These SV spectra were used to optimize redshift distributions, characterize exposure times, determine calibration procedures, and assess observational overheads for the five-year program. In this paper, we present the final target selection algorithms, redshift distributions, and projected cosmology constraints resulting from those studies. We also present a `One-Percent survey' conducted at the conclusion of Survey Validation covering 140 deg$^2$ using the final target selection algorithms with exposures of a depth typical of the main survey. The Survey Validation indicates that DESI will be able to complete the full 14,000 deg$^2$ program with spectroscopically-confirmed targets from the MWS, BGS, LRG, ELG, and quasar programs with total sample sizes of 7.2, 13.8, 7.46, 15.7, and 2.87 million, respectively. These samples will allow exploration of the Milky Way halo, clustering on all scales, and BAO measurements with a statistical precision of 0.28% over the redshift interval $z<1.1$, 0.39% over the redshift interval $1.1

The halo occupation distribution (HOD) framework is an empirical method to describe the connection between dark matter halos and galaxies, which is constrained by small scale clustering data. Efficient fitting procedures are required to scan the HOD parameter space. This paper describes such a method based on Gaussian Processes to iteratively build a surrogate model of the posterior of the likelihood surface from a reasonable amount of likelihood computations, typically two orders of magnitude less than standard Monte Carlo Markov chain algorithms. Errors in the likelihood computation due to stochastic HOD modelling are also accounted for in the method we propose. We report results of reproducibility, accuracy and stability tests of the method derived from simulation, taking as a test case star-forming emission line galaxies, which constitute the main tracer of the Dark Energy Spectroscopic Instrument and have so far a poorly constrained galaxy-halo connection from observational data.

Recent advances in synthetic data generation (SDG) have been hailed as a solution to the difficult problem of sharing sensitive data while protecting privacy. SDG aims to learn statistical properties of real data in order to generate "artificial" data that are structurally and statistically similar to sensitive data. However, prior research suggests that inference attacks on synthetic data can undermine privacy, but only for specific outlier records. In this work, we introduce a new attribute inference attack against synthetic data. The attack is based on linear reconstruction methods for aggregate statistics, which target all records in the dataset, not only outliers. We evaluate our attack on state-of-the-art SDG algorithms, including Probabilistic Graphical Models, Generative Adversarial Networks, and recent differentially private SDG mechanisms. By defining a formal privacy game, we show that our attack can be highly accurate even on arbitrary records, and that this is the result of individual information leakage (as opposed to population-level inference). We then systematically evaluate the tradeoff between protecting privacy and preserving statistical utility. Our findings suggest that current SDG methods cannot consistently provide sufficient privacy protection against inference attacks while retaining reasonable utility. The best method evaluated, a differentially private SDG mechanism, can provide both protection against inference attacks and reasonable utility, but only in very specific settings. Lastly, we show that releasing a larger number of synthetic records can improve utility but at the cost of making attacks far more effective.

The Dark Energy Spectroscopic Instrument (DESI) Survey has obtained a set of spectroscopic measurements of galaxies to validate the final survey design and target selections. To assist in these tasks, we visually inspect (VI) DESI spectra of approximately 2,500 bright galaxies, 3,500 luminous red galaxies (LRGs), and 10,000 emission line galaxies (ELGs), to obtain robust redshift identifications. We then utilize the VI redshift information to characterize the performance of the DESI operation. Based on the VI catalogs, our results show that the final survey design yields samples of bright galaxies, LRGs, and ELGs with purity greater than $99\%$. Moreover, we demonstrate that the precision of the redshift measurements is approximately 10 km/s for bright galaxies and ELGs and approximately 40 km/s for LRGs. The average redshift accuracy is within 10 km/s for the three types of galaxies. The VI process also helps improve the quality of the DESI data by identifying spurious spectral features introduced by the pipeline. Finally, we show examples of unexpected real astronomical objects, such as Ly$\alpha$ emitters and strong lensing candidates, identified by VI. These results demonstrate the importance and utility of visually inspecting data from incoming and upcoming surveys, especially during their early operation phases., Comment: 22 pages, 14 figures, 3 tables, one of a suite of 8 papers detailing targeting for DESI. ApJ accepted version with minor textual updates

The Dark Energy Spectroscopic Instrument (DESI) has embarked on an ambitious five-year survey to explore the nature of dark energy with spectroscopy of 40 million galaxies and quasars. DESI will determine precise redshifts and employ the Baryon Acoustic Oscillation method to measure distances from the nearby universe to z > 3.5, as well as measure the growth of structure and probe potential modifications to general relativity. In this paper we describe the significant instrumentation we developed for the DESI survey. The new instrumentation includes a wide-field, 3.2-deg diameter prime-focus corrector that focuses the light onto 5020 robotic fiber positioners on the 0.812 m diameter, aspheric focal surface. The positioners and their fibers are divided among ten wedge-shaped petals. Each petal is connected to one of ten spectrographs via a contiguous, high-efficiency, nearly 50 m fiber cable bundle. The ten spectrographs each use a pair of dichroics to split the light into three channels that together record the light from 360 - 980 nm with a resolution of 2000 to 5000. We describe the science requirements, technical requirements on the instrumentation, and management of the project. DESI was installed at the 4-m Mayall telescope at Kitt Peak, and we also describe the facility upgrades to prepare for DESI and the installation and functional verification process. DESI has achieved all of its performance goals, and the DESI survey began in May 2021. Some performance highlights include RMS positioner accuracy better than 0.1", SNR per \sqrt{\AA} > 0.5 for a z > 2 quasar with flux 0.28e-17 erg/s/cm^2/A at 380 nm in 4000s, and median SNR = 7 of the [OII] doublet at 8e-17 erg/s/cm^2 in a 1000s exposure for emission line galaxies at z = 1.4 - 1.6. We conclude with highlights from the on-sky validation and commissioning of the instrument, key successes, and lessons learned. (abridged), Comment: 78 pages, 32 figures, submitted to AJ