Search

Your search keyword '"A. Rosset"' showing total 13,970 results
Start Over Author "A. Rosset"
13,970 results on '"A. Rosset"'

1. Euclid: Relativistic effects in the dipole of the 2-point correlation function

Author

Lepori, F., Schulz, S., Tutusaus, I., Breton, M. -A., Saga, S., Viglione, C., Adamek, J., Bonvin, C., Dam, L., Fosalba, P., Amendola, L., Andreon, S., Baccigalupi, C., Baldi, M., Bardelli, S., Bonino, D., Branchini, E., Brescia, M., Brinchmann, J., Caillat, A., Camera, S., Capobianco, V., Carbone, C., Carretero, J., Casas, S., Castellano, M., Castignani, G., Cavuoti, S., Cimatti, A., Colodro-Conde, C., Congedo, G., Conversi, L., Copin, Y., Courbin, F., Courtois, H. M., Degaudenzi, H., De Lucia, G., Dubath, F., Duncan, C. A. J., Dupac, X., Dusini, S., Farina, M., Farrens, S., Ferriol, S., Frailis, M., Franceschi, E., Galeotta, S., Gillis, B., Giocoli, C., Grazian, A., Grupp, F., Haugan, S. V. H., Holmes, W., Hormuth, F., Hornstrup, A., Ilić, S., Jahnke, K., Jhabvala, M., Keihänen, E., Kiessling, A., Kilbinger, M., Kubik, B., Kunz, M., Kurki-Suonio, H., Ligori, S., Lilje, P. B., Lindholm, V., Lloro, I., Maiorano, E., Mansutti, O., Marggraf, O., Markovic, K., Martinelli, M., Martinet, N., Marulli, F., Massey, R., Medinaceli, E., Melchior, M., Mellier, Y., Meneghetti, M., Merlin, E., Meylan, G., Moresco, M., Moscardini, L., Neissner, C., Niemi, S. -M., Padilla, C., Paltani, S., Pasian, F., Pedersen, K., Pettorino, V., Pires, S., Polenta, G., Poncet, M., Popa, L. A., Raison, F., Renzi, A., Rhodes, J., Riccio, G., Romelli, E., Roncarelli, M., Rosset, C., Rossetti, E., Saglia, R., Sakr, Z., Sánchez, A. G., Sapone, D., Sartoris, B., Schirmer, M., Schneider, P., Schrabback, T., Secroun, A., Seidel, G., Serrano, S., Sirignano, C., Sirri, G., Stanco, L., Steinwagner, J., Tallada-Crespí, P., Tereno, I., Toledo-Moreo, R., Torradeflot, F., Valenziano, L., Vassallo, T., Wang, Y., Weller, J., Zucca, E., Burigana, C., Fabbian, G., Finelli, F., Pezzotta, A., Scottez, V., and Viel, M.

Subjects
Astrophysics - Cosmology and Nongalactic Astrophysics
Abstract

Gravitational redshift and Doppler effects give rise to an antisymmetric component of the galaxy correlation function when cross-correlating two galaxy populations or two different tracers. In this paper, we assess the detectability of these effects in the Euclid spectroscopic galaxy survey. We model the impact of gravitational redshift on the observed redshift of galaxies in the Flagship mock catalogue using a Navarro-Frenk-White profile for the host haloes. We isolate these relativistic effects, largely subdominant in the standard analysis, by splitting the galaxy catalogue into two populations of faint and bright objects and estimating the dipole of their cross-correlation in four redshift bins. In the simulated catalogue, we detect the dipole signal on scales below $30\,h^{-1}{\rm Mpc}$, with detection significances of $4\,\sigma$ and $3\,\sigma$ in the two lowest redshift bins, respectively. At higher redshifts, the detection significance drops below $2\,\sigma$. Overall, we estimate the total detection significance in the Euclid spectroscopic sample to be approximately $6\,\sigma$. We find that on small scales, the major contribution to the signal comes from the nonlinear gravitational potential. Our study on the Flagship mock catalogue shows that this observable can be detected in Euclid Data Release 2 and beyond., Comment: 21 pages, 11 figures, 1 appendix; submitted on behalf of the Euclid Collaboration

Published
2024

2. The Warburg Effect is the result of faster ATP production by glycolysis than respiration.

Author

Kukurugya, Matthew, Rosset, Saharon, and Titov, Denis

Subjects
Warburg Effect, cancer metabolism, energy metabolism, modeling, systems biology, Glycolysis, Adenosine Triphosphate, Saccharomyces cerevisiae, Escherichia coli, Glucose, Models, Biological, Humans, Energy Metabolism, Cell Respiration, Animals
Abstract

Many prokaryotic and eukaryotic cells metabolize glucose to organism-specific by-products instead of fully oxidizing it to carbon dioxide and water-a phenomenon referred to as the Warburg Effect. The benefit to a cell is not fully understood, given that partial metabolism of glucose yields an order of magnitude less adenosine triphosphate (ATP) per molecule of glucose than complete oxidation. Here, we test a previously formulated hypothesis that the benefit of the Warburg Effect is to increase ATP production rate by switching from high-yielding respiration to faster glycolysis when excess glucose is available and respiration rate becomes limited by proteome occupancy. We show that glycolysis produces ATP faster per gram of pathway protein than respiration in Escherichia coli, Saccharomyces cerevisiae, and mammalian cells. We then develop a simple mathematical model of energy metabolism that uses five experimentally estimated parameters and show that this model can accurately predict absolute rates of glycolysis and respiration in all three organisms under diverse conditions, providing strong support for the validity of the ATP production rate maximization hypothesis. In addition, our measurements show that mammalian respiration produces ATP up to 10-fold slower than respiration in E. coli or S. cerevisiae, suggesting that the ATP production rate per gram of pathway protein is a highly evolvable trait that is heavily optimized in microbes. We also find that E. coli respiration is faster than fermentation, explaining the observation that E. coli, unlike S. cerevisiae or mammalian cells, never switch to pure fermentation in the presence of oxygen.

Published
2024

3. Stable determination of the Winkler subgrade coefficient in a nanoplate

Author

Alessandrini, G., Morassi, A., Rosset, E., Sincich, E., and Vessella, S.

Subjects
Mathematics - Analysis of PDEs, 35R30 (Primary), 35J25 - 86A22 (Secondary)
Abstract

We study the inverse problem of determining the Winkler coefficient in a nanoplate resting on an elastic foundation and clamped at the boundary. The nanoplate is described within a simplified strain gradient elasticity theory for isotropic materials, under the Kirchhoff-Love kinematic assumptions in infinitesimal deformation. We prove a global H\"older stability estimate of the subgrade coefficient by performing a single interior measurement of the transverse deflection of the nanoplate induced by a load concentrated at one point., Comment: 24 pages. arXiv admin note: text overlap with arXiv:1502.04842

Published
2024

4. Signatures of paracrystallinity in amorphous silicon

Author

Rosset, Louise A. M., Drabold, David A., and Deringer, Volker L.

Subjects
Condensed Matter - Materials Science, Condensed Matter - Disordered Systems and Neural Networks
Abstract

The structure of amorphous silicon (a-Si) has been studied for decades. The two main theories are based on a continuous random network and on a `paracrystalline' model, respectively -- the latter being defined as showing localized structural order resembling the crystalline state whilst retaining an overall amorphous network. However, the extent of this local order has been unclear, and experimental data have led to conflicting interpretations. Here we show that signatures of paracrystallinity in an otherwise disordered network are indeed compatible with the existing body of experimental observations for a-Si. We use quantum-mechanically accurate, machine-learning-driven simulations to systematically sample the configurational space of quenched a-Si, thereby allowing us to elucidate the boundary between amorphization and crystallization. We analyze our dataset using structural and local-energy descriptors to show that paracrystalline models are consistent with experiments in both regards. Our work provides a unified explanation for seemingly conflicting theories in one of the most widely studied amorphous networks.

Published
2024

5. Characterisation of Lawvere-Tierney Topologies on Simplicial Sets, Bicolored Graphs, and Fuzzy Sets

Author

Rosset, Aloïs, Hansen, Helle Hvid, and Endrullis, Jörg

Subjects
Computer Science - Logic in Computer Science, Mathematics - Category Theory
Abstract

Simplicial sets generalise many categories of graphs. In this paper, we give a complete characterisation of the Lawvere-Tierney topologies on (semi-)simplicial sets, on bicolored graphs, and on fuzzy sets. We apply our results to establish that 'partially simple' simplicial sets and 'partially simple' graphs form quasitoposes.

Published
2024

6. AgentInstruct: Toward Generative Teaching with Agentic Flows

Author

Mitra, Arindam, Del Corro, Luciano, Zheng, Guoqing, Mahajan, Shweti, Rouhana, Dany, Codas, Andres, Lu, Yadong, Chen, Wei-ge, Vrousgos, Olga, Rosset, Corby, Silva, Fillipe, Khanpour, Hamed, Lara, Yash, and Awadallah, Ahmed

Subjects
Computer Science - Artificial Intelligence, Computer Science - Computation and Language, Computer Science - Machine Learning
Abstract

Synthetic data is becoming increasingly important for accelerating the development of language models, both large and small. Despite several successful use cases, researchers also raised concerns around model collapse and drawbacks of imitating other models. This discrepancy can be attributed to the fact that synthetic data varies in quality and diversity. Effective use of synthetic data usually requires significant human effort in curating the data. We focus on using synthetic data for post-training, specifically creating data by powerful models to teach a new skill or behavior to another model, we refer to this setting as Generative Teaching. We introduce AgentInstruct, an extensible agentic framework for automatically creating large amounts of diverse and high-quality synthetic data. AgentInstruct can create both the prompts and responses, using only raw data sources like text documents and code files as seeds. We demonstrate the utility of AgentInstruct by creating a post training dataset of 25M pairs to teach language models different skills, such as text editing, creative writing, tool usage, coding, reading comprehension, etc. The dataset can be used for instruction tuning of any base model. We post-train Mistral-7b with the data. When comparing the resulting model Orca-3 to Mistral-7b-Instruct (which uses the same base model), we observe significant improvements across many benchmarks. For example, 40% improvement on AGIEval, 19% improvement on MMLU, 54% improvement on GSM8K, 38% improvement on BBH and 45% improvement on AlpacaEval. Additionally, it consistently outperforms other models such as LLAMA-8B-instruct and GPT-3.5-turbo.

Published
2024

7. A scalable and robust variance components method reveals insights into the architecture of gene-environment interactions underlying complex traits.

Author

Pazokitoroudi, Ali, Liu, Zhengtong, Dahl, Andrew, Zaitlen, Noah, Rosset, Saharon, and Sankararaman, Sriram

Subjects
UK Biobank, complex traits, gene-context interaction, gene-drug interaction, gene-environment interaction, genetic architecture of gene-environment interactions, noise heterogeneity, patitioning GxE heritability, scalable variance component analysis, Humans, Gene-Environment Interaction, Polymorphism, Single Nucleotide, Genome-Wide Association Study, Multifactorial Inheritance, Male, Female, Quantitative Trait, Heritable, Phenotype, Models, Genetic, Quantitative Trait Loci
Abstract

Understanding the contribution of gene-environment interactions (GxE) to complex trait variation can provide insights into disease mechanisms, explain sources of heritability, and improve genetic risk prediction. While large biobanks with genetic and deep phenotypic data hold promise for obtaining novel insights into GxE, our understanding of GxE architecture in complex traits remains limited. We introduce a method to estimate the proportion of trait variance explained by GxE (GxE heritability) and additive genetic effects (additive heritability) across the genome and within specific genomic annotations. We show that our method is accurate in simulations and computationally efficient for biobank-scale datasets. We applied our method to common array SNPs (MAF ≥1%), fifty quantitative traits, and four environmental variables (smoking, sex, age, and statin usage) in unrelated white British individuals in the UK Biobank. We found 68 trait-E pairs with significant genome-wide GxE heritability (p

Published
2024

8. Exploratory Preference Optimization: Harnessing Implicit Q*-Approximation for Sample-Efficient RLHF

Author

Xie, Tengyang, Foster, Dylan J., Krishnamurthy, Akshay, Rosset, Corby, Awadallah, Ahmed, and Rakhlin, Alexander

Subjects
Computer Science - Machine Learning, Computer Science - Artificial Intelligence, Computer Science - Computation and Language, Statistics - Machine Learning
Abstract

Reinforcement learning from human feedback (RLHF) has emerged as a central tool for language model alignment. We consider online exploration in RLHF, which exploits interactive access to human or AI feedback by deliberately encouraging the model to produce diverse, maximally informative responses. By allowing RLHF to confidently stray from the pre-trained model, online exploration offers the possibility of novel, potentially super-human capabilities, but its full potential as a paradigm for language model training has yet to be realized, owing to computational and statistical bottlenecks in directly adapting existing reinforcement learning techniques. We propose a new algorithm for online exploration in RLHF, Exploratory Preference Optimization (XPO), which is simple and practical -- a one-line change to (online) Direct Preference Optimization (DPO; Rafailov et al., 2023) -- yet enjoys the strongest known provable guarantees and promising empirical performance. XPO augments the DPO objective with a novel and principled exploration bonus, empowering the algorithm to explore outside the support of the initial model and human feedback data. In theory, we show that XPO is provably sample-efficient and converges to a near-optimal language model policy under natural exploration conditions, irrespective of whether the initial model has good coverage. Our analysis, which builds on the observation that DPO implicitly performs a form of $Q^{\star}$-approximation (or, Bellman error minimization), combines previously disparate techniques from language modeling and theoretical reinforcement learning in a serendipitous fashion through the perspective of KL-regularized Markov decision processes. Empirically, we find that XPO is more sample-efficient than non-exploratory DPO variants in a preliminary evaluation.

Published
2024

9. Fast training and sampling of Restricted Boltzmann Machines

Author

Béreux, Nicolas, Decelle, Aurélien, Furtlehner, Cyril, Rosset, Lorenzo, and Seoane, Beatriz

Subjects
Computer Science - Machine Learning, Condensed Matter - Disordered Systems and Neural Networks, Condensed Matter - Statistical Mechanics
Abstract

Restricted Boltzmann Machines (RBMs) are effective tools for modeling complex systems and deriving insights from data. However, training these models with highly structured data presents significant challenges due to the slow mixing characteristics of Markov Chain Monte Carlo processes. In this study, we build upon recent theoretical advancements in RBM training, to significantly reduce the computational cost of training (in very clustered datasets), evaluating and sampling in RBMs in general. The learning process is analogous to thermodynamic continuous phase transitions observed in ferromagnetic models, where new modes in the probability measure emerge in a continuous manner. Such continuous transitions are associated with the critical slowdown effect, which adversely affects the accuracy of gradient estimates, particularly during the initial stages of training with clustered data. To mitigate this issue, we propose a pre-training phase that encodes the principal components into a low-rank RBM through a convex optimization process. This approach enables efficient static Monte Carlo sampling and accurate computation of the partition function. We exploit the continuous and smooth nature of the parameter annealing trajectory to achieve reliable and computationally efficient log-likelihood estimations, enabling online assessment during the training, and propose a novel sampling strategy named parallel trajectory tempering (PTT) which outperforms previously optimized MCMC methods. Our results show that this training strategy enables RBMs to effectively address highly structured datasets that conventional methods struggle with. We also provide evidence that our log-likelihood estimation is more accurate than traditional, more computationally intensive approaches in controlled scenarios. The PTT algorithm significantly accelerates MCMC processes compared to existing and conventional methods., Comment: 31 pages, 16 figures

Published
2024

10. Euclid. V. The Flagship galaxy mock catalogue: a comprehensive simulation for the Euclid mission

Author

Euclid Collaboration, Castander, F. J., Fosalba, P., Stadel, J., Potter, D., Carretero, J., Tallada-Crespí, P., Pozzetti, L., Bolzonella, M., Mamon, G. A., Blot, L., Hoffmann, K., Huertas-Company, M., Monaco, P., Gonzalez, E. J., De Lucia, G., Scarlata, C., Breton, M. -A., Linke, L., Viglione, C., Li, S. -S., Zhai, Z., Baghkhani, Z., Pardede, K., Neissner, C., Teyssier, R., Crocce, M., Tutusaus, I., Miller, L., Congedo, G., Biviano, A., Hirschmann, M., Pezzotta, A., Aussel, H., Hoekstra, H., Kitching, T., Percival, W. J., Guzzo, L., Mellier, Y., Oesch, P. A., Bowler, R. A. A., Bruton, S., Allevato, V., Gonzalez-Perez, V., Manera, M., Avila, S., Kovács, A., Aghanim, N., Altieri, B., Amara, A., Amendola, L., Andreon, S., Auricchio, N., Baldi, M., Balestra, A., Bardelli, S., Bender, R., Bodendorf, C., Bonino, D., Branchini, E., Brescia, M., Brinchmann, J., Camera, S., Capobianco, V., Carbone, C., Casas, S., Castellano, M., Cavuoti, S., Cimatti, A., Conselice, C. J., Conversi, L., Copin, Y., Corcione, L., Courbin, F., Courtois, H. M., Da Silva, A., Degaudenzi, H., Di Giorgio, A. M., Dinis, J., Douspis, M., Dubath, F., Duncan, C. A. J., Dupac, X., Dusini, S., Ealet, A., Farina, M., Farrens, S., Ferriol, S., Fotopoulou, S., Fourmanoit, N., Frailis, M., Franceschi, E., Franzetti, P., Galeotta, S., Gillard, W., Gillis, B., Giocoli, C., Gómez-Alvarez, P., Granett, B. R., Grazian, A., Grupp, F., Haugan, S. V. H., Holliman, M. S., Holmes, W., Hook, I., Hormuth, F., Hornstrup, A., Hudelot, P., Jahnke, K., Jhabvala, M., Joachimi, B., Keihänen, E., Kermiche, S., Kiessling, A., Kilbinger, M., Kohley, R., Kubik, B., Kümmel, M., Kunz, M., Kurki-Suonio, H., Lahav, O., Laureijs, R., Mignant, D. Le, Ligori, S., Lilje, P. B., Lindholm, V., Lloro, I., Maino, D., Maiorano, E., Mansutti, O., Marggraf, O., Markovic, K., Martinet, N., Marulli, F., Massey, R., Masters, D. C., Maurogordato, S., McCracken, H. J., Medinaceli, E., Mei, S., Melchior, M., Meneghetti, M., Merlin, E., Meylan, G., Mohr, J. J., Moresco, M., Moscardini, L., Munari, E., Nakajima, R., Nichol, R. C., Niemi, S. -M., Padilla, C., Paech, K., Paltani, S., Pasian, F., Peacock, J. A., Pedersen, K., Pettorino, V., Pires, S., Polenta, G., Poncet, M., Popa, L. A., Raison, F., Rebolo, R., Renzi, A., Rhodes, J., Riccio, G., Romelli, E., Roncarelli, M., Rosset, C., Rossetti, E., Saglia, R., Sapone, D., Schirmer, M., Schneider, P., Schrabback, T., Scodeggio, M., Secroun, A., Seidel, G., Serrano, S., Sirignano, C., Sirri, G., Stanco, L., Starck, J. -L., Taylor, A. N., Teplitz, H. I., Tereno, I., Toledo-Moreo, R., Torradeflot, F., Tsyganov, A., Valenziano, L., Vassallo, T., Veropalumbo, A., Wang, Y., Weller, J., Zacchei, A., Zamorani, G., Zerbi, F. M., Zoubian, J., Zucca, E., Baccigalupi, C., Bernardeau, F., Boucaud, A., Bozzo, E., Burigana, C., Calabrese, M., Casenove, P., Castignani, G., Colodro-Conde, C., Di Ferdinando, D., Vigo, J. A. Escartin, Fabbian, G., Finelli, F., Gracia-Carpio, J., Ilić, S., Liebing, P., Marcin, S., Martinelli, M., Matthew, S., Mauri, N., Pöntinen, M., Porciani, C., Sakr, Z., Scottez, V., Sefusatti, E., Steinwagner, J., Tenti, M., Viel, M., Wiesmann, M., Akrami, Y., Anselmi, S., Archidiacono, M., Atrio-Barandela, F., Aubourg, E., Balaguera-Antolinez, A., Ballardini, M., Bertacca, D., Bethermin, M., Blanchard, A., Böhringer, H., Borgani, S., Bouvard, T., Cabanac, R., Calabro, A., Quevedo, B. Camacho, Canas-Herrera, G., Cappi, A., Caro, F., Carvalho, C. S., Castro, T., Chambers, K. C., Contarini, S., Contini, T., Cooray, A. R., Costanzi, M., Cucciati, O., Davini, S., De Caro, B., de la Torre, S., Desprez, G., Díaz-Sánchez, A., Diaz, J. J., Di Domizio, S., Dole, H., Escoffier, S., Ezziati, M., Ferrari, A. G., Ferreira, P. G., Ferrero, I., Finoguenov, A., Fontana, A., Fornari, F., Gabarra, L., Ganga, K., García-Bellido, J., Gasparetto, T., Gaztanaga, E., Giacomini, F., Gianotti, F., Gonzalez, A. H., Gozaliasl, G., Hall, A., Hartley, W. G., Hildebrandt, H., Hjorth, J., Holland, A. D., Ilbert, O., Joudaki, S., Jullo, E., Kajava, J. J. E., Kansal, V., Karagiannis, D., Kirkpatrick, C. C., Graet, J. Le, Legrand, L., Lesgourgues, J., Liaudat, T. I., Loureiro, A., Macias-Perez, J., Magliocchetti, M., Mancini, C., Mannucci, F., Maoli, R., Martins, C. J. A. P., Maurin, L., Metcalf, R. B., Migliaccio, M., Miluzio, M., Mora, A., Moretti, C., Morgante, G., Nadathur, S., Nicastro, L., Walton, Nicholas A., Oguri, M., Patrizii, L., Popa, V., Pourtsidou, A., Reimberg, P., Risso, I., Rocci, P. -F., Rollins, R. P., Rusholme, B., Sahlén, M., Sánchez, A. G., Schaye, J., Schewtschenko, J. A., Schneider, A., Schultheis, M., Sereno, M., Shankar, F., Shulevski, A., Silvestri, A., Simon, P., Mancini, A. Spurio, Stanford, S. A., Tanidis, K., Tao, C., Tessore, N., Testera, G., Tewes, M., Toft, S., Tosi, S., Troja, A., Tucci, M., Valieri, C., Valiviita, J., Vergani, D., Vernizzi, F., Verza, G., Vielzeuf, P., Weaver, J. R., Zalesky, L., Dimauro, P., Duc, P. -A., Fang, Y., Ferguson, A. M. N., Gutierrez, C. M., Kova{č}ić, I., Kruk, S., Brun, A. M. C. Le, Montoro, A., Murray, C., Pagano, L., Paoletti, D., Sarpa, E., Viitanen, A., Martín-Fleitas, J., and Yung, L. Y. A.

Subjects
Astrophysics - Cosmology and Nongalactic Astrophysics
Abstract

We present the Flagship galaxy mock, a simulated catalogue of billions of galaxies designed to support the scientific exploitation of the Euclid mission. Euclid is a medium-class mission of the European Space Agency optimised to determine the properties of dark matter and dark energy on the largest scales of the Universe. It probes structure formation over more than 10 billion years primarily from the combination of weak gravitational lensing and galaxy clustering data. The breath of Euclid's data will also foster a wide variety of scientific analyses. The Flagship simulation was developed to provide a realistic approximation to the galaxies that will be observed by Euclid and used in its scientific analyses. We ran a state-of-the-art N-body simulation with four trillion particles, producing a lightcone on the fly. From the dark matter particles, we produced a catalogue of 16 billion haloes in one octant of the sky in the lightcone up to redshift z=3. We then populated these haloes with mock galaxies using a halo occupation distribution and abundance matching approach, calibrating the free parameters of the galaxy mock against observed correlations and other basic galaxy properties. Modelled galaxy properties include luminosity and flux in several bands, redshifts, positions and velocities, spectral energy distributions, shapes and sizes, stellar masses, star formation rates, metallicities, emission line fluxes, and lensing properties. We selected a final sample of 3.4 billion galaxies with a magnitude cut of H_E<26, where we are complete. We have performed a comprehensive set of validation tests to check the similarity to observational data and theoretical models. In particular, our catalogue is able to closely reproduce the main characteristics of the weak lensing and galaxy clustering samples to be used in the mission's main cosmological analysis. (abridged), Comment: Paper submitted as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Published
2024

11. Euclid. III. The NISP Instrument

Author

Euclid Collaboration, Jahnke, K., Gillard, W., Schirmer, M., Ealet, A., Maciaszek, T., Prieto, E., Barbier, R., Bonoli, C., Corcione, L., Dusini, S., Grupp, F., Hormuth, F., Ligori, S., Martin, L., Morgante, G., Padilla, C., Toledo-Moreo, R., Trifoglio, M., Valenziano, L., Bender, R., Castander, F. J., Garilli, B., Lilje, P. B., Rix, H. -W., Auricchio, N., Balestra, A., Barriere, J. -C., Battaglia, P., Berthe, M., Bodendorf, C., Boenke, T., Bon, W., Bonnefoi, A., Caillat, A., Capobianco, V., Carle, M., Casas, R., Cho, H., Costille, A., Ducret, F., Ferriol, S., Franceschi, E., Gimenez, J. -L., Holmes, W., Hornstrup, A., Jhabvala, M., Kohley, R., Kubik, B., Laureijs, R., Mignant, D. Le, Lloro, I., Medinaceli, E., Mellier, Y., Polenta, G., Racca, G. D., Renzi, A., Salvignol, J. -C., Secroun, A., Seidel, G., Seiffert, M., Sirignano, C., Sirri, G., Strada, P., Smadja, G., Stanco, L., Wachter, S., Anselmi, S., Borsato, E., Caillat, L., Cogato, F., Colodro-Conde, C., Crouzet, P. -E., Conforti, V., D'Alessandro, M., Copin, Y., Cuillandre, J. -C., Davies, J. E., Davini, S., Derosa, A., Diaz, J. J., Di Domizio, S., Di Ferdinando, D., Farinelli, R., Ferrari, A. G., Fornari, F., Gabarra, L., Gutierrez, C. M., Giacomini, F., Lagier, P., Gianotti, F., Krause, O., Madrid, F., Laudisio, F., Macias-Perez, J., Naletto, G., Niclas, M., Marpaud, J., Mauri, N., da Silva, R., Passalacqua, F., Paterson, K., Patrizii, L., Risso, I., Solheim, B. G. B., Scodeggio, M., Stassi, P., Steinwagner, J., Tenti, M., Testera, G., Travaglini, R., Tosi, S., Troja, A., Tubio, O., Valieri, C., Vescovi, C., Ventura, S., Aghanim, N., Altieri, B., Amara, A., Amiaux, J., Andreon, S., Aussel, H., Baldi, M., Bardelli, S., Basset, A., Bonchi, A., Bonino, D., Branchini, E., Brescia, M., Brinchmann, J., Camera, S., Carbone, C., Cardone, V. F., Carretero, J., Casas, S., Castellano, M., Cavuoti, S., Chabaud, P. -Y., Cimatti, A., Congedo, G., Conselice, C. J., Conversi, L., Courbin, F., Courtois, H. M., Cropper, M., Cuby, J. -G., Da Silva, A., Degaudenzi, H., Di Giorgio, A. M., Dinis, J., Douspis, M., Dubath, F., Duncan, C. A. J., Dupac, X., Fabricius, M., Farina, M., Farrens, S., Faustini, F., Fosalba, P., Fotopoulou, S., Fourmanoit, N., Frailis, M., Franzetti, P., Galeotta, S., Gillis, B., Giocoli, C., Gómez-Alvarez, P., Granett, B. R., Grazian, A., Guzzo, L., Hailey, M., Haugan, S. V. H., Hoar, J., Hoekstra, H., Hook, I., Hudelot, P., Joachimi, B., Keihänen, E., Kermiche, S., Kiessling, A., Kilbinger, M., Kitching, T., Kümmel, M., Kunz, M., Kurki-Suonio, H., Lahav, O., Lindholm, V., Alvarez, J. Lorenzo, Maino, D., Maiorano, E., Mansutti, O., Marggraf, O., Markovic, K., Martignac, J., Martinet, N., Marulli, F., Massey, R., Masters, D. C., Maurogordato, S., McCracken, H. J., Mei, S., Melchior, M., Meneghetti, M., Merlin, E., Meylan, G., Mohr, J. J., Moresco, M., Moscardini, L., Nakajima, R., Nichol, R. C., Niemi, S. -M., Nutma, T., Paech, K., Paltani, S., Pasian, F., Peacock, J. A., Pedersen, K., Percival, W. J., Pettorino, V., Pires, S., Poncet, M., Popa, L. A., Pozzetti, L., Raison, F., Rebolo, R., Refregier, A., Rhodes, J., Riccio, G., Romelli, E., Roncarelli, M., Rosset, C., Rossetti, E., Rottgering, H. J. A., Saglia, R., Sapone, D., Sauvage, M., Scaramella, R., Schneider, P., Schrabback, T., Serrano, S., Tallada-Crespí, P., Tavagnacco, D., Taylor, A. N., Teplitz, H. I., Tereno, I., Torradeflot, F., Tutusaus, I., Vassallo, T., Kleijn, G. Verdoes, Veropalumbo, A., Vibert, D., Wang, Y., Weller, J., Zacchei, A., Zamorani, G., Zerbi, F. M., Zoubian, J., Zucca, E., Appleton, P. N., Baccigalupi, C., Biviano, A., Bolzonella, M., Boucaud, A., Bozzo, E., Burigana, C., Calabrese, M., Casenove, P., Crocce, M., De Lucia, G., Vigo, J. A. Escartin, Fabbian, G., Finelli, F., George, K., Gracia-Carpio, J., Ilić, S., Liebing, P., Liu, C., Mainetti, G., Marcin, S., Martinelli, M., Morris, P. W., Neissner, C., Pezzotta, A., Pöntinen, M., Porciani, C., Sakr, Z., Scottez, V., Sefusatti, E., Viel, M., Wiesmann, M., Akrami, Y., Allevato, V., Aubourg, E., Ballardini, M., Bertacca, D., Bethermin, M., Blanchard, A., Blot, L., Borgani, S., Borlaff, A. S., Bruton, S., Cabanac, R., Calabro, A., Calderone, G., Canas-Herrera, G., Cappi, A., Carvalho, C. S., Castignani, G., Castro, T., Chambers, K. C., Charles, Y., Chary, R., Colbert, J., Contarini, S., Contini, T., Cooray, A. R., Costanzi, M., Cucciati, O., De Caro, B., de la Torre, S., Desprez, G., Díaz-Sánchez, A., Dole, H., Escoffier, S., Ferreira, P. G., Ferrero, I., Finoguenov, A., Fontana, A., Ganga, K., García-Bellido, J., Gautard, V., Gaztanaga, E., Gozaliasl, G., Gregorio, A., Hall, A., Hartley, W. G., Hemmati, S., Hildebrandt, H., Hjorth, J., Hosseini, S., Huertas-Company, M., Ilbert, O., Jacobson, J., Joudaki, S., Kajava, J. J. E., Kansal, V., Karagiannis, D., Kirkpatrick, C. C., Lacasa, F., Brun, V. Le, Graet, J. Le, Legrand, L., Libet, G., Liu, S. J., Loureiro, A., Magliocchetti, M., Mancini, C., Mannucci, F., Maoli, R., Martins, C. J. A. P., Matthew, S., Maurin, L., McPartland, C. J. R., Metcalf, R. B., Migliaccio, M., Miluzio, M., Monaco, P., Moretti, C., Nadathur, S., Nicastro, L., Walton, Nicholas A., Odier, J., Oguri, M., Popa, V., Potter, D., Pourtsidou, A., Rocci, P. -F., Rollins, R. P., Rusholme, B., Sahlén, M., Sánchez, A. G., Scarlata, C., Schaye, J., Schewtschenko, J. A., Schneider, A., Schultheis, M., Sereno, M., Shankar, F., Shulevski, A., Sikkema, G., Silvestri, A., Simon, P., Mancini, A. Spurio, Stadel, J., Stanford, S. A., Tanidis, K., Tao, C., Tessore, N., Teyssier, R., Toft, S., Tucci, M., Valiviita, J., Vergani, D., Vernizzi, F., Verza, G., Vielzeuf, P., Weaver, J. R., Zalesky, L., Zinchenko, I. A., Archidiacono, M., Atrio-Barandela, F., Bennett, C. L., Bouvard, T., Caro, F., Conseil, S., Dimauro, P., Duc, P. -A., Fang, Y., Ferguson, A. M. N., Gasparetto, T., Kova{č}ić, I., Kruk, S., Brun, A. M. C. Le, Liaudat, T. I., Montoro, A., Mora, A., Murray, C., Pagano, L., Paoletti, D., Radovich, M., Sarpa, E., Tommasi, E., Viitanen, A., Lesgourgues, J., Levi, M. E., and Martín-Fleitas, J.

Subjects
Astrophysics - Instrumentation and Methods for Astrophysics, Astrophysics - Cosmology and Nongalactic Astrophysics, Astrophysics - Astrophysics of Galaxies
Abstract

The Near-Infrared Spectrometer and Photometer (NISP) on board the Euclid satellite provides multiband photometry and R>=450 slitless grism spectroscopy in the 950-2020nm wavelength range. In this reference article we illuminate the background of NISP's functional and calibration requirements, describe the instrument's integral components, and provide all its key properties. We also sketch the processes needed to understand how NISP operates and is calibrated, and its technical potentials and limitations. Links to articles providing more details and technical background are included. NISP's 16 HAWAII-2RG (H2RG) detectors with a plate scale of 0.3" pix^-1 deliver a field-of-view of 0.57deg^2. In photo mode, NISP reaches a limiting magnitude of ~24.5AB mag in three photometric exposures of about 100s exposure time, for point sources and with a signal-to-noise ratio (SNR) of 5. For spectroscopy, NISP's point-source sensitivity is a SNR = 3.5 detection of an emission line with flux ~2x10^-16erg/s/cm^2 integrated over two resolution elements of 13.4A, in 3x560s grism exposures at 1.6 mu (redshifted Ha). Our calibration includes on-ground and in-flight characterisation and monitoring of detector baseline, dark current, non-linearity, and sensitivity, to guarantee a relative photometric accuracy of better than 1.5%, and relative spectrophotometry to better than 0.7%. The wavelength calibration must be better than 5A. NISP is the state-of-the-art instrument in the NIR for all science beyond small areas available from HST and JWST - and an enormous advance due to its combination of field size and high throughput of telescope and instrument. During Euclid's 6-year survey covering 14000 deg^2 of extragalactic sky, NISP will be the backbone for determining distances of more than a billion galaxies. Its NIR data will become a rich reference imaging and spectroscopy data set for the coming decades., Comment: Paper submitted as part of the A&A special issue 'Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Published
2024

12. Euclid. I. Overview of the Euclid mission

Author

Euclid Collaboration, Mellier, Y., Abdurro'uf, Barroso, J. A. Acevedo, Achúcarro, A., Adamek, J., Adam, R., Addison, G. E., Aghanim, N., Aguena, M., Ajani, V., Akrami, Y., Al-Bahlawan, A., Alavi, A., Albuquerque, I. S., Alestas, G., Alguero, G., Allaoui, A., Allen, S. W., Allevato, V., Alonso-Tetilla, A. V., Altieri, B., Alvarez-Candal, A., Alvi, S., Amara, A., Amendola, L., Amiaux, J., Andika, I. T., Andreon, S., Andrews, A., Angora, G., Angulo, R. E., Annibali, F., Anselmi, A., Anselmi, S., Arcari, S., Archidiacono, M., Aricò, G., Arnaud, M., Arnouts, S., Asgari, M., Asorey, J., Atayde, L., Atek, H., Atrio-Barandela, F., Aubert, M., Aubourg, E., Auphan, T., Auricchio, N., Aussel, B., Aussel, H., Avelino, P. P., Avgoustidis, A., Avila, S., Awan, S., Azzollini, R., Baccigalupi, C., Bachelet, E., Bacon, D., Baes, M., Bagley, M. B., Bahr-Kalus, B., Balaguera-Antolinez, A., Balbinot, E., Balcells, M., Baldi, M., Baldry, I., Balestra, A., Ballardini, M., Ballester, O., Balogh, M., Bañados, E., Barbier, R., Bardelli, S., Baron, M., Barreiro, T., Barrena, R., Barriere, J. -C., Barros, B. J., Barthelemy, A., Bartolo, N., Basset, A., Battaglia, P., Battisti, A. J., Baugh, C. M., Baumont, L., Bazzanini, L., Beaulieu, J. -P., Beckmann, V., Belikov, A. N., Bel, J., Bellagamba, F., Bella, M., Bellini, E., Benabed, K., Bender, R., Benevento, G., Bennett, C. L., Benson, K., Bergamini, P., Bermejo-Climent, J. R., Bernardeau, F., Bertacca, D., Berthe, M., Berthier, J., Bethermin, M., Beutler, F., Bevillon, C., Bhargava, S., Bhatawdekar, R., Bianchi, D., Bisigello, L., Biviano, A., Blake, R. P., Blanchard, A., Blazek, J., Blot, L., Bosco, A., Bodendorf, C., Boenke, T., Böhringer, H., Boldrini, P., Bolzonella, M., Bonchi, A., Bonici, M., Bonino, D., Bonino, L., Bonvin, C., Bon, W., Booth, J. T., Borgani, S., Borlaff, A. S., Borsato, E., Bose, B., Botticella, M. T., Boucaud, A., Bouche, F., Boucher, J. S., Boutigny, D., Bouvard, T., Bouwens, R., Bouy, H., Bowler, R. A. A., Bozza, V., Bozzo, E., Branchini, E., Brando, G., Brau-Nogue, S., Brekke, P., Bremer, M. N., Brescia, M., Breton, M. -A., Brinchmann, J., Brinckmann, T., Brockley-Blatt, C., Brodwin, M., Brouard, L., Brown, M. L., Bruton, S., Bucko, J., Buddelmeijer, H., Buenadicha, G., Buitrago, F., Burger, P., Burigana, C., Busillo, V., Busonero, D., Cabanac, R., Cabayol-Garcia, L., Cagliari, M. S., Caillat, A., Caillat, L., Calabrese, M., Calabro, A., Calderone, G., Calura, F., Quevedo, B. Camacho, Camera, S., Campos, L., Canas-Herrera, G., Candini, G. P., Cantiello, M., Capobianco, V., Cappellaro, E., Cappelluti, N., Cappi, A., Caputi, K. I., Cara, C., Carbone, C., Cardone, V. F., Carella, E., Carlberg, R. G., Carle, M., Carminati, L., Caro, F., Carrasco, J. M., Carretero, J., Carrilho, P., Duque, J. Carron, Carry, B., Carvalho, A., Carvalho, C. S., Casas, R., Casas, S., Casenove, P., Casey, C. M., Cassata, P., Castander, F. J., Castelao, D., Castellano, M., Castiblanco, L., Castignani, G., Castro, T., Cavet, C., Cavuoti, S., Chabaud, P. -Y., Chambers, K. C., Charles, Y., Charlot, S., Chartab, N., Chary, R., Chaumeil, F., Cho, H., Chon, G., Ciancetta, E., Ciliegi, P., Cimatti, A., Cimino, M., Cioni, M. -R. L., Claydon, R., Cleland, C., Clément, B., Clements, D. L., Clerc, N., Clesse, S., Codis, S., Cogato, F., Colbert, J., Cole, R. E., Coles, P., Collett, T. E., Collins, R. S., Colodro-Conde, C., Colombo, C., Combes, F., Conforti, V., Congedo, G., Conseil, S., Conselice, C. J., Contarini, S., Contini, T., Conversi, L., Cooray, A. R., Copin, Y., Corasaniti, P. -S., Corcho-Caballero, P., Corcione, L., Cordes, O., Corpace, O., Correnti, M., Costanzi, M., Costille, A., Courbin, F., Mifsud, L. Courcoult, Courtois, H. M., Cousinou, M. -C., Covone, G., Cowell, T., Cragg, C., Cresci, G., Cristiani, S., Crocce, M., Cropper, M., Crouzet, P. E, Csizi, B., Cuby, J. -G., Cucchetti, E., Cucciati, O., Cuillandre, J. -C., Cunha, P. A. C., Cuozzo, V., Daddi, E., D'Addona, M., Dafonte, C., Dagoneau, N., Dalessandro, E., Dalton, G. B., D'Amico, G., Dannerbauer, H., Danto, P., Das, I., Da Silva, A., da Silva, R., Doumerg, W. d'Assignies, Daste, G., Davies, J. E., Davini, S., Dayal, P., de Boer, T., Decarli, R., De Caro, B., Degaudenzi, H., Degni, G., de Jong, J. T. A., de la Bella, L. F., de la Torre, S., Delhaise, F., Delley, D., Delucchi, G., De Lucia, G., Denniston, J., De Paolis, F., De Petris, M., Derosa, A., Desai, S., Desjacques, V., Despali, G., Desprez, G., De Vicente-Albendea, J., Deville, Y., Dias, J. D. F., Díaz-Sánchez, A., Diaz, J. J., Di Domizio, S., Diego, J. M., Di Ferdinando, D., Di Giorgio, A. M., Dimauro, P., Dinis, J., Dolag, K., Dolding, C., Dole, H., Sánchez, H. Domínguez, Doré, O., Dournac, F., Douspis, M., Dreihahn, H., Droge, B., Dryer, B., Dubath, F., Duc, P. -A., Ducret, F., Duffy, C., Dufresne, F., Duncan, C. A. J., Dupac, X., Duret, V., Durrer, R., Durret, F., Dusini, S., Ealet, A., Eggemeier, A., Eisenhardt, P. R. M., Elbaz, D., Elkhashab, M. Y., Ellien, A., Endicott, J., Enia, A., Erben, T., Vigo, J. A. Escartin, Escoffier, S., Sanz, I. Escudero, Essert, J., Ettori, S., Ezziati, M., Fabbian, G., Fabricius, M., Fang, Y., Farina, A., Farina, M., Farinelli, R., Farrens, S., Faustini, F., Feltre, A., Ferguson, A. M. N., Ferrando, P., Ferrari, A. G., Ferré-Mateu, A., Ferreira, P. G., Ferreras, I., Ferrero, I., Ferriol, S., Ferruit, P., Filleul, D., Finelli, F., Finkelstein, S. L., Finoguenov, A., Fiorini, B., Flentge, F., Focardi, P., Fonseca, J., Fontana, A., Fontanot, F., Fornari, F., Fosalba, P., Fossati, M., Fotopoulou, S., Fouchez, D., Fourmanoit, N., Frailis, M., Fraix-Burnet, D., Franceschi, E., Franco, A., Franzetti, P., Freihoefer, J., Frenk, C. . S., Frittoli, G., Frugier, P. -A., Frusciante, N., Fumagalli, A., Fumagalli, M., Fumana, M., Fu, Y., Gabarra, L., Galeotta, S., Galluccio, L., Ganga, K., Gao, H., García-Bellido, J., Garcia, K., Gardner, J. P., Garilli, B., Gaspar-Venancio, L. -M., Gasparetto, T., Gautard, V., Gavazzi, R., Gaztanaga, E., Genolet, L., Santos, R. Genova, Gentile, F., George, K., Gerbino, M., Ghaffari, Z., Giacomini, F., Gianotti, F., Gibb, G. P. S., Gillard, W., Gillis, B., Ginolfi, M., Giocoli, C., Girardi, M., Giri, S. K., Goh, L. W. K., Gómez-Alvarez, P., Gonzalez-Perez, V., Gonzalez, A. H., Gonzalez, E. J., Gonzalez, J. C., Beauchamps, S. Gouyou, Gozaliasl, G., Gracia-Carpio, J., Grandis, S., Granett, B. R., Granvik, M., Grazian, A., Gregorio, A., Grenet, C., Grillo, C., Grupp, F., Gruppioni, C., Gruppuso, A., Guerbuez, C., Guerrini, S., Guidi, M., Guillard, P., Gutierrez, C. M., Guttridge, P., Guzzo, L., Gwyn, S., Haapala, J., Haase, J., Haddow, C. R., Hailey, M., Hall, A., Hall, D., Hamaus, N., Haridasu, B. S., Harnois-Déraps, J., Harper, C., Hartley, W. G., Hasinger, G., Hassani, F., Hatch, N. A., Haugan, S. V. H., Häußler, B., Heavens, A., Heisenberg, L., Helmi, A., Helou, G., Hemmati, S., Henares, K., Herent, O., Hernández-Monteagudo, C., Heuberger, T., Hewett, P. C., Heydenreich, S., Hildebrandt, H., Hirschmann, M., Hjorth, J., Hoar, J., Hoekstra, H., Holland, A. D., Holliman, M. S., Holmes, W., Hook, I., Horeau, B., Hormuth, F., Hornstrup, A., Hosseini, S., Hu, D., Hudelot, P., Hudson, M. J., Huertas-Company, M., Huff, E. M., Hughes, A. C. N., Humphrey, A., Hunt, L. K., Huynh, D. D., Ibata, R., Ichikawa, K., Iglesias-Groth, S., Ilbert, O., Ilić, S., Ingoglia, L., Iodice, E., Israel, H., Israelsson, U. E., Izzo, L., Jablonka, P., Jackson, N., Jacobson, J., Jafariyazani, M., Jahnke, K., Jain, B., Jansen, H., Jarvis, M. J., Jasche, J., Jauzac, M., Jeffrey, N., Jhabvala, M., Jimenez-Teja, Y., Muñoz, A. Jimenez, Joachimi, B., Johansson, P. H., Joudaki, S., Jullo, E., Kajava, J. J. E., Kang, Y., Kannawadi, A., Kansal, V., Karagiannis, D., Kärcher, M., Kashlinsky, A., Kazandjian, M. V., Keck, F., Keihänen, E., Kerins, E., Kermiche, S., Khalil, A., Kiessling, A., Kiiveri, K., Kilbinger, M., Kim, J., King, R., Kirkpatrick, C. C., Kitching, T., Kluge, M., Knabenhans, M., Knapen, J. H., Knebe, A., Kneib, J. -P., Kohley, R., Koopmans, L. V. E., Koskinen, H., Koulouridis, E., Kou, R., Kovács, A., Kovačić, I., Kowalczyk, A., Koyama, K., Kraljic, K., Krause, O., Kruk, S., Kubik, B., Kuchner, U., Kuijken, K., Kümmel, M., Kunz, M., Kurki-Suonio, H., Lacasa, F., Lacey, C. G., La Franca, F., Lagarde, N., Lahav, O., Laigle, C., La Marca, A., La Marle, O., Lamine, B., Lam, M. C., Lançon, A., Landt, H., Langer, M., Lapi, A., Larcheveque, C., Larsen, S. S., Lattanzi, M., Laudisio, F., Laugier, D., Laureijs, R., Laurent, V., Lavaux, G., Lawrenson, A., Lazanu, A., Lazeyras, T., Boulc'h, Q. Le, Brun, A. M. C. Le, Brun, V. Le, Leclercq, F., Lee, S., Graet, J. Le, Legrand, L., Leirvik, K. N., Jeune, M. Le, Lembo, M., Mignant, D. Le, Lepinzan, M. D., Lepori, F., Reun, A. Le, Leroy, G., Lesci, G. F., Lesgourgues, J., Leuzzi, L., Levi, M. E., Liaudat, T. I., Libet, G., Liebing, P., Ligori, S., Lilje, P. B., Lin, C. -C., Linde, D., Linder, E., Lindholm, V., Linke, L., Li, S. -S., Liu, S. J., Lloro, I., Lobo, F. S. N., Lodieu, N., Lombardi, M., Lombriser, L., Lonare, P., Longo, G., López-Caniego, M., Lopez, X. Lopez, Alvarez, J. Lorenzo, Loureiro, A., Loveday, J., Lusso, E., Macias-Perez, J., Maciaszek, T., Maggio, G., Magliocchetti, M., Magnard, F., Magnier, E. A., Magro, A., Mahler, G., Mainetti, G., Maino, D., Maiorano, E., Malavasi, N., Mamon, G. A., Mancini, C., Mandelbaum, R., Manera, M., Manjón-García, A., Mannucci, F., Mansutti, O., Outeiro, M. Manteiga, Maoli, R., Maraston, C., Marcin, S., Marcos-Arenal, P., Margalef-Bentabol, B., Marggraf, O., Marinucci, D., Marinucci, M., Markovic, K., Marleau, F. R., Marpaud, J., Martignac, J., Martín-Fleitas, J., Martin-Moruno, P., Martin, E. L., Martinelli, M., Martinet, N., Martin, H., Martins, C. J. A. P., Marulli, F., Massari, D., Massey, R., Masters, D. C., Matarrese, S., Matsuoka, Y., Matthew, S., Maughan, B. J., Mauri, N., Maurin, L., Maurogordato, S., McCarthy, K., McConnachie, A. W., McCracken, H. J., McDonald, I., McEwen, J. D., McPartland, C. J. R., Medinaceli, E., Mehta, V., Mei, S., Melchior, M., Melin, J. -B., Ménard, B., Mendes, J., Mendez-Abreu, J., Meneghetti, M., Mercurio, A., Merlin, E., Metcalf, R. B., Meylan, G., Migliaccio, M., Mignoli, M., Miller, L., Miluzio, M., Milvang-Jensen, B., Mimoso, J. P., Miquel, R., Miyatake, H., Mobasher, B., Mohr, J. J., Monaco, P., Monguió, M., Montoro, A., Mora, A., Dizgah, A. Moradinezhad, Moresco, M., Moretti, C., Morgante, G., Morisset, N., Moriya, T. J., Morris, P. W., Mortlock, D. J., Moscardini, L., Mota, D. F., Mottet, S., Moustakas, L. A., Moutard, T., Müller, T., Munari, E., Murphree, G., Murray, C., Murray, N., Musi, P., Nadathur, S., Nagam, B. C., Nagao, T., Naidoo, K., Nakajima, R., Nally, C., Natoli, P., Navarro-Alsina, A., Girones, D. Navarro, Neissner, C., Nersesian, A., Nesseris, S., Nguyen-Kim, H. N., Nicastro, L., Nichol, R. C., Nielbock, M., Niemi, S. -M., Nieto, S., Nilsson, K., Noller, J., Norberg, P., Nouri-Zonoz, A., Ntelis, P., Nucita, A. A., Nugent, P., Nunes, N. J., Nutma, T., Ocampo, I., Odier, J., Oesch, P. A., Oguri, M., Oliveira, D. Magalhaes, Onoue, M., Oosterbroek, T., Oppizzi, F., Ordenovic, C., Osato, K., Pacaud, F., Pace, F., Padilla, C., Paech, K., Pagano, L., Page, M. J., Palazzi, E., Paltani, S., Pamuk, S., Pandolfi, S., Paoletti, D., Paolillo, M., Papaderos, P., Pardede, K., Parimbelli, G., Parmar, A., Partmann, C., Pasian, F., Passalacqua, F., Paterson, K., Patrizii, L., Pattison, C., Paulino-Afonso, A., Paviot, R., Peacock, J. A., Pearce, F. R., Pedersen, K., Peel, A., Peletier, R. F., Ibanez, M. Pellejero, Pello, R., Penny, M. T., Percival, W. J., Perez-Garrido, A., Perotto, L., Pettorino, V., Pezzotta, A., Pezzuto, S., Philippon, A., Pierre, M., Piersanti, O., Pietroni, M., Piga, L., Pilo, L., Pires, S., Pisani, A., Pizzella, A., Pizzuti, L., Plana, C., Polenta, G., Pollack, J. E., Poncet, M., Pöntinen, M., Pool, P., Popa, L. A., Popa, V., Popp, J., Porciani, C., Porth, L., Potter, D., Poulain, M., Pourtsidou, A., Pozzetti, L., Prandoni, I., Pratt, G. W., Prezelus, S., Prieto, E., Pugno, A., Quai, S., Quilley, L., Racca, G. D., Raccanelli, A., Rácz, G., Radinović, S., Radovich, M., Ragagnin, A., Ragnit, U., Raison, F., Ramos-Chernenko, N., Ranc, C., Rasera, Y., Raylet, N., Rebolo, R., Refregier, A., Reimberg, P., Reiprich, T. H., Renk, F., Renzi, A., Retre, J., Revaz, Y., Reylé, C., Reynolds, L., Rhodes, J., Ricci, F., Ricci, M., Riccio, G., Ricken, S. O., Rissanen, S., Risso, I., Rix, H. -W., Robin, A. C., Rocca-Volmerange, B., Rocci, P. -F., Rodenhuis, M., Rodighiero, G., Monroy, M. Rodriguez, Rollins, R. P., Romanello, M., Roman, J., Romelli, E., Romero-Gomez, M., Roncarelli, M., Rosati, P., Rosset, C., Rossetti, E., Roster, W., Rottgering, H. J. A., Rozas-Fernández, A., Ruane, K., Rubino-Martin, J. A., Rudolph, A., Ruppin, F., Rusholme, B., Sacquegna, S., Sáez-Casares, I., Saga, S., Saglia, R., Sahlén, M., Saifollahi, T., Sakr, Z., Salvalaggio, J., Salvaterra, R., Salvati, L., Salvato, M., Salvignol, J. -C., Sánchez, A. G., Sanchez, E., Sanders, D. B., Sapone, D., Saponara, M., Sarpa, E., Sarron, F., Sartori, S., Sartoris, B., Sassolas, B., Sauniere, L., Sauvage, M., Sawicki, M., Scaramella, R., Scarlata, C., Scharré, L., Schaye, J., Schewtschenko, J. A., Schindler, J. -T., Schinnerer, E., Schirmer, M., Schmidt, F., Schmidt, M., Schneider, A., Schneider, M., Schneider, P., Schöneberg, N., Schrabback, T., Schultheis, M., Schulz, S., Schuster, N., Schwartz, J., Sciotti, D., Scodeggio, M., Scognamiglio, D., Scott, D., Scottez, V., Secroun, A., Sefusatti, E., Seidel, G., Seiffert, M., Sellentin, E., Selwood, M., Semboloni, E., Sereno, M., Serjeant, S., Serrano, S., Setnikar, G., Shankar, F., Sharples, R. M., Short, A., Shulevski, A., Shuntov, M., Sias, M., Sikkema, G., Silvestri, A., Simon, P., Sirignano, C., Sirri, G., Skottfelt, J., Slezak, E., Sluse, D., Smith, G. P., Smith, L. C., Smith, R. E., Smit, S. J. A., Soldano, F., Solheim, B. G. B., Sorce, J. G., Sorrenti, F., Soubrie, E., Spinoglio, L., Mancini, A. Spurio, Stadel, J., Stagnaro, L., Stanco, L., Stanford, S. A., Starck, J. -L., Stassi, P., Steinwagner, J., Stern, D., Stone, C., Strada, P., Strafella, F., Stramaccioni, D., Surace, C., Sureau, F., Suyu, S. H., Swindells, I., Szafraniec, M., Szapudi, I., Taamoli, S., Talia, M., Tallada-Crespí, P., Tanidis, K., Tao, C., Tarrío, P., Tavagnacco, D., Taylor, A. N., Taylor, J. E., Taylor, P. L., Teixeira, E. M., Tenti, M., Idiago, P. Teodoro, Teplitz, H. I., Tereno, I., Tessore, N., Testa, V., Testera, G., Tewes, M., Teyssier, R., Theret, N., Thizy, C., Thomas, P. D., Toba, Y., Toft, S., Toledo-Moreo, R., Tolstoy, E., Tommasi, E., Torbaniuk, O., Torradeflot, F., Tortora, C., Tosi, S., Tosti, S., Trifoglio, M., Troja, A., Trombetti, T., Tronconi, A., Tsedrik, M., Tsyganov, A., Tucci, M., Tutusaus, I., Uhlemann, C., Ulivi, L., Urbano, M., Vacher, L., Vaillon, L., Valageas, P., Valdes, I., Valentijn, E. A., Valenziano, L., Valieri, C., Valiviita, J., Broeck, M. Van den, Vassallo, T., Vavrek, R., Vega-Ferrero, J., Venemans, B., Venhola, A., Ventura, S., Kleijn, G. Verdoes, Vergani, D., Verma, A., Vernizzi, F., Veropalumbo, A., Verza, G., Vescovi, C., Vibert, D., Viel, M., Vielzeuf, P., Viglione, C., Viitanen, A., Villaescusa-Navarro, F., Vinciguerra, S., Visticot, F., Voggel, K., von Wietersheim-Kramsta, M., Vriend, W. J., Wachter, S., Walmsley, M., Walth, G., Walton, D. M., Walton, N. A., Wander, M., Wang, L., Wang, Y., Weaver, J. R., Weller, J., Wetzstein, M., Whalen, D. J., Whittam, I. H., Widmer, A., Wiesmann, M., Wilde, J., Williams, O. R., Winther, H. -A., Wittje, A., Wong, J. H. W., Wright, A. H., Yankelevich, V., Yeung, H. W., Yoon, M., Youles, S., Yung, L. Y. A., Zacchei, A., Zalesky, L., Zamorani, G., Vitorelli, A. Zamorano, Marc, M. Zanoni, Zennaro, M., Zerbi, F. M., Zinchenko, I. A., Zoubian, J., Zucca, E., and Zumalacarregui, M.

Subjects
Astrophysics - Cosmology and Nongalactic Astrophysics, Astrophysics - Astrophysics of Galaxies, Astrophysics - Instrumentation and Methods for Astrophysics
Abstract

The current standard model of cosmology successfully describes a variety of measurements, but the nature of its main ingredients, dark matter and dark energy, remains unknown. Euclid is a medium-class mission in the Cosmic Vision 2015-2025 programme of the European Space Agency (ESA) that will provide high-resolution optical imaging, as well as near-infrared imaging and spectroscopy, over about 14,000 deg^2 of extragalactic sky. In addition to accurate weak lensing and clustering measurements that probe structure formation over half of the age of the Universe, its primary probes for cosmology, these exquisite data will enable a wide range of science. This paper provides a high-level overview of the mission, summarising the survey characteristics, the various data-processing steps, and data products. We also highlight the main science objectives and expected performance., Comment: Accepted for publication in the A&A special issue`Euclid on Sky'

Published
2024

13. Euclid. II. The VIS Instrument

Author

Euclid Collaboration, Cropper, M., Al-Bahlawan, A., Amiaux, J., Awan, S., Azzollini, R., Benson, K., Berthe, M., Boucher, J., Bozzo, E., Brockley-Blatt, C., Candini, G. P., Cara, C., Chaudery, R. A., Cole, R. E., Danto, P., Denniston, J., Di Giorgio, A. M., Dryer, B., Endicott, J., Dubois, J. -P., Farina, M., Galli, E., Genolet, L., Gow, J. P. D., Guttridge, P., Hailey, M., Hall, D., Harper, C., Holland, A. D., Horeau, B., Hu, D., King, R., James, R. E., Larcheveque, C., Khalil, A., Lawrenson, A., Liebing, P., Martignac, J., McCracken, H. J., Murray, N., Nakajima, R., Niemi, S. -M., Pendem, A., Paltani, S., Philippon, A., Pool, P., Plana, C., Pottinger, S., Racca, G. D., Rousseau, A., Ruane, K., Salatti, M., Salvignol, J. -C., Sciortino, A., Short, Alexander, Liu, S. J., Skottfelt, J., Swindells, I., Smit, S. J. A., Szafraniec, M., Thomas, P. D., Thomas, W., Tommasi, E., Winter, B., Tosti, S., Visticot, F., Walton, D. M., Willis, G., Mora, A., Kohley, R., Massey, R., Nightingale, J. W., Kitching, T., Hoekstra, H., Aghanim, N., Altieri, B., Amara, A., Andreon, S., Auricchio, N., Aussel, H., Baldi, M., Balestra, A., Bardelli, S., Basset, A., Bender, R., Bodendorf, C., Boenke, T., Bonino, D., Branchini, E., Brescia, M., Brinchmann, J., Camera, S., Capobianco, V., Carbone, C., Cardone, V. F., Carretero, J., Casas, R., Casas, S., Castander, F. J., Castellano, M., Cavuoti, S., Cimatti, A., Congedo, G., Conselice, C. J., Conversi, L., Copin, Y., Courbin, F., Courtois, H. M., Cuby, J. -G., Cuillandre, J. -C., Da Silva, A., Degaudenzi, H., Dinis, J., Dolding, C., Douspis, M., Duncan, C. A. J., Dupac, X., Dusini, S., Ealet, A., Fabricius, M., Farrens, S., Ferriol, S., Fosalba, P., Fotopoulou, S., Frailis, M., Franceschi, E., Franzetti, P., Frugier, P. -A., Fumana, M., Galeotta, S., Garilli, B., Gillard, W., Gillis, B., Giocoli, C., Gómez-Alvarez, P., Granett, B. R., Grazian, A., Grupp, F., Guzzo, L., Haugan, S. V. H., Herent, O., Hoar, J., Holliman, M. S., Hook, I., Hormuth, F., Hornstrup, A., Hudelot, P., Jahnke, K., Jhabvala, M., Joachimi, B., Keihänen, E., Kermiche, S., Kilbinger, M., Kubik, B., Kuijken, K., Kümmel, M., Kunz, M., Kurki-Suonio, H., Lahav, O., Laureijs, R., Ligori, S., Lilje, P. B., Lindholm, V., Lloro, I., Alvarez, J. Lorenzo, Maino, D., Maiorano, E., Mansutti, O., Marggraf, O., Martinet, N., Marulli, F., Masters, D. C., Maurogordato, S., Medinaceli, E., Mei, S., Melchior, M., Mellier, Y., Meneghetti, M., Merlin, E., Meylan, G., Miller, L., Mohr, J. J., Moresco, M., Moscardini, L., Nichol, R. C., Nutma, T., Padilla, C., Paech, K., Pasian, F., Peacock, J. A., Pedersen, K., Percival, W. J., Pettorino, V., Pires, S., Polenta, G., Poncet, M., Popa, L. A., Pozzetti, L., Raison, F., Rebolo, R., Refregier, A., Renzi, A., Riccio, G., Rix, Hans-Walter, Romelli, E., Roncarelli, M., Rosset, C., Rossetti, E., Rottgering, H. J. A., Saglia, R., Sapone, D., Sauvage, M., Scaramella, R., Schirmer, M., Schneider, P., Schrabback, T., Secroun, A., Seidel, G., Serrano, S., Sirignano, C., Sirri, G., Stanco, L., Starck, J. -L., Tallada-Crespí, P., Tavagnacco, D., Taylor, A. N., Teplitz, H. I., Tereno, I., Toledo-Moreo, R., Torradeflot, F., Tutusaus, I., Valentijn, E. A., Valenziano, L., Vassallo, T., Kleijn, G. Verdoes, Veropalumbo, A., Wachter, S., Wang, Y., Weller, J., Zamorani, G., Zoubian, J., Zucca, E., Baccigalupi, C., Bernardeau, F., Biviano, A., Bolzonella, M., Boucaud, A., Burigana, C., Calabrese, M., Casenove, P., Colodro-Conde, C., Crocce, M., De Lucia, G., Di Ferdinando, D., Vigo, J. A. Escartin, Fabbian, G., Farinelli, R., Finelli, F., George, K., Gracia-Carpio, J., Ilić, S., Israel, H., Mainetti, G., Marcin, S., Martinelli, M., Mauri, N., Neissner, C., Nguyen-Kim, H. N., Pezzotta, A., Pöntinen, M., Porciani, C., Sakr, Z., Scottez, V., Sefusatti, E., Tenti, M., Viel, M., Wiesmann, M., Akrami, Y., Allevato, V., Anselmi, S., Aubourg, E., Ballardini, M., Bertacca, D., Bethermin, M., Blanchard, A., Blot, L., Borgani, S., Borlaff, A. S., Bruton, S., Cabanac, R., Calabro, A., Calderone, G., Canas-Herrera, G., Cappi, A., Carvalho, C. S., Castignani, G., Castro, T., Chambers, K. C., Chary, R., Contarini, S., Cooray, A. R., Cordes, O., Costanzi, M., Cucciati, O., Davini, S., De Caro, B., Desprez, G., Díaz-Sánchez, A., Di Domizio, S., Dole, H., Escoffier, S., Ferrari, A. G., Ferreira, P. G., Ferrero, I., Finoguenov, A., Fontana, A., Fornari, F., Gabarra, L., Ganga, K., García-Bellido, J., Gautard, V., Gaztanaga, E., Giacomini, F., Gianotti, F., Gozaliasl, G., Gregorio, A., Hall, A., Hartley, W. G., Hildebrandt, H., Hjorth, J., Huertas-Company, M., Ilbert, O., Joudaki, S., Kajava, J. J. E., Kansal, V., Karagiannis, D., Kirkpatrick, C. C., Lacasa, F., Graet, J. Le, Legrand, L., Libet, G., Loureiro, A., Macias-Perez, J., Magliocchetti, M., Mancini, C., Mannucci, F., Maoli, R., Martins, C. J. A. P., Matthew, S., Maurin, L., McPartland, C. J. R., Metcalf, R. B., Migliaccio, M., Miluzio, M., Monaco, P., Moretti, C., Morgante, G., Nadathur, S., Walton, Nicholas A., Odier, J., Oguri, M., Patrizii, L., Popa, V., Potter, D., Pourtsidou, A., Reimberg, P., Risso, I., Rocci, P. -F., Rollins, R. P., Rusholme, B., Sahlén, M., Sánchez, A. G., Scarlata, C., Schaye, J., Schewtschenko, J. A., Schneider, A., Schultheis, M., Sereno, M., Shankar, F., Sikkema, G., Silvestri, A., Simon, P., Mancini, A. Spurio, Stadel, J., Stanford, S. A., Steinwagner, J., Tanidis, K., Tao, C., Tessore, N., Testera, G., Tewes, M., Teyssier, R., Toft, S., Tosi, S., Troja, A., Tucci, M., Valieri, C., Valiviita, J., Vergani, D., Vernizzi, F., Verza, G., Vielzeuf, P., Weaver, J. R., Zalesky, L., Zinchenko, I. A., Archidiacono, M., Atrio-Barandela, F., Bouvard, T., Caro, F., Dimauro, P., Duc, P. -A., Fang, Y., Ferguson, A. M. N., Gasparetto, T., Gutierrez, C. M., Kova{č}ić, I., Kruk, S., Brun, A. M. C. Le, Liaudat, T. I., Montoro, A., Murray, C., Pagano, L., Paoletti, D., Sarpa, E., Viitanen, A., Lesgourgues, J., and Martín-Fleitas, J.

Subjects
Astrophysics - Instrumentation and Methods for Astrophysics, Astrophysics - Cosmology and Nongalactic Astrophysics
Abstract

This paper presents the specification, design, and development of the Visible Camera (VIS) on the ESA Euclid mission. VIS is a large optical-band imager with a field of view of 0.54 deg^2 sampled at 0.1" with an array of 609 Megapixels and spatial resolution of 0.18". It will be used to survey approximately 14,000 deg^2 of extragalactic sky to measure the distortion of galaxies in the redshift range z=0.1-1.5 resulting from weak gravitational lensing, one of the two principal cosmology probes of Euclid. With photometric redshifts, the distribution of dark matter can be mapped in three dimensions, and, from how this has changed with look-back time, the nature of dark energy and theories of gravity can be constrained. The entire VIS focal plane will be transmitted to provide the largest images of the Universe from space to date, reaching m_AB>24.5 with S/N >10 in a single broad I_E~(r+i+z) band over a six year survey. The particularly challenging aspects of the instrument are the control and calibration of observational biases, which lead to stringent performance requirements and calibration regimes. With its combination of spatial resolution, calibration knowledge, depth, and area covering most of the extra-Galactic sky, VIS will also provide a legacy data set for many other fields. This paper discusses the rationale behind the VIS concept and describes the instrument design and development before reporting the pre-launch performance derived from ground calibrations and brief results from the in-orbit commissioning. VIS should reach fainter than m_AB=25 with S/N>10 for galaxies of full-width half-maximum of 0.3" in a 1.3" diameter aperture over the Wide Survey, and m_AB>26.4 for a Deep Survey that will cover more than 50 deg^2. The paper also describes how VIS works with the other Euclid components of survey, telescope, and science data processing to extract the cosmological information., Comment: Paper submitted as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Published
2024

14. MS MARCO Web Search: a Large-scale Information-rich Web Dataset with Millions of Real Click Labels

Author

Chen, Qi, Geng, Xiubo, Rosset, Corby, Buractaon, Carolyn, Lu, Jingwen, Shen, Tao, Zhou, Kun, Xiong, Chenyan, Gong, Yeyun, Bennett, Paul, Craswell, Nick, Xie, Xing, Yang, Fan, Tower, Bryan, Rao, Nikhil, Dong, Anlei, Jiang, Wenqi, Liu, Zheng, Li, Mingqin, Liu, Chuanjie, Li, Zengzhong, Majumder, Rangan, Neville, Jennifer, Oakley, Andy, Risvik, Knut Magne, Simhadri, Harsha Vardhan, Varma, Manik, Wang, Yujing, Yang, Linjun, Yang, Mao, and Zhang, Ce

Subjects
Computer Science - Information Retrieval
Abstract

Recent breakthroughs in large models have highlighted the critical significance of data scale, labels and modals. In this paper, we introduce MS MARCO Web Search, the first large-scale information-rich web dataset, featuring millions of real clicked query-document labels. This dataset closely mimics real-world web document and query distribution, provides rich information for various kinds of downstream tasks and encourages research in various areas, such as generic end-to-end neural indexer models, generic embedding models, and next generation information access system with large language models. MS MARCO Web Search offers a retrieval benchmark with three web retrieval challenge tasks that demand innovations in both machine learning and information retrieval system research domains. As the first dataset that meets large, real and rich data requirements, MS MARCO Web Search paves the way for future advancements in AI and system research. MS MARCO Web Search dataset is available at: https://github.com/microsoft/MS-MARCO-Web-Search., Comment: 10 pages, 6 figures, for associated dataset, see http://github.com/microsoft/MS-MARCO-Web-Search

Published
2024
Full Text
View/download PDF

15. Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Author

Abdin, Marah, Aneja, Jyoti, Awadalla, Hany, Awadallah, Ahmed, Awan, Ammar Ahmad, Bach, Nguyen, Bahree, Amit, Bakhtiari, Arash, Bao, Jianmin, Behl, Harkirat, Benhaim, Alon, Bilenko, Misha, Bjorck, Johan, Bubeck, Sébastien, Cai, Martin, Cai, Qin, Chaudhary, Vishrav, Chen, Dong, Chen, Dongdong, Chen, Weizhu, Chen, Yen-Chun, Chen, Yi-Ling, Cheng, Hao, Chopra, Parul, Dai, Xiyang, Dixon, Matthew, Eldan, Ronen, Fragoso, Victor, Gao, Jianfeng, Gao, Mei, Gao, Min, Garg, Amit, Del Giorno, Allie, Goswami, Abhishek, Gunasekar, Suriya, Haider, Emman, Hao, Junheng, Hewett, Russell J., Hu, Wenxiang, Huynh, Jamie, Iter, Dan, Jacobs, Sam Ade, Javaheripi, Mojan, Jin, Xin, Karampatziakis, Nikos, Kauffmann, Piero, Khademi, Mahoud, Kim, Dongwoo, Kim, Young Jin, Kurilenko, Lev, Lee, James R., Lee, Yin Tat, Li, Yuanzhi, Li, Yunsheng, Liang, Chen, Liden, Lars, Lin, Xihui, Lin, Zeqi, Liu, Ce, Liu, Liyuan, Liu, Mengchen, Liu, Weishung, Liu, Xiaodong, Luo, Chong, Madan, Piyush, Mahmoudzadeh, Ali, Majercak, David, Mazzola, Matt, Mendes, Caio César Teodoro, Mitra, Arindam, Modi, Hardik, Nguyen, Anh, Norick, Brandon, Patra, Barun, Perez-Becker, Daniel, Portet, Thomas, Pryzant, Reid, Qin, Heyang, Radmilac, Marko, Ren, Liliang, de Rosa, Gustavo, Rosset, Corby, Roy, Sambudha, Ruwase, Olatunji, Saarikivi, Olli, Saied, Amin, Salim, Adil, Santacroce, Michael, Shah, Shital, Shang, Ning, Sharma, Hiteshi, Shen, Yelong, Shukla, Swadheen, Song, Xia, Tanaka, Masahiro, Tupini, Andrea, Vaddamanu, Praneetha, Wang, Chunyu, Wang, Guanhua, Wang, Lijuan, Wang, Shuohang, Wang, Xin, Wang, Yu, Ward, Rachel, Wen, Wen, Witte, Philipp, Wu, Haiping, Wu, Xiaoxia, Wyatt, Michael, Xiao, Bin, Xu, Can, Xu, Jiahang, Xu, Weijian, Xue, Jilong, Yadav, Sonali, Yang, Fan, Yang, Jianwei, Yang, Yifan, Yang, Ziyi, Yu, Donghan, Yuan, Lu, Zhang, Chenruidong, Zhang, Cyril, Zhang, Jianwen, Zhang, Li Lyna, Zhang, Yi, Zhang, Yue, Zhang, Yunan, and Zhou, Xiren

Subjects
Computer Science - Computation and Language, Computer Science - Artificial Intelligence
Abstract

We introduce phi-3-mini, a 3.8 billion parameter language model trained on 3.3 trillion tokens, whose overall performance, as measured by both academic benchmarks and internal testing, rivals that of models such as Mixtral 8x7B and GPT-3.5 (e.g., phi-3-mini achieves 69% on MMLU and 8.38 on MT-bench), despite being small enough to be deployed on a phone. Our training dataset is a scaled-up version of the one used for phi-2, composed of heavily filtered publicly available web data and synthetic data. The model is also further aligned for robustness, safety, and chat format. We also provide parameter-scaling results with a 7B, 14B models trained for 4.8T tokens, called phi-3-small, phi-3-medium, both significantly more capable than phi-3-mini (e.g., respectively 75%, 78% on MMLU, and 8.7, 8.9 on MT-bench). To enhance multilingual, multimodal, and long-context capabilities, we introduce three models in the phi-3.5 series: phi-3.5-mini, phi-3.5-MoE, and phi-3.5-Vision. The phi-3.5-MoE, a 16 x 3.8B MoE model with 6.6 billion active parameters, achieves superior performance in language reasoning, math, and code tasks compared to other open-source models of similar scale, such as Llama 3.1 and the Mixtral series, and on par with Gemini-1.5-Flash and GPT-4o-mini. Meanwhile, phi-3.5-Vision, a 4.2 billion parameter model derived from phi-3.5-mini, excels in reasoning tasks and is adept at handling both single-image and text prompts, as well as multi-image and text prompts., Comment: 24 pages

Published
2024

16. Small Language Models are Good Too: An Empirical Study of Zero-Shot Classification

Author

Lepagnol, Pierre, Gerald, Thomas, Ghannay, Sahar, Servan, Christophe, and Rosset, Sophie

Subjects
Computer Science - Artificial Intelligence
Abstract

This study is part of the debate on the efficiency of large versus small language models for text classification by prompting.We assess the performance of small language models in zero-shot text classification, challenging the prevailing dominance of large models.Across 15 datasets, our investigation benchmarks language models from 77M to 40B parameters using different architectures and scoring functions. Our findings reveal that small models can effectively classify texts, getting on par with or surpassing their larger counterparts.We developed and shared a comprehensive open-source repository that encapsulates our methodologies. This research underscores the notion that bigger isn't always better, suggesting that resource-efficient small models may offer viable solutions for specific data classification challenges.

Published
2024

17. Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences

Author

Rosset, Corby, Cheng, Ching-An, Mitra, Arindam, Santacroce, Michael, Awadallah, Ahmed, and Xie, Tengyang

Subjects
Computer Science - Machine Learning, Computer Science - Artificial Intelligence, Computer Science - Computation and Language
Abstract

This paper studies post-training large language models (LLMs) using preference feedback from a powerful oracle to help a model iteratively improve over itself. The typical approach for post-training LLMs involves Reinforcement Learning from Human Feedback (RLHF), which traditionally separates reward learning and subsequent policy optimization. However, such a reward maximization approach is limited by the nature of "point-wise" rewards (such as Bradley-Terry model), which fails to express complex intransitive or cyclic preference relations. While advances on RLHF show reward learning and policy optimization can be merged into a single contrastive objective for stability, they yet still remain tethered to the reward maximization framework. Recently, a new wave of research sidesteps the reward maximization presumptions in favor of directly optimizing over "pair-wise" or general preferences. In this paper, we introduce Direct Nash Optimization (DNO), a provable and scalable algorithm that marries the simplicity and stability of contrastive learning with theoretical generality from optimizing general preferences. Because DNO is a batched on-policy algorithm using a regression-based objective, its implementation is straightforward and efficient. Moreover, DNO enjoys monotonic improvement across iterations that help it improve even over a strong teacher (such as GPT-4). In our experiments, a resulting 7B parameter Orca-2.5 model aligned by DNO achieves the state-of-the-art win-rate against GPT-4-Turbo of 33% on AlpacaEval 2.0 (even after controlling for response length), an absolute gain of 26% (7% to 33%) over the initializing model. It outperforms models with far more parameters, including Mistral Large, Self-Rewarding LM (70B parameters), and older versions of GPT-4.

Published
2024

19. Correspondence between Composite Theories and Distributive Laws

Author

Rosset, Aloïs, Zwart, Maaike, Hansen, Helle Hvid, and Endrullis, Jörg

Subjects
Computer Science - Logic in Computer Science, Mathematics - Category Theory
Abstract

Composite theories are the algebraic equivalent of distributive laws. In this paper, we delve into the details of this correspondence and concretely show how to construct a composite theory from a distributive law and vice versa. Using term rewriting methods, we also describe when a minimal set of equations axiomatises the composite theory.

Published
2024

20. New Semantic Task for the French Spoken Language Understanding MEDIA Benchmark

Author

Alavoine, Nadège, Laperriere, Gaëlle, Servan, Christophe, Ghannay, Sahar, and Rosset, Sophie

Subjects
Computer Science - Computation and Language, Computer Science - Artificial Intelligence
Abstract

Intent classification and slot-filling are essential tasks of Spoken Language Understanding (SLU). In most SLUsystems, those tasks are realized by independent modules. For about fifteen years, models achieving both of themjointly and exploiting their mutual enhancement have been proposed. A multilingual module using a joint modelwas envisioned to create a touristic dialogue system for a European project, HumanE-AI-Net. A combination ofmultiple datasets, including the MEDIA dataset, was suggested for training this joint model. The MEDIA SLU datasetis a French dataset distributed since 2005 by ELRA, mainly used by the French research community and free foracademic research since 2020. Unfortunately, it is annotated only in slots but not intents. An enhanced version ofMEDIA annotated with intents has been built to extend its use to more tasks and use cases. This paper presents thesemi-automatic methodology used to obtain this enhanced version. In addition, we present the first results of SLUexperiments on this enhanced dataset using joint models for intent classification and slot-filling.

Published
2024

21. mALBERT: Is a Compact Multilingual BERT Model Still Worth It?

Author

Servan, Christophe, Ghannay, Sahar, and Rosset, Sophie

Subjects
Computer Science - Artificial Intelligence
Abstract

Within the current trend of Pretained Language Models (PLM), emerge more and more criticisms about the ethical andecological impact of such models. In this article, considering these critical remarks, we propose to focus on smallermodels, such as compact models like ALBERT, which are more ecologically virtuous than these PLM. However,PLMs enable huge breakthroughs in Natural Language Processing tasks, such as Spoken and Natural LanguageUnderstanding, classification, Question--Answering tasks. PLMs also have the advantage of being multilingual, and,as far as we know, a multilingual version of compact ALBERT models does not exist. Considering these facts, wepropose the free release of the first version of a multilingual compact ALBERT model, pre-trained using Wikipediadata, which complies with the ethical aspect of such a language model. We also evaluate the model against classicalmultilingual PLMs in classical NLP tasks. Finally, this paper proposes a rare study on the subword tokenizationimpact on language performances., Comment: The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, May 2024, Torino, Italy

Published
2024

22. Researchy Questions: A Dataset of Multi-Perspective, Decompositional Questions for LLM Web Agents

Author

Rosset, Corby, Chung, Ho-Lam, Qin, Guanghui, Chau, Ethan C., Feng, Zhuo, Awadallah, Ahmed, Neville, Jennifer, and Rao, Nikhil

Subjects
Computer Science - Computation and Language, Computer Science - Artificial Intelligence
Abstract

Existing question answering (QA) datasets are no longer challenging to most powerful Large Language Models (LLMs). Traditional QA benchmarks like TriviaQA, NaturalQuestions, ELI5 and HotpotQA mainly study ``known unknowns'' with clear indications of both what information is missing, and how to find it to answer the question. Hence, good performance on these benchmarks provides a false sense of security. A yet unmet need of the NLP community is a bank of non-factoid, multi-perspective questions involving a great deal of unclear information needs, i.e. ``unknown uknowns''. We claim we can find such questions in search engine logs, which is surprising because most question-intent queries are indeed factoid. We present Researchy Questions, a dataset of search engine queries tediously filtered to be non-factoid, ``decompositional'' and multi-perspective. We show that users spend a lot of ``effort'' on these questions in terms of signals like clicks and session length, and that they are also challenging for GPT-4. We also show that ``slow thinking'' answering techniques, like decomposition into sub-questions shows benefit over answering directly. We release $\sim$ 100k Researchy Questions, along with the Clueweb22 URLs that were clicked.

Published
2024

23. Orca-Math: Unlocking the potential of SLMs in Grade School Math

Author

Mitra, Arindam, Khanpour, Hamed, Rosset, Corby, and Awadallah, Ahmed

Subjects
Computer Science - Computation and Language, Computer Science - Artificial Intelligence
Abstract

Mathematical word problem-solving has long been recognized as a complex task for small language models (SLMs). A recent study hypothesized that the smallest model size, needed to achieve over 80% accuracy on the GSM8K benchmark, is 34 billion parameters. To reach this level of performance with smaller models, researcher often train SLMs to generate Python code or use tools to help avoid calculation errors. Additionally, they employ ensembling, where outputs of up to 100 model runs are combined to arrive at a more accurate result. Result selection is done using consensus, majority vote or a separate a verifier model used in conjunction with the SLM. Ensembling provides a substantial boost in accuracy but at a significant cost increase with multiple calls to the model (e.g., Phi-GSM uses top-48 to boost the performance from 68.2 to 81.5). In this work, we present Orca-Math, a 7-billion-parameter SLM based on the Mistral-7B, which achieves 86.81% on GSM8k without the need for multiple model calls or the use of verifiers, code execution or any other external tools. Our approach has the following key elements: (1) A high quality synthetic dataset of 200K math problems created using a multi-agent setup where agents collaborate to create the data, (2) An iterative learning techniques that enables the SLM to practice solving problems, receive feedback on its solutions and learn from preference pairs incorporating the SLM solutions and the feedback. When trained with Supervised Fine-Tuning alone, Orca-Math achieves 81.50% on GSM8k pass@1 metric. With iterative preference learning, Orca-Math achieves 86.81% pass@1. Orca-Math surpasses the performance of significantly larger models such as LLAMA-2-70B, WizardMath-70B, Gemini-Pro, ChatGPT-3.5. It also significantly outperforms other smaller models while using much smaller data (hundreds of thousands vs. millions of problems).

Published
2024

24. Euclid preparation: XLVIII. The pre-launch Science Ground Segment simulation framework

Author

Euclid Collaboration, Serrano, S., Hudelot, P., Seidel, G., Pollack, J. E., Jullo, E., Torradeflot, F., Benielli, D., Fahed, R., Auphan, T., Carretero, J., Aussel, H., Casenove, P., Castander, F. J., Davies, J. E., Fourmanoit, N., Huot, S., Kara, A., Keihänen, E., Kermiche, S., Okumura, K., Zoubian, J., Ealet, A., Boucaud, A., Bretonnière, H., Casas, R., Clément, B., Duncan, C. A. J., George, K., Kiiveri, K., Kurki-Suonio, H., Kümmel, M., Laugier, D., Mainetti, G., Mohr, J. J., Montoro, A., Neissner, C., Rosset, C., Schirmer, M., Tallada-Crespí, P., Tonello, N., Venhola, A., Verderi, A., Zacchei, A., Aghanim, N., Altieri, B., Amara, A., Andreon, S., Auricchio, N., Azzollini, R., Baccigalupi, C., Baldi, M., Bardelli, S., Basset, A., Battaglia, P., Bernardeau, F., Bodendorf, C., Bonino, D., Branchini, E., Brescia, M., Brinchmann, J., Camera, S., Candini, G. P., Capobianco, V., Carbone, C., Casas, S., Castellano, M., Castignani, G., Cavuoti, S., Cimatti, A., Cledassou, R., Colodro-Conde, C., Congedo, G., Conselice, C. J., Conversi, L., Copin, Y., Corcione, L., Courbin, F., Courtois, H. M., Crocce, M., Cropper, M., Da Silva, A., Degaudenzi, H., De Lucia, G., Di Giorgio, A. M., Dinis, J., Dubath, F., Dupac, X., Dusini, S., Farina, M., Farrens, S., Ferriol, S., Frailis, M., Franceschi, E., Franzetti, P., Galeotta, S., Garilli, B., Gillard, W., Gillis, B., Giocoli, C., Granett, B. R., Grazian, A., Grupp, F., Guzzo, L., Haugan, S. V. H., Hoar, J., Hoekstra, H., Holmes, W., Hook, I., Hormuth, F., Hornstrup, A., Jahnke, K., Joachimi, B., Kiessling, A., Kitching, T., Kohley, R., Kunz, M., Boulc'h, Q. Le, Liebing, P., Ligori, S., Lilje, P. B., Lindholm, V., Lloro, I., Maino, D., Maiorano, E., Mansutti, O., Marcin, S., Marggraf, O., Markovic, K., Martinelli, M., Martinet, N., Marulli, F., Massey, R., Maurogordato, S., Medinaceli, E., Mei, S., Melchior, M., Mellier, Y., Meneghetti, M., Merlin, E., Meylan, G., Moresco, M., Morris, P., Moscardini, L., Munari, E., Nakajima, R., Niemi, S. -M., Nutma, T., Padilla, C., Paltani, S., Pasian, F., Pedersen, K., Percival, W. J., Pettorino, V., Pires, S., Polenta, G., Poncet, M., Popa, L. A., Pozzetti, L., Raison, F., Rebolo, R., Renzi, A., Rhodes, J., Riccio, G., Romelli, E., Roncarelli, M., Rossetti, E., Rusholme, B., Saglia, R., Sakr, Z., Sánchez, A. G., Sapone, D., Sartoris, B., Sauvage, M., Schneider, P., Schrabback, T., Scodeggio, M., Secroun, A., Sirignano, C., Sirri, G., Skottfelt, J., Stanco, L., Starck, J. -L., Steinwagner, J., Taylor, A. N, Teplitz, H., Tereno, I., Toledo-Moreo, R., Tutusaus, I., Valentijn, E. A., Valenziano, L., Vassallo, T., Veropalumbo, A., Wang, Y., Weller, J., Zamorani, G., Zucca, E., Biviano, A., Bozzo, E., Di Ferdinando, D., Farinelli, R., Graciá-Carpio, J., Mauri, N., Scottez, V., Tenti, M., Akrami, Y., Allevato, V., Ballardini, M., Blanchard, A., Borgani, S., Borlaff, A. S., Bruton, S., Burigana, C., Cappi, A., Carvalho, C. S., Castro, T., Cañas-Herrera, G., Chambers, K. C., Cooray, A. R., Coupon, J., Davini, S., de la Torre, S., Desai, S., Desprez, G., Díaz-Sánchez, A., Di Domizio, S., Dole, H., Vigo, J. A. Escartin, Escoffier, S., Ferrero, I., Finelli, F., Gabarra, L., Ganga, K., Garcia-Bellido, J., Gaztanaga, E., Giacomini, F., Gozaliasl, G., Gregorio, A., Hildebrandt, H., Huertas-Company, M., Ilbert, O., Muñoz, A. Jimenez, Kajava, J. J. E., Kansal, V., Kirkpatrick, C. C., Legrand, L., Loureiro, A., Macias-Perez, J., Magliocchetti, M., Maoli, R., Martins, C. J. A. P., Matthew, S., Maurin, L., Metcalf, R. B., Migliaccio, M., Monaco, P., Morgante, G., Nadathur, S., Nucita, A. A., Pöntinen, M., Popa, V., Porciani, C., Potter, D., Reimberg, P., Schneider, A., Sereno, M., Shulevski, A., Simon, P., Mancini, A. Spurio, Stadel, J., Tewes, M., Teyssier, R., Toft, S., Tucci, M., Valiviita, J., Viel, M., and Zinchenko, I. A.

Subjects
Astrophysics - Cosmology and Nongalactic Astrophysics, Astrophysics - Instrumentation and Methods for Astrophysics
Abstract

The European Space Agency's Euclid mission is one of the upcoming generation of large-scale cosmology surveys, which will map the large-scale structure in the Universe with unprecedented precision. The development and validation of the SGS pipeline requires state-of-the-art simulations with a high level of complexity and accuracy that include subtle instrumental features not accounted for previously as well as faster algorithms for the large-scale production of the expected Euclid data products. In this paper, we present the Euclid SGS simulation framework as applied in a large-scale end-to-end simulation exercise named Science Challenge 8. Our simulation pipeline enables the swift production of detailed image simulations for the construction and validation of the Euclid mission during its qualification phase and will serve as a reference throughout operations. Our end-to-end simulation framework starts with the production of a large cosmological N-body & mock galaxy catalogue simulation. We perform a selection of galaxies down to I_E=26 and 28 mag, respectively, for a Euclid Wide Survey spanning 165 deg^2 and a 1 deg^2 Euclid Deep Survey. We build realistic stellar density catalogues containing Milky Way-like stars down to H<26. Using the latest instrumental models for both the Euclid instruments and spacecraft as well as Euclid-like observing sequences, we emulate with high fidelity Euclid satellite imaging throughout the mission's lifetime. We present the SC8 data set consisting of overlapping visible and near-infrared Euclid Wide Survey and Euclid Deep Survey imaging and low-resolution spectroscopy along with ground-based. This extensive data set enables end-to-end testing of the entire ground segment data reduction and science analysis pipeline as well as the Euclid mission infrastructure, paving the way to future scientific and technical developments and enhancements., Comment: 39 pages, 25 figures, A&A submitted

Published
2024
Full Text
View/download PDF

27. Axiomatic Preference Modeling for Longform Question Answering

Author

Rosset, Corby, Zheng, Guoqing, Dibia, Victor, Awadallah, Ahmed, and Bennett, Paul

Subjects
Computer Science - Artificial Intelligence, Computer Science - Computation and Language
Abstract

The remarkable abilities of large language models (LLMs) like GPT-4 partially stem from post-training processes like Reinforcement Learning from Human Feedback (RLHF) involving human preferences encoded in a reward model. However, these reward models (RMs) often lack direct knowledge of why, or under what principles, the preferences annotations were made. In this study, we identify principles that guide RMs to better align with human preferences, and then develop an axiomatic framework to generate a rich variety of preference signals to uphold them. We use these axiomatic signals to train a model for scoring answers to longform questions. Our approach yields a Preference Model with only about 220M parameters that agrees with gold human-annotated preference labels more often than GPT-4. The contributions of this work include: training a standalone preference model that can score human- and LLM-generated answers on the same scale; developing an axiomatic framework for generating training data pairs tailored to certain principles; and showing that a small amount of axiomatic signals can help small models outperform GPT-4 in preference scoring. We release our model on huggingface: https://huggingface.co/corbyrosset/axiomatic_preference_model, Comment: Accepted to EMNLP 2023

Published
2023

28. Orca 2: Teaching Small Language Models How to Reason

Author

Mitra, Arindam, Del Corro, Luciano, Mahajan, Shweti, Codas, Andres, Simoes, Clarisse, Agarwal, Sahaj, Chen, Xuxi, Razdaibiedina, Anastasia, Jones, Erik, Aggarwal, Kriti, Palangi, Hamid, Zheng, Guoqing, Rosset, Corby, Khanpour, Hamed, and Awadallah, Ahmed

Subjects
Computer Science - Artificial Intelligence
Abstract

Orca 1 learns from rich signals, such as explanation traces, allowing it to outperform conventional instruction-tuned models on benchmarks like BigBench Hard and AGIEval. In Orca 2, we continue exploring how improved training signals can enhance smaller LMs' reasoning abilities. Research on training small LMs has often relied on imitation learning to replicate the output of more capable models. We contend that excessive emphasis on imitation may restrict the potential of smaller models. We seek to teach small LMs to employ different solution strategies for different tasks, potentially different from the one used by the larger model. For example, while larger models might provide a direct answer to a complex task, smaller models may not have the same capacity. In Orca 2, we teach the model various reasoning techniques (step-by-step, recall then generate, recall-reason-generate, direct answer, etc.). More crucially, we aim to help the model learn to determine the most effective solution strategy for each task. We evaluate Orca 2 using a comprehensive set of 15 diverse benchmarks (corresponding to approximately 100 tasks and over 36,000 unique prompts). Orca 2 significantly surpasses models of similar size and attains performance levels similar or better to those of models 5-10x larger, as assessed on complex tasks that test advanced reasoning abilities in zero-shot settings. make Orca 2 weights publicly available at aka.ms/orca-lm to support research on the development, evaluation, and alignment of smaller LMs, Comment: Added url to model weights fixed typo in Author name

Published
2023

29. Overview of the TREC 2023 Product Product Search Track

Author

Campos, Daniel, Kallumadi, Surya, Rosset, Corby, Zhai, Cheng Xiang, and Magnani, Alessandro

Subjects
Computer Science - Information Retrieval, Computer Science - Artificial Intelligence
Abstract

This is the first year of the TREC Product search track. The focus this year was the creation of a reusable collection and evaluation of the impact of the use of metadata and multi-modal data on retrieval accuracy. This year we leverage the new product search corpus, which includes contextual metadata. Our analysis shows that in the product search domain, traditional retrieval systems are highly effective and commonly outperform general-purpose pretrained embedding models. Our analysis also evaluates the impact of using simplified and metadata-enhanced collections, finding no clear trend in the impact of the expanded collection. We also see some surprising outcomes; despite their widespread adoption and competitive performance on other tasks, we find single-stage dense retrieval runs can commonly be noncompetitive or generate low-quality results both in the zero-shot and fine-tuned domain., Comment: 14 pages, 4 figures, 11 tables - TREC 2023

Published
2023

30. Dodo: Dynamic Contextual Compression for Decoder-only LMs

Author

Qin, Guanghui, Rosset, Corby, Chau, Ethan C., Rao, Nikhil, and Van Durme, Benjamin

Subjects
Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Machine Learning, I.2.7, I.2.6
Abstract

Transformer-based language models (LMs) are inefficient in long contexts. We propose Dodo, a solution for context compression. Instead of one vector per token in a standard transformer model, Dodo represents text with a dynamic number of hidden states at each layer, reducing the cost of self-attention to a fraction of typical time and space. Moreover, off-the-shelf models such as LLaMA can be adapted to Dodo by efficient parameter tuning methods such as LoRA. In use, Dodo can act as either an autoregressive LM or a context compressor for downstream tasks. We demonstrate through experiments in language modeling, question answering, and summarization that Dodo retains capabilities in these tasks, while drastically reducing the overhead during decoding. For example, in the autoencoding task, Dodo shrinks context at a 20x compression ratio with a BLEU score of 98% for reconstruction, achieving nearly lossless encoding., Comment: ACL 2024 camera-ready. 15 pages and 7 figures

Published
2023
Full Text
View/download PDF

31. Automatic Pair Construction for Contrastive Post-training

Author

Xu, Canwen, Rosset, Corby, Chau, Ethan C., Del Corro, Luciano, Mahajan, Shweti, McAuley, Julian, Neville, Jennifer, Awadallah, Ahmed Hassan, and Rao, Nikhil

Subjects
Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Machine Learning
Abstract

Alignment serves as an important step to steer large language models (LLMs) towards human preferences. In this paper, we propose an automatic way to construct contrastive data for LLM, using preference pairs from multiple models of varying strengths (e.g., InstructGPT, ChatGPT and GPT-4). We compare the contrastive techniques of SLiC and DPO to SFT baselines and find that DPO provides a step-function improvement even after continuing SFT saturates. We also explore a data curriculum learning scheme for contrastive post-training, which starts by learning from "easier" pairs and transitioning to "harder" ones, which further improves alignment. Finally, we scale up our experiments to train with more data and larger models like Orca. Remarkably, our automatic contrastive post-training further improves the performance of Orca, already a state-of-the-art instruction learning model tuned with GPT-4 outputs, to outperform ChatGPT., Comment: NAACL 2024 (Findings)

Published
2023

33. Advancing forest inventorying and monitoring

Author

Ferretti, Marco, Fischer, Christoph, Gessler, Arthur, Graham, Catherine, Meusburger, Katrin, Abegg, Meinrad, Bebi, Peter, Bergamini, Ariel, Brockerhoff, Eckehard G., Brunner, Ivano, Bühler, Christoph, Conedera, Marco, Cothereau, Pierre, D’Odorico, Petra, Düggelin, Christoph, Ginzler, Christian, Grendelmeier, Alex, Haeni, Matthias, Hagedorn, Frank, Hägeli, Martin, Hegetschweiler, Karin Tessa, Holderegger, Rolf, Krumm, Frank, Gugerli, Felix, Queloz, Valentin, Rigling, Andreas, Risch, Anita C., Rohner, Brigitte, Rosset, Christian, Scherrer, Daniel, Schulz, Tobias, Thürig, Esther, Traub, Berthold, von Arx, Georg, Waldner, Peter, Wohlgemuth, Thomas, Zimmermann, Niklaus E., and Shackleton, Ross T.

Published
2024
Full Text
View/download PDF

36. Fast and Functional Structured Data Generators Rooted in Out-of-Equilibrium Physics

Author

Carbone, Alessandra, Decelle, Aurélien, Rosset, Lorenzo, and Seoane, Beatriz

Subjects
Computer Science - Machine Learning, Condensed Matter - Disordered Systems and Neural Networks, Quantitative Biology - Biomolecules, Quantitative Biology - Genomics, Quantitative Biology - Quantitative Methods
Abstract

In this study, we address the challenge of using energy-based models to produce high-quality, label-specific data in complex structured datasets, such as population genetics, RNA or protein sequences data. Traditional training methods encounter difficulties due to inefficient Markov chain Monte Carlo mixing, which affects the diversity of synthetic data and increases generation times. To address these issues, we use a novel training algorithm that exploits non-equilibrium effects. This approach, applied on the Restricted Boltzmann Machine, improves the model's ability to correctly classify samples and generate high-quality synthetic data in only a few sampling steps. The effectiveness of this method is demonstrated by its successful application to four different types of data: handwritten digits, mutations of human genomes classified by continental origin, functionally characterized sequences of an enzyme protein family, and homologous RNA sequences from specific taxonomies., Comment: 15 pages

Published
2023

37. Evaluation of European-based polygenic risk score for breast cancer in Ashkenazi Jewish women in Israel

Author

Levi, Hagai, Carmi, Shai, Rosset, Saharon, Yerushalmi, Rinat, Zick, Aviad, Yablonski-Peretz, Tamar, Consortium, The BCAC, Wang, Qin, Bolla, Manjeet K, Dennis, Joe, Michailidou, Kyriaki, Lush, Michael, Ahearn, Thomas, Andrulis, Irene L, Anton-Culver, Hoda, Antoniou, Antonis C, Arndt, Volker, Augustinsson, Annelie, Auvinen, Päivi, Freeman, Laura Beane, Beckmann, Matthias, Behrens, Sabine, Bermisheva, Marina, Bodelon, Clara, Bogdanova, Natalia V, Bojesen, Stig E, Brenner, Hermann, Byers, Helen, Camp, Nicola, Castelao, Jose, Chang-Claude, Jenny, Chirlaque, María-Dolores, Chung, Wendy, Clarke, Christine, Collaborators, NBCS, Collee, Margriet J, Colonna, Sarah, Consortium, CTS, Couch, Fergus, Cox, Angela, Cross, Simon S, Czene, Kamila, Daly, Mary, Devilee, Peter, Dork, Thilo, Dossus, Laure, Eccles, Diana M, Eliassen, A Heather, Eriksson, Mikael, Evans, Gareth, Fasching, Peter, Fletcher, Olivia, Flyger, Henrik, Fritschi, Lin, Gabrielson, Marike, Gago-Dominguez, Manuela, García-Closas, Montserrat, Garcia-Saenz, Jose Angel, Genkinger, Jeanine, Giles, Graham G, Goldberg, Mark, Guénel, Pascal, Hall, Per, Hamann, Ute, He, Wei, Hillemanns, Peter, Hollestelle, Antoinette, Hoppe, Reiner, Hopper, John, Investigators, ABCTB, Jakovchevska, Simona, Jakubowska, Anna, Jernström, Helena, John, Esther, Johnson, Nichola, Jones, Michael, Vijai, Joseph, Kaaks, Rudolf, Khusnutdinova, Elza, Kitahara, Cari, Koutros, Stella, Kristensen, Vessela, Kurian, Allison W, Lacey, James, Lambrechts, Diether, Le Marchand, Loic, Lejbkowicz, Flavio, Lindblom, Annika, Loibl, Sibylle, Lori, Adriana, Lubinski, Jan, Mannermaa, Arto, Manoochehri, Mehdi, Mavroudis, Dimitrios, Menon, Usha, Mulligan, AnnaMarie, Murphy, Rachel, Nevelsteen, Ines, Newman, William G, and Obi, Nadia

Subjects
Biological Sciences, Biomedical and Clinical Sciences, Genetics, Oncology and Carcinogenesis, Breast Cancer, Prevention, Cancer, Humans, Female, Breast Neoplasms, Genome-Wide Association Study, Jews, Israel, Genetic Predisposition to Disease, Risk Factors, Multifactorial Inheritance, Transcription Factors, Genomics, Polymorphism, Genetic, BCAC Consortium, NBCS Collaborators, CTS Consortium, ABCTB Investigators, Polymorphism, Genetic, Medical and Health Sciences, Genetics & Heredity, Clinical sciences
Abstract

BackgroundPolygenic risk score (PRS), calculated based on genome-wide association studies (GWASs), can improve breast cancer (BC) risk assessment. To date, most BC GWASs have been performed in individuals of European (EUR) ancestry, and the generalisation of EUR-based PRS to other populations is a major challenge. In this study, we examined the performance of EUR-based BC PRS models in Ashkenazi Jewish (AJ) women.MethodsWe generated PRSs based on data on EUR women from the Breast Cancer Association Consortium (BCAC). We tested the performance of the PRSs in a cohort of 2161 AJ women from Israel (1437 cases and 724 controls) from BCAC (BCAC cohort from Israel (BCAC-IL)). In addition, we tested the performance of these EUR-based BC PRSs, as well as the established 313-SNP EUR BC PRS, in an independent cohort of 181 AJ women from Hadassah Medical Center (HMC) in Israel.ResultsIn the BCAC-IL cohort, the highest OR per 1 SD was 1.56 (±0.09). The OR for AJ women at the top 10% of the PRS distribution compared with the middle quintile was 2.10 (±0.24). In the HMC cohort, the OR per 1 SD of the EUR-based PRS that performed best in the BCAC-IL cohort was 1.58±0.27. The OR per 1 SD of the commonly used 313-SNP BC PRS was 1.64 (±0.28).ConclusionsExtant EUR GWAS data can be used for generating PRSs that identify AJ women with markedly elevated risk of BC and therefore hold promise for improving BC risk assessment in AJ women.

Published
2023

38. Mentha spp. essential oils: toxicity to Alphitobius diaperinus, activity against poultry pathogenic bacteria, and Beauveria bassiana compatibility

Author

Gebauer, Sandra, Pompermayer, Katiane, de Oliveira, Daian Guilherme Pinto, da Silva Pinto, Fabiana Gisele, Rosset, Jéssica, Bandeira, Debora Marina, de Souza e Silva, Gabriela Trindade, de Oliveira, Murilo Silva, Silva, Geraldo Humberto, Alves, Luis Francisco Angeli, Carvalho, Geraldo Andrade, de Oliveira, Denilson Ferreira, and Alves, Dejane Santos

Published
2024
Full Text
View/download PDF

39. An agent-based decentralized threshold policy finding the constrained shortest paths

Author

Rosset, Francesca, Pesenti, Raffaele, and Blanchini, Franco

Subjects
Mathematics - Optimization and Control, Electrical Engineering and Systems Science - Systems and Control, Mathematics - Dynamical Systems
Abstract

We consider a problem where autonomous agents enter a dynamic and unknown environment described by a network of weighted arcs. These agents move within the network from node to node according to a decentralized policy using only local information, with the goal of finding a path to an unknown sink node to leave the network. This policy makes each agent move to some adjacent node or stop at the current node. The transition along an arc is allowed or denied based on a threshold mechanism that takes into account the number of agents already accumulated in the arc's end nodes and the arc's weight. We show that this policy ensures path-length optimality in the sense that, in a finite time, all new agents entering the network reach the closer sinks by the shortest paths. Our approach is later extended to support constraints on the paths that agents can follow., Comment: This work has been submitted to the IEEE for possible publication

Published
2023

40. Mixed Semi-Supervised Generalized-Linear-Regression with applications to Deep-Learning and Interpolators

Author

Yuval, Oren and Rosset, Saharon

Subjects
Statistics - Methodology, Computer Science - Machine Learning, Statistics - Machine Learning, 62F10, 62J12, 68T07
Abstract

We present a methodology for using unlabeled data to design semi supervised learning (SSL) methods that improve the prediction performance of supervised learning for regression tasks. The main idea is to design different mechanisms for integrating the unlabeled data, and include in each of them a mixing parameter $\alpha$, controlling the weight given to the unlabeled data. Focusing on Generalized Linear Models (GLM) and linear interpolators classes of models, we analyze the characteristics of different mixing mechanisms, and prove that in all cases, it is invariably beneficial to integrate the unlabeled data with some nonzero mixing ratio $\alpha>0$, in terms of predictive performance. Moreover, we provide a rigorous framework to estimate the best mixing ratio $\alpha^*$ where mixed SSL delivers the best predictive performance, while using the labeled and unlabeled data on hand. The effectiveness of our methodology in delivering substantial improvement compared to the standard supervised models, in a variety of settings, is demonstrated empirically through extensive simulation, in a manner that supports the theoretical analysis. We also demonstrate the applicability of our methodology (with some intuitive modifications) to improve more complex models, such as deep neural networks, in real-world regression tasks., Comment: 63 pages, 10 figures

Published
2023

41. Euclid: Cosmology forecasts from the void-galaxy cross-correlation function with reconstruction

Author

Radinović, S., Nadathur, S., Winther, H. -A., Percival, W. J., Woodfinden, A., Massara, E., Paillas, E., Contarini, S., Hamaus, N., Kovacs, A., Pisani, A., Verza, G., Aubert, M., Amara, A., Auricchio, N., Baldi, M., Bonino, D., Branchini, E., Brescia, M., Camera, S., Capobianco, V., Carbone, C., Cardone, V. F., Carretero, J., Castellano, M., Cavuoti, S., Cimatti, A., Cledassou, R., Congedo, G., Conversi, L., Copin, Y., Corcione, L., Courbin, F., Da Silva, A., Douspis, M., Dubath, F., Dupac, X., Farrens, S., Ferriol, S., Fosalba, P., Frailis, M., Franceschi, E., Fumana, M., Galeotta, S., Garilli, B., Gillard, W., Gillis, B., Giocoli, C., Grazian, A., Grupp, F., Haugan, S. V. H., Holmes, W., Hornstrup, A., Jahnke, K., Kümmel, M., Kiessling, A., Kilbinger, M., Kitching, T., Kurki-Suonio, H., Ligori, S., Lilje, P. B., Lloro, I., Maiorano, E., Mansutti, O., Marggraf, O., Markovic, K., Marulli, F., Massey, R., Mei, S., Melchior, M., Mellier, Y., Meneghetti, M., Merlin, E., Meylan, G., Moresco, M., Moscardini, L., Niemi, S. -M., Nightingale, J. W., Nutma, T., Padilla, C., Paltani, S., Pasian, F., Pedersen, K., Pettorino, V., Pires, S., Polenta, G., Poncet, M., Popa, L. A., Pozzetti, L., Raison, F., Renzi, A., Rhodes, J., Riccio, G., Romelli, E., Roncarelli, M., Rosset, C., Saglia, R., Sapone, D., Sartoris, B., Schneider, P., Secroun, A., Seidel, G., Serrano, S., Sirignano, C., Sirri, G., Stanco, L., Starck, J. -L., Surace, C., Tallada-Crespí, P., Tereno, I., Toledo-Moreo, R., Torradeflot, F., Tutusaus, I., Valentijn, E. A., Valenziano, L., Vassallo, T., Wang, Y., Weller, J., Zamorani, G., Zoubian, J., and Scottez, V.

Subjects
Astrophysics - Cosmology and Nongalactic Astrophysics
Abstract

We investigate the cosmological constraints that can be expected from measurement of the cross-correlation of galaxies with cosmic voids identified in the Euclid spectroscopic survey, which will include spectroscopic information for tens of millions of galaxies over $15\,000$ deg$^2$ of the sky in the redshift range $0.9\leq z<1.8$. We do this using simulated measurements obtained from the Flagship mock catalogue, the official Euclid mock that closely matches the expected properties of the spectroscopic data set. To mitigate anisotropic selection-bias effects, we use a velocity field reconstruction method to remove large-scale redshift-space distortions from the galaxy field before void-finding. This allows us to accurately model contributions to the observed anisotropy of the cross-correlation function arising from galaxy velocities around voids as well as from the Alcock-Paczynski effect, and we study the dependence of constraints on the efficiency of reconstruction. We find that Euclid voids will be able to constrain the ratio of the transverse comoving distance $D_{\rm M}$ and Hubble distance $D_{\rm H}$ to a relative precision of about $0.3\%$, and the growth rate $f\sigma_8$ to a precision of between $5\%$ and $8\%$ in each of four redshift bins covering the full redshift range. In the standard cosmological model, this translates to a statistical uncertainty $\Delta\Omega_\mathrm{m}=\pm0.0028$ on the matter density parameter from voids, better than can be achieved from either Euclid galaxy clustering and weak lensing individually. We also find that voids alone can measure the dark energy equation of state to $6\%$ precision., Comment: 20 pages, 13 figures, accepted version

Published
2023
Full Text
View/download PDF

42. Augmenting Zero-Shot Dense Retrievers with Plug-in Mixture-of-Memories

Author

Ge, Suyu, Xiong, Chenyan, Rosset, Corby, Overwijk, Arnold, Han, Jiawei, and Bennett, Paul

Subjects
Computer Science - Computation and Language
Abstract

In this paper we improve the zero-shot generalization ability of language models via Mixture-Of-Memory Augmentation (MoMA), a mechanism that retrieves augmentation documents from multiple information corpora ("external memories"), with the option to "plug in" new memory at inference time. We develop a joint learning mechanism that trains the augmentation component with latent labels derived from the end retrieval task, paired with hard negatives from the memory mixture. We instantiate the model in a zero-shot dense retrieval setting by augmenting a strong T5-based retriever with MoMA. Our model, MoMA, obtains strong zero-shot retrieval accuracy on the eighteen tasks included in the standard BEIR benchmark. It outperforms systems that seek generalization from increased model parameters and computation steps. Our analysis further illustrates the necessity of augmenting with mixture-of-memory for robust generalization, the benefits of augmentation learning, and how MoMA utilizes the plug-in memory at inference time without changing its parameters. We plan to open source our code.

Published
2023

43. Unsupervised hierarchical clustering using the learning dynamics of RBMs

Author

Decelle, Aurélien, Rosset, Lorenzo, and Seoane, Beatriz

Subjects
Computer Science - Machine Learning, Condensed Matter - Disordered Systems and Neural Networks, Condensed Matter - Statistical Mechanics
Abstract

Datasets in the real world are often complex and to some degree hierarchical, with groups and sub-groups of data sharing common characteristics at different levels of abstraction. Understanding and uncovering the hidden structure of these datasets is an important task that has many practical applications. To address this challenge, we present a new and general method for building relational data trees by exploiting the learning dynamics of the Restricted Boltzmann Machine (RBM). Our method is based on the mean-field approach, derived from the Plefka expansion, and developed in the context of disordered systems. It is designed to be easily interpretable. We tested our method in an artificially created hierarchical dataset and on three different real-world datasets (images of digits, mutations in the human genome, and a homologous family of proteins). The method is able to automatically identify the hierarchical structure of the data. This could be useful in the study of homologous protein sequences, where the relationships between proteins are critical for understanding their function and evolution., Comment: Version accepted in Physical Review E

Published
2023
Full Text
View/download PDF

44. Fuzzy Presheaves are Quasitoposes

Author

Rosset, Aloïs, Overbeek, Roy, and Endrullis, Jörg

Subjects
Computer Science - Logic in Computer Science
Abstract

Quasitoposes encompass a wide range of structures, including various categories of graphs. They have proven to be a natural setting for reasoning about the metatheory of algebraic graph rewriting. In this paper we propose and motivate the notion of fuzzy presheaves, which generalises fuzzy sets and fuzzy graphs. We prove that fuzzy presheaves are rm-adhesive quasitoposes, proving our recent conjecture for fuzzy graphs. Furthermore, we show that simple fuzzy graphs categories are quasitoposes.

Published
2023

45. Zero-shot Clarifying Question Generation for Conversational Search

Author

Wang, Zhenduo, Tu, Yuancheng, Rosset, Corby, Craswell, Nick, Wu, Ming, and Ai, Qingyao

Subjects
Computer Science - Information Retrieval, Computer Science - Computation and Language
Abstract

A long-standing challenge for search and conversational assistants is query intention detection in ambiguous queries. Asking clarifying questions in conversational search has been widely studied and considered an effective solution to resolve query ambiguity. Existing work have explored various approaches for clarifying question ranking and generation. However, due to the lack of real conversational search data, they have to use artificial datasets for training, which limits their generalizability to real-world search scenarios. As a result, the industry has shown reluctance to implement them in reality, further suspending the availability of real conversational search interaction data. The above dilemma can be formulated as a cold start problem of clarifying question generation and conversational search in general. Furthermore, even if we do have large-scale conversational logs, it is not realistic to gather training data that can comprehensively cover all possible queries and topics in open-domain search scenarios. The risk of fitting bias when training a clarifying question retrieval/generation model on incomprehensive dataset is thus another important challenge. In this work, we innovatively explore generating clarifying questions in a zero-shot setting to overcome the cold start problem and we propose a constrained clarifying question generation system which uses both question templates and query facets to guide the effective and precise question generation. The experiment results show that our method outperforms existing state-of-the-art zero-shot baselines by a large margin. Human annotations to our model outputs also indicate our method generates 25.2\% more natural questions, 18.1\% more useful questions, 6.1\% less unnatural and 4\% less useless questions., Comment: To appear in the Web Conference 2023

Published
2023

46. Navigating post-ICU care: understanding family members’ experiences - a qualitative study

Author

Matteo Danielis, Alessandro Garau, Dina Molaro, Sara Gentilini, Marika Rosset, Serena Giorgino, Federica Vuerich, Renzo Zanotti, and Lorenza Entilli

Subjects
Family members, caregivers, intensive care unit, nursing, quality of life, Medicine, Psychology, BF1-990
Abstract

Background: Comprehending and addressing the needs of caregivers during the post-intensive care unit (ICU) phase is vital for establishing sustainable support systems and improving the overall quality of life (QoL) for both patients and caregivers.Objective: To explore the experiences of family members (FMs) caring for loved ones three-months after ICU discharge and their related QoL.Methods and measures: A qualitative, descriptive research was conducted. Participants were recruited from two general ICUs in an Italian Academic Hospital. Data collection lasted two months and was performed with telephonic interviews led by ICU nurses. Thematic analysis was conducted using a hybrid approach, incorporating both deductive and inductive coding strategies. This process has been facilitated by Atlas.ti software.Results: Twenty-four FMs participated, representing a diverse range of familial relationships with the patients. Thematic analysis revealed four overarching themes: 1) QoL underwent transformations; 2) Positive emotions laden with significance; 3) Supporting role taken on by a caregiver; and 4) Life’s transience through the meaning-making of the illness event. These themes highlighted the multifaceted nature of the caregiving experience.Conclusions: This study provides valuable insights into the challenges and dynamics faced by FMs following ICU discharge. Findings underscore the importance of addressing environmental challenges, cultivating positive emotions, and strengthening caregiver-patient relationships to enhance the caregiving experience and promote overall QoL. FMs can adapt their personal concepts and reach their full potential by learning to coexist with the demanding role of caregiver and achieve a new level of resilience and fulfillment.

Published
2024
Full Text
View/download PDF

47. Giant prostatic hyperplasia in a 54-years old patient treated by prostate artery embolization: case report

Author

Nicolas Villard, Georgia Tsoumakidou, Paul C. Moldovan, Rémy Rosset, Olivier Rouvière, Hakim Fassi-Fehri, and Gaële Pagnoux

Subjects
prostatic hyperplasia, lower urinary tract symptoms, interventional radiology, endovascular procedures, therapeutic embolization, transurethral resection of prostate, Diseases of the genitourinary system. Urology, RC870-923
Abstract

Giant prostatic hyperplasia (GPH) is defined as benign prostate hyperplasia (BPH) of more than 200 ml. It is a challenging condition because transurethral resection is classically indicated for prostate volume less than 80 ml and open adenectomy remains the gold standard therapy for GPH. Herein, we present the case of a 54-years old male with giant prostatic hyperplasia (total prostate volume of 265 ml) causing lower urinary tract symptoms (LUTS) and recurrent episodes of acute urinary retention. The patient refused the surgical adenomectomy and underwent bilateral prostate arteries embolization (PAE). Post embolization period was uneventful. Total prostate volume decreased progressively and LUTS disappeared. At more than 5 years follow-up the patient remains still asymptomatic, despite the discrete regrowth of the prostate detected on imaging. This case report suggests that PEA may be a good alternative to open surgery for patients with symptomatic GPH.

Published
2024
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results