Daniel C. Alexander, Andrada Ianus, Zhijie Zhang, Mingwu Jin, Geert Jan Biessels, Mauro Zucchelli, Santiago Aja-Fernández, Ariel Rokem, Vesna Prchkovska, Rachid Deriche, Alexander Leemans, Matteo Frigo, Vishwesh Nath, Eleftherios Garyfallidis, Rutger Fick, Derek K. Jones, Evren Özarslan, Maryam Afzali, Marco Palombo, Martijn Froeling, Haoze Chen, Jan Sijbers, Abib Alimi, Prasanna Parvathaneni, Paulo Rodrigues, Sara Sedlar, Tomasz Pieciak, Stefan Endres, Markus Nilsson, Fabian Bogusz, Bennett A. Landman, Shreyas Fadnavis, Enes Albay, Noam Shemesh, Jan Morez, Irina Sánchez, Ben Jeurissen, Fengxiang Wang, Alberto De Luca, Samuel Deslauriers-Gauthier, Kurt G. Schilling, Hui Zhang, Image sciences institute - University of Utrecht (ISI), University Medical Center [Utrecht], Utrecht Brain Center [UMC], Champalimaud Centre for the Unknown [Lisbon], Laboratoire des Maladies Neurodégénératives - UMR 9199 (LMN), Service MIRCEN (MIRCEN), Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Institut de Biologie François JACOB (JACOB), Direction de Recherche Fondamentale (CEA) (DRF (CEA)), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Direction de Recherche Fondamentale (CEA) (DRF (CEA)), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Institut de Biologie François JACOB (JACOB), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Centre National de la Recherche Scientifique (CNRS), Centre for Medical Image Computing (CMIC), University College of London [London] (UCL), Department of Forest Ecology and Management, Swedish University of Agricultural Sciences (SLU), Computational Imaging of the Central Nervous System (ATHENA), Inria Sophia Antipolis - Méditerranée (CRISAM), Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Istanbul Technical University (ITÜ), TRIBVN Healthcare, Cardiff University's Brain Research Imaging Centre [Cardiff] (CUBRIC), School of Psychology [Cardiff University], Cardiff University-Cardiff University, Department of Automatics (AGH-UST), AGH University of Science and Technology [Krakow, PL] (AGH UST), Laboratorio de Procesado de Imagen [Valladolid] (LPI), Université de Valladolid, Department of Biomedical Engineering [Linköping], Linköping University (LIU), Taiyuan University of Technology, University of Texas at Arlington [Arlington], NVIDIA (NVIDIA), National Institutes of Health [Bethesda] (NIH), Vision Lab [Antwerp], University of Antwerp (UA), Indiana University [Bloomington], Indiana University System, Institute of Materials Engineering [Bremen] (IWT ), University of Bremen, University of Washington [Seattle], QMENTA Inc, Vanderbilt University [Nashville], Vanderbilt University Medical Center [Nashville], ANR-19-P3IA-0002,3IA@cote d'azur,3IA Côte d'Azur(2019), European Project: 694665,H2020 ERC,ERC-2015-AdG,CoBCoM(2016), UMC Utrecht, Centre National de la Recherche Scientifique (CNRS)-Service MIRCEN (MIRCEN), Université Paris-Saclay-Institut de Biologie François JACOB (JACOB), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Université Paris-Saclay-Institut de Biologie François JACOB (JACOB), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA), Department of Physics, The University of Texas at Arlington, United States, and Vanderbilt University Institute of Imaging Science, Vanderbilt University, Nashville
Diffusion MRI (dMRI) has become an invaluable tool to assess the microstructural organization of brain tissue. Depending on the specific acquisition settings, the dMRI signal encodes specific properties of the underlying diffusion process. In the last two decades, several signal representations have been proposed to fit the dMRI signal and decode such properties. Most methods, however, are tested and developed on a limited amount of data, and their applicability to other acquisition schemes remains unknown. With this work, we aimed to shed light on the generalizability of existing dMRI signal representations to different diffusion encoding parameters and brain tissue types. To this end, we organized a community challenge - named MEMENTO, making available the same datasets for fair comparisons across algorithms and techniques. We considered two state-of-the-art diffusion datasets, including single-diffusion-encoding (SDE) spin-echo data from a human brain with over 3820 unique diffusion weightings (the MASSIVE dataset), and double (oscillating) diffusion encoding data (DDE/DODE) of a mouse brain including over 2520 unique data points. A subset of the data sampled in 5 different voxels was openly distributed, and the challenge participants were asked to predict the remaining part of the data. After one year, eight participant teams submitted a total of 80 signal fits. For each submission, we evaluated the mean squared error, the variance of the prediction error and the Bayesian information criteria. The received submissions predicted either multi-shell SDE data (37%) or DODE data (22%), followed by cartesian SDE data (19%) and DDE (18%). Most submissions predicted the signals measured with SDE remarkably well, with the exception of low and very strong diffusion weightings. The prediction of DDE and DODE data seemed more challenging, likely because none of the submissions explicitly accounted for diffusion time and frequency. Next to the choice of the model, decisions on fit procedure and hyperparameters play a major role in the prediction performance, highlighting the importance of optimizing and reporting such choices. This work is a community effort to highlight strength and limitations of the field at representing dMRI acquired with trending encoding schemes, gaining insights into how different models generalize to different tissue types and fiber configurations over a large range of diffusion encodings. Funding Agencies|European Research Council (ERC) under the European UnionEuropean Research Council (ERC) [694665]; French government, through the 3IA Cote DAzur Investments in the Future project [ANR-19-P3IA-0002]; EPSRCUK Research & Innovation (UKRI)Engineering & Physical Sciences Research Council (EPSRC) [EP/N018702/1, MR/T020296/1, ISLRA-2009]; European Space AgencyEuropean Space AgencyEuropean Commission; Belgian Science Policy Office-ProdexBelgian Federal Science Policy Office; Research Foundation Flanders (FWO Vlaanderen)FWO [12M3119N, G0D7216N]; Wellcome Trust Investigator AwardWellcome Trust [096646/Z/11/Z]; Wellcome Trust Strategic AwardWellcome Trust [104943/Z/14/Z]; Polish National Agency for Academic ExchangePolish National Agency for Academic Exchange (NAWA) [PN/BEK/2019/1/00421]; Ministry of Science and Higher Education (Poland)Ministry of Science and Higher Education, Poland [692/STYP/13/2018]; AGH Science and Technology, Poland [16.16.120.773]; Linkoping University (LiU) Center for Industrial Information Technology (CENIIT); LiU Cancer [VINNOVA/ITEA3 17021 IMPACT]; Swedish Foundation for Strategic ResearchSwedish Foundation for Strategic Research [RMX18-0056]; "la Caixa" FoundationLa Caixa Foundation [100010434]; European UnionEuropean Commission [847648, LCF/BQ/PI20/11760029]; Ministerio de Ciencia e Innovacion" of SpainSpanish Government [RTI2018-094569-B-I00]; National Institute for Biomedical Imaging [5R01EB027585-02]