1. Overview of the CLEF eHealth Evaluation Lab 2021
- Author
-
Rishabh Upadhyay, Nicola Brew-Sam, Jorge Vivaldi, Marco Viviani, Viviana Cotik, Hanna Suominen, Elias Bassani, Roland Roller, Chenchen Xu, Gabriela Nicole González-Sáez, Darío Filippo, Philippe Mulhem, Liadh Kelly, Gabriella Pasi, Lorraine Goeuriot, Franco M. Luque, Laura Alonso Alemany, Sandaru Seneviratne, Candan, KS, Ionescu, B, Goeuriot, L, Larsen, B, Müller, H, Joly, A, Maistro, M, Piroi, F, Faggioli, G, Ferro, N, Suominen, H, Kelly, L, Alemany, L, Bassani, E, Brew-Sam, N, Cotik, V, Filippo, D, González-Sáez, G, Luque, F, Mulhem, P, Pasi, G, Roller, R, Seneviratne, S, Upadhyay, R, Vivaldi, J, Viviani, M, Xu, C, Australian National University (ANU), Commonwealth Scientific and Industrial Research Organisation [Canberra] (CSIRO), University of Turku, Modélisation et Recherche d’Information Multimédia [Grenoble] (MRIM ), Laboratoire d'Informatique de Grenoble (LIG), Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes (UGA)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP ), Université Grenoble Alpes (UGA)-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes (UGA)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP ), Université Grenoble Alpes (UGA), Computer Science Department [Maynooth], National University of Ireland Maynooth (Maynooth University), Universidad Nacional de Córdoba [Argentina], Università degli Studi di Milano-Bicocca [Milano] (UNIMIB), Consorzio per il Trasferimento Tecnologico (C2T), Departamento de Computación [Buenos Aires], Facultad de Ciencias Exactas y Naturales [Buenos Aires] (FCEyN), Universidad de Buenos Aires [Buenos Aires] (UBA)-Universidad de Buenos Aires [Buenos Aires] (UBA), CONICET / IICE-UBA, Instituto de Investigación en Ciencias de la Computación [Buenos Aires] (ICC), Consejo Nacional de Investigaciones Científicas y Técnicas [Buenos Aires] (CONICET)-Facultad de Ciencias Exactas y Naturales [Buenos Aires] (FCEyN), Modélisation et Recherche d’Information Multimédia [Grenoble] (MRIM), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut National Polytechnique de Grenoble (INPG)-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut National Polytechnique de Grenoble (INPG)-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF), Deutsches Forschungszentrum für Künstliche Intelligenz GmbH = German Research Center for Artificial Intelligence (DFKI), Universitat Pompeu Fabra [Barcelona] (UPF), and ANR-19-CE23-0029,Kodicare,Variations de l'environnement d'évaluation : caractérisation du delta et impact sur l'évolution continue des systèmes de recherche d'information(2019)
- Subjects
Ninth ,Text segmentation ,Information extraction ,Computer science ,Self-diagnosi ,02 engineering and technology ,computer.software_genre ,Health informatics ,Task (project management) ,World Wide Web ,Health record ,Entity linking ,Resource (project management) ,020204 information systems ,Health care ,0202 electrical engineering, electronic engineering, information engineering ,eHealth ,Information retrieval ,Test-set generation ,Medical informatic ,Evaluation ,ComputingMilieux_MISCELLANEOUS ,business.industry ,Clef ,3. Good health ,[INFO.INFO-IR]Computer Science [cs]/Information Retrieval [cs.IR] ,Text classification ,020201 artificial intelligence & image processing ,business ,computer - Abstract
In this paper, we provide an overview of the ninth annual edition of the CLEF eHealth evaluation lab. CLEF eHealth 2021 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins, health care professionals, and health scientists in understanding, accessing, and authoring electronic health information in a multilingual setting. The 2021 lab offered two tasks: Task 1 on multilingual Information Extraction (IE), this year extending to a corpus of Spanish radiology reports; and Task 2 on Consumer Health Search (CHS) that builds on the previous year’s Information Retrieval (IR) tasks. In total, 11 teams took part in these tasks (7 in Task 1 on IE and 4 in Task 2 on IR). Herein, we describe the resources created for these tasks and the evaluation methodology adopted, and we provide a brief summary of the participants of this year’s challenges as well as the results obtained. As in previous years, the organizers have made data, tools, and more specific overview papers associated with the lab tasks available for future research and development.
- Published
- 2021
- Full Text
- View/download PDF