1. The Brain Tumor Segmentation (BraTS-METS) Challenge 2023: Brain Metastasis Segmentation on Pre-treatment MRI
- Author
-
Moawad, Ahmed W., Janas, Anastasia, Baid, Ujjwal, Ramakrishnan, Divya, Saluja, Rachit, Ashraf, Nader, Maleki, Nazanin, Jekel, Leon, Yordanov, Nikolay, Fehringer, Pascal, Gkampenis, Athanasios, Amiruddin, Raisa, Manteghinejad, Amirreza, Adewole, Maruf, Albrecht, Jake, Anazodo, Udunna, Aneja, Sanjay, Anwar, Syed Muhammad, Bergquist, Timothy, Chiang, Veronica, Chung, Verena, Conte, Gian Marco, Dako, Farouk, Eddy, James, Ezhov, Ivan, Khalili, Nastaran, Farahani, Keyvan, Iglesias, Juan Eugenio, Jiang, Zhifan, Johanson, Elaine, Kazerooni, Anahita Fathi, Kofler, Florian, Krantchev, Kiril, LaBella, Dominic, Van Leemput, Koen, Li, Hongwei Bran, Linguraru, Marius George, Liu, Xinyang, Meier, Zeke, Menze, Bjoern H, Moy, Harrison, Osenberg, Klara, Piraud, Marie, Reitman, Zachary, Shinohara, Russell Takeshi, Wang, Chunhao, Wiestler, Benedikt, Wiggins, Walter, Shafique, Umber, Willms, Klara, Avesta, Arman, Bousabarah, Khaled, Chakrabarty, Satrajit, Gennaro, Nicolo, Holler, Wolfgang, Kaur, Manpreet, LaMontagne, Pamela, Lin, MingDe, Lost, Jan, Marcus, Daniel S., Maresca, Ryan, Merkaj, Sarah, Pedersen, Gabriel Cassinelli, von Reppert, Marc, Sotiras, Aristeidis, Teytelboym, Oleg, Tillmans, Niklas, Westerhoff, Malte, Youssef, Ayda, Godfrey, Devon, Floyd, Scott, Rauschecker, Andreas, Villanueva-Meyer, Javier, Pfluger, Irada, Cho, Jaeyoung, Bendszus, Martin, Brugnara, Gianluca, Cramer, Justin, Perez-Carillo, Gloria J. Guzman, Johnson, Derek R., Kam, Anthony, Kwan, Benjamin Yin Ming, Lai, Lillian, Lall, Neil U., Memon, Fatima, Krycia, Mark, Patro, Satya Narayana, Petrovic, Bojan, So, Tiffany Y., Thompson, Gerard, Wu, Lei, Schrickel, E. Brooke, Bansal, Anu, Barkhof, Frederik, Besada, Cristina, Chu, Sammy, Druzgal, Jason, Dusoi, Alexandru, Farage, Luciano, Feltrin, Fabricio, Fong, Amy, Fung, Steve H., Gray, R. Ian, Ikuta, Ichiro, Iv, Michael, Postma, Alida A., Mahajan, Amit, Joyner, David, Krumpelman, Chase, Letourneau-Guillon, Laurent, Lincoln, Christie M., Maros, Mate E., Miller, Elka, Moron, Fanny, Nimchinsky, Esther A., Ozsarlak, Ozkan, Patel, Uresh, Rohatgi, Saurabh, Saha, Atin, Sayah, Anousheh, Schwartz, Eric D., Shih, Robert, Shiroishi, Mark S., Small, Juan E., Tanwar, Manoj, Valerie, Jewels, Weinberg, Brent D., White, Matthew L., Young, Robert, Zohrabian, Vahe M., Azizova, Aynur, Bruseler, Melanie Maria Theresa, Ghonim, Mohanad, Ghonim, Mohamed, Okar, Abdullah, Pasquini, Luca, Sharifi, Yasaman, Singh, Gagandeep, Sollmann, Nico, Soumala, Theodora, Taherzadeh, Mahsa, Vollmuth, Philipp, Foltyn-Dumitru, Martha, Malhotra, Ajay, Abayazeed, Aly H., Dellepiane, Francesco, Lohmann, Philipp, Perez-Garcia, Victor M., Elhalawani, Hesham, de Verdier, Maria Correia, Al-Rubaiey, Sanaria, Armindo, Rui Duarte, Ashraf, Kholod, Asla, Moamen M., Badawy, Mohamed, Bisschop, Jeroen, Lomer, Nima Broomand, Bukatz, Jan, Chen, Jim, Cimflova, Petra, Corr, Felix, Crawley, Alexis, Deptula, Lisa, Elakhdar, Tasneem, Shawali, Islam H., Faghani, Shahriar, Frick, Alexandra, Gulati, Vaibhav, Haider, Muhammad Ammar, Hierro, Fatima, Dahl, Rasmus Holmboe, Jacobs, Sarah Maria, Hsieh, Kuang-chun Jim, Kandemirli, Sedat G., Kersting, Katharina, Kida, Laura, Kollia, Sofia, Koukoulithras, Ioannis, Li, Xiao, Abouelatta, Ahmed, Mansour, Aya, Maria-Zamfirescu, Ruxandra-Catrinel, Marsiglia, Marcela, Mateo-Camacho, Yohana Sarahi, McArthur, Mark, McDonnell, Olivia, McHugh, Maire, Moassefi, Mana, Morsi, Samah Mostafa, Munteanu, Alexander, Nandolia, Khanak K., Naqvi, Syed Raza, Nikanpour, Yalda, Alnoury, Mostafa, Nouh, Abdullah Mohamed Aly, Pappafava, Francesca, Patel, Markand D., Petrucci, Samantha, Rawie, Eric, Raymond, Scott, Roohani, Borna, Sabouhi, Sadeq, Sanchez-Garcia, Laura M., Shaked, Zoe, Suthar, Pokhraj P., Altes, Talissa, Isufi, Edvin, Dhemesh, Yaseen, Gass, Jaime, Thacker, Jonathan, Tarabishy, Abdul Rahman, Turner, Benjamin, Vacca, Sebastiano, Vilanilam, George K., Warren, Daniel, Weiss, David, Worede, Fikadu, Yousry, Sara, Lerebo, Wondwossen, Aristizabal, Alejandro, Karargyris, Alexandros, Kassem, Hasan, Pati, Sarthak, Sheller, Micah, Link, Katherine E., Calabrese, Evan, Tahon, Nourel hoda, Nada, Ayman, Velichko, Yuri S., Bakas, Spyridon, Rudie, Jeffrey D., and Aboian, Mariam
- Subjects
Quantitative Biology - Other Quantitative Biology ,Electrical Engineering and Systems Science - Image and Video Processing - Abstract
The translation of AI-generated brain metastases (BM) segmentation into clinical practice relies heavily on diverse, high-quality annotated medical imaging datasets. The BraTS-METS 2023 challenge has gained momentum for testing and benchmarking algorithms using rigorously annotated internationally compiled real-world datasets. This study presents the results of the segmentation challenge and characterizes the challenging cases that impacted the performance of the winning algorithms. Untreated brain metastases on standard anatomic MRI sequences (T1, T2, FLAIR, T1PG) from eight contributed international datasets were annotated in stepwise method: published UNET algorithms, student, neuroradiologist, final approver neuroradiologist. Segmentations were ranked based on lesion-wise Dice and Hausdorff distance (HD95) scores. False positives (FP) and false negatives (FN) were rigorously penalized, receiving a score of 0 for Dice and a fixed penalty of 374 for HD95. Eight datasets comprising 1303 studies were annotated, with 402 studies (3076 lesions) released on Synapse as publicly available datasets to challenge competitors. Additionally, 31 studies (139 lesions) were held out for validation, and 59 studies (218 lesions) were used for testing. Segmentation accuracy was measured as rank across subjects, with the winning team achieving a LesionWise mean score of 7.9. Common errors among the leading teams included false negatives for small lesions and misregistration of masks in space.The BraTS-METS 2023 challenge successfully curated well-annotated, diverse datasets and identified common errors, facilitating the translation of BM segmentation across varied clinical environments and providing personalized volumetric reports to patients undergoing BM treatment.
- Published
- 2023