1. PET-Guided Attention Network for Segmentation of Lung Tumors from PET/CT Images
- Author
-
Imant Daunhawer, Thomas Weikert, Julia E. Vogt, Bram Stieltjes, Varaha Karthik Pattisapu, Alexander W. Sauter, Akata, Zeynep, Geiger, Andreas, and Sattler, Torsten
- Subjects
PET-CT ,business.industry ,Computer science ,02 engineering and technology ,Gold standard (test) ,Article ,030218 nuclear medicine & medical imaging ,03 medical and health sciences ,0302 clinical medicine ,Attention network ,0202 electrical engineering, electronic engineering, information engineering ,020201 artificial intelligence & image processing ,Segmentation ,Computer vision ,Artificial intelligence ,Ct imaging ,business ,Limited resources ,Healthcare system - Abstract
PET/CT imaging is the gold standard for the diagnosis and staging of lung cancer. However, especially in healthcare systems with limited resources, costly PET/CT images are often not readily available. Conventional machine learning models either process CT or PET/CT images but not both. Models designed for PET/CT images are hence restricted by the number of PET images, such that they are unable to additionally leverage CT-only data. In this work, we apply the concept of visual soft attention to efficiently learn a model for lung cancer segmentation from only a small fraction of PET/CT scans and a larger pool of CT-only scans. We show that our model is capable of jointly processing PET/CT as well as CT-only images, which performs on par with the respective baselines whether or not PET images are available at test time. We then demonstrate that the model learns efficiently from only a few PET/CT scans in a setting where mostly CT-only data is available, unlike conventional models. Electronic supplementary material The online version of this chapter (10.1007/978-3-030-71278-5_32) contains supplementary material, which is available to authorized users.
- Published
- 2021
- Full Text
- View/download PDF