1. Learning to detect lymphocytes in immunohistochemistry with deep learning
- Author
-
Geert Litjens, Mustapha Abubakar, Hans Pinckaers, Margarita Melnikova, Mart van Rijthoven, Oscar Geessink, Quirine F. Manson, Maschenka Balkenhol, Zaneta Swiderska-Chadaj, Jeroen van der Laak, Francesco Ciompi, Jeremy Parry, Mark E. Sherman, and António Polónia
- Subjects
Male ,Computer science ,Normal tissue ,Datasets as Topic ,Breast Neoplasms ,Health Informatics ,030218 nuclear medicine & medical imaging ,03 medical and health sciences ,Prostate cancer ,Computational pathology ,Tumours of the digestive tract Radboud Institute for Health Sciences [Radboudumc 14] ,Deep Learning ,0302 clinical medicine ,All institutes and research themes of the Radboud University Medical Center ,medicine ,Humans ,Radiology, Nuclear Medicine and imaging ,Lymphocytes ,Reference standards ,Netherlands ,Radiological and Ultrasound Technology ,business.industry ,Deep learning ,Prostatic Neoplasms ,Cancer ,Pattern recognition ,medicine.disease ,Immunohistochemistry ,Computer Graphics and Computer-Aided Design ,Immune cell detection ,3. Good health ,Women's cancers Radboud Institute for Health Sciences [Radboudumc 17] ,Test set ,Urological cancers Radboud Institute for Health Sciences [Radboudumc 15] ,Colonic Neoplasms ,Female ,Computer Vision and Pattern Recognition ,Artificial intelligence ,Artifacts ,business ,030217 neurology & neurosurgery - Abstract
The immune system is of critical importance in the development of cancer. The evasion of destruction by the immune system is one of the emerging hallmarks of cancer. We have built a dataset of 171,166 manually annotated CD3 + and CD8 + cells, which we used to train deep learning algorithms for automatic detection of lymphocytes in histopathology images to better quantify immune response. Moreover, we investigate the effectiveness of four deep learning based methods when different subcompartments of the whole-slide image are considered: normal tissue areas, areas with immune cell clusters, and areas containing artifacts. We have compared the proposed methods in breast, colon and prostate cancer tissue slides collected from nine different medical centers. Finally, we report the results of an observer study on lymphocyte quantification, which involved four pathologists from different medical centers, and compare their performance with the automatic detection. The results give insights on the applicability of the proposed methods for clinical use. U-Net obtained the highest performance with an F1-score of 0.78 and the highest agreement with manual evaluation ( κ = 0.72 ), whereas the average pathologists agreement with reference standard was κ = 0.64 . The test set and the automatic evaluation procedure are publicly available at lyon19.grand-challenge.org .
- Published
- 2019
- Full Text
- View/download PDF