1. Deep Learning-based Prediction of Breast Cancer Tumor and Immune Phenotypes from Histopathology
- Author
-
Gonçalves, Tiago, Pulido-Arias, Dagoberto, Willett, Julian, Hoebel, Katharina V., Cleveland, Mason, Ahmed, Syed Rakin, Gerstner, Elizabeth, Kalpathy-Cramer, Jayashree, Cardoso, Jaime S., Bridge, Christopher P., and Kim, Albert E.
- Subjects
Electrical Engineering and Systems Science - Image and Video Processing ,Computer Science - Computer Vision and Pattern Recognition ,Computer Science - Machine Learning ,Quantitative Biology - Quantitative Methods ,92C55 ,I.5.1 ,I.5.4 ,I.2.10 ,J.3 - Abstract
The interactions between tumor cells and the tumor microenvironment (TME) dictate therapeutic efficacy of radiation and many systemic therapies in breast cancer. However, to date, there is not a widely available method to reproducibly measure tumor and immune phenotypes for each patient's tumor. Given this unmet clinical need, we applied multiple instance learning (MIL) algorithms to assess activity of ten biologically relevant pathways from the hematoxylin and eosin (H&E) slide of primary breast tumors. We employed different feature extraction approaches and state-of-the-art model architectures. Using binary classification, our models attained area under the receiver operating characteristic (AUROC) scores above 0.70 for nearly all gene expression pathways and on some cases, exceeded 0.80. Attention maps suggest that our trained models recognize biologically relevant spatial patterns of cell sub-populations from H&E. These efforts represent a first step towards developing computational H&E biomarkers that reflect facets of the TME and hold promise for augmenting precision oncology., Comment: Paper accepted at the First Workshop on Imageomics (Imageomics-AAAI-24) - Discovering Biological Knowledge from Images using AI (https://sites.google.com/vt.edu/imageomics-aaai-24/home), held as part of the 38th Annual AAAI Conference on Artificial Intelligence (https://aaai.org/aaai-conference/)
- Published
- 2024