1. Training immunophenotyping deep learning models with the same-section ground truth cell label derivation method improves virtual staining accuracy
- Author
-
Abu Bakr Azam, Felicia Wee, Juha P. Väyrynen, Willa Wen-You Yim, Yue Zhen Xue, Bok Leong Chua, Jeffrey Chun Tatt Lim, Aditya Chidambaram Somasundaram, Daniel Shao Weng Tan, Angela Takano, Chun Yuen Chow, Li Yan Khor, Tony Kiat Hon Lim, Joe Yeong, Mai Chan Lau, and Yiyu Cai
- Subjects
virtual staining ,CD3 ,Pix2Pix generative adversarial network (P2P-GAN) ,tumor-infiltrating lymphocytes (TILs) ,hematoxylin and eosin (H&E) ,ground truth cell label ,Immunologic diseases. Allergy ,RC581-607 - Abstract
IntroductionDeep learning (DL) models predicting biomarker expression in images of hematoxylin and eosin (H&E)-stained tissues can improve access to multi-marker immunophenotyping, crucial for therapeutic monitoring, biomarker discovery, and personalized treatment development. Conventionally, these models are trained on ground truth cell labels derived from IHC-stained tissue sections adjacent to H&E-stained ones, which might be less accurate than labels from the same section. Although many such DL models have been developed, the impact of ground truth cell label derivation methods on their performance has not been studied.MethodologyIn this study, we assess the impact of cell label derivation on H&E model performance, with CD3+ T-cells in lung cancer tissues as a proof-of-concept. We compare two Pix2Pix generative adversarial network (P2P-GAN)-based virtual staining models: one trained with cell labels obtained from the same tissue section as the H&E-stained section (the ‘same-section’ model) and one trained on cell labels from an adjacent tissue section (the ‘serial-section’ model).ResultsWe show that the same-section model exhibited significantly improved prediction performance compared to the ‘serial-section’ model. Furthermore, the same-section model outperformed the serial-section model in stratifying lung cancer patients within a public lung cancer cohort based on survival outcomes, demonstrating its potential clinical utility.DiscussionCollectively, our findings suggest that employing ground truth cell labels obtained through the same-section approach boosts immunophenotyping DL solutions.
- Published
- 2024
- Full Text
- View/download PDF