1. Screening for extranodal extension in HPV-associated oropharyngeal carcinoma: evaluation of a CT-based deep learning algorithm in patient data from a multicentre, randomised de-escalation trial.
- Author
-
Kann BH, Likitlersuang J, Bontempi D, Ye Z, Aneja S, Bakst R, Kelly HR, Juliano AF, Payabvash S, Guenette JP, Uppaluri R, Margalit DN, Schoenfeld JD, Tishler RB, Haddad R, Aerts HJWL, Garcia JJ, Flamand Y, Subramaniam RM, Burtness BA, and Ferris RL
- Subjects
- Humans, Human Papillomavirus Viruses, Retrospective Studies, Extranodal Extension, Algorithms, Tomography, X-Ray Computed, Papillomavirus Infections diagnostic imaging, Papillomavirus Infections complications, Deep Learning, Oropharyngeal Neoplasms diagnostic imaging, Oropharyngeal Neoplasms pathology, Carcinoma complications
- Abstract
Background: Pretreatment identification of pathological extranodal extension (ENE) would guide therapy de-escalation strategies for in human papillomavirus (HPV)-associated oropharyngeal carcinoma but is diagnostically challenging. ECOG-ACRIN Cancer Research Group E3311 was a multicentre trial wherein patients with HPV-associated oropharyngeal carcinoma were treated surgically and assigned to a pathological risk-based adjuvant strategy of observation, radiation, or concurrent chemoradiation. Despite protocol exclusion of patients with overt radiographic ENE, more than 30% had pathological ENE and required postoperative chemoradiation. We aimed to evaluate a CT-based deep learning algorithm for prediction of ENE in E3311, a diagnostically challenging cohort wherein algorithm use would be impactful in guiding decision-making., Methods: For this retrospective evaluation of deep learning algorithm performance, we obtained pretreatment CTs and corresponding surgical pathology reports from the multicentre, randomised de-escalation trial E3311. All enrolled patients on E3311 required pretreatment and diagnostic head and neck imaging; patients with radiographically overt ENE were excluded per study protocol. The lymph node with largest short-axis diameter and up to two additional nodes were segmented on each scan and annotated for ENE per pathology reports. Deep learning algorithm performance for ENE prediction was compared with four board-certified head and neck radiologists. The primary endpoint was the area under the curve (AUC) of the receiver operating characteristic., Findings: From 178 collected scans, 313 nodes were annotated: 71 (23%) with ENE in general, 39 (13%) with ENE larger than 1 mm ENE. The deep learning algorithm AUC for ENE classification was 0·86 (95% CI 0·82-0·90), outperforming all readers (p<0·0001 for each). Among radiologists, there was high variability in specificity (43-86%) and sensitivity (45-96%) with poor inter-reader agreement (κ 0·32). Matching the algorithm specificity to that of the reader with highest AUC (R2, false positive rate 22%) yielded improved sensitivity to 75% (+ 13%). Setting the algorithm false positive rate to 30% yielded 90% sensitivity. The algorithm showed improved performance compared with radiologists for ENE larger than 1 mm (p<0·0001) and in nodes with short-axis diameter 1 cm or larger., Interpretation: The deep learning algorithm outperformed experts in predicting pathological ENE on a challenging cohort of patients with HPV-associated oropharyngeal carcinoma from a randomised clinical trial. Deep learning algorithms should be evaluated prospectively as a treatment selection tool., Funding: ECOG-ACRIN Cancer Research Group and the National Cancer Institute of the US National Institutes of Health., Competing Interests: Declaration of interests BHK reports research support from the US National Institutes of Health (NIH; grant number K08DE030216-01) and the Radiological Society of North America, honoraria from Dedham Group, and stock options in Monogram Orthopedics. JDS reports research support paid to their institution from Merck, Bristol Myers Squibb (BMS), Regeneron, Debiopharm, and Merck KGA; consulting, scientific advisory board, and travel fees from Castle Biosciences, Genentech, Immunitas, Debiopharm, BMS, Nanobiotix, Tilos, AstraZeneca, LEK Consulting, Catenion, ACI Clinical, Astellas, Stimit, and Merck KGA; expert witness fees; stock options in Immunitas; and equity in Doximity. RH reports payment for consulting from Celgene, Nanobiotix, ISA, Merck, Eisai, BMS, AstraZeneca, Pfizer, Loxo, Genentech, Immunomic Therapeutics, GlaxoSmithKline, Gilead Sciences, Vaccinex, Emmanuel Merck Darmstadt (EMD), Serono, BioNTech, Achilles Therapeutics, Bayer, Coherus Biosciences, Boehringer Ingelheim, and Mirati Therapeutics; and research funding from Boehringer Ingelheim, Merck, BMS, Celgene, AstraZeneca, Genentech, Pfizer, Kura Oncology, EMD, and Serono. SA reports research support from the Agency for Healthcare Research and Quality, National Cancer Institute, National Science Foundation, American Cancer Society, American Society of Clinical Oncology, Amazon, and Patterson Trust; fees from American Society of Clinical Oncology, HighCape Capital, Emmerson Collective; and stock options in Prophet Brand Strategy. HJWLA reports research support from NIH (grant numbers U24CA194354, U01CA190234, U01CA209414, and R35CA22052), and the European Union—European research Council (grant number 866504) and stock and other ownership interests in Onc.Ai, Love Health, Health-AI, and Bayerische Motoren Werke AG. BAB reports a consulting or advisory role with Merck, Debiopharm Group, CUE Biopharma, Maverick Therapeutics, Rakuten Medical, Nanobiotix, Macrogenics, ALX Oncology, IO Biotech, Ipsen, Genentech/Roche, Kura Oncology, Merck KGA, Pharmaceutical Product Development Global, and Exelixis; research funding to their institution from Merck, Aduro Biotech, Formation Biologics, BMS, and CUE Biopharma; and travel, accommodations, or expenses from Merck and Debiopharm Group. RLF reports stock and other ownership interests in Novasenta; a consulting or advisory role with Merck, Pfizer, EMD Serono, Numab, Macrogenics, Aduro Biotech, Novasenta, Sanofi, Zymeworks, and BMS; and research funding from Bristol Myers Squibb, AstraZeneca/MedImmune, Merck, Tesaro, and Novasenta. All other authors declare no competing interests., (Copyright © 2023 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY-NC-ND 4.0 license. Published by Elsevier Ltd.. All rights reserved.)
- Published
- 2023
- Full Text
- View/download PDF