1. Management of Incidental Thyroid Nodules on Chest CT: Using Natural Language Processing to Assess White Paper Adherence and Track Patient Outcomes
- Author
-
Benjamin Wildman-Tobriner, Steven Dondlinger, and Ryan G. Short
- Subjects
Thyroid nodules ,Chest ct ,Thyroid ultrasound ,computer.software_genre ,030218 nuclear medicine & medical imaging ,03 medical and health sciences ,0302 clinical medicine ,White paper ,Chart review ,medicine ,Humans ,Radiology, Nuclear Medicine and imaging ,Thyroid Nodule ,Natural Language Processing ,Retrospective Studies ,Incidental Findings ,business.industry ,Ultrasound ,Nodule (medicine) ,medicine.disease ,030220 oncology & carcinogenesis ,Artificial intelligence ,medicine.symptom ,Tomography, X-Ray Computed ,business ,computer ,Natural language processing - Abstract
Objective The purpose of this study was to develop a natural language processing (NLP) pipeline to identify incidental thyroid nodules (ITNs) meeting criteria for sonographic follow-up and to assess both adherence rates to white paper recommendations and downstream outcomes related to these incidental findings. Methods 21583 non-contrast chest CT reports from 2017 and 2018 were retrospectively evaluated to identify reports which included either an explicit recommendation for thyroid ultrasound, a description of a nodule ≥ 1.5 cm, or description of a nodule with suspicious features. Reports from 2018 were used to train an NLP algorithm called fastText for automated identification of such reports. Algorithm performance was then evaluated on the 2017 reports. Next, any patient from 2017 with a report meeting criteria for ultrasound follow-up was further evaluated with manual chart review to determine follow-up adherence rates and nodule-related outcomes. Results NLP identified reports with ITNs meeting criteria for sonographic follow-up with an accuracy of 96.5% (95% CI 96.2-96.7) and sensitivity of 92.1% (95% CI 89.8-94.3). In 10006 chest CTs from 2017, ITN follow-up ultrasound was indicated according to white paper criteria in 81 patients (0.8%), explicitly recommended in 46.9% (38/81) of patients, and obtained in less than half of patients in which it was appropriately recommended (17/35, 48.6%). Discussion NLP accurately identified chest CT reports meeting criteria for ITN ultrasound follow-up. Radiologist adherence to white paper guidelines and subsequent referrer adherence to radiologist recommendations showed room for improvement.
- Published
- 2022
- Full Text
- View/download PDF