1. Development and Validation of a Machine Learning Model for Early Detection of Untreated Infection.
- Author
-
Buell KG, Carey KA, Dussault N, Parker WF, Dumanian J, Bhavani SV, Gilbert ER, Winslow CJ, Shah NS, Afshar M, Edelson DP, and Churpek MM
- Subjects
- Humans, Female, Male, Middle Aged, Aged, Adult, Illinois, Cohort Studies, Infections diagnosis, ROC Curve, Anti-Bacterial Agents therapeutic use, Anti-Bacterial Agents administration & dosage, Area Under Curve, Machine Learning, Early Diagnosis
- Abstract
Background: Early diagnostic uncertainty for infection causes delays in antibiotic administration in infected patients and unnecessary antibiotic administration in noninfected patients., Objective: To develop a machine learning model for the early detection of untreated infection (eDENTIFI), with the presence of infection determined by clinician chart review., Derivation Cohort: Three thousand three hundred fifty-seven adult patients hospitalized between 2006 and 2018 at two health systems in Illinois, United States., Validation Cohort: We validated in 1632 patients in a third Illinois health system using area under the receiver operating characteristic curve (AUC)., Prediction Model: Using a longitudinal discrete-time format, we trained a gradient boosted machine model to predict untreated infection in the next 6 hours using routinely available patient demographics, vital signs, and laboratory results., Results: eDENTIFI had an AUC of 0.80 (95% CI, 0.79-0.81) in the validation cohort and outperformed the systemic inflammatory response syndrome criteria with an AUC of 0.64 (95% CI, 0.64-0.65; p < 0.001). The most important features were body mass index, age, temperature, and heart rate. Using a threshold with a 47.6% sensitivity, eDENTIFI detected infection a median 2.0 hours (interquartile range, 0.9-5.2 hr) before antimicrobial administration, with a negative predictive value of 93.6%. Antibiotic administration guided by eDENTIFI could have decreased unnecessary IV antibiotic administration in noninfected patients by 10.8% absolute or 46.4% relative percentage points compared with clinicians., Conclusion: eDENTIFI could both decrease the time to antimicrobial administration in infected patients and unnecessary antibiotic administration in noninfected patients. Further prospective validation is needed., Competing Interests: Dr. Buell is supported by T32 HL007605. Dr. Bhavani is supported by the National Institute of General Medical Sciences GM144867. Dr. Parker is supported by K08HL150291 and R01LM014263. Dr. Churpek is supported by R35GM145330. The remaining authors have disclosed that they do not have any potential conflicts of interest., (Copyright © 2024 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of the Society of Critical Care Medicine.)
- Published
- 2024
- Full Text
- View/download PDF