1. Validation of a Deep Learning Tool in the Detection of Intracranial Hemorrhage and Large Vessel Occlusion
- Author
-
Joel McLouth, Sebastian Elstrott, Yasmina Chaibi, Sarah Quenet, Peter D. Chang, Daniel S. Chow, and Jennifer E. Soun
- Subjects
medicine.medical_specialty ,Clinical Trials and Supportive Activities ,Clinical Sciences ,030204 cardiovascular system & hematology ,03 medical and health sciences ,0302 clinical medicine ,Clinical Research ,medicine.artery ,large vessel occlusion ,Occlusion ,Medicine ,neuroradiology ,Psychology ,cardiovascular diseases ,RC346-429 ,Original Research ,Neuroradiology ,screening and diagnosis ,Middle cerebral artery M1 segment ,medicine.diagnostic_test ,business.industry ,Neurosciences ,deep learning ,artificial intelligence ,radiology ,Brain Disorders ,Stroke ,Detection ,Neurology ,Multicenter study ,Middle cerebral artery ,Angiography ,Biomedical Imaging ,Neurology. Diseases of the nervous system ,Neurology (clinical) ,Radiology ,Internal carotid artery ,business ,030217 neurology & neurosurgery ,intracranial hemorrhage ,4.2 Evaluation of markers and technologies ,Large vessel occlusion - Abstract
Purpose: Recently developed machine-learning algorithms have demonstrated strong performance in the detection of intracranial hemorrhage (ICH) and large vessel occlusion (LVO). However, their generalizability is often limited by geographic bias of studies. The aim of this study was to validate a commercially available deep learning-based tool in the detection of both ICH and LVO across multiple hospital sites and vendors throughout the U.S.Materials and Methods: This was a retrospective and multicenter study using anonymized data from two institutions. Eight hundred fourteen non-contrast CT cases and 378 CT angiography cases were analyzed to evaluate ICH and LVO, respectively. The tool's ability to detect and quantify ICH, LVO, and their various subtypes was assessed among multiple CT vendors and hospitals across the United States. Ground truth was based off imaging interpretations from two board-certified neuroradiologists.Results: There were 255 positive and 559 negative ICH cases. Accuracy was 95.6%, sensitivity was 91.4%, and specificity was 97.5% for the ICH tool. ICH was further stratified into the following subtypes: intraparenchymal, intraventricular, epidural/subdural, and subarachnoid with true positive rates of 92.9, 100, 94.3, and 89.9%, respectively. ICH true positive rates by volume [small (25 mL)] were 71.8, 100, and 100%, respectively. There were 156 positive and 222 negative LVO cases. The LVO tool demonstrated an accuracy of 98.1%, sensitivity of 98.1%, and specificity of 98.2%. A subset of 55 randomly selected cases were also assessed for LVO detection at various sites, including the distal internal carotid artery, middle cerebral artery M1 segment, proximal middle cerebral artery M2 segment, and distal middle cerebral artery M2 segment with an accuracy of 97.0%, sensitivity of 94.3%, and specificity of 97.4%.Conclusion: Deep learning tools can be effective in the detection of both ICH and LVO across a wide variety of hospital systems. While some limitations were identified, specifically in the detection of small ICH and distal M2 occlusion, this study highlights a deep learning tool that can assist radiologists in the detection of emergent findings in a variety of practice settings.
- Published
- 2021