1. A Deep Learning Model with High Standalone Performance for Diagnosis of Unruptured Intracranial Aneurysm
- Author
-
Beomseok Sohn, Sang Min Lee, Seung Koo Lee, Kyunghwa Han, Hwa Pyung Kim, Tae Gyu Kim, Jihoon Cha, So Yeon Won, Jong Mun Choi, Bio Joo, Hyun Seok Choi, Sung Soo Ahn, and Hwi Young Kim
- Subjects
medicine.medical_specialty ,Artificial intelligence ,medicine.diagnostic_test ,business.industry ,Deep learning ,magnetic resonance angiography ,Intracranial Aneurysm ,General Medicine ,medicine.disease ,Confidence interval ,Magnetic resonance angiography ,Radiology, Medical Imaging ,Clinical trial ,Aneurysm ,Deep Learning ,Sample size determination ,medicine ,Humans ,Christian ministry ,Original Article ,Radiology ,Detection rate ,business ,Retrospective Studies - Abstract
Purpose This study aimed to investigate whether a deep learning model for automated detection of unruptured intracranial aneurysms on time-of-flight (TOF) magnetic resonance angiography (MRA) can achieve a target diagnostic performance comparable to that of human radiologists for approval from the Korean Ministry of Food and Drug Safety as an artificial intelligence-applied software. Materials and methods In this single-center, retrospective, confirmatory clinical trial, the diagnostic performance of the model was evaluated in a predetermined test set. After sample size estimation, the test set consisted of 135 aneurysm-containing examinations with 168 intracranial aneurysms and 197 aneurysm-free examinations. The target sensitivity and specificity were set as 87% and 92%, respectively. The patient-wise sensitivity and specificity of the model were analyzed. Moreover, the lesion-wise sensitivity and false-positive detection rate per case were also investigated. Results The sensitivity and specificity of the model were 91.11% [95% confidence interval (CI): 84.99, 95.32] and 93.91% (95% CI: 89.60, 96.81), respectively, which met the target performance values. The lesion-wise sensitivity was 92.26%. The overall false-positive detection rate per case was 0.123. Of the 168 aneurysms, 13 aneurysms from 12 examinations were missed by the model. Conclusion The present deep learning model for automated detection of unruptured intracranial aneurysms on TOF MRA achieved the target diagnostic performance comparable to that of human radiologists. With high standalone performance, this model may be useful for accurate and efficient diagnosis of intracranial aneurysm.
- Published
- 2021