101. Deep learning-based artificial intelligence model to assist thyroid nodule diagnosis and management: a multicentre diagnostic study
- Author
-
Hong Yang, Qiuyi Zheng, Wei Wang, Weiming Lv, Jie Ren, Nie Fangxing, Jie Li, Longzhong Liu, Xuehua Zhang, Zelong Liu, Qian Zhou, Guang-Jian Liu, Han Xiao, Hang-Tong Hu, Gao Huang, Yuchen Guo, Haibo Wang, Sui Peng, Haipeng Xiao, Erik K. Alexander, Du Qiang, Xiaodong Wang, Jin-Yu Liang, Yihao Liu, Fenghua Lai, and Yanbing Li
- Subjects
Thyroid nodules ,medicine.diagnostic_test ,Receiver operating characteristic ,business.industry ,MEDLINE ,Medicine (miscellaneous) ,Health Informatics ,Nodule (medicine) ,medicine.disease ,Test (assessment) ,Fine-needle aspiration ,Health Information Management ,Predictive value of tests ,Medicine ,Decision Sciences (miscellaneous) ,Artificial intelligence ,Medical diagnosis ,medicine.symptom ,business - Abstract
BACKGROUND Strategies for integrating artificial intelligence (AI) into thyroid nodule management require additional development and testing. We developed a deep-learning AI model (ThyNet) to differentiate between malignant tumours and benign thyroid nodules and aimed to investigate how ThyNet could help radiologists improve diagnostic performance and avoid unnecessary fine needle aspiration. METHODS ThyNet was developed and trained on 18 049 images of 8339 patients (training set) from two hospitals (the First Affiliated Hospital of Sun Yat-sen University, Guangzhou, China, and Sun Yat-sen University Cancer Center, Guangzhou, China) and tested on 4305 images of 2775 patients (total test set) from seven hospitals (the First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China; the Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China; the Guangzhou Army General Hospital, Guangzhou, China; the Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China; the First Affiliated Hospital of Sun Yat-sen University; Sun Yat-sen University Cancer Center; and the First Affiliated Hospital of Guangxi Medical University, Nanning, China) in three stages. All nodules in the training and total test set were pathologically confirmed. The diagnostic performance of ThyNet was first compared with 12 radiologists (test set A); a ThyNet-assisted strategy, in which ThyNet assisted diagnoses made by radiologists, was developed to improve diagnostic performance of radiologists using images (test set B); the ThyNet assisted strategy was then tested in a real-world clinical setting (using images and videos; test set C). In a simulated scenario, the number of unnecessary fine needle aspirations avoided by ThyNet-assisted strategy was calculated. FINDINGS The area under the receiver operating characteristic curve (AUROC) for accurate diagnosis of ThyNet (0·922 [95% CI 0·910-0·934]) was significantly higher than that of the radiologists (0·839 [0·834-0·844]; p
- Published
- 2021