Search

PURPOSE Translation of AI algorithms into clinical practice is significantly limited by lack of large individual hospital-based datasets with expert annotations. Current methods for generation of annotated imaging data are significantly limited due to inefficient imaging data transfer, complicated annotation software, and time required for experts to generate ground truth information. We incorporated AI tools for auto-segmentation of gliomas into PACS that is used at our institution for reading clinical studies and developed a workflow for annotation of images and development of volumetric segmentations in neuroradiology clinical workflow. Material: 1990 patients from Yale Radiation Oncology Registry (2012-2019) were identified. Segmentations were performed using a UNETR algorithm trained on BRaTS 2021 and an internal dataset of manually segmented tumors. Segmentations were validated by a board-certified neuro-radiologist and natively embedded PyRadiomics in PACS was used for feature extraction. RESULTS In 7 Months (05/2021 - 08/2021, 03/2022 - 05/2022) segmentations and annotations were performed in 835 patients (322 female, 467 male, 46 unknown, mean age 53 yrs). Dataset includes 275 Grade 4 Gliomas (54 Grade 3, 100 Grade 2, 31 Grade 1, 375 unknown). Molecular subtypes include IDH (113 mutated, 498 wildtype, 2 Equivocal, 222 unknown), 1p/19q (87 deleted or co-deleted, 122 intact, 626 unknown), MGMT promotor (182 methylated, 95 partially methylated, 275 unmethylated, 283 unknown), EGFR (76 amplified, 177 not amplified, 582 unknown), ATRX (40 mutated, 157 retained, 638 unknown), Ki-67 (616 known, 219 unknown) and p53 (549 known, 286 unknown). Classification of gliomas between grade 3/4 and grade 1/2, yielded AUC of 0.85. CONCLUSION We developed a method for incorporation of volumetric segmentation, feature extraction, and classification that is easily incorporated into neuroradiology workflow. These tools allowed us to annotate over 100 gliomas per month, thus establishing a proof of concept for rapid development of annotated imaging database for AI applications.

PURPOSE Monitoring metastatic disease to the brain is laborious and time-consuming, especially in the setting of multiple metastases and when performed manually. Response assessment in brain metastases based on maximal unidimensional diameter as per the RANO-BM guideline is commonly performed1, however, accurate volumetric lesion estimates can be crucial for clinical decision-making2 and enhance outcome prediction3. We propose a deep learning (DL)-based auto-segmentation approach with the potential for improvement of time-efficiency, reproducibility and robustness against inter-rater variability. Materials and METHODS We retrospectively retrieved 259 patients with a total number of 916 lesions from our institutional database from 2014 - 2021. Patients with prior history of local radiation therapy or surgery were excluded. Manually generated trainee segmentations were revised and adjusted by a board-certified radiologist and served as ground truth for evaluation of segmentation accuracy. Model performance was tested via dice-similarity-coefficient (DSC). Volumetric measurements were then obtained within our PACS-integrated workflow on Visage 7 (Visage Imaging, Inc., San Diego, CA) at the click of one button. RESULTS For model training and evaluation, a train-test split of 90:10 on patient-level was performed (n= 234:25 (Patients), n= 861:55 (Lesions). A DL-algorithm (nnUNet) was incrementally trained on 10 batches of 23 patients. The DSC of the U-Net gradually increased throughout the training process and heuristically reached a plateau of 0.85. The sensitivity of the algorithm was 83% with detection of 46 out of 55 lesions in the testing dataset. The lesions that were not detected by the algorithm were below 5 mm in size. The false positive rate was 8% (n=4/50). CONCLUSION Our study demonstrates the feasibility of PACS-based integration of automatized segmentation workflows of brain metastases. An incremental-training approach is recommended to adapt DL algorithms to specific hospital settings.