Back to Search
Start Over
Inter-rater reliability for assessing intracranial collaterals in patients with acute ischemic stroke: comparing 29 raters and an artificial intelligence-based software
- Source :
- Neuroradiology, 64(12), 2277-2284. Springer Verlag, on behalf of the MR CLEAN investigators 2022, ' Inter-rater reliability for assessing intracranial collaterals in patients with acute ischemic stroke : comparing 29 raters and an artificial intelligence-based software ', Neuroradiology, vol. 64, no. 12, pp. 2277-2284 . https://doi.org/10.1007/s00234-022-02984-z, Neuroradiology, 64, 12, pp. 2277-2284, Neuroradiology, 64(12), 2277-2284. Springer-Verlag, Neuroradiology, 64, 2277-2284, Neuroradiology, 64(12), 2277-2284. Springer, Cham
- Publication Year :
- 2022
-
Abstract
- Purpose Outcome of endovascular treatment in acute ischemic stroke patients is depending on the collateral circulation maintaining blood flow to the ischemic territory. We evaluated the inter-rater reliability and accuracy of raters and an automated algorithm for assessing the collateral score (CS, range: 0–3) in acute ischemic stroke patients. Methods Baseline CTA scans with an intracranial anterior occlusion from the MR CLEAN study (n=500) were used. For each core lab CS, ten CTA scans with sufficient quality were randomly selected. After a training session in collateral scoring, all selected CTA scans were individually evaluated for a visual CS by three groups: 7 radiologists, 13 junior and 9 senior radiology residents. Two additional radiologists scored CS to be used as reference, with a third providing a CS to produce a 2 out of 3 consensus CS in case of disagreement. An automated algorithm was also used to compute CS. Inter-rater agreement was reported with intraclass correlation coefficient (ICC). Accuracy of visual and automated CS were calculated. Results 39 CTA scans were assessed (1 corrupt CTA-scan excluded). All groups showed a moderate ICC (0.689-0.780) in comparison to the reference standard. Overall human accuracy was 65± 7% and increased to 88± 5% for dichotomized CS (0–1, 2–3). Automated CS accuracy was 62%, and 90% for dichotomized CS. No significant difference in accuracy was found between groups with different levels of expertise. Conclusion After training, inter-rater reliability in collateral scoring was not influenced by experience. Automated CS performs similar to residents and radiologists in determining a collateral score.
- Subjects :
- Reproducibility of results
OUTCOMES
Collateral circulation
Consensus
Ischemic stroke
Other Research Radboud Institute for Health Sciences [Radboudumc 0]
Brain Ischemia
Cerebral Angiography
Stroke
Artificial Intelligence
PERFUSION
SCORE
CT-ANGIOGRAPHY
Humans
Radiology, Nuclear Medicine and imaging
Neurology (clinical)
BURDEN
Cardiology and Cardiovascular Medicine
Software
Algorithms
INTRAARTERIAL TREATMENT
Subjects
Details
- Language :
- English
- ISSN :
- 00283940
- Database :
- OpenAIRE
- Journal :
- Neuroradiology, 64(12), 2277-2284. Springer Verlag, on behalf of the MR CLEAN investigators 2022, ' Inter-rater reliability for assessing intracranial collaterals in patients with acute ischemic stroke : comparing 29 raters and an artificial intelligence-based software ', Neuroradiology, vol. 64, no. 12, pp. 2277-2284 . https://doi.org/10.1007/s00234-022-02984-z, Neuroradiology, 64, 12, pp. 2277-2284, Neuroradiology, 64(12), 2277-2284. Springer-Verlag, Neuroradiology, 64, 2277-2284, Neuroradiology, 64(12), 2277-2284. Springer, Cham
- Accession number :
- edsair.doi.dedup.....8420e62a8d5cb6217cf205a2a0bf9919