Search

Objectives: The assessment of lumbar central canal stenosis (LCCS) is crucial for diagnosing and planning treatment for patients with low back pain and neurogenic pain. However, manual assessment methods are time-consuming, variable, and require axial MRIs. The aim of this study is to develop and validate an AI-based model that automatically classifies LCCS using sagittal T2-weighted MRIs., Methods: A pre-existing 3D AI algorithm was utilized to segment the spinal canal and intervertebral discs (IVDs), enabling quantitative measurements at each IVD level. Four musculoskeletal radiologists graded 683 IVD levels from 186 LCCS patients using the 4-class Lee grading system. A second consensus reading was conducted by readers 1 and 2, which, along with automatic measurements, formed the training dataset for a multiclass (grade 0-3) and binary (grade 0-1 vs. 2-3) random forest classifier with tenfold cross-validation., Results: The multiclass model achieved a Cohen's weighted kappa of 0.86 (95% CI: 0.82-0.90), comparable to readers 3 and 4 with 0.85 (95% CI: 0.80-0.89) and 0.73 (95% CI: 0.68-0.79) respectively. The binary model demonstrated an AUC of 0.98 (95% CI: 0.97-0.99), sensitivity of 93% (95% CI: 91-96%), and specificity of 91% (95% CI: 87-95%). In comparison, readers 3 and 4 achieved a specificity of 98 and 99% and sensitivity of 74 and 54%, respectively., Conclusion: Both the multiclass and binary models, while only using sagittal MR images, perform on par with experienced radiologists who also had access to axial sequences. This underscores the potential of this novel algorithm in enhancing diagnostic accuracy and efficiency in medical imaging., Key Points: Question How can the classification of lumbar central canal stenosis (LCCS) be made more efficient? Findings Multiclass and binary AI models, using only sagittal MR images, performed on par with experienced radiologists who also had access to axial sequences. Clinical relevance Our AI algorithm accurately classifies LCCS from sagittal MRI, matching experienced radiologists. This study offers a promising tool for automated LCCS assessment from sagittal T2 MRI, potentially reducing the reliance on additional axial imaging., (© 2024. The Author(s).)

Objectives: Severity of degenerative scoliosis (DS) is assessed by measuring the Cobb angle on anteroposterior radiographs. However, MRI images are often available to study the degenerative spine. This retrospective study aims to develop and evaluate the reliability of a novel automatic method that measures coronal Cobb angles on lumbar MRI in DS patients., Materials and Methods: Vertebrae and intervertebral discs were automatically segmented using a 3D AI algorithm, trained on 447 lumbar MRI series. The segmentations were used to calculate all possible angles between the vertebral endplates, with the largest being the Cobb angle. The results were validated with 50 high-resolution sagittal lumbar MRI scans of DS patients, in which three experienced readers measured the Cobb angle. Reliability was determined using the intraclass correlation coefficient (ICC)., Results: The ICCs between the readers ranged from 0.90 (95% CI 0.83-0.94) to 0.93 (95% CI 0.88-0.96). The ICC between the maximum angle found by the algorithm and the average manually measured Cobb angles was 0.83 (95% CI 0.71-0.90). In 9 out of the 50 cases (18%), all readers agreed on both vertebral levels for Cobb angle measurement. When using the algorithm to extract the angles at the vertebral levels chosen by the readers, the ICCs ranged from 0.92 (95% CI 0.87-0.96) to 0.97 (95% CI 0.94-0.98)., Conclusion: The Cobb angle can be accurately measured on MRI using the newly developed algorithm in patients with DS. The readers failed to consistently choose the same vertebral level for Cobb angle measurement, whereas the automatic approach ensures the maximum angle is consistently measured., Clinical Relevance Statement: Our AI-based algorithm offers reliable Cobb angle measurement on routine MRI for degenerative scoliosis patients, potentially reducing the reliance on conventional radiographs, ensuring consistent assessments, and therefore improving patient care., Key Points: • While often available, MRI images are rarely utilized to determine the severity of degenerative scoliosis. • The presented MRI Cobb angle algorithm is more reliable than humans in patients with degenerative scoliosis. • Radiographic imaging for Cobb angle measurements is mitigated when lumbar MRI images are available., (© 2024. The Author(s).)

Purpose: AI-assisted techniques for lesion registration and segmentation have the potential to make CT-based tumor follow-up assessment faster and less reader-dependent. However, empirical evidence on the advantages of AI-assisted volumetric segmentation for lymph node and soft tissue metastases in follow-up CT scans is lacking. The aim of this study was to assess the efficiency, quality, and inter-reader variability of an AI-assisted workflow for volumetric segmentation of lymph node and soft tissue metastases in follow-up CT scans. Three hypotheses were tested: (H1) Assessment time for follow-up lesion segmentation is reduced using an AI-assisted workflow. (H2) The quality of the AI-assisted segmentation is non-inferior to the quality of fully manual segmentation. (H3) The inter-reader variability of the resulting segmentations is reduced with AI assistance., Materials and Methods: The study retrospectively analyzed 126 lymph nodes and 135 soft tissue metastases from 55 patients with stage IV melanoma. Three radiologists from two institutions performed both AI-assisted and manual segmentation, and the results were statistically analyzed and compared to a manual segmentation reference standard., Results: AI-assisted segmentation reduced user interaction time significantly by 33% (222 s vs. 336 s), achieved similar Dice scores (0.80-0.84 vs. 0.81-0.82) and decreased inter-reader variability (median Dice 0.85-1.0 vs. 0.80-0.82; ICC 0.84 vs. 0.80), compared to manual segmentation., Conclusion: The findings of this study support the use of AI-assisted registration and volumetric segmentation for lymph node and soft tissue metastases in follow-up CT scans. The AI-assisted workflow achieved significant time savings, similar segmentation quality, and reduced inter-reader variability compared to manual segmentation., (© 2024. The Author(s).)

This paper presents a large publicly available multi-center lumbar spine magnetic resonance imaging (MRI) dataset with reference segmentations of vertebrae, intervertebral discs (IVDs), and spinal canal. The dataset includes 447 sagittal T1 and T2 MRI series from 218 patients with a history of low back pain and was collected from four different hospitals. An iterative data annotation approach was used by training a segmentation algorithm on a small part of the dataset, enabling semi-automatic segmentation of the remaining images. The algorithm provided an initial segmentation, which was subsequently reviewed, manually corrected, and added to the training data. We provide reference performance values for this baseline algorithm and nnU-Net, which performed comparably. Performance values were computed on a sequestered set of 39 studies with 97 series, which were additionally used to set up a continuous segmentation challenge that allows for a fair comparison of different segmentation algorithms. This study may encourage wider collaboration in the field of spine segmentation and improve the diagnostic value of lumbar spine MRI., (© 2024. The Author(s).)

Bone ranks as the third most frequent tissue affected by cancer metastases, following the lung and liver. Bone metastases are often painful and may result in pathological fracture, which is a major cause of morbidity and mortality in cancer patients. To quantify fracture risk, finite element (FE) analysis has shown to be a promising tool, but metastatic lesions are typically not specifically segmented and therefore their mechanical properties may not be represented adequately. Deep learning methods potentially provide the opportunity to automatically segment these lesions and change the mechanical properties more adequately. In this study, our primary focus was to gain insight into the performance of an automatic segmentation algorithm for femoral metastatic lesions using deep learning methods and the subsequent effects on FE outcomes. The aims were to determine the similarity between manual segmentation and automatic segmentation; the differences in predicted failure load between FE models with automatically segmented osteolytic and mixed lesions and the models with CT-based lesion values (the gold standard); and the effect on the BOne Strength (BOS) score (failure load adjusted for body weight) and subsequent fracture risk assessments. From two patient cohorts, a total number of 50 femurs with osteolytic and mixed metastatic lesions were included in this study. The femurs were segmented from CT images and transferred into FE meshes. The material behavior was implemented as non-linear isotropic. These FE models were considered as gold standard (Finite Element no Segmented Lesion: FE-no-SL), whereby the local calcium equivalent density of both femur and metastatic lesion was extracted from CT-values. Lesions in the femur were manually segmented by two biomechanical experts after which final lesion segmentation for each femur was obtained based on consensus of opinions between two observers. Subsequently, a self-configuring variant of the popular deep learning model U-Net known as nnU-Net was used to automatically segment metastatic lesions within the femur. For these models with segmented lesions (Finite Element with Segmented Lesion: FE-with-SL), the calcium equivalent density within the metastatic lesions was set to zero after being segmented by the neural network, simulating absence of load-bearing capacity of these lesions. The models (either with or without automatically segmented lesions) were loaded incrementally in axial direction until failure was simulated. Dice coefficient was used to evaluate the similarity of the manual and automatic segmentation. Mean calcium equivalent density values within the automatically segmented lesions were calculated. Failure loads and patterns were determined. Furthermore, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated for both groups by comparing the predictions to the occurrence or absence of actual fracture within the patient cohorts. The automatic segmentation algorithm performed in a none-robust manner. Dice coefficients describing the similarity between consented manual and automatic segmentations were relatively low (mean 0.45 ± standard deviation 0.33, median 0.54). Failure load difference between the FE-no-SL and FE-with-SL groups varied from 0 % to 48 % (mean 6.6 %). Correlation analysis of failure loads between the two groups showed a strong relationship (R 2  > 0.9). From the 50 cases, four cases showed clear deviations for which models with automatic lesion segmentation (FE-with-SL) showed considerably lower failure loads. In the whole database including osteolytic and mixed lesions, sensitivity and NPV remained the same, but specificity and PPV decreased from 94 % to 83 %, and from 78 % to 54 % respectively from FE-no-SL to FE-with-SL. This study indicates that the nnU-Net yielded none-robust outcomes in femoral lesion segmentation and that other segmentation algorithms should be considered. However, the difference in failure pattern and failure load between FE models with automatically segmented osteolytic and mixed lesions were relatively small in most cases with a few exceptions. On the other hand, the accuracy of fracture risk assessment using the BOS score was lower compared to the FE-no-SL. In conclusion, this study showed that automatic lesion segmentation is a none-solved issue and therefore, quantifying lesion characteristics and the subsequent effect on the fracture risk using deep learning will remain challenging., Competing Interests: Declaration of competing interest None., (Copyright © 2023 The Authors. Published by Elsevier Inc. All rights reserved.)

Purpose: Low back pain (LBP) is one of the most prevalent health condition worldwide and responsible for the most years lived with disability, yet the etiology is often unknown. Magnetic resonance imaging (MRI) is frequently used for treatment decision even though it is often inconclusive. There are many different image features that could relate to low back pain. Conversely, multiple etiologies do relate to spinal degeneration but do not actually cause the perceived pain. This narrative review provides an overview of all possible relevant features visible on MRI images and determines their relation to LBP., Methods: We conducted a separate literature search per image feature. All included studies were scored using the GRADE guidelines. Based on the reported results per feature an evidence agreement (EA) score was provided, enabling us to compare the collected evidence of separate image features. The various relations between MRI features and their associated pain mechanisms were evaluated to provide a list of features that are related to LBP., Results: All searches combined generated a total of 4472 hits of which 31 articles were included. Features were divided into five different categories:'discogenic', 'neuropathic','osseous', 'facetogenic', and'paraspinal', and discussed separately., Conclusion: Our research suggests that type I Modic changes, disc degeneration, endplate defects, disc herniation, spinal canal stenosis, nerve compression, and muscle fat infiltration have the highest probability to be related to LBP. These can be used to improve clinical decision-making for patients with LBP based on MRI., (© 2023. The Author(s).)

Image registration is a fundamental medical image analysis task, and a wide variety of approaches have been proposed. However, only a few studies have comprehensively compared medical image registration approaches on a wide range of clinically relevant tasks. This limits the development of registration methods, the adoption of research advances into practice, and a fair benchmark across competing approaches. The Learn2Reg challenge addresses these limitations by providing a multi-task medical image registration data set for comprehensive characterisation of deformable registration algorithms. A continuous evaluation will be possible at https://learn2reg.grand-challenge.org. Learn2Reg covers a wide range of anatomies (brain, abdomen, and thorax), modalities (ultrasound, CT, MR), availability of annotations, as well as intra- and inter-patient registration evaluation. We established an easily accessible framework for training and validation of 3D registration methods, which enabled the compilation of results of over 65 individual method submissions from more than 20 unique teams. We used a complementary set of metrics, including robustness, accuracy, plausibility, and runtime, enabling unique insight into the current state-of-the-art of medical image registration. This paper describes datasets, tasks, evaluation methods and results of the challenge, as well as results of further analysis of transferability to new datasets, the importance of label supervision, and resulting bias. While no single approach worked best across all tasks, many methodological aspects could be identified that push the performance of medical image registration to new state-of-the-art performance. Furthermore, we demystified the common belief that conventional registration methods have to be much slower than deep-learning-based methods.

Deep learning methods have demonstrated the ability to perform accurate coronary artery calcium (CAC) scoring. However, these methods require large and representative training data hampering applicability to diverse CT scans showing the heart and the coronary arteries. Training methods that accurately score CAC in cross-domain settings remains challenging. To address this, we present an unsupervised domain adaptation method that learns to perform CAC scoring in coronary CT angiography (CCTA) from non-contrast CT (NCCT). To address the domain shift between NCCT (source) domain and CCTA (target) domain, feature distributions are aligned between two domains using adversarial learning. A CAC scoring convolutional neural network is divided into a feature generator that maps input images to features in the latent space and a classifier that estimates predictions from the extracted features. For adversarial learning, a discriminator is used to distinguish the features between source and target domains. Hence, the feature generator aims to extract features with aligned distributions to fool the discriminator. The network is trained with adversarial loss as the objective function and a classification loss on the source domain as a constraint for adversarial learning. In the experiments, three data sets were used. The network is trained with 1,687 labeled chest NCCT scans from the National Lung Screening Trial. Furthermore, 200 labeled cardiac NCCT scans and 200 unlabeled CCTA scans were used to train the generator and the discriminator for unsupervised domain adaptation. Finally, a data set containing 313 manually labeled CCTA scans was used for testing. Directly applying the CAC scoring network trained on NCCT to CCTA led to a sensitivity of 0.41 and an average false positive volume 140 mm 3 /scan. The proposed method improved the sensitivity to 0.80 and reduced average false positive volume of 20 mm 3 /scan. The results indicate that the unsupervised domain adaptation approach enables automatic CAC scoring in contrast enhanced CT while learning from a large and diverse set of CT scans without contrast. This may allow for better utilization of existing annotated data sets and extend the applicability of automatic CAC scoring to contrast-enhanced CT scans without the need for additional manual annotations. The code is publicly available at https://github.com/qurAI-amsterdam/CACscoringUsingDomainAdaptation., Competing Interests: Author II reports institutional research grants by Pie Medical Imaging, Esaote, Dutch Technology Foundation with participation of Pie Medical Imaging and Philips Healthcare (DLMedIA P15-26). Author TL reports institutional research grants by Pie Medical Imaging, Dutch Technology Foundation with participation of Pie Medical Imaging and Philips Healthcare (DLMedIA P15-26). The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2022 Zhai, van Velzen, Lessmann, Planken, Leiner and Išgum.)

Purpose: Ensembles of convolutional neural networks (CNNs) often outperform a single CNN in medical image segmentation tasks, but inference is computationally more expensive and makes ensembles unattractive for some applications. We compared the performance of differently constructed ensembles with the performance of CNNs derived from these ensembles using knowledge distillation, a technique for reducing the footprint of large models such as ensembles. Approach: We investigated two different types of ensembles, namely, diverse ensembles of networks with three different architectures and two different loss-functions, and uniform ensembles of networks with the same architecture but initialized with different random seeds. For each ensemble, additionally, a single student network was trained to mimic the class probabilities predicted by the teacher model, the ensemble. We evaluated the performance of each network, the ensembles, and the corresponding distilled networks across three different publicly available datasets. These included chest computed tomography scans with four annotated organs of interest, brain magnetic resonance imaging (MRI) with six annotated brain structures, and cardiac cine-MRI with three annotated heart structures. Results: Both uniform and diverse ensembles obtained better results than any of the individual networks in the ensemble. Furthermore, applying knowledge distillation resulted in a single network that was smaller and faster without compromising performance compared with the ensemble it learned from. The distilled networks significantly outperformed the same network trained with reference segmentation instead of knowledge distillation. Conclusion: Knowledge distillation can compress segmentation ensembles of uniform or diverse composition into a single CNN while maintaining the performance of the ensemble., (© 2022 The Authors.)

Background: A baseline computed tomography (CT) scan for lung cancer (LC) screening may reveal information indicating that certain LC screening participants can be screened less, and instead require dedicated early cardiac and respiratory clinical input. We aimed to develop and validate competing death (CD) risk models using CT information to identify participants with a low LC risk and a high CD risk., Methods: Participant demographics and quantitative CT measures of LC, cardiovascular disease and chronic obstructive pulmonary disease were considered for deriving a logistic regression model for predicting 5-year CD risk using a sample from the National Lung Screening Trial (n=15 000). Multicentric Italian Lung Detection data were used to perform external validation (n=2287)., Results: Our final CD model outperformed an external pre-scan model (CD Risk Assessment Tool) in both the derivation (area under the curve (AUC) 0.744 (95% CI 0.727-0.761) and 0.677 (95% CI 0.658-0.695), respectively) and validation cohorts (AUC 0.744 (95% CI 0.652-0.835) and 0.725 (95% CI 0.633-0.816), respectively). By also taking LC incidence risk into consideration, we suggested a risk threshold where a subgroup (6258/23 096 (27%)) was identified with a number needed to screen to detect one LC of 216 ( versus 23 in the remainder of the cohort) and ratio of 5.41 CDs per LC case ( versus 0.88). The respective values in the validation cohort subgroup (774/2287 (34%)) were 129 ( versus 29) and 1.67 ( versus 0.43)., Conclusions: Evaluating both LC and CD risks post-scan may improve the efficiency of LC screening and facilitate the initiation of multidisciplinary trajectories among certain participants., Competing Interests: Conflict of interest: A. Schreuder has nothing to disclose. Conflict of interest: C. Jacobs reports grants from MeVis Medical Solutions AG, Bremen, Germany, outside the submitted work. Conflict of interest: N. Lessmann has nothing to disclose. Conflict of interest: M.J.M. Broeders has nothing to disclose. Conflict of interest: M. Silva has nothing to disclose. Conflict of interest: I. Išgum has nothing to disclose. Conflict of interest: P.A. de Jong reports departmental research support from Philips Healthcare, during the conduct of the study. Conflict of interest: M.M. van den Heuvel has nothing to disclose. Conflict of interest: N. Sverzellati has nothing to disclose. Conflict of interest: M. Prokop reports personal fees for lectures from Bracco, Bayer, Toshiba and Siemens, grants from Toshiba, other (departmental spin-off with no personal financial interest) from Thiroux, outside the submitted work. Conflict of interest: U. Pastorino has nothing to disclose. Conflict of interest: C.M. Schaefer-Prokop has nothing to disclose. Conflict of interest: B. van Ginneken reports royalties from MeVis Medical Solutions and Delft Imaging Systems, and is co-founder and shareholder of Thirona, outside the submitted work., (Copyright ©The authors 2022. For reproduction rights and permissions contact permissions@ersnet.org.)

Competing Interests: Disclosures of Conflicts of Interest: M.H. Radiology: Artificial Intelligence trainee editorial board member. N.L. No relevant relationships.

Amidst the ongoing pandemic, the assessment of computed tomography (CT) images for COVID-19 presence can exceed the workload capacity of radiologists. Several studies addressed this issue by automating COVID-19 classification and grading from CT images with convolutional neural networks (CNNs). Many of these studies reported initial results of algorithms that were assembled from commonly used components. However, the choice of the components of these algorithms was often pragmatic rather than systematic and systems were not compared to each other across papers in a fair manner. We systematically investigated the effectiveness of using 3-D CNNs instead of 2-D CNNs for seven commonly used architectures, including DenseNet, Inception, and ResNet variants. For the architecture that performed best, we furthermore investigated the effect of initializing the network with pretrained weights, providing automatically computed lesion maps as additional network input, and predicting a continuous instead of a categorical output. A 3-D DenseNet-201 with these components achieved an area under the receiver operating characteristic curve of 0.930 on our test set of 105 CT scans and an AUC of 0.919 on a publicly available set of 742 CT scans, a substantial improvement in comparison with a previously published 2-D CNN. This article provides insights into the performance benefits of various components for COVID-19 classification and grading systems. We have created a challenge on grand-challenge.org to allow for a fair comparison between the results of this and future research.

Vertebral labelling and segmentation are two fundamental tasks in an automated spine processing pipeline. Reliable and accurate processing of spine images is expected to benefit clinical decision support systems for diagnosis, surgery planning, and population-based analysis of spine and bone health. However, designing automated algorithms for spine processing is challenging predominantly due to considerable variations in anatomy and acquisition protocols and due to a severe shortage of publicly available data. Addressing these limitations, the Large Scale Vertebrae Segmentation Challenge (VerSe) was organised in conjunction with the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) in 2019 and 2020, with a call for algorithms tackling the labelling and segmentation of vertebrae. Two datasets containing a total of 374 multi-detector CT scans from 355 patients were prepared and 4505 vertebrae have individually been annotated at voxel level by a human-machine hybrid algorithm (https://osf.io/nqjyw/, https://osf.io/t98fz/). A total of 25 algorithms were benchmarked on these datasets. In this work, we present the results of this evaluation and further investigate the performance variation at the vertebra level, scan level, and different fields of view. We also evaluate the generalisability of the approaches to an implicit domain shift in data by evaluating the top-performing algorithms of one challenge iteration on data from the other iteration. The principal takeaway from VerSe: the performance of an algorithm in labelling and segmenting a spine scan hinges on its ability to correctly identify vertebrae in cases of rare anatomical variations. The VerSe content and code can be accessed at: https://github.com/anjany/verse., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2021 Elsevier B.V. All rights reserved.)

Plasma osteoprotegerin (OPG) and vascular smooth muscle cell (VSMC) derived extracellular vesicles (EVs) are important regulators in the process of vascular calcification (VC). In population studies, high levels of OPG are associated with events. In animal studies, however, high OPG levels result in reduction of VC. VSMC-derived EVs are assumed to be responsible for OPG transport and VC but this role has not been studied. For this, we investigated the association between OPG in plasma and circulating EVs with coronary artery calcium (CAC) as surrogate for VC in symptomatic patients. We retrospectively assessed 742 patients undergoing myocardial perfusion imaging (MPI). CAC scores were determined on the MPI-CT images using a previously developed automated algorithm. Levels of OPG were quantified in plasma and two EV-subpopulations (LDL and TEX), using an electrochemiluminescence immunoassay. Circulating levels of OPG were independently associated with CAC scores in plasma; OR 1.39 (95% CI 1.17-1.65), and both EV populations; EV-LDL; OR 1.51 (95% CI 1.27-1.80) and EV-TEX; OR 1.21 (95% CI 1.02-1.42). High levels of OPG in plasma were independently associated with CAC scores in this symptomatic patient cohort. High levels of EV-derived OPG showed the same positive association with CAC scores, suggesting that EV-derived OPG mirrors the same pathophysiological process as plasma OPG., (© 2021. The Author(s).)

Objectives: Combined assessment of cardiovascular disease (CVD), COPD and lung cancer may improve the effectiveness of lung cancer screening in smokers. The aims were to derive and assess risk models for predicting lung cancer incidence, CVD mortality and COPD mortality by combining quantitative computed tomography (CT) measures from each disease, and to quantify the added predictive benefit of self-reported patient characteristics given the availability of a CT scan., Methods: A survey model (patient characteristics only), CT model (CT information only) and final model (all variables) were derived for each outcome using parsimonious Cox regression on a sample from the National Lung Screening Trial (n=15 000). Validation was performed using Multicentric Italian Lung Detection data (n=2287). Time-dependent measures of model discrimination and calibration are reported., Results: Age, mean lung density, emphysema score, bronchial wall thickness and aorta calcium volume are variables that contributed to all final models. Nodule features were crucial for lung cancer incidence predictions but did not contribute to CVD and COPD mortality prediction. In the derivation cohort, the lung cancer incidence CT model had a 5-year area under the receiver operating characteristic curve of 82.5% (95% CI 80.9-84.0%), significantly inferior to that of the final model (84.0%, 82.6-85.5%). However, the addition of patient characteristics did not improve the lung cancer incidence model performance in the validation cohort (CT model 80.1%, 74.2-86.0%; final model 79.9%, 73.9-85.8%). Similarly, the final CVD mortality model outperformed the other two models in the derivation cohort (survey model 74.9%, 72.7-77.1%; CT model 76.3%, 74.1-78.5%; final model 79.1%, 77.0-81.2%), but not the validation cohort (survey model 74.8%, 62.2-87.5%; CT model 72.1%, 61.1-83.2%; final model 72.2%, 60.4-84.0%). Combining patient characteristics and CT measures provided the largest increase in accuracy for the COPD mortality final model (92.3%, 90.1-94.5%) compared to either other model individually (survey model 87.5%, 84.3-90.6%; CT model 87.9%, 84.8-91.0%), but no external validation was performed due to a very low event frequency., Conclusions: CT measures of CVD and COPD provides small but reproducible improvements to nodule-based lung cancer risk prediction accuracy from 3 years onwards. Self-reported patient characteristics may not be of added predictive value when CT information is available., Competing Interests: Conflict of interest: A. Schreuder has nothing to disclose. Conflict of interest: C. Jacobs reports grants from MeVis Medical Solutions AG, Bremen, Germany, outside the submitted work. Conflict of interest: N. Lessmann has nothing to disclose. Conflict of interest: M.J.M. Broeders has nothing to disclose. Conflict of interest: M. Silva has nothing to disclose. Conflict of interest: I. Išgum has nothing to disclose. Conflict of interest: P.A. de Jong reports other (research support to institution) from Philips Healthcare, during the conduct of the study. Conflict of interest: N. Sverzellati has nothing to disclose. Conflict of interest: M. Prokop reports personal fees for lectures from Bracco, Bayer, Toshiba and Siemens, grants from Toshiba, other (department spin-off) from Thiroux, outside the submitted work. Conflict of interest: U. Pastorino has nothing to disclose. Conflict of interest: C.M. Schaefer-Prokop has nothing to disclose. Conflict of interest: B. van Ginneken reports other (co-founder/shareholder) from Thirona, grants/royalties from Mevis Medical Solutions and Delft Imaging Systems, outside the submitted work., (Copyright ©The authors 2021. For reproduction rights and permissions contact permissions@ersnet.org.)

Deep-learning-based registration methods emerged as a fast alternative to conventional registration methods. However, these methods often still cannot achieve the same performance as conventional registration methods because they are either limited to small deformation or they fail to handle a superposition of large and small deformations without producing implausible deformation fields with foldings inside. In this paper, we identify important strategies of conventional registration methods for lung registration and successfully developed the deep-learning counterpart. We employ a Gaussian-pyramid-based multilevel framework that can solve the image registration optimization in a coarse-to-fine fashion. Furthermore, we prevent foldings of the deformation field and restrict the determinant of the Jacobian to physiologically meaningful values by combining a volume change penalty with a curvature regularizer in the loss function. Keypoint correspondences are integrated to focus on the alignment of smaller structures. We perform an extensive evaluation to assess the accuracy, the robustness, the plausibility of the estimated deformation fields, and the transferability of our registration approach. We show that it achieves state-of-the-art results on the COPDGene dataset compared to conventional registration method with much shorter execution time. In our experiments on the DIRLab exhale to inhale lung registration, we demonstrate substantial improvements (TRE below 1.2 mm) over other deep learning methods. Our algorithm is publicly available at https://grand-challenge.org/algorithms/deep-learning-based-ct-lung-registration/., Competing Interests: Declaration of Competing Interest There’s no financial/personal interest or belief that could affect the objectivity of the submitted research results. No conflict of interests exist., (Copyright © 2021 The Author(s). Published by Elsevier B.V. All rights reserved.)

Importance: Cardiovascular disease (CVD) is common in patients treated for breast cancer, especially in patients treated with systemic treatment and radiotherapy and in those with preexisting CVD risk factors. Coronary artery calcium (CAC), a strong independent CVD risk factor, can be automatically quantified on radiotherapy planning computed tomography (CT) scans and may help identify patients at increased CVD risk., Objective: To evaluate the association of CAC with CVD and coronary artery disease (CAD) in patients with breast cancer., Design, Setting, and Participants: In this multicenter cohort study of 15 915 patients with breast cancer receiving radiotherapy between 2005 and 2016 who were followed until December 31, 2018, age, calendar year, and treatment-adjusted Cox proportional hazard models were used to evaluate the association of CAC with CVD and CAD., Exposures: Overall CAC scores were automatically extracted from planning CT scans using a deep learning algorithm. Patients were classified into Agatston risk categories (0, 1-10, 11-100, 101-399, >400 units)., Main Outcomes and Measures: Occurrence of fatal and nonfatal CVD and CAD were obtained from national registries., Results: Of the 15 915 participants included in this study, the mean (SD) age at CT scan was 59.0 (11.2; range, 22-95) years, and 15 879 (99.8%) were women. Seventy percent (n = 11 179) had no CAC. Coronary artery calcium scores of 1 to 10, 11 to 100, 101 to 400, and greater than 400 were present in 10.0% (n = 1584), 11.5% (n = 1825), 5.2% (n = 830), and 3.1% (n = 497) respectively. After a median follow-up of 51.2 months, CVD risks increased from 5.2% in patients with no CAC to 28.2% in patients with CAC scores higher than 400. After adjustment, CVD risk increased with higher CAC score (hazard ratio [HR]CAC = 1-10 = 1.1; 95% CI, 0.9-1.4; HRCAC = 11-100 = 1.8; 95% CI, 1.5-2.1; HRCAC = 101-400 = 2.1; 95% CI, 1.7-2.6; and HRCAC>400 = 3.4; 95% CI, 2.8-4.2). Coronary artery calcium was particularly strongly associated with CAD (HRCAC>400 = 7.8; 95% CI, 5.5-11.2). The association between CAC and CVD was strongest in patients treated with anthracyclines (HRCAC>400 = 5.8; 95% CI, 3.0-11.4) and patients who received a radiation boost (HRCAC>400 = 6.1; 95% CI, 3.8-9.7)., Conclusions and Relevance: This cohort study found that coronary artery calcium on breast cancer radiotherapy planning CT scan results was associated with CVD, especially CAD. Automated CAC scoring on radiotherapy planning CT scans may be used as a fast and low-cost tool to identify patients with breast cancer at increased risk of CVD, allowing implementing CVD risk-mitigating strategies with the aim to reduce the risk of CVD burden after breast cancer., Trial Registration: ClinicalTrials.gov Identifier: NCT03206333.

Purpose: To examine the prognostic value of location-specific arterial calcification quantities at lung screening low-dose CT for the prediction of cardiovascular disease (CVD) mortality., Materials and Methods: This retrospective study included 5564 participants who underwent low-dose CT from the National Lung Screening Trial between August 2002 and April 2004, who were followed until December 2009. A deep learning network was trained to quantify six types of vascular calcification: thoracic aorta calcification (TAC); aortic and mitral valve calcification; and coronary artery calcification (CAC) of the left main, the left anterior descending, and the right coronary artery. TAC and CAC were determined in six evenly distributed slabs spatially aligned among chest CT images. CVD mortality prediction was performed with multivariable logistic regression using least absolute shrinkage and selection operator. The methods were compared with semiautomatic baseline prediction using self-reported participant characteristics, such as age, history of smoking, and history of illness. Statistical significance between the prediction models was tested using the nonparametric DeLong test., Results: The prediction model was trained with data from 4451 participants (median age, 61 years; 37.9% women) and then tested on data from 1113 participants (median age, 61 years; 37.9% women). The prediction model using calcium scores achieved a C statistic of 0.74 (95% CI: 0.69, 0.79), and it outperformed the baseline model using only participant characteristics (C statistic, 0.69; P = .049). Best results were obtained when combining all variables (C statistic, 0.76; P < .001)., Conclusion: Five-year CVD mortality prediction using automatically extracted image-based features is feasible at lung screening low-dose CT.© RSNA, 2021., Competing Interests: Disclosures of Conflicts of Interest: B.D.d.V. Activities related to the present article: disclosed no relevant relationships. Activities not related to the present article: author is co-founder of Quantib-U and is currently an advisor and shareholder, current work was largely performed before author’s employment there. Other relationships: disclosed no relevant relationships. N.L. disclosed no relevant relationships. P.A.d.J. disclosed no relevant relationships. I.I. Activities related to the present article: author’s institution has research grant from Dutch Technology Foundation (No. 12726). Activities not related to the present article: author’s institution has research grant from Dutch Technology Foundation with participation of Philips Healthcare and Pie Medical Imaging, research grants from Pie Medical Imaging, research grant from The Netherlands Organisation for Health Research and Development with participation of Pie Medical Imaging; author received money for patent issued by Pie Medical Imaging. Other relationships: disclosed no relevant relationships., (2021 by the Radiological Society of North America, Inc.)

Purpose: Vitamin K-dependent proteins are involved in (patho)physiological calcification of the vasculature and the bones. Type 2 diabetes mellitus (DM2) is associated with increased arterial calcification and increased fractures. This study investigates the effect of 6 months vitamin K2 supplementation on systemic arterial calcification and bone mineral density (BMD) in DM2 patients with a history of cardiovascular disease (CVD)., Methods: In this pre-specified, post hoc analysis of a double-blind, randomized, controlled clinical trial, patients with DM2 and CVD were randomized to a daily, oral dose of 360 µg vitamin K2 or placebo for 6 months. CT scans were made at baseline and follow-up. Arterial calcification mass was quantified in several large arterial beds and a total arterial calcification mass score was calculated. BMD was assessed in all non-fractured thoracic and lumbar vertebrae., Results: 68 participants were randomized, 35 to vitamin K2 (33 completed follow-up) and 33 to placebo (27 completed follow-up). The vitamin K group had higher arterial calcification mass at baseline [median (IQR): 1694 (812-3584) vs 1182 (235-2445)] for the total arterial calcification mass). Six months vitamin K supplementation did not reduce arterial calcification progression (β [95% CI]: - 0.02 [- 0.10; 0.06] for the total arterial calcification mass) or slow BMD decline (β [95% CI]: - 2.06 [- 11.26; 7.30] Hounsfield units for all vertebrae) when compared to placebo., Conclusion: Six months vitamin K supplementation did not halt progression of arterial calcification or decline of BMD in patients with DM2 and CVD. Future clinical trials may want to pre-select patients with very low vitamin K status and longer follow-up time might be warranted. This trial was registered at clinicaltrials.gov as NCT02839044.

Background The coronavirus disease 2019 (COVID-19) pandemic has spread across the globe with alarming speed, morbidity, and mortality. Immediate triage of patients with chest infections suspected to be caused by COVID-19 using chest CT may be of assistance when results from definitive viral testing are delayed. Purpose To develop and validate an artificial intelligence (AI) system to score the likelihood and extent of pulmonary COVID-19 on chest CT scans using the COVID-19 Reporting and Data System (CO-RADS) and CT severity scoring systems. Materials and Methods The CO-RADS AI system consists of three deep-learning algorithms that automatically segment the five pulmonary lobes, assign a CO-RADS score for the suspicion of COVID-19, and assign a CT severity score for the degree of parenchymal involvement per lobe. This study retrospectively included patients who underwent a nonenhanced chest CT examination because of clinical suspicion of COVID-19 at two medical centers. The system was trained, validated, and tested with data from one of the centers. Data from the second center served as an external test set. Diagnostic performance and agreement with scores assigned by eight independent observers were measured using receiver operating characteristic analysis, linearly weighted κ values, and classification accuracy. Results A total of 105 patients (mean age, 62 years ± 16 [standard deviation]; 61 men) and 262 patients (mean age, 64 years ± 16; 154 men) were evaluated in the internal and external test sets, respectively. The system discriminated between patients with COVID-19 and those without COVID-19, with areas under the receiver operating characteristic curve of 0.95 (95% CI: 0.91, 0.98) and 0.88 (95% CI: 0.84, 0.93), for the internal and external test sets, respectively. Agreement with the eight human observers was moderate to substantial, with mean linearly weighted κ values of 0.60 ± 0.01 for CO-RADS scores and 0.54 ± 0.01 for CT severity scores. Conclusion With high diagnostic performance, the CO-RADS AI system correctly identified patients with COVID-19 using chest CT scans and assigned standardized CO-RADS and CT severity scores that demonstrated good agreement with findings from eight independent observers and generalized well to external data. © RSNA, 2020 Supplemental material is available for this article.

Purpose: The purpose of this study was to elucidate the impact of being unmarried on coronary computed tomography (CT) imaging biomarkers and mortality in a lung cancer screening population., Materials and Methods: In this retrospective case-control study, 5707 subjects (3777 married; mean age: 61.9±5.1 y and 1930 unmarried; mean age: 61.9±5.3 y) underwent low-dose CT as part of the National Lung Screening Trial (NLST). The median follow-up time was 6.5 (Q1-Q3: 5.6 to 6.9) years. Being unmarried was defined as never married, widowed, separated, or divorced. Being married was defined as married or living as married. Our primary endpoint was cardiovascular disease (CVD)-related death; our secondary endpoint was all-cause mortality. Coronary CT imaging biomarkers (calcium score, density, and volume) on low-dose chest CT scan were calculated using dedicated automatic software. Weighted Cox proportional-hazards regression was performed to examine the association between marital status and death. Kaplan-Meier curves were generated to visualize subject survival., Results: Being unmarried was significantly associated with an increased risk for CVD-related death (hazard ratio [HR]: 1.58; 95% confidence interval [CI]: 1.31-1.91) and all-cause mortality (HR: 1.39; 95% CI: 1.26-1.53), which remained significant even after adjusting for traditional cardiovascular risk factors (HR CVD death: 1.75; 1.44-2.12 and HR all-cause mortality: 1.58; 95% CI: 1.43-1.74) and coronary calcium score (HR CVD death: 1.58; 95% CI: 1.31-1.91 and HR all-cause mortality: 1.40; 95% CI: 1.27-1.54)., Conclusions: Being unmarried is associated with an increased CVD-related death and all-cause mortality mainly due to cardiovascular etiology. On the basis of this, marital status might be taken into consideration when assessing individuals' health status.

Background Although several deep learning (DL) calcium scoring methods have achieved excellent performance for specific CT protocols, their performance in a range of CT examination types is unknown. Purpose To evaluate the performance of a DL method for automatic calcium scoring across a wide range of CT examination types and to investigate whether the method can adapt to different types of CT examinations when representative images are added to the existing training data set. Materials and Methods The study included 7240 participants who underwent various types of nonenhanced CT examinations that included the heart: coronary artery calcium (CAC) scoring CT, diagnostic CT of the chest, PET attenuation correction CT, radiation therapy treatment planning CT, CAC screening CT, and low-dose CT of the chest. CAC and thoracic aorta calcification (TAC) were quantified using a convolutional neural network trained with (a) 1181 low-dose chest CT examinations (baseline), (b) a small set of examinations of the respective type supplemented to the baseline (data specific), and (c) a combination of examinations of all available types (combined). Supplemental training sets contained 199-568 CT images depending on the calcium burden of each population. The DL algorithm performance was evaluated with intraclass correlation coefficients (ICCs) between DL and manual (Agatston) CAC and (volume) TAC scoring and with linearly weighted κ values for cardiovascular risk categories (Agatston score; cardiovascular disease risk categories: 0, 1-10, 11-100, 101-400, >400). Results At baseline, the DL algorithm yielded ICCs of 0.79-0.97 for CAC and 0.66-0.98 for TAC across the range of different types of CT examinations. ICCs improved to 0.84-0.99 (CAC) and 0.92-0.99 (TAC) for CT protocol-specific training and to 0.85-0.99 (CAC) and 0.96-0.99 (TAC) for combined training. For assignment of cardiovascular disease risk category, the κ value for all test CT scans was 0.90 (95% confidence interval [CI]: 0.89, 0.91) for the baseline training. It increased to 0.92 (95% CI: 0.91, 0.93) for both data-specific and combined training. Conclusion A deep learning calcium scoring algorithm for quantification of coronary and thoracic calcium was robust, despite substantial differences in CT protocol and variations in subject population. Augmenting the algorithm training with CT protocol-specific images further improved algorithm performance. © RSNA, 2020 See also the editorial by Vannier in this issue.

Aims: The aim is to investigate (multifocal) cardiovascular calcification in patients with established cardiovascular disease (CVD), regarding prevalence, risk factors, and relation with recurrent CVD or vascular interventions. Coronary artery calcification (CAC), thoracic aortic calcification (TAC) (including ascending aorta, aortic arch, descending aorta), mitral annular calcification (MAC), and aortic valve calcification (AVC) are studied., Methods: The study concerned 568 patients with established CVD enrolled in the ORACLE cohort. All patients underwent computed tomography. Prevalence of site-specific and multifocal calcification was determined. Ordinal regression analyses were performed to quantify associations of risk factors with cardiovascular calcification, and Cox regression analyses to determine the relation between calcium scores and recurrent CVD or vascular interventions., Results: Calcification was multifocal in 76% (N = 380) of patients with calcification. Age (per SD) was associated with calcification at all locations (lowest OR 2.17; 99%CI 1.54-3.11 for ascending aorta calcification). Diabetes mellitus and systolic blood pressure were associated with TAC, whereas male sex was a determinant of CAC. TAC and CAC were related to the combined endpoint CVD or vascular intervention (N = 68). In a model with all calcium scores combined, only CAC was related to the combined outcome (HR 1.39; 95%CI 1.15-1.68)., Conclusion: Cardiovascular calcification is generally multifocal in patients with established CVD. Differences in associations between risk factors and calcification at various anatomical locations stress the divergence in pathophysiological pathways. CAC is most strongly related to recurrent CVD or vascular interventions independent of traditional risk factors, and independent of heart valve and thoracic aorta calcification., (© 2020 The Authors.)

Background: Myocardial perfusion imaging (MPI) is an accurate noninvasive test for patients with suspected obstructive coronary artery disease (CAD) and coronary artery calcium (CAC) score is known to be a powerful predictor of cardiovascular events. Collection of CAC scores simultaneously with MPI is unexplored., Aim: We aimed to investigate whether automatically derived CAC scores during myocardial perfusion imaging would further improve the diagnostic accuracy of MPI to detect obstructive CAD., Methods: We analyzed 150 consecutive patients without a history of coronary revascularization with suspected obstructive CAD who were referred for 82Rb PET/CT and available coronary angiographic data. Myocardial perfusion was evaluated both semi quantitatively as well as quantitatively according to the European guidelines. CAC scores were automatically derived from the low-dose attenuation correction CT scans using previously developed software based on deep learning. Obstructive CAD was defined as stenosis >70% (or >50% in the left main coronary artery) and/or fractional flow reserve (FFR) ≤0.80., Results: In total 58% of patients had obstructive CAD of which seventy-four percent were male. Addition of CAC scores to MPI and clinical predictors significantly improved the diagnostic accuracy of MPI to detect obstructive CAD. The area under the curve (AUC) increased from 0.87 to 0.91 (p: 0.025). Sensitivity and specificity analysis showed an incremental decrease in false negative tests with our MPI + CAC approach (n = 14 to n = 4), as a consequence an increase in false positive tests was seen (n = 11 to n = 28)., Conclusion: CAC scores collected simultaneously with MPI improve the detection of obstructive coronary artery disease in patients without a history of coronary revascularization., (© 2019 Published by Elsevier B.V.)

Objectives: The aim of this study was to investigate sex differences in the prevalence, extent, and association of coronary artery calcium (CAC) and thoracic aorta calcium (TAC) scores with cardiovascular mortality in a population eligible for lung screening., Background: CAC and TAC scores derived from chest computed tomography (CT) might be useful biomarkers for individualized cardiovascular disease prevention and could be especially relevant in high-risk populations such as heavy smokers. Therefore, it is important to know the prevalence of arterial calcifications in male and female heavy smokers, and if there are differences in the predictive value calcifications carry., Methods: We performed a nested case-control study with 5,718 participants of the CT arm of the NLST (National Lung Screening Trial). Prevalence and extent of CAC and TAC were resampled to the full cohort to provide unbiased estimates of the typical calcium burden of male and female heavy smokers. Weighted Cox proportional hazards regression was used to assess differences in the association of CAC and TAC scores with all-cause and cardiovascular mortality., Results: CAC was substantially more common and more severe in men (prevalence: 81% vs. 60%; median volume: 104 mm³ vs. 12 mm³). Women had CAC comparable to that of men who were 10 years younger. TAC was equally common in men and women, with a tendency to be more pronounced in women (prevalence: 92% vs. 93%; median volume: 388 mm³ vs. 404 mm³). Both types of calcification were associated with increased cardiovascular and all-cause mortality. TAC scores improved the prediction of coronary heart disease mortality over CAC in men, but not in women. In both sexes, TAC, but not CAC, was associated with cardiovascular mortality other than coronary heart disease., Conclusions: CAC develops later in women, whereas TAC develops equally in both sexes. CAC is strongly associated with coronary heart disease, whereas TAC is especially associated with extracardiac vascular mortality in either sex., (Copyright © 2019 American College of Cardiology Foundation. Published by Elsevier Inc. All rights reserved.)

Cardiovascular disease (CVD) is the global leading cause of death. A strong risk factor for CVD events is the amount of coronary artery calcium (CAC). To meet the demands of the increasing interest in quantification of CAC, i.e., coronary calcium scoring, especially as an unrequested finding for screening and research, automatic methods have been proposed. The current automatic calcium scoring methods are relatively computationally expensive and only provide scores for one type of CT. To address this, we propose a computationally efficient method that employs two convolutional neural networks: the first performs registration to align the fields of view of input CTs and the second performs direct regression of the calcium score, thereby circumventing time-consuming intermediate CAC segmentation. Optional decision feedback provides insight into the regions that are contributed to the calcium score. Experiments were performed using 903 cardiac CT and 1687 chest CT scans. The method predicted calcium scores in less than 0.3 s. The intra-class correlation coefficient between predicted and manual calcium scores was 0.98 for both cardiac and chest CT. The method showed almost perfect agreement between automatic and manual CVD risk categorization in both the datasets, with a linearly weighted Cohen's kappa of 0.95 in cardiac CT and 0.93 in chest CT. Performance is similar to that of the state-of-the-art methods, but the proposed method is hundreds of times faster. By providing visual feedback, insight is given in the decision process, making it readily implementable in clinical and research settings.

Introduction: Cardiovascular disease (CVD) is an important cause of death in breast cancer survivors. Some breast cancer treatments including anthracyclines, trastuzumab and radiotherapy can increase the risk of CVD, especially for patients with pre-existing CVD risk factors. Early identification of patients at increased CVD risk may allow switching to less cardiotoxic treatments, active surveillance or treatment of CVD risk factors. One of the strongest independent CVD risk factors is the presence and extent of coronary artery calcifications (CAC). In clinical practice, CAC are generally quantified on ECG-triggered cardiac CT scans. Patients with breast cancer treated with radiotherapy routinely undergo radiotherapy planning CT scans of the chest, and those scans could provide the opportunity to routinely assess CAC before a potentially cardiotoxic treatment. The Bragatston study aims to investigate the association between calcifications in the coronary arteries, aorta and heart valves (hereinafter called 'cardiovascular calcifications') measured automatically on planning CT scans of patients with breast cancer and CVD risk., Methods and Analysis: In a first step, we will optimise and validate a deep learning algorithm for automated quantification of cardiovascular calcifications on planning CT scans of patients with breast cancer. Then, in a multicentre cohort study (University Medical Center Utrecht, Utrecht, Erasmus MC Cancer Institute, Rotterdam and Radboudumc, Nijmegen, The Netherlands), the association between cardiovascular calcifications measured on planning CT scans of patients with breast cancer (n≈16 000) and incident (non-)fatal CVD events will be evaluated. To assess the added predictive value of these calcifications over traditional CVD risk factors and treatment characteristics, a case-cohort analysis will be performed among all cohort members diagnosed with a CVD event during follow-up (n≈200) and a random sample of the baseline cohort (n≈600)., Ethics and Dissemination: The Institutional Review Boards of the participating hospitals decided that the Medical Research Involving Human Subjects Act does not apply. Findings will be published in peer-reviewed journals and presented at conferences., Trial Registration Number: NCT03206333., Competing Interests: Competing interests: II: disclosures not related to the present article: II received research grants from 1) PIE Medical Imaging BV; 2) the Netherlands Organization for Health Research and Development (ZonMw) with participation of PIE Medical Imaging BV; 3) the Dutch Technology Foundation (STW) within Deep Learning for Medical Image Analysis (DLMedIA) with participation of PIE Medical Imaging BV and Philips Healthcare; 4) Dutch Technology Foundation (STW) with participation of PIE Medical Imaging BV and 3mensio Medical Imaging. In addition, II has a patent, US Patent Application Number 15/933854, with royalties paid and she is scientific founder and a shareholder of Quantib-U BV. JP: disclosures not related to the present article: JP received grants from 1) Accuray, Sunnyvale, California, USA; 2) Elekta AB,Stockholm, Sweden., (© Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.)

Precise segmentation and anatomical identification of the vertebrae provides the basis for automatic analysis of the spine, such as detection of vertebral compression fractures or other abnormalities. Most dedicated spine CT and MR scans as well as scans of the chest, abdomen or neck cover only part of the spine. Segmentation and identification should therefore not rely on the visibility of certain vertebrae or a certain number of vertebrae. We propose an iterative instance segmentation approach that uses a fully convolutional neural network to segment and label vertebrae one after the other, independently of the number of visible vertebrae. This instance-by-instance segmentation is enabled by combining the network with a memory component that retains information about already segmented vertebrae. The network iteratively analyzes image patches, using information from both image and memory to search for the next vertebra. To efficiently traverse the image, we include the prior knowledge that the vertebrae are always located next to each other, which is used to follow the vertebral column. The network concurrently performs multiple tasks, which are segmentation of a vertebra, regression of its anatomical label and prediction whether the vertebra is completely visible in the image, which allows to exclude incompletely visible vertebrae from further analyses. The predicted anatomical labels of the individual vertebrae are additionally refined with a maximum likelihood approach, choosing the overall most likely labeling if all detected vertebrae are taken into account. This method was evaluated with five diverse datasets, including multiple modalities (CT and MR), various fields of view and coverages of different sections of the spine, and a particularly challenging set of low-dose chest CT scans. For vertebra segmentation, the average Dice score was 94.9 ± 2.1% with an average absolute symmetric surface distance of 0.2 ± 10.1mm. The anatomical identification had an accuracy of 93%, corresponding to a single case with mislabeled vertebrae. Vertebrae were classified as completely or incompletely visible with an accuracy of 97%. The proposed iterative segmentation method compares favorably with state-of-the-art methods and is fast, flexible and generalizable., (Copyright © 2019 Elsevier B.V. All rights reserved.)

Introduction: The amount of coronary artery calcium determined in CT scans is a well established predictor of cardiovascular events. However, high interscan variability of coronary calcium quantification may lead to incorrect cardiovascular risk assignment. Partial volume effect contributes to high interscan variability. Hence, we propose a method for coronary calcium quantification employing partial volume correction., Methods: Two phantoms containing artificial coronary artery calcifications and 293 subject chest CT scans were used. The first and second phantom contained nine calcifications and the second phantom contained three artificial arteries with three calcifications of different volumes, shapes and densities. The first phantom was scanned five times with and without extension rings. The second phantom was scanned three times without and with simulated cardiac motion (10 and 30 mm/s). Chest CT scans were acquired without ECG-synchronization and reconstructed using sharp and soft kernels. Coronary calcifications were annotated employing the clinically used intensity value thresholding (130 HU). Thereafter, a threshold separating each calcification from its background was determined using an Expectation-Maximization algorithm. Finally, for each lesion the partial content of calcification in each voxel was determined depending on its intensity and the determined threshold., Results: Clinical calcium scoring resulted in overestimation of calcium volume for medium and high density calcifications in the first phantom, and overestimation of calcium volume for high density and underestimation for low density calcifications in the second phantom. With induced motion these effects were further emphasized. The proposed quantification resulted in better accuracy and substantially lower over- and underestimation of calcium volume even in presence of motion. In chest CT, the agreement between calcium scores from the two reconstructions improved when proposed method was used., Conclusion: Compared with clinical calcium scoring, proposed quantification provides a better estimate of the true calcium volume in phantoms and better agreement in calcium scores between different subject scan reconstructions., Competing Interests: We have the following disclosures. I. Išgum, T. Leiner and M. A. Viergever have received an institutional research grant from PIE Medical Imaging B.V., research grant by the Netherlands Organization for Health Research and Development (ZonMw) with participation of PIE Medical Imaging B.V., research grant by Dutch Technology Foundation (TTW Perspectief) in the framework of the Deep learning in Medical Image Analysis program (DLMedIA), with participation of Philips Healthcare and Pie Medical Imaging B.V.; and research grant by Dutch Technology Foundation (TTW Perspectief) in the framework of the Population Imaging Genetics (ImaGene) program within Project 12726 awarded with participation of Pie Medical Imaging B.V. and 3mensio Medical Imaging that funded this research. The Department of Radiology of the University Medical Center Utrecht receives research support from Philips Healthcare. T. Leiner is a recipient of a ZonMW Clinical Fellowship. This does not alter our adherence to PLOS ONE policies on sharing data and materials.

The amount of coronary artery calcification (CAC) quantified in computed tomography (CT) scans enables prediction of cardiovascular disease (CVD) risk. However, interscan variability of CAC quantification is high, especially in scans made without ECG synchronization. We propose a method for automatic detection of CACs that are severely affected by cardiac motion. Subsequently, we evaluate the impact of such CACs on CAC quantification and CVD risk determination. This study includes 1000 baseline and 585 one-year follow-up low-dose chest CTs from the National Lung Screening Trial. About 415 baseline scans are used to train and evaluate a convolutional neural network that identifies observer determined CACs affected by severe motion artifacts. Therefore, 585 paired scans acquired at baseline and follow-up were used to evaluate the impact of severe motion artifacts on CAC quantification and risk categorization. Based on the CAC amount, the scans were categorized into four standard CVD risk categories. The method identified CACs affected by severe motion artifacts with 85.2% accuracy. Moreover, reproducibility of CAC scores in scan pairs is higher in scans containing mostly CACs not affected by severe cardiac motion. Hence, the proposed method enables identification of scans affected by severe cardiac motion, where CAC quantification may not be reproducible.

Purpose: This study automatically quantified calcifications in coronary arteries (CAC) and thoracic aorta (TAC) on breast planning computed tomography (CT) scans and assessed its reproducibility compared to manual scoring., Material and Methods: Dutch (n = 1199) and Singaporean (n = 1090) breast cancer patients with radiotherapy planning CT scan were included. CAC and TAC were automatically scored using deep learning algorithm. CVD risk categories were based on Agatson CAC: 0, 1-10, 11-100, 101-400 and >400. Reliability between automatic and manual scoring was assessed in 120 randomly selected CT scans from each population, with linearly weighted kappa for CAC categories and intraclass correlation coefficient for TAC., Results: Median age was higher in Dutch patients than Singaporean patients: 57 versus 52 years. CAC and TAC increased with age and were more present in Dutch patients than Singaporean patients: 24.2% versus 17.3% and 73.0% versus 62.2%, respectively. Reliability of CAC categories and TAC was excellent in the Netherlands (0.85 (95% confidence interval (CI) = 0.77-0.93) and 0.98 (95% CI = 0.96-0.98) respectively) and Singapore (0.90 (95% CI = 0.84-0.96) and 0.99 (95% CI = 0.98-0.99) respectively)., Conclusions: CAC and TAC prevalence was considerable and increased with age. Deep learning software is a reliable method to automatically measure CAC and TAC on radiotherapy breast CT scans., (Copyright © 2018 Elsevier B.V. All rights reserved.)

Heavy smokers undergoing screening with low-dose chest CT are affected by cardiovascular disease as much as by lung cancer. Low-dose chest CT scans acquired in screening enable quantification of atherosclerotic calcifications and thus enable identification of subjects at increased cardiovascular risk. This paper presents a method for automatic detection of coronary artery, thoracic aorta, and cardiac valve calcifications in low-dose chest CT using two consecutive convolutional neural networks. The first network identifies and labels potential calcifications according to their anatomical location and the second network identifies true calcifications among the detected candidates. This method was trained and evaluated on a set of 1744 CT scans from the National Lung Screening Trial. To determine whether any reconstruction or only images reconstructed with soft tissue filters can be used for calcification detection, we evaluated the method on soft and medium/sharp filter reconstructions separately. On soft filter reconstructions, the method achieved F 1 scores of 0.89, 0.89, 0.67, and 0.55 for coronary artery, thoracic aorta, aortic valve, and mitral valve calcifications, respectively. On sharp filter reconstructions, the F 1 scores were 0.84, 0.81, 0.64, and 0.66, respectively. Linearly weighted kappa coefficients for risk category assignment based on per subject coronary artery calcium were 0.91 and 0.90 for soft and sharp filter reconstructions, respectively. These results demonstrate that the presented method enables reliable automatic cardiovascular risk assessment in all low-dose chest CT scans acquired for lung cancer screening.

In patients with coronary artery stenoses of intermediate severity, the functional significance needs to be determined. Fractional flow reserve (FFR) measurement, performed during invasive coronary angiography (ICA), is most often used in clinical practice. To reduce the number of ICA procedures, we present a method for automatic identification of patients with functionally significant coronary artery stenoses, employing deep learning analysis of the left ventricle (LV) myocardium in rest coronary CT angiography (CCTA). The study includes consecutively acquired CCTA scans of 166 patients who underwent invasive FFR measurements. To identify patients with a functionally significant coronary artery stenosis, analysis is performed in several stages. First, the LV myocardium is segmented using a multiscale convolutional neural network (CNN). To characterize the segmented LV myocardium, it is subsequently encoded using unsupervised convolutional autoencoder (CAE). As ischemic changes are expected to appear locally, the LV myocardium is divided into a number of spatially connected clusters, and statistics of the encodings are computed as features. Thereafter, patients are classified according to the presence of functionally significant stenosis using an SVM classifier based on the extracted features. Quantitative evaluation of LV myocardium segmentation in 20 images resulted in an average Dice coefficient of 0.91 and an average mean absolute distance between the segmented and reference LV boundaries of 0.7 mm. Twenty CCTA images were used to train the LV myocardium encoder. Classification of patients was evaluated in the remaining 126 CCTA scans in 50 10-fold cross-validation experiments and resulted in an area under the receiver operating characteristic curve of 0.74 ± 0.02. At sensitivity levels 0.60, 0.70 and 0.80, the corresponding specificity was 0.77, 0.71 and 0.59, respectively. The results demonstrate that automatic analysis of the LV myocardium in a single CCTA scan acquired at rest, without assessment of the anatomy of the coronary arteries, can be used to identify patients with functionally significant coronary artery stenosis. This might reduce the number of patients undergoing unnecessary invasive FFR measurements., (Copyright © 2017 Elsevier B.V. All rights reserved.)

We evaluated the prevalence of significant lung abnormalities on computed tomography (CT) in patients who died from a respiratory illness other than lung cancer in the National Lung Screening Trial (NLST).In this retrospective case-control study, NLST participants in the CT arm who died of respiratory illness other than lung cancer were matched for age, sex, pack-years and smoking status to a surviving control. A chest radiologist and a radiology resident blinded to the outcome independently scored baseline CT scans visually and qualitatively for the presence of emphysema, airway wall thickening and fibrotic lung disease. The prevalence of CT abnormalities was compared between cases and controls by using chi-squared tests.In total, 167 participants died from a respiratory cause other than lung cancer. The prevalence of severe emphysema, airway wall thickening and fibrotic lung disease were 28.7% versus 4.8%, 26.9% versus 13.2% and 18.6% versus 0.5% in cases and controls, respectively. Radiological findings were significantly more prevalent in deaths compared with controls (all p<0.001).CT-diagnosed severe emphysema, airway wall thickening and fibrosis were much more common in NLST participants who died from respiratory disease, and CT may provide an additional means of identifying these diseases., Competing Interests: Conflict of interest: Disclosures can be found alongside this article at erj.ersjournals.com, (Copyright ©ERS 2017.)

Purpose: Precise localization in bronchoscopy is challenging, particularly for peripheral lesions that cannot be reached by conventional bronchoscopes with a large working channel. Existing navigation methods are hampered by respiratory motion, e.g., in the lower lobes. We present an image-guided approach that considers respiratory motion and can localize instruments., Methods: We developed a rigid chest marker containing steel balls visible in X-ray images and a pattern for passive tracking with an optical camera system. An experimental setup to evaluate stereoscopic localization and to mimic chest motion was established in our interventional suite. The marker motion was recorded, and X-ray images were acquired from different angles using a standard C-arm. All coordinates were expressed with respect to the stationary tracking camera. The feasibility of motion-compensated stereoscopic localization was assessed., Results: The orientation of the C-arm could be established with a mean error of less than 1°. Triangulation based on two different X-ray images from different angles resulted in a mean error of 1.8 (±0.7) mm. A similar result was obtained when the marker was moved between X-ray acquisitions, and the mean error was 1.6 (±1.4) mm. The latencies were approximately 80 and 380 ms for tracking camera and X-ray imaging, respectively. Stereoscopic localization of a moving target was feasible., Conclusions: The system presents a flexible alternative for precise stereoscopic localization of a bronchoscope or instruments using a standard C-arm. We demonstrated the ability to track multiple moving markers and to compensate for respiratory motion.