Search

The generalization of deep neural network algorithms to a broader population is an important challenge in the medical field. We aimed to apply self-supervised learning using masked autoencoders (MAEs) to improve the performance of the 12-lead electrocardiography (ECG) analysis model using limited ECG data. We pretrained Vision Transformer (ViT) models by reconstructing the masked ECG data with MAE. We fine-tuned this MAE-based ECG pretrained model on ECG-echocardiography data from The University of Tokyo Hospital (UTokyo) for the detection of left ventricular systolic dysfunction (LVSD), and then evaluated it using multi-center external validation data from seven institutions, employing the area under the receiver operating characteristic curve (AUROC) for assessment. We included 38,245 ECG-echocardiography pairs from UTokyo and 229,439 pairs from all institutions. The performances of MAE-based ECG models pretrained using ECG data from UTokyo were significantly higher than that of other Deep Neural Network models across all external validation cohorts (AUROC, 0.913-0.962 for LVSD, p < 0.001). Moreover, we also found improvements for the MAE-based ECG analysis model depending on the model capacity and the amount of training data. Additionally, the MAE-based ECG analysis model maintained high performance even on the ECG benchmark dataset (PTB-XL). Our proposed method developed high performance MAE-based ECG analysis models using limited ECG data.

Coronary angiography (CAG) is still considered the reference standard for coronary artery assessment, especially in the treatment of acute coronary syndrome (ACS). Although aging causes changes in coronary arteries, the age-related imaging features on CAG and their prognostic relevance have not been fully characterized. We hypothesized that a deep neural network (DNN) model could be trained to estimate vascular age only using CAG and that this age prediction from CAG could show significant associations with clinical outcomes of ACS. A DNN was trained to estimate vascular age using ten separate frames from each of 5,923 CAG videos from 572 patients. It was then tested on 1,437 CAG videos from 144 patients. Subsequently, 298 ACS patients who underwent percutaneous coronary intervention (PCI) were analysed to assess whether predicted age by DNN was associated with clinical outcomes. Age predicted as a continuous variable showed mean absolute error of 4 years with R squared of 0.72 (r = 0.856). Among the ACS patients stratified by predicted age from CAG images before PCI, major adverse cardiovascular events (MACE) were more frequently observed in the older vascular age group than in the younger vascular age group (p = 0.017). Furthermore, after controlling for actual age, gender, peak creatine kinase, and history of heart failure, the older vascular age group independently suffered from more MACE (hazard ratio 2.14, 95% CI 1.07 to 4.29, p = 0.032). The vascular age estimated based on CAG imaging by DNN showed high predictive value. The age predicted from CAG images by DNN could have significant associations with clinical outcomes in patients with ACS.

Intravascular ultrasound (IVUS) is a diagnostic modality used during percutaneous coronary intervention. However, specialist skills are required to interpret IVUS images. To address this issue, we developed a new artificial intelligence (AI) program that categorizes vessel components, including calcification and stents, seen in IVUS images of complex lesions. When developing our AI using U-Net, IVUS images were taken from patients with angina pectoris and were manually segmented into the following categories: lumen area, medial plus plaque area, calcification, and stent. To evaluate our AI’s performance, we calculated the classification accuracy of vessel components in IVUS images of vessels with clinically significantly narrowed lumina (< 4 mm2) and those with severe calcification. Additionally, we assessed the correlation between lumen areas in manually-labeled ground truth images and those in AI-predicted images, the mean intersection over union (IoU) of a test set, and the recall score for detecting stent struts in each IVUS image in which a stent was present in the test set. Among 3738 labeled images, 323 were randomly selected for use as a test set. The remaining 3415 images were used for training. The classification accuracies for vessels with significantly narrowed lumina and those with severe calcification were 0.97 and 0.98, respectively. Additionally, there was a significant correlation in the lumen area between the ground truth images and the predicted images (ρ = 0.97, R2 = 0.97, p < 0.001). However, the mean IoU of the test set was 0.66 and the recall score for detecting stent struts was 0.64. Our AI program accurately classified vessels requiring treatment and vessel components, except for stents in IVUS images of complex lesions. AI may be a powerful tool for assisting in the interpretation of IVUS imaging and could promote the popularization of IVUS-guided percutaneous coronary intervention in a clinical setting.