Search

We sought to determine the cardiac ultrasound view of greatest quality using a machine learning (ML) approach on a cohort of transthoracic echocardiograms (TTE) with abnormal left ventricular (LV) systolic function. We utilize an ML model to determine the TTE view of highest quality when scanned by sonographers. A random sample of TTEs with reported LV dysfunction from 09/25/2017-01/15/2019 were downloaded from the regional database. Component video files were analyzed using ML models that jointly classified view and image quality. The model consisted of convolutional layers for extracting spatial features and Long Short-term Memory units to temporally aggregate the frame-wise spatial embeddings. We report the view-specific quality scores for each TTE. Pair-wise comparisons amongst views were performed with Wilcoxon signed-rank test. Of 1,145 TTEs analyzed by the ML model, 74.5% were from males and mean LV ejection fraction was 43.1 ± 9.9%. Maximum quality score was best for the apical 4 chamber (AP4) view (70.6 ± 13.9%, p<0.001 compared to all other views) and worst for the apical 2 chamber (AP2) view (60.4 ± 15.4%, p<0.001 for all views except parasternal short-axis view at mitral/papillary muscle level, PSAX M/PM). In TTEs scanned by professional sonographers, the view with greatest ML-derived quality was the AP4 view., (© 2023. Crown.)

In echocardiography (echo), an electrocardiogram (ECG) is conventionally used to temporally align different cardiac views for assessing critical measurements. However, in emergencies or point-of-care situations, acquiring an ECG is often not an option, hence motivating the need for alternative temporal synchronization methods. Here, we propose Echo-SyncNet, a self-supervised learning framework to synchronize various cross-sectional 2D echo series without any human supervision or external inputs. The proposed framework takes advantage of two types of supervisory signals derived from the input data: spatiotemporal patterns found between the frames of a single cine (intra-view self-supervision) and interdependencies between multiple cines (inter-view self-supervision). The combined supervisory signals are used to learn a feature-rich and low dimensional embedding space where multiple echo cines can be temporally synchronized. Two intra-view self-supervisions are used, the first is based on the information encoded by the temporal ordering of a cine (temporal intra-view) and the second on the spatial similarities between nearby frames (spatial intra-view). The inter-view self-supervision is used to promote the learning of similar embeddings for frames captured from the same cardiac phase in different echo views. We evaluate the framework with multiple experiments: 1) Using data from 998 patients, Echo-SyncNet shows promising results for synchronizing Apical 2 chamber and Apical 4 chamber cardiac views, which are acquired spatially perpendicular to each other; 2) Using data from 3070 patients, our experiments reveal that the learned representations of Echo-SyncNet outperform a supervised deep learning method that is optimized for automatic detection of fine-grained cardiac cycle phase; 3) We go one step further and show the usefulness of the learned representations in a one-shot learning scenario of cardiac key-frame detection. Without any fine-tuning, key frames in 1188 validation patient studies are identified by synchronizing them with only one labeled reference cine. We do not make any prior assumption about what specific cardiac views are used for training, and hence we show that Echo-SyncNet can accurately generalize to views not present in its training set. Project repository: github.com/fatemehtd/Echo-SyncNet>.

We developed a machine learning model for efficient analysis of echocardiographic image quality in hospitalized patients. This study applied a machine learning model for automated transthoracic echo (TTE) image quality scoring in three inpatient groups. Our objectives were: (1) Assess the feasibility of a machine learning model for echo image quality analysis, (2) Establish the comprehensiveness of real-world TTE reporting by clinical group, and (3) Determine the relationship between machine learning image quality and comprehensiveness of TTE reporting. A machine learning model was developed and applied to TTEs from three matched cohorts for image quality of nine standard views. Case TTEs were comprehensive studies in mechanically ventilated patients between 01/01/2010 and 12/31/2015. For each case TTE, there were two matched spontaneously breathing controls (Control 1: Inpatients scanned in the lab and Control 2: Portable studies). We report the overall mean maximum and view specific quality scores for each TTE. The comprehensiveness of an echo report was calculated as the documented proportion of 12 standard parameters. An inverse probability weighted regression model was fit to determine the relationship between machine learning quality score and the completeness of a TTE report. 175 mechanically ventilated TTEs were included with 350 non-intubated samples (175 Control 1: Lab and 175 Control 2: Portable). In total, the machine learning model analyzed 14,086 echo video clips for quality. The overall accuracy of the model with regard to the expert ground truth for the view classification was 87.0%. The overall mean maximum quality score was lower for mechanically ventilated TTEs (0.55 [95% CI 0.54, 0.56]) versus 0.61 (95% CI 0.59, 0.62) for Control 1: Lab and 0.64 (95% CI 0.63, 0.66) for Control 2: Portable; p = 0.002. Furthermore, mechanically ventilated TTE reports were the least comprehensive, with fewer reported parameters. The regression model demonstrated the correlation of echo image quality and completeness of TTE reporting regardless of the clinical group. Mechanically ventilated TTEs were of inferior quality and clinical utility compared to spontaneously breathing controls and machine learning derived image quality correlates with completeness of TTE reporting regardless of the clinical group.

Uncertainty of labels in clinical data resulting from intra-observer variability can have direct impact on the reliability of assessments made by deep neural networks. In this paper, we propose a method for modelling such uncertainty in the context of 2D echocardiography (echo), which is a routine procedure for detecting cardiovascular disease at point-of-care. Echo imaging quality and acquisition time is highly dependent on the operator's experience level. Recent developments have shown the possibility of automating echo image quality quantification by mapping an expert's assessment of quality to the echo image via deep learning techniques. Nevertheless, the observer variability in the expert's assessment can impact the quality quantification accuracy. Here, we aim to model the intra-observer variability in echo quality assessment as an aleatoric uncertainty modelling regression problem with the introduction of a novel method that handles the regression problem with categorical labels. A key feature of our design is that only a single forward pass is sufficient to estimate the level of uncertainty for the network output. Compared to the 0.11 ± 0.09 absolute error (in a scale from 0 to 1) archived by the conventional regression method, the proposed method brings the error down to 0.09 ± 0.08, where the improvement is statistically significant and equivalents to 5.7% test accuracy improvement. The simplicity of the proposed approach means that it could be generalized to other applications of deep learning in medical imaging, where there is often uncertainty in clinical labels.

Purpose:  The emerging market of cardiac handheld ultrasound (US) is on the rise. Despite the advantages in ease of access and the lower cost, a gap in image quality can still be observed between the echocardiography (echo) data captured by point-of-care ultrasound (POCUS) compared to conventional cart-based US, which limits the further adaptation of POCUS. In this work, we aim to present a machine learning solution based on recent advances in adversarial training to investigate the feasibility of translating POCUS echo images to the quality level of high-end cart-based US systems., Methods:  We propose a constrained cycle-consistent generative adversarial architecture for unpaired translation of cardiac POCUS to cart-based US data. We impose a structured shape-wise regularization via a critic segmentation network to preserve the underlying shape of the heart during quality translation. The proposed deep transfer model is constrained to the anatomy of the left ventricle (LV) in apical two-chamber (AP2) echo views., Results:  A total of 1089 echo studies from 841 patients are used in this study. The AP2 frames are captured by POCUS (Philips Lumify and Clarius) and cart-based (Philips iE33 and Vivid E9) US machines. The dataset of quality translation comprises a total of 441 echo studies from 395 patients. Data from both POCUS and cart-based systems of the same patient were available in 122 cases. The deep-quality transfer model is integrated into a pipeline for an automated cardiac evaluation task, namely segmentation of LV in AP2 view. By transferring the low-quality POCUS data to the cart-based US, a significant average improvement of 30% and 34 mm is obtained in the LV segmentation Dice score and Hausdorff distance metrics, respectively., Conclusion:  This paper presents the feasibility of a machine learning solution to transform the image quality of POCUS data to that of high-quality high-end cart-based systems. The experiments show that by leveraging the quality translation through the proposed constrained adversarial training, the accuracy of automatic segmentation with POCUS data could be improved.

Accurate detection of end-systolic (ES) and end-diastolic (ED) frames in an echocardiographic cine series can be difficult but necessary pre-processing step for the development of automatic systems to measure cardiac parameters. The detection task is challenging due to variations in cardiac anatomy and heart rate often associated with pathological conditions. We formulate this problem as a regression problem and propose several deep learning-based architectures that minimize a novel global extrema structured loss function to localize the ED and ES frames. The proposed architectures integrate convolution neural networks (CNNs)-based image feature extraction model and recurrent neural networks (RNNs) to model temporal dependencies between each frame in a sequence. We explore two CNN architectures: DenseNet and ResNet, and four RNN architectures: long short-term memory, bi-directional LSTM, gated recurrent unit (GRU), and Bi-GRU, and compare the performance of these models. The optimal deep learning model consists of a DenseNet and GRU trained with the proposed loss function. On average, we achieved 0.20 and 1.43 frame mismatch for the ED and ES frames, respectively, which are within reported inter-observer variability for the manual detection of these frames.

Purpose: Left ventricular ejection fraction (LVEF) is one of the key metrics to assess the heart functionality, and cardiac ultrasound (echo) is a standard imaging modality for EF measurement. There is an emerging interest to exploit the point-of-care ultrasound (POCUS) usability due to low cost and ease of access. In this work, we aim to present a computationally efficient mobile application for accurate LVEF estimation., Methods: Our proposed mobile application for LVEF estimation runs in real time on Android mobile devices that have either a wired or wireless connection to a cardiac POCUS device. We propose a pipeline for biplane ejection fraction estimation using apical two-chamber (AP2) and apical four-chamber (AP4) echo views. A computationally efficient multi-task deep fully convolutional network is proposed for simultaneous LV segmentation and landmark detection in these views, which is integrated into the LVEF estimation pipeline. An adversarial critic model is used in the training phase to impose a shape prior on the LV segmentation output., Results: The system is evaluated on a dataset of 427 patients. Each patient has a pair of captured AP2 and AP4 echo studies, resulting in a total of more than 40,000 echo frames. The mobile system reaches a noticeably high average Dice score of 92% for LV segmentation, an average Euclidean distance error of 2.85 pixels for the detection of anatomical landmarks used in LVEF calculation, and a median absolute error of 6.2% for LVEF estimation compared to the expert cardiologist's annotations and measurements., Conclusion: The proposed system runs in real time on mobile devices. The experiments show the effectiveness of the proposed system for automatic LVEF estimation by demonstrating an adequate correlation with the cardiologist's examination.

Echocardiography (echo) is a skilled technical procedure that depends on the experience of the operator. The aim of this paper is to reduce user variability in data acquisition by automatically computing a score of echo quality for operator feedback. To do this, a deep convolutional neural network model, trained on a large set of samples, was developed for scoring apical four-chamber (A4C) echo. In this paper, 6,916 end-systolic echo images were manually studied by an expert cardiologist and were assigned a score between 0 (not acceptable) and 5 (excellent). The images were divided into two independent training-validation and test sets. The network architecture and its parameters were based on the stochastic approach of the particle swarm optimization on the training-validation data. The mean absolute error between the scores from the ultimately trained model and the expert's manual scores was 0.71 ± 0.58. The reported error was comparable to the measured intra-rater reliability. The learned features of the network were visually interpretable and could be mapped to the anatomy of the heart in the A4C echo, giving confidence in the training result. The computation time for the proposed network architecture, running on a graphics processing unit, was less than 10 ms per frame, sufficient for real-time deployment. The proposed approach has the potential to facilitate the widespread use of echo at the point-of-care and enable early and timely diagnosis and treatment. Finally, the approach did not use any specific assumptions about the A4C echo, so it could be generalizable to other standard echo views.

Background: Automated rhythm detection on echocardiography through artificial intelligence (AI) has yet to be fully realized. We propose an AI model trained to identify atrial fibrillation (AF) using apical 4-chamber (AP4) cines without requiring electrocardiogram (ECG) data. Methods: Transthoracic echocardiography studies of consecutive patients ≥ 18 years old at our tertiary care centre were retrospectively reviewed for AF and sinus rhythm. The study was first interpreted by level III-trained echocardiography cardiologists as the gold standard for rhythm diagnosis based on ECG rhythm strip and imaging assessment, which was also verified with a 12-lead ECG around the time of the study. AP4 cines with three cardiac cycles were then extracted from these studies with the rhythm strip and Doppler information removed and introduced to the deep learning model ResNet(2+1)D with an 80:10:10 training–validation–test split ratio. Results: 634 patient studies (1205 cines) were included. After training, the AI model achieved high accuracy on validation for detection of both AF and sinus rhythm (mean F1-score = 0.92; AUROC = 0.95). Performance was consistent on the test dataset (mean F1-score = 0.94, AUROC = 0.98) when using the cardiologist's assessment of the ECG rhythm strip as the gold standard, who had access to the full study and external ECG data, while the AI model did not. Conclusions: AF detection by AI on echocardiography without ECG appears accurate when compared to an echocardiography cardiologist's assessment of the ECG rhythm strip as the gold standard. This has potential clinical implications in point-of-care ultrasound and stroke risk stratification. [ABSTRACT FROM AUTHOR]

BACKGROUND: There is limited data on the residual echocardiographic findings including strain analysis among post-coronavirus disease (COVID) patients. The aim of our study is to prospectively phenotype post-COVID patients. METHODS: All patients discharged following acute COVID infection were systematically followed in the post-COVID-19 Recovery Clinic at Vancouver General Hospital and St. Paul's Hospital. At 4-18 weeks post diagnosis, patients underwent comprehensive echocardiographic assessment. Left ventricular ejection fraction (LVEF) was assessed by 3D, 2D Biplane Simpson's, or visual estimate. LV global longitudinal strain (GLS) was measured using a vendor-independent 2D speckle-tracking software (TomTec). RESULTS: A total of 127 patients (53% female, mean age 58 years) were included in our analyses. At baseline, cardiac conditions were present in 58% of the patients (15% coronary artery disease, 4% heart failure, 44% hypertension, 10% atrial fibrillation) while the remainder were free of cardiac conditions. COVID-19 serious complications were present in 79% of the patients (76% pneumonia, 37% intensive care unit admission, 21% intubation, 1% myocarditis). Normal LVEF was seen in 96% of the cohort and 97% had normal right ventricular systolic function. A high proportion (53%) had abnormal LV GLS defined as < 18%. Average LV GLS of septal and inferior segments were lower compared to that of other segments. Among patients without pre-existing cardiac conditions, LVEF was abnormal in only 1.9%, but LV GLS was abnormal in 46% of the patients. CONCLUSIONS: Most post-COVID patients had normal LVEF at 4-18 weeks post diagnosis, but over half had abnormal LV GLS. [ABSTRACT FROM AUTHOR]

This paper presents U-LanD, a framework for automatic detection of landmarks on key frames of the video by leveraging the uncertainty of landmark prediction. We tackle a specifically challenging problem, where training labels are noisy and highly sparse. U-LanD builds upon a pivotal observation: a deep Bayesian landmark detector solely trained on key video frames, has significantly lower predictive uncertainty on those frames vs. other frames in videos. We use this observation as an unsupervised signal to automatically recognize key frames on which we detect landmarks. As a test-bed for our framework, we use ultrasound imaging videos of the heart, where sparse and noisy clinical labels are only available for a single frame in each video. Using data from 4,493 patients, we demonstrate that U-LanD can exceedingly outperform the state-of-the-art non-Bayesian counterpart by a noticeable absolute margin of 42% in ${R}^{{2}}$ score, with almost no overhead imposed on the model size. [ABSTRACT FROM AUTHOR]

Heart failure with reduced ejection fraction (HFrEF) is associated with high mortality rates. The identification of patients with HFrEF in urgent and emergent situations can be delayed in the absence of clinicians skilled in acquiring and interpreting echocardiography (echo) images. Although the standard-of-care for measuring ejection fraction (EF) involves segmentation of the left ventricle in echo, experienced interpreters often opt for visual estimation of EF in clinical settings. In this paper, we mimic this process using dual-channel deep neural networks for segmentation-free classification of echo cine loops: low-risk ( 40 % < E F ≤ 75 %) vs. high-risk (reduced EF, i.e. E F ≤ 40 %). The proposed architecture utilises densely connected networks for extraction of unsupervised spatial features. Temporal embedding is then achieved by aggregating these frame-level feature vectors and feeding them through recurrent blocks. We use 949 and 237 clinical echo exams to train and validate the proposed method, respectively. We demonstrate that direct cine-based detection of patients at high-risk of HFrEF is feasible using densely connected convolutional and recurrent-based architectures. [ABSTRACT FROM AUTHOR]

We propose a joint information approach for automatic analysis of 2D echocardiography (echo) data. The approach combines a priori images, their segmentations and patient diagnostic information within a unified framework to determine various clinical parameters, such as cardiac chamber volumes, and cardiac disease labels. The main idea behind the approach is to employ joint Independent Component Analysis of both echo image intensity information and corresponding segmentation labels to generate models that jointly describe the image and label space of echo patients on multiple apical views, instead of independently. These models are then both used for segmentation and volume estimation of cardiac chambers such as the left atrium and for detecting pathological abnormalities such as mitral regurgitation. We validate the approach on a large cohort of echoes obtained from 6,993 studies. We report performance of the proposed approach in estimation of the left-atrium volume and detection of mitral-regurgitation severity. A correlation coefficient of 0.87 was achieved for volume estimation of the left atrium when compared to the clinical report. Moreover, we classified patients that suffer from moderate or severe mitral regurgitation with an average accuracy of 82%. [ABSTRACT FROM PUBLISHER]

Echocardiographic assessment of diastolic function is complex but can aid in the diagnosis of heart failure, particularly in patients with preserved ejection fraction. In 2016, the American Society of Echocardiography (ASE) and European Association of Cardiovascular Imaging (EACVI) published an updated algorithm for the evaluation of diastolic function. The objective of our study was to assess its impact on diastolic function assessment in a real-world cohort of echo studies. We retrospectively identified 71,727 consecutive transthoracic echo studies performed at a tertiary care center between February 2010 and March 2016 in which diastolic function was reported based on the 2009 ASE Guidelines. We then programmed a software algorithm to assess diastolic function in these echo studies according to the 2016 ASE/EACVI Guidelines. When diastolic function assessment based on the 2009 guidelines was compared to that using the 2016 guidelines, there were significant differences in proportion of studies classified as normal (23% vs. 32%) or indeterminate (43% vs. 36%) function, and mild (23% vs. 23%), moderate (10% vs. 8%), or severe (1% vs. 2%) diastolic dysfunction, with poor agreement between the two methods (Kappa 0.323, 95% CI 0.318–0.328). Furthermore, within the subgroup of studies with preserved ejection fraction and no evidence of myocardial disease, there was significant reclassification from mild diastolic dysfunction to normal diastolic function. The updated guidelines result in significant differences in diastolic function interpretation in the real world. Our findings have important implications for the identification of patients with or at risk for heart failure. • Diastolic function grading changed significantly after an update in guidelines. • There was substantial reclassification from indeterminate to normal function. • Patients with no heart disease tended to reclassify from mild dysfunction to normal. • Up to 48% of echo studies received a different diastolic function interpretation. • Updated guidelines have important implications in the diagnosis of heart failure. [ABSTRACT FROM AUTHOR]