1. Spatiotemporal registration and fusion of transthoracic echocardiography and volumetric coronary artery tree
- Author
-
Talayeh Ghodsizad, Hamid Behnam, Emad Fatemizadeh, Taraneh Faghihi Langroudi, and Fariba Bayat
- Subjects
Similarity (geometry) ,Computed Tomography Angiography ,Computer science ,0206 medical engineering ,Biomedical Engineering ,Health Informatics ,02 engineering and technology ,Coronary Angiography ,Pattern search ,Trees ,030218 nuclear medicine & medical imaging ,03 medical and health sciences ,0302 clinical medicine ,Humans ,Radiology, Nuclear Medicine and imaging ,Radiation treatment planning ,business.industry ,Image (category theory) ,Frame (networking) ,Nonlinear dimensionality reduction ,Pattern recognition ,General Medicine ,Coronary Vessels ,020601 biomedical engineering ,Computer Graphics and Computer-Aided Design ,Computer Science Applications ,body regions ,Tree (data structure) ,Hausdorff distance ,Echocardiography ,Surgery ,Computer Vision and Pattern Recognition ,Artificial intelligence ,business ,Algorithms - Abstract
Cardiac multimodal image fusion can offer an image with various types of information in a single image. Many coronary stenosis, which are anatomically clear, are not functionally significant. The treatment of such kind of stenosis can cause irreversible effects on the patient. Thus, choosing the best treatment planning depend on anatomical and functional information is very beneficial. An algorithm for the fusion of coronary computed tomography angiography (CCTA) as an anatomical and transthoracic echocardiography (TTE) as a functional modality is presented. CCTA and TTE are temporally registered using manifold learning. A pattern search optimization algorithm, using normalized mutual information, is used to find the best match slice to TTE frame from CCTA volume. By employing a free-form deformation, the heart's non-rigid deformations are modeled. The spatiotemporal registered TTE frame is embedded to achieve the fusion result. The accuracy is evaluated on CCTA and TTE data obtained from 10 patients. In temporal registration, mean absolute error of 1.97 $$\, \pm \, $$ 1.23 is resulted from comparing the output frame numbers from the algorithm and from manual assignment by an expert. In spatial registration, the accuracy of the similarity between the best match slice from CCTA volume and TTE frame is resulted in 1.82 $$\, \pm \, $$ 0.024 mm, 6.74 $$\, \pm \, $$ 0.013 mm, and 0.901 $$\, \pm \, $$ 0.0548 due to mean absolute distance, Hausdorff distance, and Dice similarity coefficient, respectively. Without the use of ECG and Optical tracking systems, a semiautomatic framework of spatiotemporal registration and fusion of CCTA volume and TTE frame is presented. The experimental results showed the effectiveness of our proposed method to create complementary information from TTE and CCTA, which may help in the early diagnosis and effective treatment of cardiovascular diseases (CVDs).
- Published
- 2021