Back to Search Start Over

Multi-view Contour-constrained Transformer Network for Thin-cap Fibroatheroma Identification

Authors :
Liu, Sijie
Xin, Jingmin
Wu, Jiayi
Deng, Yangyang
Su, Ruisheng
Niessen, Wiro
Zheng, Nanning
van Walsum, Theo
Liu, Sijie
Xin, Jingmin
Wu, Jiayi
Deng, Yangyang
Su, Ruisheng
Niessen, Wiro
Zheng, Nanning
van Walsum, Theo
Source :
Liu , S , Xin , J , Wu , J , Deng , Y , Su , R , Niessen , W , Zheng , N & van Walsum , T 2023 , ' Multi-view Contour-constrained Transformer Network for Thin-cap Fibroatheroma Identification ' , Neurocomputing , vol. 523 , pp. 224-234 .
Publication Year :
2023

Abstract

Identification and detection of thin-cap fibroatheroma (TCFA) from intravascular optical coherence tomography (IVOCT) images is critical for treatment of coronary heart diseases. Recently, deep learning methods have shown promising successes in TCFA identification. However, most methods usually do not effectively utilize multi-view information or incorporate prior domain knowledge. In this paper, we propose a multi-view contour-constrained transformer network (MVCTN) for TCFA identification in IVOCT images. Inspired by the diagnosis process of cardiologists, we use contour constrained self-attention modules (CCSM) to emphasize features corresponding to salient regions (i.e., vessel walls) in an unsupervised manner and enhance the visual interpretability based on class activation mapping (CAM). Moreover, we exploit transformer modules (TM) to build global-range relations between two views (i.e., polar and Cartesian views) to effectively fuse features at multiple feature scales. Experimental results on a semi-public dataset and an in-house dataset demonstrate that the proposed MVCTN outperforms other single-view and multi-view methods. Lastly, the proposed MVCTN can also provide meaningful visualization for cardiologists via CAM.

Details

Database :
OAIster
Journal :
Liu , S , Xin , J , Wu , J , Deng , Y , Su , R , Niessen , W , Zheng , N & van Walsum , T 2023 , ' Multi-view Contour-constrained Transformer Network for Thin-cap Fibroatheroma Identification ' , Neurocomputing , vol. 523 , pp. 224-234 .
Notes :
application/pdf, English
Publication Type :
Electronic Resource
Accession number :
edsoai.on1376784110
Document Type :
Electronic Resource