1. Multi-Modal Siamese Network for Diagnostically Similar Lesion Retrieval in Prostate MRI
- Author
-
Franco Scarselli, Monica Bianchini, Alberto Rossi, Henkjan J. Huisman, and Matin Hosseinzadeh
- Subjects
Male ,Computer science ,Feature extraction ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Feature extraction, Cancer, Magnetic resonance imaging, Neural networks, Lesions, Task analysis, Prostate cancer ,030218 nuclear medicine & medical imaging ,03 medical and health sciences ,Prostate cancer ,0302 clinical medicine ,medicine ,Medical imaging ,Humans ,Electrical and Electronic Engineering ,Multiparametric Magnetic Resonance Imaging ,Image retrieval ,Cancer ,Radiological and Ultrasound Technology ,medicine.diagnostic_test ,Artificial neural network ,business.industry ,Deep learning ,Prostatic Neoplasms ,Magnetic resonance imaging ,Pattern recognition ,medicine.disease ,Magnetic Resonance Imaging ,Computer Science Applications ,Urological cancers Radboud Institute for Health Sciences [Radboudumc 15] ,Task analysis ,Lesions ,Artificial intelligence ,business ,Neural networks ,Software ,Rare cancers Radboud Institute for Health Sciences [Radboudumc 9] - Abstract
Contains fulltext : 232917.pdf (Publisher’s version ) (Open Access) Multi-parametric prostate MRI (mpMRI) is a powerful tool to diagnose prostate cancer, though difficult to interpret even for experienced radiologists. A common radiological procedure is to compare a magnetic resonance image with similarly diagnosed cases. To assist the radiological image interpretation process, computerized Content-Based Image Retrieval systems (CBIRs) can therefore be employed to improve the reporting workflow and increase its accuracy. In this article, we propose a new, supervised siamese deep learning architecture able to handle multi-modal and multi-view MR images with similar PIRADS score. An experimental comparison with well-established deep learning-based CBIRs (namely standard siamese networks and autoencoders) showed significantly improved performance with respect to both diagnostic (ROC-AUC), and information retrieval metrics (Precision-Recall, Discounted Cumulative Gain and Mean Average Precision). Finally, the new proposed multi-view siamese network is general in design, facilitating a broad use in diagnostic medical imaging retrieval.
- Published
- 2021