1. Multi-modal classification of polyp malignancy using CNN features with balanced class augmentation
- Author
-
Roger Fonolla, Fons van der Sommen, Ramon M. Schreuder, Erik J. Schoon, Peter H.N. de With, Video Coding & Architectures, and Center for Care & Cure Technology Eindhoven
- Subjects
Data augmentation ,Computer science ,Colorectal cancer ,Colonoscopy ,Blue Laser Imaging ,colorectal cancer ,Malignancy ,SDG 3 – Goede gezondheid en welzijn ,Convolutional neural network ,03 medical and health sciences ,0302 clinical medicine ,SDG 3 - Good Health and Well-being ,colonoscopy ,medicine ,medicine.diagnostic_test ,business.industry ,svm ,Polyp classification ,deep learning ,Pattern recognition ,medicine.disease ,Class (biology) ,LCI ,3. Good health ,Bli ,Linked color imaging ,030220 oncology & carcinogenesis ,030211 gastroenterology & hepatology ,Artificial intelligence ,business ,CNN - Abstract
Colorectal polyps are an indicator of colorectal cancer (CRC). Classification of polyps during colonoscopy is still a challenge for which many medical experts have come up with visual models albeit with limited success. In this paper, a classification approach is proposed to differentiate between polyp malignancy, using features extracted from the Global Average Pooling (GAP) layer of a Convolutional Neural Network (CNNs). Two recent endoscopic modalities are used to improve the algorithm prediction: Blue Laser Imaging (BLI) and Linked Color Imaging (LCI). Furthermore, a new strategy of per-class data augmentation is adopted to tackle an unbalanced class distribution and to improve the decision of the classifiers. As a result, we increase the performance compared to state-of-the-art methods (0.97 vs 0.90 AUC). Our method for automatic polyp malignancy classification facilitates future advances towards patient safety and may avoid time-consuming and costly histopathological assessment.
- Published
- 2019