Deep learning can predict lymph node status directly from histology in colorectal cancer.

Lymph node status is a prognostic marker and strongly influences therapeutic decisions in colorectal cancer (CRC). The objective of the study is to investigate whether image features extracted by a deep learning model from routine histological slides and/or clinical data can be used to predict CRC lymph node metastasis (LNM). Using histological whole slide images (WSIs) of primary tumours of 2431 patients in the DACHS cohort, we trained a convolutional neural network to predict LNM. In parallel, we used clinical data derived from the same cases in logistic regression analyses. Subsequently, the slide-based artificial intelligence predictor (SBAIP) score was included in the regression. WSIs and data from 582 patients of the TCGA cohort were used as the external test set. On the internal test set, the SBAIP achieved an area under receiver operating characteristic (AUROC) of 71.0%, the clinical classifier achieved an AUROC of 67.0% and a combination of the two classifiers yielded an improvement to 74.1%. Whereas the clinical classifier's performance remained stable on the TCGA set, performance of the SBAIP dropped to an AUROC of 61.2%. Performance of the clinical classifier depended strongly on the T stage. Deep learning–based image analysis may help predict LNM of patients with CRC using routine histological slides. Combination with clinical data such as T stage might be useful. Strategies to increase performance of the SBAIP on external images should be investigated. • We aimed to develop a new biomarker to predict lymph node status of patients with colorectal cancer (CRC). • Convolutional neural network–based image analysis and clinical data were used individually and in combination. • Models were trained and tested on haematoxylin and eosin slides of 3013 primary CRC tumours. • The combined model on the internal test set yielded the best results (area under receiver operating curve of 74.1%). • Studies should address generalisation of the image classifier to external data. [ABSTRACT FROM AUTHOR]