Search

Abstract Understanding factors that impact prognosis for cancer patients have high clinical relevance for treatment decisions and monitoring of the disease outcome. Advances in artificial intelligence (AI) and digital pathology offer an exciting opportunity to capitalize on the use of whole slide images (WSIs) of hematoxylin and eosin (H&E) stained tumor tissue for objective prognosis and prediction of response to targeted therapies. AI models often require hand-delineated annotations for effective training which may not be readily available for larger data sets. In this study, we investigated whether AI models can be trained without region-level annotations and solely on patient-level survival data. We present a weakly supervised survival convolutional neural network (WSS-CNN) approach equipped with a visual attention mechanism for predicting overall survival. The inclusion of visual attention provides insights into regions of the tumor microenvironment with the pathological interpretation which may improve our understanding of the disease pathomechanism. We performed this analysis on two independent, multi-center patient data sets of lung (which is publicly available data) and bladder urothelial carcinoma. We perform univariable and multivariable analysis and show that WSS-CNN features are prognostic of overall survival in both tumor indications. The presented results highlight the significance of computational pathology algorithms for predicting prognosis using H&E stained images alone and underpin the use of computational methods to improve the efficiency of clinical trial studies.

For personalization of medicine, increasingly clinical and demographic data are integrated into nomograms for prognostic use, while molecular biomarkers are being developed to add independent diagnostic, prognostic, or management information. In a number of cases in surgical pathology, morphometric quantitation is already performed manually or semi-quantitatively, with this effort contributing to diagnostic workup. Digital whole slide imaging, coupled with emerging image analysis algorithms, offers great promise as an adjunctive tool for the surgical pathologist in areas of screening, quality assurance, consistency, and quantitation. We have recently reported such an algorithm, SIVQ (Spatially Invariant Vector Quantization), which avails itself of the geometric advantages of ring vectors for pattern matching, and have proposed a number of potential applications. One key test, however, remains the need for demonstration and optimization of SIVQ for discrimination between foreground (neoplasm- malignant epithelium) and background (normal parenchyma, stroma, vessels, inflammatory cells). Especially important is the determination of relative contributions of each key SIVQ matching parameter with respect to the algorithm’s overall detection performance. Herein, by combinatorial testing of SIVQ ring size, sub-ring number, and inter-ring wobble parameters, in the setting of a morphologically complex bladder cancer use case, we ascertain the relative contributions of each of these parameters towards overall detection optimization using urothelial carcinoma as a use case, providing an exemplar by which this algorithm and future histology-oriented pattern matching tools may be validated and subsequently, implemented broadly in other appropriate microscopic classification settings.

Introduction: The advent of digital slides offers new opportunities within the practice of pathology such as the use of image analysis techniques to facilitate computer aided diagnosis (CAD) solutions. Use of CAD holds promise to enable new levels of decision support and allow for additional layers of quality assurance and consistency in rendered diagnoses. However, the development and testing of prostate cancer CAD solutions requires a ground truth map of the cancer to enable the generation of receiver operator characteristic (ROC) curves. This requires a pathologist to annotate, or paint, each of the malignant glands in prostate cancer with an image editor software - a time consuming and exhaustive process.

Recently, with the advent of the 7th edition of the AJCC Cancer Staging manual, at least one set of criteria (e.g. breast) were modified to now require the measurement of maximal depth of stromal invasion. With the current manual interpretive morphological approaches typically employed by surgical pathologists to assess tumor extent, the specialty now potentially has stumbled upon a crossroads of practice, where the diagnostic criteria have exceeded the capabilities of our commonly available tools. While whole slide imaging (WSI) technology holds the potential to offer many improvements in clinical workflow over conventional slide microscopy including unambiguous utility for facilitating quantitative diagnostic tasks with one important example being the determination of both linear dimension and surface area. However, the availability of histology data in digital form is of little utility if time-consuming and cumbersome manual workflow steps are necessarily imposed upon the pathologist in order to generate such measurements, especially as encountered with the complex and ill-defined shapes inherent to infiltrative tumors. In this communication, we demonstrate the utility of the recently described SIVQ algorithm to serve as the basis of a highly accurate, precise and semi-automated tool for direct surface area measurement of tumor infiltration from WSI data sets. By anticipating the current trend in cancer staging that emphasizes increasingly precise feature characterization, as witnessed by the recent publication of AJCC's 7th edition of the Cancer Staging Manual, this tool holds promise to will be of value to pathologists for clinical utility.