Search

The alignment of tissue between histopathological whole-slide-images (WSI) is crucial for research and clinical applications. Advances in computing, deep learning, and availability of large WSI datasets have revolutionised WSI analysis. Therefore, the current state-of-the-art in WSI registration is unclear. To address this, we conducted the ACROBAT challenge, based on the largest WSI registration dataset to date, including 4,212 WSIs from 1,152 breast cancer patients. The challenge objective was to align WSIs of tissue that was stained with routine diagnostic immunohistochemistry to its H&E-stained counterpart. We compare the performance of eight WSI registration algorithms, including an investigation of the impact of different WSI properties and clinical covariates. We find that conceptually distinct WSI registration methods can lead to highly accurate registration performances and identify covariates that impact performances across methods. These results provide a comparison of the performance of current WSI registration methods and guide researchers in selecting and developing methods., Competing Interests: Declaration of competing interest The authors declare the following financial interests/personal relationships which may be considered as potential competing interests: Philippe Weitz reports a relationship with Stratipath AB that includes: employment. Mattias Rantalainen reports a relationship with Stratipath AB that includes: equity or stocks. Johan Hartman reports a relationship with Stratipath AB that includes: equity or stocks. Kimmo Kartasalo reports a relationship with Clinsight AB that includes: equity or stocks. If there are other authors, they declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024. Published by Elsevier B.V.)

Background and Objective: Image-based artificial intelligence (AI) methods have shown high accuracy in prostate cancer (PCa) detection. Their impact on patient outcomes and cost effectiveness in comparison to human pathologists remains unknown. Our aim was to evaluate the effectiveness and cost-effectiveness of AI-assisted pathology for PCa diagnosis in Sweden., Methods: We modeled quadrennial prostate-specific antigen (PSA) screening for men between the ages of 50 and 74 yr over a lifetime horizon using a health care perspective. Men with PSA ≥3 ng/ml were referred for standard biopsy (SBx), for which cores were either examined via AI followed by a pathologist for AI-labeled positive cores, or a pathologist alone. The AI performance characteristics were estimated using an internal STHLM3 validation data set. Outcome measures included the number of tests, PCa incidence and mortality, overdiagnosis, quality-adjusted life years (QALYs), and the potential reduction in pathologist-evaluated biopsy cores if AI were used. Cost-effectiveness was assessed using the incremental cost-effectiveness ratio., Key Findings and Limitations: In comparison to a pathologist alone, the AI-assisted workflow increased the number of PSA tests, SBx procedures, and PCa deaths by ≤0.03%, and slightly reduced PCa incidence and overdiagnosis. AI would reduce the proportion of biopsy cores evaluated by a pathologist by 80%. At a cost of €10 per case, the AI-assisted workflow would cost less and result in <0.001% lower QALYs in comparison to a pathologist alone. The results were sensitive to the AI cost., Conclusions and Clinical Implications: According to our model, AI-assisted pathology would significantly decrease the workload of pathologists, would not affect patient quality of life, and would yield cost savings in Sweden when compared to a human pathologist alone., Patient Summary: We compared outcomes for prostate cancer patients and relevant costs for two methods of assessing prostate biopsies in Sweden: (1) artificial intelligence (AI) technology and review of positive biopsies by a human pathologist; and (2) a human pathologist alone for all biopsies. We found that addition of AI would reduce the pathology workload and save money, and would not affect patient outcomes when compared to a human pathologist alone. The results suggest that adding AI to prostate pathology in Sweden would save costs., (Copyright © 2024. Published by Elsevier B.V.)

The analysis of FFPE tissue sections stained with haematoxylin and eosin (H&E) or immunohistochemistry (IHC) is essential for the pathologic assessment of surgically resected breast cancer specimens. IHC staining has been broadly adopted into diagnostic guidelines and routine workflows to assess the status of several established biomarkers, including ER, PGR, HER2 and KI67. Biomarker assessment can also be facilitated by computational pathology image analysis methods, which have made numerous substantial advances recently, often based on publicly available whole slide image (WSI) data sets. However, the field is still considerably limited by the sparsity of public data sets. In particular, there are no large, high quality publicly available data sets with WSIs of matching IHC and H&E-stained tissue sections from the same tumour. Here, we publish the currently largest publicly available data set of WSIs of tissue sections from surgical resection specimens from female primary breast cancer patients with matched WSIs of corresponding H&E and IHC-stained tissue, consisting of 4,212 WSIs from 1,153 patients., (© 2023. Springer Nature Limited.)

Background: Stochastic optical reconstruction microscopy (STORM), a super-resolution microscopy technique based on single-molecule localizations, has become popular to characterize sub-diffraction limit targets. However, due to lengthy image acquisition, STORM recordings are prone to sample drift. Existing cross-correlation or fiducial marker-based algorithms allow correcting the drift within each channel, but misalignment between channels remains due to interchannel drift accumulating during sequential channel acquisition. This is a major drawback in multi-color STORM, a technique of utmost importance for the characterization of various biological interactions., Results: We developed RegiSTORM, a software for reducing channel misalignment by accurately registering STORM channels utilizing fiducial markers in the sample. RegiSTORM identifies fiducials from the STORM localization data based on their non-blinking nature and uses them as landmarks for channel registration. We first demonstrated accurate registration on recordings of fiducials only, as evidenced by significantly reduced target registration error with all the tested channel combinations. Next, we validated the performance in a more practically relevant setup on cells multi-stained for tubulin. Finally, we showed that RegiSTORM successfully registers two-color STORM recordings of cargo-loaded lipid nanoparticles without fiducials, demonstrating the broader applicability of this software., Conclusions: The developed RegiSTORM software was demonstrated to be able to accurately register multiple STORM channels and is freely available as open-source (MIT license) at https://github.com/oystein676/RegiSTORM.git and https://doi.org/10.5281/zenodo.5509861 (archived), and runs as a standalone executable (Windows) or via Python (Mac OS, Linux)., (© 2023. The Author(s).)

Aims: There is strong evidence that cribriform morphology indicates a worse prognosis of prostatic adenocarcinoma. Our aim was to investigate its interobserver reproducibility in prostate needle biopsies., Methods and Results: A panel of nine prostate pathology experts from five continents independently reviewed 304 digitised biopsies for cribriform cancer according to recent International Society of Urological Pathology criteria. The biopsies were collected from a series of 702 biopsies that were reviewed by one of the panellists for enrichment of high-grade cancer and potentially cribriform structures. A 2/3 consensus diagnosis of cribriform and noncribriform cancer was reached in 90% (272/304) of the biopsies with a mean kappa value of 0.56 (95% confidence interval 0.52-0.61). The prevalence of consensus cribriform cancers was estimated to 4%, 12%, 21%, and 20% of Gleason scores 7 (3 + 4), 7 (4 + 3), 8, and 9-10, respectively. More than two cribriform structures per level or a largest cribriform mass with ≥9 lumina or a diameter of ≥0.5 mm predicted a consensus diagnosis of cribriform cancer in 88% (70/80), 84% (87/103), and 90% (56/62), respectively, and noncribriform cancer in 3% (2/80), 5% (5/103), and 2% (1/62), respectively (all P < 0.01)., Conclusion: Cribriform prostate cancer was seen in a minority of needle biopsies with high-grade cancer. Stringent diagnostic criteria enabled the identification of cribriform patterns and the generation of a large set of consensus cases for standardisation., (© 2023 The Authors. Histopathology published by John Wiley & Sons Ltd.)

Unreliable predictions can occur when an artificial intelligence (AI) system is presented with data it has not been exposed to during training. We demonstrate the use of conformal prediction to detect unreliable predictions, using histopathological diagnosis and grading of prostate biopsies as example. We digitized 7788 prostate biopsies from 1192 men in the STHLM3 diagnostic study, used for training, and 3059 biopsies from 676 men used for testing. With conformal prediction, 1 in 794 (0.1%) predictions is incorrect for cancer diagnosis (compared to 14 errors [2%] without conformal prediction) while 175 (22%) of the predictions are flagged as unreliable when the AI-system is presented with new data from the same lab and scanner that it was trained on. Conformal prediction could with small samples (N = 49 for external scanner, N = 10 for external lab and scanner, and N = 12 for external lab, scanner and pathology assessment) detect systematic differences in external data leading to worse predictive performance. The AI-system with conformal prediction commits 3 (2%) errors for cancer detection in cases of atypical prostate tissue compared to 44 (25%) without conformal prediction, while the system flags 143 (80%) unreliable predictions. We conclude that conformal prediction can increase patient safety of AI-systems., (© 2022. The Author(s).)

The presence of perineural invasion (PNI) by carcinoma in prostate biopsies has been shown to be associated with poor prognosis. The assessment and quantification of PNI are, however, labor intensive. To aid pathologists in this task, we developed an artificial intelligence (AI) algorithm based on deep neural networks. We collected, digitized, and pixel-wise annotated the PNI findings in each of the approximately 80,000 biopsy cores from the 7406 men who underwent biopsy in a screening trial between 2012 and 2014. In total, 485 biopsy cores showed PNI. We also digitized more than 10% (n = 8318) of the PNI negative biopsy cores. Digitized biopsies from a random selection of 80% of the men were used to build the AI algorithm, while 20% were used to evaluate its performance. For detecting PNI in prostate biopsy cores, the AI had an estimated area under the receiver operating characteristics curve of 0.98 (95% CI 0.97-0.99) based on 106 PNI positive cores and 1652 PNI negative cores in the independent test set. For a pre-specified operating point, this translates to sensitivity of 0.87 and specificity of 0.97. The corresponding positive and negative predictive values were 0.67 and 0.99, respectively. The concordance of the AI with pathologists, measured by mean pairwise Cohen's kappa (0.74), was comparable to inter-pathologist concordance (0.68 to 0.75). The proposed algorithm detects PNI in prostate biopsies with acceptable performance. This could aid pathologists by reducing the number of biopsies that need to be assessed for PNI and by highlighting regions of diagnostic interest., (© 2022. The Author(s).)

Motivation: Molecular phenotyping by gene expression profiling is central in contemporary cancer research and in molecular diagnostics but remains resource intense to implement. Changes in gene expression occurring in tumours cause morphological changes in tissue, which can be observed on the microscopic level. The relationship between morphological patterns and some of the molecular phenotypes can be exploited to predict molecular phenotypes from routine haematoxylin and eosin-stained whole slide images (WSIs) using convolutional neural networks (CNNs). In this study, we propose a new, computationally efficient approach to model relationships between morphology and gene expression., Results: We conducted the first transcriptome-wide analysis in prostate cancer, using CNNs to predict bulk RNA-sequencing estimates from WSIs for 370 patients from the TCGA PRAD study. Out of 15 586 protein coding transcripts, 6618 had predicted expression significantly associated with RNA-seq estimates (FDR-adjusted P-value <1×10-4) in a cross-validation and 5419 (81.9%) of these associations were subsequently validated in a held-out test set. We furthermore predicted the prognostic cell-cycle progression score directly from WSIs. These findings suggest that contemporary computer vision models offer an inexpensive and scalable solution for prediction of gene expression phenotypes directly from WSIs, providing opportunity for cost-effective large-scale research studies and molecular diagnostics., Availability and Implementation: A self-contained example is available from http://github.com/phiwei/prostate&#95;coexpression. Model predictions and metrics are available from doi.org/10.5281/zenodo.4739097., Supplementary Information: Supplementary data are available at Bioinformatics online., (© The Author(s) 2022. Published by Oxford University Press.)

Histological changes in tissue are of primary importance in pathological research and diagnosis. Automated histological analysis requires ability to computationally separate pathological alterations from normal tissue. Conventional histopathological assessments are performed from individual tissue sections, leading to the loss of three-dimensional context of the tissue. Yet, the tissue context and spatial determinants are critical in several pathologies, such as in understanding growth patterns of cancer in its local environment. Here, we develop computational methods for visualization and quantitative assessment of histopathological alterations in three dimensions. First, we reconstruct the 3D representation of the whole organ from serial sectioned tissue. Then, we proceed to analyze the histological characteristics and regions of interest in 3D. As our example cases, we use whole slide images representing hematoxylin-eosin stained whole mouse prostates in a Pten+/- mouse prostate tumor model. We show that quantitative assessment of tumor sizes, shapes, and separation between spatial locations within the organ enable characterizing and grouping tumors. Further, we show that 3D visualization of tissue with computationally quantified features provides an intuitive way to observe tissue pathology. Our results underline the heterogeneity in composition and cellular organization within individual tumors. As an example, we show how prostate tumors have nuclear density gradients indicating areas of tumor growth directions and reflecting varying pressure from the surrounding tissue. The methods presented here are applicable to any tissue and different types of pathologies. This work provides a proof-of-principle for gaining a comprehensive view from histology by studying it quantitatively in 3D., Competing Interests: The authors declare no conflict of interest., (© 2022 The Authors.)

Artificial intelligence (AI) has shown promise for diagnosing prostate cancer in biopsies. However, results have been limited to individual studies, lacking validation in multinational settings. Competitions have been shown to be accelerators for medical imaging innovations, but their impact is hindered by lack of reproducibility and independent validation. With this in mind, we organized the PANDA challenge-the largest histopathology competition to date, joined by 1,290 developers-to catalyze development of reproducible AI algorithms for Gleason grading using 10,616 digitized prostate biopsies. We validated that a diverse set of submitted algorithms reached pathologist-level performance on independent cross-continental cohorts, fully blinded to the algorithm developers. On United States and European external validation sets, the algorithms achieved agreements of 0.862 (quadratically weighted κ, 95% confidence interval (CI), 0.840-0.884) and 0.868 (95% CI, 0.835-0.900) with expert uropathologists. Successful generalization across different patient populations, laboratories and reference standards, achieved by a variety of algorithmic approaches, warrants evaluating AI-based Gleason grading in prospective clinical trials., (© 2022. The Author(s).)

Summary: Digital pathology enables applying computational methods, such as deep learning, in pathology for improved diagnostics and prognostics, but lack of interoperability between whole slide image formats of different scanner vendors is a challenge for algorithm developers. We present OpenPhi-Open PatHology Interface, an Application Programming Interface for seamless access to the iSyntax format used by the Philips Ultra Fast Scanner, the first digital pathology scanner approved by the United States Food and Drug Administration. OpenPhi is extensible and easily interfaced with existing vendor-neutral applications., Availability and Implementation: OpenPhi is implemented in Python and is available as open-source under the MIT license at: https://gitlab.com/BioimageInformaticsGroup/openphi. The Philips Software Development Kit is required and available at: https://www.openpathology.philips.com. OpenPhi version 1.1.1 is additionally provided as Supplementary Data., Supplementary Information: Supplementary data are available at Bioinformatics online., (© The Author(s) 2021. Published by Oxford University Press.)

Background: Virtual reality (VR) enables data visualization in an immersive and engaging manner, and it can be used for creating ways to explore scientific data. Here, we use VR for visualization of 3D histology data, creating a novel interface for digital pathology to aid cancer research., Methods: Our contribution includes 3D modeling of a whole organ and embedded objects of interest, fusing the models with associated quantitative features and full resolution serial section patches, and implementing the virtual reality application. Our VR application is multi-scale in nature, covering two object levels representing different ranges of detail, namely organ level and sub-organ level. In addition, the application includes several data layers, including the measured histology image layer and multiple representations of quantitative features computed from the histology., Results: In our interactive VR application, the user can set visualization properties, select different samples and features, and interact with various objects, which is not possible in the traditional 2D-image view used in digital pathology. In this work, we used whole mouse prostates (organ level) with prostate cancer tumors (sub-organ objects of interest) as example cases, and included quantitative histological features relevant for tumor biology in the VR model., Conclusions: Our application enables a novel way for exploration of high-resolution, multidimensional data for biomedical research purposes, and can also be used in teaching and researcher training. Due to automated processing of the histology data, our application can be easily adopted to visualize other organs and pathologies from various origins., (© 2021. The Author(s).)

Molecular profiling is central in cancer precision medicine but remains costly and is based on tumor average profiles. Morphologic patterns observable in histopathology sections from tumors are determined by the underlying molecular phenotype and therefore have the potential to be exploited for prediction of molecular phenotypes. We report here the first transcriptome-wide expression-morphology (EMO) analysis in breast cancer, where individual deep convolutional neural networks were optimized and validated for prediction of mRNA expression in 17,695 genes from hematoxylin and eosin-stained whole slide images. Predicted expressions in 9,334 (52.75%) genes were significantly associated with RNA sequencing estimates. We also demonstrated successful prediction of an mRNA-based proliferation score with established clinical value. The results were validated in independent internal and external test datasets. Predicted spatial intratumor variabilities in expression were validated through spatial transcriptomics profiling. These results suggest that EMO provides a cost-efficient and scalable approach to predict both tumor average and intratumor spatial expression from histopathology images. SIGNIFICANCE: Transcriptome-wide expression morphology deep learning analysis enables prediction of mRNA expression and proliferation markers from routine histopathology whole slide images in breast cancer., (©2021 The Authors; Published by the American Association for Cancer Research.)

Prostate cancer is a common cancer type in men, yet some of its traits are still under-explored. One reason for this is high molecular and morphological heterogeneity. The purpose of this study was to develop a method to gain new insights into the connection between morphological changes and underlying molecular patterns. We used artificial intelligence (AI) to analyze the morphology of seven hematoxylin and eosin (H&E)-stained prostatectomy slides from a patient with multi-focal prostate cancer. We also paired the slides with spatially resolved expression for thousands of genes obtained by a novel spatial transcriptomics (ST) technique. As both spaces are highly dimensional, we focused on dimensionality reduction before seeking associations between them. Consequently, we extracted morphological features from H&E images using an ensemble of pre-trained convolutional neural networks and proposed a workflow for dimensionality reduction. To summarize the ST data into genetic profiles, we used a previously proposed factor analysis. We found that the regions were automatically defined, outlined by unsupervised clustering, associated with independent manual annotations, in some cases, finding further relevant subdivisions. The morphological patterns were also correlated with molecular profiles and could predict the spatial variation of individual genes. This novel approach enables flexible unsupervised studies relating morphological and genetic heterogeneity using AI to be carried out.

Diagnosis and Gleason grading of prostate cancer in biopsies are critical for the clinical management of men with prostate cancer. Despite this, the high grading variability among pathologists leads to the potential for under- and overtreatment. Artificial intelligence (AI) systems have shown promise in assisting pathologists to perform Gleason grading, which could help address this problem. In this mini-review, we highlight studies reporting on the development of AI systems for cancer detection and Gleason grading, and discuss the progress needed for widespread clinical implementation, as well as anticipated future developments. PATIENT SUMMARY: This mini-review summarizes the evidence relating to the validation of artificial intelligence (AI)-assisted cancer detection and Gleason grading of prostate cancer in biopsies, and highlights the remaining steps required prior to its widespread clinical implementation. We found that, although there is strong evidence to show that AI is able to perform Gleason grading on par with experienced uropathologists, more work is needed to ensure the accuracy of results from AI systems in diverse settings across different patient populations, digitization platforms, and pathology laboratories., (Copyright © 2021 The Authors. Published by Elsevier B.V. All rights reserved.)

Numerous studies have shown a correlation between perineural invasion (PNI) in prostate biopsies and outcome. The reporting of PNI varies widely in the literature. While the interobserver variability of prostate cancer grading has been studied extensively, less is known regarding the reproducibility of PNI. A total of 212 biopsy cores from a population-based screening trial were included in this study (106 with and 106 without PNI according to the original pathology reports). The glass slides were scanned and circulated among four pathologists with a special interest in urological pathology for assessment of PNI. Discordant cases were stained by immunohistochemistry for S-100 protein. PNI was diagnosed by all four observers in 34.0% of cases, while 41.5% were considered to be negative for PNI. In 24.5% of cases, there was a disagreement between the observers. The kappa for interobserver variability was 0.67-0.75 (mean 0.73). The observations from one participant were compared with data from the original reports, and a kappa for intraobserver variability of 0.87 was achieved. Based on immunohistochemical findings among discordant cases, 88.6% had PNI while 11.4% did not. The most common diagnostic pitfall was the presence of bundles of stroma or smooth muscle. It was noted in a few cases that collagenous micronodules could be mistaken for a nerve. The distance between cancer and nerve was another cause of disagreement. Although the results suggest that the reproducibility of PNI may be greater than that of prostate cancer grading, there is still a need for improvement and standardization.

The International Society of Urological Pathology (ISUP) hosts a reference image database supervised by experts with the purpose of establishing an international standard in prostate cancer grading. Here, we aimed to identify areas of grading difficulties and compare the results with those obtained from an artificial intelligence system trained in grading. In a series of 87 needle biopsies of cancers selected to include problematic cases, experts failed to reach a 2/3 consensus in 41.4% (36/87). Among consensus and non-consensus cases, the weighted kappa was 0.77 (range 0.68-0.84) and 0.50 (range 0.40-0.57), respectively. Among the non-consensus cases, four main causes of disagreement were identified: the distinction between Gleason score 3 + 3 with tangential cutting artifacts vs. Gleason score 3 + 4 with poorly formed or fused glands (13 cases), Gleason score 3 + 4 vs. 4 + 3 (7 cases), Gleason score 4 + 3 vs. 4 + 4 (8 cases) and the identification of a small component of Gleason pattern 5 (6 cases). The AI system obtained a weighted kappa value of 0.53 among the non-consensus cases, placing it as the observer with the sixth best reproducibility out of a total of 24. AI may serve as a decision support and decrease inter-observer variability by its ability to make consistent decisions. The grading of these cancer patterns that best predicts outcome and guides treatment warrants further clinical and genetic studies. Results of such investigations should be used to improve calibration of AI systems.

Automatic Non-rigid Histological Image Registration (ANHIR) challenge was organized to compare the performance of image registration algorithms on several kinds of microscopy histology images in a fair and independent manner. We have assembled 8 datasets, containing 355 images with 18 different stains, resulting in 481 image pairs to be registered. Registration accuracy was evaluated using manually placed landmarks. In total, 256 teams registered for the challenge, 10 submitted the results, and 6 participated in the workshop. Here, we present the results of 7 well-performing methods from the challenge together with 6 well-known existing methods. The best methods used coarse but robust initial alignment, followed by non-rigid registration, used multiresolution, and were carefully tuned for the data at hand. They outperformed off-the-shelf methods, mostly by being more robust. The best methods could successfully register over 98% of all landmarks and their mean landmark registration accuracy (TRE) was 0.44% of the image diagonal. The challenge remains open to submissions and all images are available for download.

Background: An increasing volume of prostate biopsies and a worldwide shortage of urological pathologists puts a strain on pathology departments. Additionally, the high intra-observer and inter-observer variability in grading can result in overtreatment and undertreatment of prostate cancer. To alleviate these problems, we aimed to develop an artificial intelligence (AI) system with clinically acceptable accuracy for prostate cancer detection, localisation, and Gleason grading., Methods: We digitised 6682 slides from needle core biopsies from 976 randomly selected participants aged 50-69 in the Swedish prospective and population-based STHLM3 diagnostic study done between May 28, 2012, and Dec 30, 2014 (ISRCTN84445406), and another 271 from 93 men from outside the study. The resulting images were used to train deep neural networks for assessment of prostate biopsies. The networks were evaluated by predicting the presence, extent, and Gleason grade of malignant tissue for an independent test dataset comprising 1631 biopsies from 246 men from STHLM3 and an external validation dataset of 330 biopsies from 73 men. We also evaluated grading performance on 87 biopsies individually graded by 23 experienced urological pathologists from the International Society of Urological Pathology. We assessed discriminatory performance by receiver operating characteristics and tumour extent predictions by correlating predicted cancer length against measurements by the reporting pathologist. We quantified the concordance between grades assigned by the AI system and the expert urological pathologists using Cohen's kappa., Findings: The AI achieved an area under the receiver operating characteristics curve of 0·997 (95% CI 0·994-0·999) for distinguishing between benign (n=910) and malignant (n=721) biopsy cores on the independent test dataset and 0·986 (0·972-0·996) on the external validation dataset (benign n=108, malignant n=222). The correlation between cancer length predicted by the AI and assigned by the reporting pathologist was 0·96 (95% CI 0·95-0·97) for the independent test dataset and 0·87 (0·84-0·90) for the external validation dataset. For assigning Gleason grades, the AI achieved a mean pairwise kappa of 0·62, which was within the range of the corresponding values for the expert pathologists (0·60-0·73)., Interpretation: An AI system can be trained to detect and grade cancer in prostate needle biopsy samples at a ranking comparable to that of international experts in prostate pathology. Clinical application could reduce pathology workload by reducing the assessment of benign biopsies and by automating the task of measuring cancer length in positive biopsy cores. An AI system with expert-level grading performance might contribute a second opinion, aid in standardising grading, and provide pathology expertise in parts of the world where it does not exist., Funding: Swedish Research Council, Swedish Cancer Society, Swedish eScience Research Center, EIT Health., (Copyright © 2020 Elsevier Ltd. All rights reserved.)

Competing Interests: Competing interestsThe authors declare no competing interests.

3D printing has emerged as a popular technology in various biomedical applications. Physical models of anatomical structures concretize the digital representations and can be used for teaching and analysis. In this study we combine 3D histology with 3D printing, creating realistic physical models of tissues with hotspots of interest. As an example we use mouse prostates containing tumors. Surface meshes are created from binary masks of HE-stained serial sections of mouse prostates and manually annotated tumor areas. Sections are interpolated to expand sparse image stacks for smoother results. Fiji, Meshlab and Tinkercad are used for mesh creation and processing. Objects are printed with Prusa-based dual-extruder printer enabling different colors for tumors and the surrounding prostate tissue. Our 3D-printed mouse prostates appear realistic and tumors located at the edges of the organ are clearly visible. When transparent filament is used, the tumor hotspots are visible even when they are inside the prostate.

Artificial intelligence, deep convolutional neural networks, and deep learning are all niche terms that are increasingly appearing in scientific presentations as well as in the general media. In this review, we focus on deep learning and how it is applied to microscopy image data of cells and tissue samples. Starting with an analogy to neuroscience, we aim to give the reader an overview of the key concepts of neural networks, and an understanding of how deep learning differs from more classical approaches for extracting information from image data. We aim to increase the understanding of these methods, while highlighting considerations regarding input data requirements, computational resources, challenges, and limitations. We do not provide a full manual for applying these methods to your own data, but rather review previously published articles on deep learning in image cytometry, and guide the readers toward further reading on specific networks and methods, including new methods not yet applied to cytometry data. © 2018 The Authors. Cytometry Part A published by Wiley Periodicals, Inc. on behalf of International Society for Advancement of Cytometry., (© 2018 The Authors. Cytometry Part A published by Wiley Periodicals, Inc. on behalf of International Society for Advancement of Cytometry.)

Adipose tissue is an attractive stem cell source for soft and bone tissue engineering applications and stem cell therapies. The adipose-derived stromal/stem cells (ASCs) have a multilineage differentiation capacity that is regulated through extracellular signals. The cellular events related to cell adhesion and cytoskeleton have been suggested as central regulators of differentiation fate decision. However, the detailed knowledge of these molecular mechanisms in human ASCs remains limited. This study examined the significance of focal adhesion kinase (FAK), Rho-Rho-associated protein kinase (Rho-ROCK), and their downstream target extracellular signal-regulated kinase 1/2 (ERK1/2) on hASCs differentiation towards osteoblasts and adipocytes. Analyses of osteogenic markers RUNX2A , alkaline phosphatase, and matrix mineralization revealed an essential role of active FAK, ROCK, and ERK1/2 signaling for the osteogenesis of hASCs. Inhibition of these kinases with specific small molecule inhibitors diminished osteogenesis, while inhibition of FAK and ROCK activity led to elevation of adipogenic marker genes AP2 and LEP and lipid accumulation implicating adipogenesis. This denotes to a switch-like function of FAK and ROCK signaling in the osteogenic and adipogenic fates of hASCs. On the contrary, inhibition of ERK1/2 kinase activity deceased adipogenic differentiation, indicating that activation of ERK signaling is required for both adipogenic and osteogenic potential. Our findings highlight the reciprocal role of cell adhesion mechanisms and actin dynamics in regulation of hASC lineage commitment. This study enhances the knowledge of molecular mechanisms dictating hASC differentiation and thus opens possibilities for more efficient control of hASC differentiation.

Motivation: Digital pathology enables new approaches that expand beyond storage, visualization or analysis of histological samples in digital format. One novel opportunity is 3D histology, where a three-dimensional reconstruction of the sample is formed computationally based on serial tissue sections. This allows examining tissue architecture in 3D, for example, for diagnostic purposes. Importantly, 3D histology enables joint mapping of cellular morphology with spatially resolved omics data in the true 3D context of the tissue at microscopic resolution. Several algorithms have been proposed for the reconstruction task, but a quantitative comparison of their accuracy is lacking., Results: We developed a benchmarking framework to evaluate the accuracy of several free and commercial 3D reconstruction methods using two whole slide image datasets. The results provide a solid basis for further development and application of 3D histology algorithms and indicate that methods capable of compensating for local tissue deformation are superior to simpler approaches., Availability and Implementation: Code: https://github.com/BioimageInformaticsTampere/RegBenchmark. Whole slide image datasets: http://urn.fi/urn: nbn: fi: csc-kata20170705131652639702., Supplementary Information: Supplementary data are available at Bioinformatics online.

Importance: Application of deep learning algorithms to whole-slide pathology images can potentially improve diagnostic accuracy and efficiency., Objective: Assess the performance of automated deep learning algorithms at detecting metastases in hematoxylin and eosin-stained tissue sections of lymph nodes of women with breast cancer and compare it with pathologists' diagnoses in a diagnostic setting., Design, Setting, and Participants: Researcher challenge competition (CAMELYON16) to develop automated solutions for detecting lymph node metastases (November 2015-November 2016). A training data set of whole-slide images from 2 centers in the Netherlands with (n = 110) and without (n = 160) nodal metastases verified by immunohistochemical staining were provided to challenge participants to build algorithms. Algorithm performance was evaluated in an independent test set of 129 whole-slide images (49 with and 80 without metastases). The same test set of corresponding glass slides was also evaluated by a panel of 11 pathologists with time constraint (WTC) from the Netherlands to ascertain likelihood of nodal metastases for each slide in a flexible 2-hour session, simulating routine pathology workflow, and by 1 pathologist without time constraint (WOTC)., Exposures: Deep learning algorithms submitted as part of a challenge competition or pathologist interpretation., Main Outcomes and Measures: The presence of specific metastatic foci and the absence vs presence of lymph node metastasis in a slide or image using receiver operating characteristic curve analysis. The 11 pathologists participating in the simulation exercise rated their diagnostic confidence as definitely normal, probably normal, equivocal, probably tumor, or definitely tumor., Results: The area under the receiver operating characteristic curve (AUC) for the algorithms ranged from 0.556 to 0.994. The top-performing algorithm achieved a lesion-level, true-positive fraction comparable with that of the pathologist WOTC (72.4% [95% CI, 64.3%-80.4%]) at a mean of 0.0125 false-positives per normal whole-slide image. For the whole-slide image classification task, the best algorithm (AUC, 0.994 [95% CI, 0.983-0.999]) performed significantly better than the pathologists WTC in a diagnostic simulation (mean AUC, 0.810 [range, 0.738-0.884]; P < .001). The top 5 algorithms had a mean AUC that was comparable with the pathologist interpreting the slides in the absence of time constraints (mean AUC, 0.960 [range, 0.923-0.994] for the top 5 algorithms vs 0.966 [95% CI, 0.927-0.998] for the pathologist WOTC)., Conclusions and Relevance: In the setting of a challenge competition, some deep learning algorithms achieved better diagnostic performance than a panel of 11 pathologists participating in a simulation exercise designed to mimic routine pathology workflow; algorithm performance was comparable with an expert pathologist interpreting whole-slide images without time constraints. Whether this approach has clinical utility will require evaluation in a clinical setting.

Polydimethylsiloxane (PDMS) is widely used in dynamic biological microfluidic applications. As a highly hydrophobic material, native PDMS does not support cell attachment and culture, especially in dynamic conditions. Previous covalent coating methods use glutaraldehyde (GA) which, however, is cytotoxic. This paper introduces a novel and simple method for binding collagen type I covalently on PDMS using ascorbic acid (AA) as a cross-linker instead of GA. We compare the novel method against physisorption and GA cross-linker-based methods. The coatings are characterized by immunostaining, contact angle measurement, atomic force microscopy and infrared spectroscopy, and evaluated in static and stretched human adipose stem cell (hASC) cultures up to 13 days. We found that AA can replace GA as a cross-linker in the covalent coating method and that the coating is durable after sonication and after 6 days of stretching. Furthermore, we show that hASCs attach and proliferate better on AA cross-linked samples compared with physisorbed or GA-based methods. Thus, in this paper, we provide a new PDMS coating method for studying cells, such as hASCs, in static and dynamic conditions. The proposed method is an important step in the development of PDMS-based devices in cell and tissue engineering applications., (© 2017 The Author(s).)

Digital pathology has led to a demand for automated detection of regions of interest, such as cancerous tissue, from scanned whole slide images. With accurate methods using image analysis and machine learning, significant speed-up, and savings in costs through increased throughput in histological assessment could be achieved. This article describes a machine learning approach for detection of cancerous tissue from scanned whole slide images. Our method is based on feature engineering and supervised learning with a random forest model. The features extracted from the whole slide images include several local descriptors related to image texture, spatial structure, and distribution of nuclei. The method was evaluated in breast cancer metastasis detection from lymph node samples. Our results show that the method detects metastatic areas with high accuracy (AUC = 0.97-0.98 for tumor detection within whole image area, AUC = 0.84-0.91 for tumor vs. normal tissue detection) and that the method generalizes well for images from more than one laboratory. Further, the method outputs an interpretable classification model, enabling the linking of individual features to differences between tissue types. © 2017 International Society for Advancement of Cytometry., (© 2017 International Society for Advancement of Cytometry.)

Cancer involves histological changes in tissue, which is of primary importance in pathological diagnosis and research. Automated histological analysis requires ability to computationally separate pathological alterations from normal tissue with all its variables. On the other hand, understanding connections between genetic alterations and histological attributes requires development of enhanced analysis methods suitable also for small sample sizes. Here, we set out to develop computational methods for early detection and distinction of prostate cancer-related pathological alterations. We use analysis of features from HE stained histological images of normal mouse prostate epithelium, distinguishing the descriptors for variability between ventral, lateral, and dorsal lobes. In addition, we use two common prostate cancer models, Hi-Myc and Pten+/- mice, to build a feature-based machine learning model separating the early pathological lesions provoked by these genetic alterations. This work offers a set of computational methods for separation of early neoplastic lesions in the prostates of model mice, and provides proof-of-principle for linking specific tumor genotypes to quantitative histological characteristics. The results obtained show that separation between different spatial locations within the organ, as well as classification between histologies linked to different genetic backgrounds, can be performed with very high specificity and sensitivity.

Background: Orientation and the degree of isotropy are important in many biological systems such as the sarcomeres of cardiomyocytes and other fibrillar structures of the cytoskeleton. Image based analysis of such structures is often limited to qualitative evaluation by human experts, hampering the throughput, repeatability and reliability of the analyses. Software tools are not readily available for this purpose and the existing methods typically rely at least partly on manual operation., Results: We developed CytoSpectre, an automated tool based on spectral analysis, allowing the quantification of orientation and also size distributions of structures in microscopy images. CytoSpectre utilizes the Fourier transform to estimate the power spectrum of an image and based on the spectrum, computes parameter values describing, among others, the mean orientation, isotropy and size of target structures. The analysis can be further tuned to focus on targets of particular size at cellular or subcellular scales. The software can be operated via a graphical user interface without any programming expertise. We analyzed the performance of CytoSpectre by extensive simulations using artificial images, by benchmarking against FibrilTool and by comparisons with manual measurements performed for real images by a panel of human experts. The software was found to be tolerant against noise and blurring and superior to FibrilTool when analyzing realistic targets with degraded image quality. The analysis of real images indicated general good agreement between computational and manual results while also revealing notable expert-to-expert variation. Moreover, the experiment showed that CytoSpectre can handle images obtained of different cell types using different microscopy techniques. Finally, we studied the effect of mechanical stretching on cardiomyocytes to demonstrate the software in an actual experiment and observed changes in cellular orientation in response to stretching., Conclusions: CytoSpectre, a versatile, easy-to-use software tool for spectral analysis of microscopy images was developed. The tool is compatible with most 2D images and can be used to analyze targets at different scales. We expect the tool to be useful in diverse applications dealing with structures whose orientation and size distributions are of interest. While designed for the biological field, the software could also be useful in non-biological applications.

Castration-resistant prostate cancers (CRPC) that arise after the failure of androgen-blocking therapies cause most of the deaths from prostate cancer, intensifying the need to fully understand CRPC pathophysiology. In this study, we characterized the transcriptomic differences between untreated prostate cancer and locally recurrent CRPC. Here, we report the identification of 145 previously unannotated intergenic long noncoding RNA transcripts (lncRNA) or isoforms that are associated with prostate cancer or CRPC. Of the one third of these transcripts that were specific for CRPC, we defined a novel lncRNA termed PCAT5 as a regulatory target for the transcription factor ERG, which is activated in approximately 50% of human prostate cancer. Genome-wide expression analysis of a PCAT5-positive prostate cancer after PCAT5 silencing highlighted alterations in cell proliferation pathways. Strikingly, an in vitro validation of these alterations revealed a complex integrated phenotype affecting cell growth, migration, invasion, colony-forming potential, and apoptosis. Our findings reveal a key molecular determinant of differences between prostate cancer and CRPC at the level of the transcriptome. Furthermore, they establish PCAT5 as a novel oncogenic lncRNA in ERG-positive prostate cancers, with implications for defining CRPC biomarkers and new therapeutic interventions., (©2015 American Association for Cancer Research.)