1. Analytical performance of Envisia: a genomic classifier for usual interstitial pneumonia
- Author
-
Huimin Jiang, Grazyna Fedorowicz, Jennifer Huiras, Cristina Marchisano, Manqiu Cao, Mei G. Wong, Neil M. Barth, Joshua E. Babiarz, Daniel G. Pankratz, Jiayi Lu, P. Sean Walsh, Jing Huang, Zhanzhi Hu, Yoonha Choi, Urooj Imtiaz, Giulia C. Kennedy, Edward Y. Tom, and Jessica R. Anderson
- Subjects
0301 basic medicine ,Pulmonary and Respiratory Medicine ,medicine.medical_specialty ,Pathology ,Biopsy ,Lung biopsy ,Sensitivity and Specificity ,Machine Learning ,03 medical and health sciences ,0302 clinical medicine ,Transbronchial biopsy ,Usual interstitial pneumonia ,Genomic classifier ,Bronchoscopy ,medicine ,Humans ,Medical diagnosis ,Lung ,lcsh:RC705-779 ,Reproducibility ,Envisia ,business.industry ,Sequence Analysis, RNA ,Gene Expression Profiling ,RNA ,High-Throughput Nucleotide Sequencing ,Reproducibility of Results ,lcsh:Diseases of the respiratory system ,Genomics ,respiratory system ,medicine.disease ,genomic DNA ,030104 developmental biology ,030228 respiratory system ,Radiology ,RNA extraction ,Analytical verification ,business ,Lung Diseases, Interstitial ,Classifier (UML) ,Algorithms ,Research Article - Abstract
Background Clinical guidelines specify that diagnosis of interstitial pulmonary fibrosis (IPF) requires identification of usual interstitial pneumonia (UIP) pattern. While UIP can be identified by high resolution CT of the chest, the results are often inconclusive, making surgical lung biopsy necessary to reach a definitive diagnosis (Raghu et al., Am J Respir Crit Care Med 183(6):788–824, 2011). The Envisia genomic classifier differentiates UIP from non-UIP pathology in transbronchial biopsies (TBB), potentially allowing patients to avoid an invasive procedure (Brown et al., Am J Respir Crit Care Med 195:A6792, 2017). To ensure patient safety and efficacy, a laboratory developed test (LDT) must meet strict regulatory requirements for accuracy, reproducibility and robustness. The analytical characteristics of the Envisia test are assessed and reported here. Methods The Envisia test utilizes total RNA extracted from TBB samples to perform Next Generation RNA Sequencing. The gene count data from 190 genes are then input to the Envisia genomic classifier, a machine learning algorithm, to output either a UIP or non-UIP classification result. We characterized the stability of RNA in TBBs during collection and shipment, and evaluated input RNA mass and proportions on the limit of detection of UIP. We evaluated potentially interfering substances such as blood and genomic DNA. Intra-run, inter-run, and inter-laboratory reproducibility of test results were also characterized. Results RNA content within TBBs preserved in RNAprotect is stable for up to 14 days with no detectable change in RNA quality. The Envisia test is tolerant to variation in RNA input (5 to 30 ng), with no impact on classifier results. The Envisia test can tolerate dilution of non-UIP and UIP classification signals at the RNA level by up to 60% and 20%, respectively. Analytical specificity studies utilizing UIP and non-UIP samples mixed with genomic DNA (up to 30% relative input) demonstrated no impact to classifier results. The Envisia test tolerates up to 22% of blood contamination, well beyond the level observed in TBBs. The test is reproducible from RNA extraction through to Envisia test result (standard deviation of 0.20 for Envisia classification scores on > 7-unit scale). Conclusions The Envisia test demonstrates the robust analytical performance required of an LDT. Envisia can be used to inform the diagnoses of patients with suspected IPF. Electronic supplementary material The online version of this article (doi:10.1186/s12890-017-0485-4) contains supplementary material, which is available to authorized users.
- Published
- 2017