Search

Background We demonstrate the feasibility of creating a pair of reference samples to be used as surrogates for clinical samples measured in either a research or clinical laboratory setting. The reference sample paradigm presented and evaluated here is designed to assess the capability of a measurement process to detect true differences between two biological samples. Cell-based reference samples can be created with a biomarker signature pattern designed in silico. Clinical laboratories working in regulated applications are required to participate in proficiency testing programs; research laboratories doing discovery typically do not. These reference samples can be used in proficiency tests or as process controls that allow a laboratory to evaluate and optimize its measurement systems, monitor performance over time (process drift), assess changes in protocols, reagents, and/or personnel, maintain standard operating procedures, and most importantly, provide evidence for quality results. Results The biomarkers of interest in this study are microRNAs (miRNAs), small non-coding RNAs involved in the regulation of gene expression. Multiple lung cancer associated cell lines were determined by reverse transcription (RT)-PCR to have sufficiently different miRNA profiles to serve as components in mixture designs as reference samples. In silico models based on the component profiles were used to predict miRNA abundance ratios between two different cell line mixtures, providing target values for profiles obtained from in vitro mixtures. Two reference sample types were tested: total RNA mixed after extraction from cell lines, and intact cells mixed prior to RNA extraction. MicroRNA profiling of a pair of samples composed of extracted RNA derived from these cell lines successfully replicated the target values. Mixtures of intact cells from these lines also approximated the target values, demonstrating potential utility as mimics for clinical specimens. Both designs demonstrated their utility as reference samples for inter- or intra-laboratory testing. Conclusions Cell-based reference samples can be created for performance assessment of a measurement process from biomolecule extraction through quantitation. Although this study focused on miRNA profiling with RT-PCR using cell lines associated with lung cancer, the paradigm demonstrated here should be extendable to genome-scale platforms and other biomolecular endpoints. Electronic supplementary material The online version of this article (10.1186/s12896-018-0423-4) contains supplementary material, which is available to authorized users.

BackgroundThe potential utility of microRNA as biomarkers for early detection of cancer and other diseases is being investigated with genome-scale profiling of differentially expressed microRNA. Processes for measurement assurance are critical components of genome-scale measurements. Here, we evaluated the utility of a set of total RNA samples, designed with between-sample differences in the relative abundance of miRNAs, as process controls.ResultsThree pure total human RNA samples (brain, liver, and placenta) and two different mixtures of these components were evaluated as measurement assurance control samples on multiple measurement systems at multiple sites and over multiple rounds. In silico modeling of mixtures provided benchmark values for comparison with physical mixtures. Biomarker development laboratories using next-generation sequencing (NGS) or genome-scale hybridization assays participated in the study and returned data from the samples using their routine workflows. Multiplexed and single assay reverse-transcription PCR (RT-PCR) was used to confirm in silico predicted sample differences. Data visualizations and summary metrics for genome-scale miRNA profiling assessment were developed using this dataset, and a range of performance was observed. These metrics have been incorporated into an online data analysis pipeline and provide a convenient dashboard view of results from experiments following the described design. The website also serves as a repository for the accumulation of performance values providing new participants in the project an opportunity to learn what may be achievable with similar measurement processes.ConclusionsThe set of reference samples used in this study provides benchmark values suitable for assessing genome-scale miRNA profiling processes. Incorporation of these metrics into an online resource allows laboratories to periodically evaluate their performance and assess any changes introduced into their measurement process.

Background Circulating microRNAs are undergoing exploratory use as safety biomarkers in drug development. Reverse transcription quantitative polymerase chain reaction (RT-qPCR) is one common approach used to quantitate levels of microRNAs in samples that includes the use of a standard curve of calibrators fit to a regression model. Guidelines are needed for setting assay quantitation thresholds that are appropriate for this method and to biomarker pre-validation. Results In this report, we develop two workflows for determining a lower limit of quantitation (LLOQ) for RT-qPCR assays of microRNAs in exploratory studies. One workflow is based on an error threshold calculated by a logistic model of the calibration curve data. The second workflow is based on a threshold set by the sample blank, which is the no template control for RT-qPCR. The two workflows are used to set lower thresholds of reportable microRNA levels for an example dataset in which miR-208a levels in biofluids are quantitated in a cardiac injury model. LLOQ thresholds set by either workflow are effective in filtering out microRNA values with large uncertainty estimates. Conclusions Two workflows for LLOQ determinations are presented in this report that provide methods that are easy to implement in investigational studies of microRNA safety biomarkers and offer choices in levels of conservatism in setting lower limits of acceptable values that facilitate interpretation of results. Electronic supplementary material The online version of this article (10.1186/s12896-018-0415-4) contains supplementary material, which is available to authorized users.

Background Highly multiplexed assays for quantitation of RNA transcripts are being used in many areas of biology and medicine. Using data generated by these transcriptomic assays requires measurement assurance with appropriate controls. Methods to prototype and evaluate multiple RNA controls were developed as part of the External RNA Controls Consortium (ERCC) assessment process. These approaches included a modified Latin square design to provide a broad dynamic range of relative abundance with known differences between four complex pools of ERCC RNA transcripts spiked into a human liver total RNA background. Results ERCC pools were analyzed on four different microarray platforms: Agilent 1- and 2-color, Illumina bead, and NIAID lab-made spotted microarrays; and two different second-generation sequencing platforms: the Life Technologies 5500xl and the Illumina HiSeq 2500. Individual ERCC controls were assessed for reproducible performance in signal response to concentration among the platforms. Most demonstrated linear behavior if they were not located near one of the extremes of the dynamic range. Performance issues with any individual ERCC transcript could be attributed to detection limitations, platform-specific target probe issues, or potential mixing errors. Collectively, these pools of spike-in RNA controls were evaluated for suitability as surrogates for endogenous transcripts to interrogate the performance of the RNA measurement process of each platform. The controls were useful for establishing the dynamic range of the assay, as well as delineating the useable region of that range where differential expression measurements, expressed as ratios, would be expected to be accurate. Conclusions The modified Latin square design presented here uses a composite testing scheme for the evaluation of multiple performance characteristics: linear performance of individual controls, signal response within dynamic range pools of controls, and ratio detection between pairs of dynamic range pools. This compact design provides an economical sample format for the evaluation of multiple external RNA controls within a single experiment per platform. These results indicate that well-designed pools of RNA controls, spiked into samples, provide measurement assurance for endogenous gene expression studies. Electronic supplementary material The online version of this article (doi:10.1186/s12896-016-0281-x) contains supplementary material, which is available to authorized users.

Universal approaches for assessing the diagnostic performance of microarray assays are essential for the application of microarray technology to clinical and regulatory settings. Reference systems for diagnostic assays in laboratory medicine typically involve the utilization of reference samples, metrics, and reference datasets to ensure that measurements are comparable and true. For microarray performance evaluation and process improvement, reference samples can be composed of mixes of different tissue or cell line RNAs that contain tissue-selective analytes at defined target ratios. The diagnostic accuracy of detected changes in expression, measured as the area under the curve from receiver-operating characteristic plots, can provide a single commutable value for comparing assay specificity and sensitivity. Examples of applying this method for assessing overall performance are provided using public datasets generated on five commercial human whole genome microarray platforms for the MicroArray Quality Control project, a community-wide effort to address issues surrounding microarray data reliability.

We have assessed the utility of RNA titration samples for evaluating microarray platform performance and the impact of different normalization methods on the results obtained. As part of the MicroArray Quality Control project, we investigated the performance of five commercial microarray platforms using two independent RNA samples and two titration mixtures of these samples. Focusing on 12,091 genes common across all platforms, we determined the ability of each platform to detect the correct titration response across the samples. Global deviations from the response predicted by the titration ratios were observed. These differences could be explained by variations in relative amounts of messenger RNA as a fraction of total RNA between the two independent samples. Overall, both the qualitative and quantitative correspondence across platforms was high. In summary, titration samples may be regarded as a valuable tool, not only for assessing microarray platform performance and different analysis methods, but also for determining some underlying biological features of the samples.

Over the last decade, the introduction of microarray technology has had a profound impact on gene expression research. The publication of studies with dissimilar or altogether contradictory results, obtained using different microarray platforms to analyze identical RNA samples, has raised concerns about the reliability of this technology. The MicroArray Quality Control (MAQC) project was initiated to address these concerns, as well as other performance and data analysis issues. Expression data on four titration pools from two distinct reference RNA samples were generated at multiple test sites using a variety of microarray-based and alternative technology platforms. Here we describe the experimental design and probe mapping efforts behind the MAQC project. We show intraplatform consistency across test sites as well as a high level of interplatform concordance in terms of genes identified as differentially expressed. This study provides a resource that represents an important first step toward establishing a framework for the use of microarrays in clinical and regulatory settings.

A significant limitation to the analytical accuracy and precision of dual-labeled spotted cDNA microarrays is the signal error due to dye bias. Transcript-dependent dye bias may be due to gene-specific differences of incorporation of two distinctly different chemical dyes and the resultant differential hybridization efficiencies of these two chemically different targets for the same probe. Several approaches were used to assess and minimize the effects of dye bias on fluorescent hybridization signals and maximize the experimental design efficiency of a cell culture experiment. Dye bias was measured at the individual transcript level within each batch of simultaneously processed arrays by replicate dual-labeled split-control sample hybridizations and accounted for a significant component of fluorescent signal differences. This transcript-dependent dye bias alone could introduce unacceptably high numbers of both false-positive and false-negative signals. We found that within a given set of concurrently processed hybridizations, the bias is remarkably consistent and therefore measurable and correctable. The additional microarrays and reagents required for paired technical replicate dye-swap corrections commonly performed to control for dye bias could be costly to end users. Incorporating split-control microarrays within a set of concurrently processed hybridizations to specifically measure dye bias can eliminate the need for technical dye swap replicates and reduce microarray and reagent costs while maintaining experimental accuracy and technical precision. These data support a practical and more efficient experimental design to measure and mathematically correct for dye bias.

There is a critical need for standard approaches to assess, report, and compare the technical performance of genome-scale differential gene expression experiments. We assess technical performance with a proposed "standard" dashboard of metrics derived from analysis of external spike-in RNA control ratio mixtures. These control ratio mixtures with defined abundance ratios enable assessment of diagnostic performance of differentially expressed transcript lists, limit of detection of ratio (LODR) estimates, and expression ratio variability and measurement bias. The performance metrics suite is applicable to analysis of a typical experiment, and here we also apply these metrics to evaluate technical performance among laboratories. An interlaboratory study using identical samples shared amongst 12 laboratories with three different measurement processes demonstrated generally consistent diagnostic power across 11 laboratories. Ratio measurement variability and bias were also comparable amongst laboratories for the same measurement process. Different biases were observed for measurement processes using different mRNA enrichment protocols., Comment: 65 pages, 6 Main Figures, 33 Supplementary Figures

Pharmacologically active in vivo doses of P-glycoprotein (Pgp) blockers, specifically verapamil, Cremophor EL and PSC833 cause toxicity in addition to that from the concomitantly used cancer chemotherapeutic drugs. It was shown before that these blockers cause different types of toxicities in vivo. We found that these 3 chemically distinct Pgp blockers exert different biophysical effects on the membranes of L1210 MDR cells. They also affect the general metabolism of these cells differently, but all block affinity labeling of Pgp. We could also show that the combination of suboptimal doses of these blockers can restore the uptake of the Pgp substrate rhodamine 123 into L1210MDR, 3T3MDR and KB-VI cells and can reduce the survival rate of these cells when treated in combination with daunorubicin. Our results suggest that the combination of suboptimal doses of these Pgp blockers may be advantageous in clinical practice.

The substrate specificity of the P-glycoprotein (P-170), a multidrug transporter, was studied using N-acylated daunorubicin derivatives and four MDR1 cDNA transfected cell lines. Results showed that N-acetyl-daunorubicin is a substrate, but the longer fatty acid derivatives, N-octanoyl and N-dodecanoyl daunorubicins, are not. This conclusion was reached by flow cytometric drug uptake assay, cell proliferation assays, and confocal microscopy. It was concluded that the longer fatty acid derivatives interact with plasma membranes in a way that affected P-glycoprotein function.

We have found that several dye compounds have the ability to inhibit the binding of HIV rgpl 20 to the Leu3a epitope of CD4 on PBL. One of these compounds, selected for further testing as the best candidate, can inhibit the growth of HIV In vitro. The tested dyes have varying degrees of specificity and efficacy in inhibiting the binding of rgpl 20. These results may point towards compounds that can be useful therapeutics against HIV.

Genome-scale gene expression technologies are increasingly being applied for biological research as a whole and toxicological screening in particular. In order to monitor data quality and process drift, we adopted the use of two rat-tissue mixtures (brain, liver, kidney, and testis) previously introduced as RNA reference samples. These samples were processed every time a microarray experiment was hybridized, thereby verifying the comparability of the resulting expression data for cross-study comparison. This study presents the analysis of 21 technical replicates of these two mixed-tissue samples using Affymetrix RAE230_2 GeneChip over a period of 12 months. The results show that detection sensitivity, measured by the number of present and absent sequences, is robust, and data correlation, indicated by scatter plots, varies little over time. Receiver operating characteristic (ROC) curves show the sensitivity and specificity of the current measurements are consistent with arrays previously classified as well performing. Overall, this paper shows that the inclusion of standard samples during microarray labeling and hybridization experiments is useful to benchmark the performance of microarray experiments over time and allows discovery of any process drift that, if it occurs, may confound the comparison of these datasets.

The biomarkers of interest in this study are microRNA (miRNA), small non-coding RNAs involved in the regulation of gene expression. Currently, over 1000 human miRNAs have been identified. Several laboratories within the Early Detection Research Network are currently profiling miRNA as potential biomarkers. The reference sample paradigm presented and evaluated here is designed to provide measurement assurance in the earliest phases of a cancer biomarker development pipeline. Three commercially available samples of human total RNA (brain, liver, and placenta) were selected for detectable differences in miRNA expression based upon previously reported miRNA microarray experiments. For each round of this study, replicate samples of each tissue were aliquoted, blinded, and distributed to participating laboratories. The samples were then profiled using the standard workflows of each laboratory. This was repeated over multiple rounds of measurement. Raw data were processed in pair-wise comparisons between tissue types. Log2 transformed ratios were calculated for each detectable miRNA. For each of these miRNA ratios, the results among laboratories were compared to the consensus value to provide a measure of concordance and help identify laboratories that might need to make adjustments to their process. Results demonstrated repeatability within labs and reproducibility among labs with respect to direction and magnitude of differential miRNA expression between tissues for a set of miRNAs of interest (MOI). For the first round, 79% of reported results for all log2 ratio combinations and MOI were in agreement with the consensus values. Subsequent rounds demonstrated increased concordance, with 91 and 100% agreement, respectively. The data from the nine “neat” tissue total RNA samples were also used for in silico modeling to predict the values for two complex mixtures based on three components. The two mixture designs provide a pair of reference samples with designed-in reciprocal ratios of 2:1 for brain and placenta, as well as a shared 1:1 liver component. For two brain-selective and two placenta-selective MOI, 91% of reported values were in close agreement with the target values. Overall, measurement results were harmonious for a set of miRNAs of interest measured by all participants, both within rounds and between rounds. The laboratories were also able to demonstrate the ability to resolve the 2-fold differences created with complex mixtures. These results suggest that endogenous miRNAs present within total RNA may be suitable as QA/QC process controls. Citation Format: P. Scott Pine, Lynn R. Sorbara, Sudhir Srivastava, Marc Salit. miRNA reference samples for interlaboratory study. [abstract]. In: Proceedings of the 106th Annual Meeting of the American Association for Cancer Research; 2015 Apr 18-22; Philadelphia, PA. Philadelphia (PA): AACR; Cancer Res 2015;75(15 Suppl):Abstract nr 3967. doi:10.1158/1538-7445.AM2015-3967

Background DNA microarrays, which have been increasingly used to monitor mRNA transcripts at a global level, can provide detailed insight into cellular processes involved in response to drugs and toxins. This is leading to new understandings of signaling networks that operate in the cell, and the molecular basis of diseases. Custom printed oligonucleotide arrays have proven to be an effective way to facilitate the applications of DNA microarray technology. A successful microarray experiment, however, involves many steps: well-designed oligonucleotide probes, printing, RNA extraction and labeling, hybridization, and imaging. Optimization is essential to generate reliable microarray data. Results Hybridization and washing steps are crucial for a successful microarray experiment. By following the hybridization and washing conditions recommended by an oligonucleotide provider, it was found that the expression ratios were compressed greater than expected and data analysis revealed a high degree of non-specific binding. A series of experiments was conducted using rat mixed tissue RNA reference material (MTRRM) and other RNA samples to optimize the hybridization and washing conditions. The optimized hybridization and washing conditions greatly reduced the non-specific binding and improved the accuracy of spot intensity measurements. Conclusion The results from the optimized hybridization and washing conditions greatly improved the reproducibility and accuracy of expression ratios. These experiments also suggested the importance of probe designs using better bioinformatics approaches and the need for common reference RNA samples for platform performance evaluation in order to fulfill the potential of DNA microarray technology.

Within the International Life Sciences Institute Committee on Genomics, a working group was formed to focus on the application of microarray technology to preclinical assessments of drug-induced nephrotoxicity. As part of this effort, Sprague-Dawley rats were treated with the nephrotoxicant cisplatin at doses of 0.3-5 mg/kg over a 4- to 144-hr time course. RNA prepared from these animals was run on a variety of microarray formats at multiple sites. A set of 93 differentially expressed genes associated with cisplatin-induced renal injury was identified on the National Institute of Environmental Health Sciences (NIEHS) custom cDNA microarray platform using quadruplicate measurements of pooled animal RNA. The reproducibility of this profile of statistically significant gene changes on other platforms, in pooled and individual animal replicate samples, and in an independent study was investigated. A good correlation in response between platforms was found among the 48 genes in the NIEHS data set that could be matched to probes on the Affymetrix RGU34A array by UniGene identifier or sequence alignment. Similar results were obtained with genes that could be linked between the NIEHS and Incyte or PHASE-1 arrays. The degree of renal damage induced by cisplatin in individual animals was commensurate with the number of differentially expressed genes in this data set. These results suggest that gene profiles linked to specific types of tissue injury or mechanisms of toxicity and identified in well-performed replicated microarray experiments may be extrapolatable across platform technologies, laboratories, and in-life studies.

Brief treatment of human peripheral blood lymphocytes with the potential anti-HIV compound aurintricarboxylic acid (ATA) prompts the selective release of already bound L-selectin-specific anti-Leu8 and anti-LAM1-1 antibodies from the cells. Two other anti-LAM1 antibodies, anti-LAM1-3 and anti-LAM1-5 stay antigen-bound at the same time. Interestingly, the ATA-sensitive anti-Leu8 strongly competes with the ATA-resistant anti-LAM1-3 for binding. Photobleaching fluorescence resonance energy transfer (pFRET) measurements on flow-sorted cells suggests that these two antibodies compete for the same epitope, while anti-LAM1-5-FITC and anti-Leu8-PE bind to distinct sites, although they also compete for binding. Combining the data on competition, pFRET and ATA effect, we suggest that the ATA sensitive anti-Leu8 and resistant anti-LAM1-3 bind to overlapping but non-identical epitopes. This remarkably specific effect may be exploited for designing anti-inflammatory drugs that modulate leukocyte adhesion.

Several tannins with anti-HIV activity have been described previously (Nonaka et al., J Nat Prod 53: 587-595, 1990). We have shown that the tannins chebulinic acid and punicalin were able to block the binding of HIV rgp120 to CD4. These compounds were not toxic to stimulated human peripheral blood lymphocytes at concentrations ten times above their maximal effective concentration.

The multidrug-resistant gene (MDR1) encodes an energy-dependent drug efflux pump (P-glycoprotein) for many anti-cancer drugs. We have studied the intracellular distribution of rhodamine 123 (R123), daunorubicin (DN), and doxorubicin (DOX) in cells expressing a human MDR1 gene. The distribution of these fluorescent drugs was measured by laser scanning microscopy and confocal microscopy. We devised a new method for analysis of fluorescence line scan data to determine the intracellular distribution of fluorescent probes. This method and confocal microscopy showed that R123, DN, and DOX are localized to both plasma membrane and intracellular compartments in multidrug-resistant cells. When the cells are treated with verapamil, an inhibitor of the multidrug transporter, the amount of DOX, DN, and R123 associated with the cell rises. After inhibition, the relative distribution of DOX and DN between the cell surface and intracellular structures does not change dramatically. However, R123 tends to relocalize to intracellular sites from predominantly plasma membrane sites, indicating that this dye behaves differently than the anti-cancer drugs. These results show the subcellular distributions of R123, DN, and DOX in plasma membrane, cytoplasm, and intracellular membrane systems, but do not allow definitive distinctions among existing models of how P-glycoprotein affects the distribution of drugs.

Background The interpretability of microarray data can be affected by sample quality. To systematically explore how RNA quality affects microarray assay performance, a set of rat liver RNA samples with a progressive change in RNA integrity was generated by thawing frozen tissue or by ex vivo incubation of fresh tissue over a time course. Results Incubation of tissue at 37°C for several hours had little effect on RNA integrity, but did induce changes in the transcript levels of stress response genes and immune cell markers. In contrast, thawing of tissue led to a rapid loss of RNA integrity. Probe sets identified as most sensitive to RNA degradation tended to be located more than 1000 nucleotides upstream of their transcription termini, similar to the positioning of control probe sets used to assess sample quality on Affymetrix GeneChip® arrays. Samples with RNA integrity numbers less than or equal to 7 showed a significant increase in false positives relative to undegraded liver RNA and a reduction in the detection of true positives among probe sets most sensitive to sample integrity for in silico modeled changes of 1.5-, 2-, and 4-fold. Conclusion Although moderate levels of RNA degradation are tolerated by microarrays with 3'-biased probe selection designs, in this study we identify a threshold beyond which decreased specificity and sensitivity can be observed that closely correlates with average target length. These results highlight the value of annotating microarray data with metrics that capture important aspects of sample quality.

The comparability and reliability of data generated using microarray technology would be enhanced by use of a common set of standards that allow accuracy, reproducibility and dynamic range assessments on multiple formats. We designed and tested a complex biological reagent for performance measurements on three commercial oligonucleotide array formats that differ in probe design and signal measurement methodology. The reagent is a set of two mixtures with different proportions of RNA for each of four rat tissues (brain, liver, kidney and testes). The design provides four known ratio measurements of >200 reference probes, which were chosen for their tissue-selectivity, dynamic range coverage and alignment to the same exemplar transcript sequence across all three platforms. The data generated from testing three biological replicates of the reagent at eight laboratories on three array formats provides a benchmark set for both laboratory and data processing performance assessments. Close agreement with target ratios adjusted for sample complexity was achieved on all platforms and low variance was observed among platforms, replicates and sites. The mixed tissue design produces a reagent with known gene expression changes within a complex sample and can serve as a paradigm for performance standards for microarrays that target other species.

Background Genome-scale “-omics” measurements are challenging to benchmark due to the enormous variety of unique biological molecules involved. Mixtures of previously-characterized samples can be used to benchmark repeatability and reproducibility using component proportions as truth for the measurement. We describe and evaluate experiments characterizing the performance of RNA-sequencing (RNA-Seq) measurements, and discuss cases where mixtures can serve as effective process controls. Results We apply a linear model to total RNA mixture samples in RNA-seq experiments. This model provides a context for performance benchmarking. The parameters of the model fit to experimental results can be evaluated to assess bias and variability of the measurement of a mixture. A linear model describes the behavior of mixture expression measures and provides a context for performance benchmarking. Residuals from fitting the model to experimental data can be used as a metric for evaluating the effect that an individual step in an experimental process has on the linear response function and precision of the underlying measurement while identifying signals affected by interference from other sources. Effective benchmarking requires well-defined mixtures, which for RNA-Seq requires knowledge of the post-enrichment ‘target RNA’ content of the individual total RNA components. We demonstrate and evaluate an experimental method suitable for use in genome-scale process control and lay out a method utilizing spike-in controls to determine enriched RNA content of total RNA in samples. Conclusions Genome-scale process controls can be derived from mixtures. These controls relate prior knowledge of individual components to a complex mixture, allowing assessment of measurement performance. The target RNA fraction accounts for differential selection of RNA out of variable total RNA samples. Spike-in controls can be utilized to measure this relationship between target RNA content and input total RNA. Our mixture analysis method also enables estimation of the proportions of an unknown mixture, even when component-specific markers are not previously known, whenever pure components are measured alongside the mixture. Electronic supplementary material The online version of this article (doi:10.1186/s12864-015-1912-7) contains supplementary material, which is available to authorized users.

Background Molecular biomarkers that are based on mRNA transcripts are being developed for the diagnosis and treatment of a number of diseases. DNA microarrays are one of the primary technologies being used to develop classifiers from gene expression data for clinically relevant outcomes. Microarray assays are highly multiplexed measures of comparative gene expression but have a limited dynamic range of measurement and show compression in fold change detection. To increase the clinical utility of microarrays, assay controls are needed that benchmark performance using metrics that are relevant to the analysis of genomic data generated with biological samples. Results Ratiometric controls were prepared from commercial sources of high quality RNA from human tissues with distinctly different expression profiles and mixed in defined ratios. The samples were processed using six different target labeling protocols and replicate datasets were generated on high density gene expression microarrays. The area under the curve from receiver operating characteristic plots was calculated to measure diagnostic performance. The reliable region of the dynamic range was derived from log2 ratio deviation plots made for each dataset. Small but statistically significant differences in diagnostic performance were observed between standardized assays available from the array manufacturer and alternative methods for target generation. Assay performance using the reliable range of comparative measurement as a metric was improved by adjusting sample hybridization conditions for one commercial kit. Conclusions Process improvement in microarray assay performance was demonstrated using samples prepared from commercially available materials and two metrics - diagnostic performance and the reliable range of measurement. These methods have advantages over approaches that use a limited set of external controls or correlations to reference sets, because they provide benchmark values that can be used by clinical laboratories to help optimize protocol conditions and laboratory proficiency with microarray assays.