Search

ABSTRACT The COVID-19 pandemic has given rise to numerous commercially available antigen rapid diagnostic tests (Ag-RDTs). To generate and to share accurate and independent data with the global community requires multisite prospective diagnostic evaluations of Ag-RDTs. This report describes the clinical evaluation of the OnSite COVID-19 rapid test (CTK Biotech, CA, USA) in Brazil and the United Kingdom. A total of 496 paired nasopharyngeal (NP) swabs were collected from symptomatic health care workers at Hospital das Clínicas in São Paulo, Brazil, and 211 NP swabs were collected from symptomatic participants at a COVID-19 drive-through testing site in Liverpool, United Kingdom. Swabs were analyzed by Ag-RDT, and results were compared to quantitative reverse transcriptase PCR (RT-qPCR). The clinical sensitivity of the OnSite COVID-19 rapid test in Brazil was 90.3% (95% confidence interval [CI], 75.1 to 96.7%) and in the United Kingdom was 75.3% (95% CI, 64.6 to 83.6%). The clinical specificity in Brazil was 99.4% (95% CI, 98.1 to 99.8%) and in the United Kingdom was 95.5% (95% CI, 90.6 to 97.9%). Concurrently, analytical evaluation of the Ag-RDT was assessed using direct culture supernatant of SARS-CoV-2 strains from wild-type (WT), Alpha, Delta, Gamma, and Omicron lineages. This study provides comparative performance of an Ag-RDT across two different settings, geographical areas, and populations. Overall, the OnSite Ag-RDT demonstrated a lower clinical sensitivity than claimed by the manufacturer. The sensitivity and specificity from the Brazil study fulfilled the performance criteria determined by the World Health Organization, but the performance obtained from the UK study failed to do. Further evaluation of Ag-RDTs should include harmonized protocols between laboratories to facilitate comparison between settings. IMPORTANCE Evaluating rapid diagnostic tests in diverse populations is essential to improving diagnostic responses as it gives an indication of the accuracy in real-world scenarios. In the case of rapid diagnostic testing within this pandemic, lateral flow tests that meet the minimum requirements for sensitivity and specificity can play a key role in increasing testing capacity, allowing timely clinical management of those infected, and protecting health care systems. This is particularly valuable in settings where access to the test gold standard is often restricted.

ABSTRACT The COVID-19 pandemic has led to the commercialization of many antigen-based rapid diagnostic tests (Ag-RDTs), requiring independent evaluations. This report describes the clinical evaluation of the Novel Coronavirus 2019-nCoV Antigen Test (Colloidal Gold) (Beijing Hotgen Biotech Co., Ltd.), at two sites within Brazil and one in the United Kingdom. The collected samples (446 nasal swabs from Brazil and 246 nasopharyngeal samples from the UK) were analyzed by the Ag-RDT and compared to reverse transcription-quantitative PCR (RT-qPCR). Analytical evaluation of the Ag-RDT was performed using direct culture supernatants of SARS-CoV-2 strains from the wild-type (B.1), Alpha (B.1.1.7), Delta (B.1.617.2), Gamma (P.1), and Omicron (B.1.1.529) lineages. An overall sensitivity and specificity of 88.2% (95% confidence interval [CI], 81.3 to 93.3) and 100.0% (95% CI, 99.1 to 100.0), respectively, were obtained for the Brazilian and UK cohorts. The analytical limit of detection was determined as 1.0 × 103 PFU/mL (Alpha), 2.5 × 102 PFU/mL (Delta), 2.5 × 103 PFU/mL (Gamma), and 1.0 × 103 PFU/mL (Omicron), giving a viral copy equivalent of approximately 2.1 × 104 copies/mL, 9.0 × 105 copies/mL, 1.7 × 106 copies/mL, and 1.8 × 105 copies/mL for the Ag-RDT, respectively. Overall, while a higher sensitivity was claimed by the manufacturers than that found in this study, this evaluation finds that the Ag-RDT meets the WHO minimum performance requirements for sensitivity and specificity of COVID-19 Ag-RDTs. This study illustrates the comparative performance of the Hotgen Ag-RDT across two global settings and considers the different approaches in evaluation methods. IMPORTANCE Since the beginning of the SARS-CoV-2 pandemic, we have witnessed growing numbers of antigen rapid diagnostic tests (Ag-RDTs) being brought to market. In the United Kingdom, this was somewhat controlled indirectly as the government offered free tests from a small number of companies. However, as this has now ceased, individuals are responsible for their own acquisition of test kits. Similarly in Brazil, as of January 2022, pharmacies and other health care retailers are permitted to sell Ag-RDTs directly to the community. Many of these Ag-RDTs have not been externally evaluated, and results are not readily available to the public. Thus, there is now a need for a transparent evaluation of Ag-RDTs with both analytical and clinical evaluation. We present an independent review of the Novel Coronavirus 2019-nCoV Antigen Test (Colloidal Gold) (Beijing Hotgen Biotech Co., Ltd.), at two sites within Brazil and one in the United Kingdom.

ABSTRACT Access to reverse transcription-PCR (RT-PCR) testing, the gold standard for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) detection, is limited throughout the world, due to restricted resources, available infrastructure, and high costs. Antigen-detecting rapid diagnostic tests (Ag-RDTs) overcome some of these barriers, but independent clinical validations in settings of intended use are scarce. To inform the World Health Organization’s (WHO) emergency use listing (EUL) procedure and ensure affordable, high-quality Ag-RDTs, we assessed the performance and ease of use of the SureStatus for SARS-CoV-2. For this prospective, multicenter diagnostic accuracy study, we recruited unvaccinated participants with presumed SARS-CoV-2 infection in India and Germany from December 2020 to March 2021, when the Alpha (B.1.1.7) variant was predominantly circulating. Paired swabs were performed for (i) routine clinical RT-PCR testing (sampling was either nasopharyngeal [NP] or combined NP and oropharyngeal [NP/OP]) and (ii) Ag-RDT (sampling was NP). Performance of the Ag-RDT was compared to RT-PCR overall and by predefined subgroups, e.g., cycle threshold (CT) value, symptoms, and days from symptom onset. To understand the usability, a system usability scale (SUS) questionnaire and ease-of-use (EoU) assessment were performed. A total of 1,119 participants were included in the analysis, of whom 205 (18.3%) were RT-PCR positive. SureStatus detected 169 out of 205 RT-PCR-positive participants, reporting a sensitivity of 82.4% (95% confidence interval [CI]: 76.6% to 87.1%) and a specificity of 98.5% (95% CI: 97.4% to 99.1%). In the first 7 days post-symptom onset, the sensitivity was 90.7% (95% CI: 83.5% to 94.9%), when CT values were low and viral loads were high. The test was characterized as easy to use (SUS, 85/100) and considered suitable for point-of-care settings, although quality concerns were raised due to visibly contaminated packaging of swabs included in the test kits. The SureStatus diagnostic test can be considered a reliable test during the first week of SARS-CoV-2 infection, with high sensitivity in combination with excellent usability. IMPORTANCE Our manufacturer-independent, prospective diagnostic accuracy study assessed clinical performance in participants presumed to have a SARS-CoV-2 infection at three study sites in two countries. We assessed the accuracy overall and in predefined subgroups (CT values and symptom duration). SureStatus performed with high sensitivity. Its sensitivity was particularly high in the first 3 days after symptom onset and when CT values were low (i.e., the viral load was high). The system usability and ease-of-use assessment complements the accuracy assessment of the test and highlights critical factors to facilitate the widespread use of SureStatus in point-of-care settings. The high sensitivity demonstrated by the evaluated Ag-RDT within the first days of symptoms, when most transmission occurs, supports the role of Ag-RDTs for public health-relevant screening. Evidence from this study was used to inform the World Health Organization Emergency Use Listing procedure.

ABSTRACT The emergence of each novel SARS-CoV-2 variant of concern (VOC) requires investigation of its potential impact on the performance of diagnostic tests in use, including antigen-detecting rapid diagnostic tests (Ag-RDTs). Although anecdotal reports have been circulating that the newly emerged Omicron-BA.1 variant is in principle detectable by Ag-RDTs, few data on sensitivity are available. We have performed (i) analytical sensitivity testing with cultured virus in eight Ag-RDTs and (ii) retrospective testing in duplicates with clinical samples from vaccinated individuals with Omicron-BA.1 (n = 59) or Delta (n = 54) breakthrough infection on seven Ag-RDTs. Overall, in our analytical study we have found heterogenicity between Ag-RDTs for detecting Omicron-BA.1. When using cultured virus, we observed a trend toward lower endpoint sensitivity for Omicron-BA.1 detection than for earlier circulating SARS-CoV-2 and the other VOCs. In our retrospective study, the detection of Delta and Omicron-BA.1 was assessed in a comparable set of stored clinical samples using seven Ag-RDTs. Four hundred ninety-seven of all 826 tests (60.17%) performed on Omicron-BA.1 samples were positive, compared to 489/756 (64.68%) for Delta samples. In the analytical study, the sensitivity for both Omicron-BA.1 and Delta between the Ag-RDTs was variable. All seven Ag-RDTs showed comparable sensitivities to detect Omicron-BA.1 and Delta in the retrospective study. IMPORTANCE Sensitivity for detecting Omicron-BA.1 shows high heterogenicity between Ag-RDTs, necessitating a careful consideration when using these tests to guide infection prevention measures. Analytical and retrospective testing is a proxy and timely solution to generate rapid performance data, but it is not a replacement for clinical evaluations, which are urgently needed. Biological and technical reasons for detection failure by some Ag-RDTs need to be further investigated.