Performance characteristics of five antigen-detecting rapid diagnostic test (Ag-RDT) for SARS-CoV-2 asymptomatic infection: a head-to-head benchmark comparison

Background Mass testing for early identification and isolation of infectious COVID-19 individuals, irrespective of concurrent symptoms, is an efficacious strategy to reduce disease transmission. Antigen-detecting rapid diagnostic tests (Ag-RDT) appear as a potentially suitable tool for mass testing on account of their ease-of-use, fast turnaround time, and low cost. However, benchmark comparisons are scarce, particularly in the context of unexposed asymptomatic individuals. Methods We used nasopharyngeal specimens from unexposed asymptomatic individuals to assess five Ag-RDTs: PanBio™ COVID-19 Ag Rapid test (Abbott), CLINITEST® Rapid COVID-19 Antigen Test (Siemens), SARS-CoV-2 Rapid Antigen Test (Roche Diagnostics), SARS-CoV-2 Antigen Rapid Test Kit (Lepu Medical), and COVID-19 Coronavirus Rapid Antigen Test Cassette (Surescreen). Samples were collected between December 2020-January 2021 during the third wave of the epidemic in Spain. Findings The analysis included 101 specimens with confirmed positive PCR results and 185 with negative PCR. For the overall sample, the performance parameters of Ag-RDTs were as follows: Abbott assay, sensitivity 38·6% (95% CI 29·1–48·8) and specificity 99·5% (97–100%); Siemens, sensitivity 51·5% (41·3–61·6) and specificity 98·4% (95·3–99·6); Roche, sensitivity 43·6% (33·7–53·8) and specificity 96·2% (92·4–98·5); Lepu, sensitivity 45·5% (35·6–55·8) and specificity 89·2% (83·8–93·3%); Surescreen, sensitivity 28·8% (20·2–38·6) and specificity 97·8% (94·5–99·4%). For specimens with cycle threshold (Ct) <30 in RT-qPCR, all Ag-RDT achieved a sensitivity of at least 70%, with Siemens, Roche, and Lepu assays showing sensitivities higher than 80%. In models according to population prevalence, all Ag-RDTs will have a NPV >99% and a PPV<50% at 1% prevalence. Interpretation Two commercial, widely available assays can be used for SARS-CoV-2 antigen testing to achieve sensitivity in specimens with a Ct<30 and specificity of at least 80% and 96%, respectively. Estimated negative and positive predictive values suggests the suitability of Ag-RDTs for mass screenings of SARS-CoV-2 infection in the general population. Funding Blueberry diagnostics, Fundació Institut d’Investigació en Ciències de la Salut Germans Trias i Pujol, and #YoMeCorono.org crowdfunding campaign. Evidence before this study In December 2020, we searched on PubMed for articles containing the terms “antigen”, “test” (or Ag-RDT), and “SARS-CoV-2” or “COVID-19” either in the title or the abstract. Our search yielded 79 entries corresponding to articles written in English. Of them, 33 were articles presenting the diagnostic performance of qualitative lateral-flow antigen-detecting rapid diagnostic tests (Ag-RDT). Four of these articles reported the results of head-to-head comparisons of various Ag-RDTs; in all cases, the number of tests was lower than the recommended for retrospective assessments of diagnostic performance (i.e., minimum of 100 PCR positive and 100 PCR negative). Furthermore, all head-to-head comparisons found in the literature included specimens obtained among individuals with varying disease status (none of which asymptomatic), thus limiting the adequacy of the estimates for an asymptomatic screening strategy. Added value of this study We compared for the first time head-to-head five Ag-RDT using a powered set of fresh respiratory specimens PCR-confirmed positive or negative, collected from unexposed asymptomatic individuals during screening campaigns for early detection of SARS-CoV-2 infection. The sample size was large enough to draw robust conclusions. Our analysis identified four Ag-RDTs (i.e., assays marketed by Abbott, Siemens, Roche, and Surescreen) with specificity higher than 96%. Despite the low sensitivity for the overall sample (range 29% to 51%), the corresponding values for the subset of samples with Ct <30 were higher than 80% for Siemens, Roche, and Lepu assays. The estimated NPV for a screening performed in an area with 1% prevalence would be >99% for all tests, while the PPV would be <50%. Implications of all the available evidence Current data on the diagnostic performance of Ag-RDTs is heterogeneous and precludes benchmark assessments. Furthermore, the screening of asymptomatic populations is currently not considered among the intended uses of Ag-RDT, mostly because of lack of evidence on test performance in samples from unexposed asymptomatic individuals. Our findings add to the current evidence in two ways: first, we provide benchmarking data on Ag-RDTs, assessed head-to-head in a single set of respiratory specimens; second, we provide data on the diagnostic performance of Ag-RDTs in unexposed asymptomatic individuals. Our findings support the idea that Ag-RDTs can be used for mass screening in low prevalence settings and accurately rule out a highly infectious case in such setting.

The first wave of the Spanish COVID-19 epidemic was associated with early introductions and fast spread of a dominating genetic variant

The COVID-19 pandemic has shaken the world since the beginning of 2020. Spain is among the European countries with the highest incidence of the disease during the first pandemic wave. We established a multidisciplinar consortium to monitor and study the evolution of the epidemic, with the aim of contributing to decision making and stopping rapid spreading across the country. We present the results for 2170 sequences from the first wave of the SARS-Cov-2 epidemic in Spain and representing 12% of diagnosed cases until 14th March. This effort allows us to document at least 500 initial introductions, between early February-March from multiple international sources. Importantly, we document the early raise of two dominant genetic variants in Spain (Spanish Epidemic Clades), named SEC7 and SEC8, likely amplified by superspreading events. In sharp contrast to other non-Asian countries those two variants were closely related to the initial variants of SARS-CoV-2 described in Asia and represented 40% of the genome sequences analyzed. The two dominant SECs were widely spread across the country compared to other genetic variants with SEC8 reaching a 60% prevalence just before the lockdown. Employing Bayesian phylodynamic analysis, we inferred a reduction in the effective reproductive number of these two SECs from around 2.5 to below 0.5 after the implementation of strict public-health interventions in mid March. The effects of lockdown on the genetic variants of the virus are reflected in the general replacement of preexisting SECs by a new variant at the beginning of the summer season. Our results reveal a significant difference in the genetic makeup of the epidemic in Spain and support the effectiveness of lockdown measures in controlling virus spread even for the most successful genetic variants. Finally, earlier control of SEC7 and particularly SEC8 might have reduced the incidence and impact of COVID-19 in our country.