External quality assessment to support the WHO ProSPeRo study for the evaluation of two dual HIV/syphilis point-of-care tests in seven countries.

BACKGROUND: Sexually transmitted infections (STIs) such as syphilis and HIV remain to be a significant public health issue worldwide. Dual rapid point-of-care tests (POCTs) have shown promise for detecting antibodies to HIV and syphilis but have not been fully evaluated in the field. Our study supported the WHO ProSPeRo study on Sexually Transmitted Infection Point-of-Care Testing (STI POCT) by providing external quality assessment (EQA) for HIV and syphilis testing in reference laboratories and their associated clinical sites in seven countries. METHODS: HIV/syphilis serum liquid and dried tube specimen (DTS) panels were prepared by CDC. Liquid panels were distributed to the reference laboratories for three rounds of testing using commercially and locally available laboratory-based serological tests. DTS panels were sent to the clinical testing sites for 8 rounds of POC testing using the Abbott SD BIOLINE HIV/Syphilis Duo test (hereafter referred to as SD BIOLINE) and the Chembio Dual Path Platform (DPP) HIV-Syphilis assay. EQA panels were tested at CDC using the Rapid Plasma Reagin (RPR) test and the Treponema pallidum Particle Agglutination assay (TP-PA) for syphilis antibodies. Genetic Systems HIV-1/HIV-2 Plus O EIA, Geenius HIV Supplemental Assay and the Oraquick Advance HIV test were used to detect HIV antibodies in the EQA panels. Results from the reference laboratories and POCT sites were compared to those obtained at the CDC and a percentage agreement was calculated. RESULTS: Qualitative RPR and TP-PA performed at the reference laboratories demonstrated 95.4-100% agreement with CDC results while quantitative RPR and TP-PA tests demonstrated 87.7% and 89.2% agreement, respectively. A 93.8% concordance rate was observed for qualitative HIV testing in laboratories. EQA testing at clinical sites using dual tests showed 98.7% and 99.1% agreement for detection of HIV antibodies and eight out of 10 sites had > 95.8% agreement for syphilis testing. However, two clinical sites showed only 65.0-66.7% agreement for SD BIOLINE and 84.0-86.7% for DPP, respectively, for syphilis testing. CONCLUSIONS: Overall, laboratories demonstrated high EQA performance in this study. Both HIV/syphilis POCTs gave expected results in the clinic-based evaluations using DTS. However, testing errors were identified in a few testing sites suggesting the necessity for continuous training and monitoring the quality of POC testing.

Evaluation of Three Automated Nontreponemal Rapid Plasma Reagin (RPR) Tests for the Laboratory Diagnosis of Syphilis.

Automated nontreponemal rapid plasma reagin (RPR) tests were recently introduced in the United States for syphilis testing and limited performance data are available. In collaboration with the Association of Public Health Laboratories, three public health laboratories (PHL) were chosen through a competitive selection process to evaluate the performance of three FDA-cleared automated RPR test systems: BioPlex 2200 Syphilis Total & RPR assay (Bio-Rad Laboratories), AIX 1000 (Gold Standard Diagnostics), and ASI Evolution (Arlington Scientific). Panels prepared at the CDC included: a qualitative panel comprised of 734 syphilis reactive/nonreactive sera; a quantitative panel of 50 syphilis reactive sera (RPR titer 1:64 to 1:1,024); and a reproducibility panel of 15 nonreactive and reactive sera (RPR titer 1:1 to 1:64). Panels were shipped frozen to the PHL and tested on the automated RPR systems following manufacturers' instructions. Prior test results were blinded to all laboratories. When compared to manual RPR (Arlington Scientific) performed at the CDC as a reference test, the qualitative panel results demonstrated an overall concordance of 95.9% for AIX 1000, 94.6% for ASI Evolution, and 92.6% for Bioplex RPR; quantitative panel showed within range titer of 2-fold for 94% of specimens for AIX 1000, 68% for ASI Evolution, and 64% for BioPlex RPR, and the reproducibility testing panel demonstrated point estimates ranging from 69 to 95%. Automated RPR instruments could reduce turnaround time and minimize interpretation errors. However, additional evaluations with more specimens could assist laboratories with implementing automated RPR tests and understanding their limitations.

Evaluation of the effect of extended refrigerated storage of serum and plasma specimens on syphilis serologic test results.

The effect of extended refrigerated storage of 14 serum and plasma specimens on 5 syphilis serologic tests was evaluated for 16 weeks. Higher stability of nontreponemal and treponemal antibodies in serum was recorded compared to plasma. Described work may provide insights on refrigerated specimens' stability and suitability for syphilis tests.

At-Home Specimen Self-Collection and Self-Testing for Sexually Transmitted Infection Screening Demand Accelerated by the COVID-19 Pandemic: a Review of Laboratory Implementation Issues.

The coronavirus disease 2019 (COVID-19) pandemic reduced the sexually transmitted infection (STI) testing volume due to social-distancing and stay-at-home orders, among other reasons. These events highlighted previously known benefits of at-home STI self-testing or specimen self-collection and accelerated testing demand via telemedicine. We review testing outside traditional clinical settings. We focus on three curable bacterial STIs among the top 10 U.S. nationally notifiable conditions with screening recommendations: syphilis, gonorrhea (Neisseria gonorrhoeae, also known as the gonococcus [GC]), and chlamydia (Chlamydia trachomatis). At least 19 million GC/C. trachomatis (GC/CT) screening or diagnostic tests are performed annually, presenting a considerable challenge during the pandemic. Unlike for HIV, STI at-home tests are currently not commercially available. However, innovative telemedicine providers currently offer services where specimen self-collection kits are mailed to patients at home who then ship them to laboratories for processing. We discuss technical and regulatory aspects of modifications for home-based specimen self-collection. The telemedicine provider typically manages and communicates results, provides linkage to care, and is responsible for billing and case reporting. We also describe rapid testing devices in development that may present an opportunity for future self-testing. In summary, COVID-19 has accelerated the evaluation and development of STI self-tests and specimen self-collection. The remaining obstacles are high price, regulatory approval, support for laboratories offering the service, and uncertainty regarding whether target populations with the greatest need are reached effectively. However, increased testing, convenience, and privacy are potential benefits that may enhance uptake and outlast the pandemic.

The Traditional or Reverse Algorithm for Diagnosis of Syphilis: Pros and Cons.

We reviewed relevant syphilis diagnostic literature to address the question "What diagnostic considerations should be taken into account when screening for syphilis using the traditional or reverse algorithm?" Improved laboratory diagnosis of syphilis is an important element of the effort to reduce syphilis rates. Screening for syphilis is performed using either a nontreponemal or treponemal test (part of the traditional or reverse algorithm, respectively). Both syphilis algorithms are used by laboratories. However, there are limited data on the performance and cost-effectiveness of the algorithms. An expert panel generated "key questions" in the laboratory diagnosis of syphilis. This paper pertains to the key factors that should be considered when deciding whether to screen for syphilis using either the traditional or the reverse algorithm. A systematic literature review was performed, and tables of evidence were created to address this question.

Development of a novel magnetic particle-based agglutination immunoassay for anticardiolipin antibody detection in syphilis.

OBJECTIVES: Serological tests of non-treponemal and treponemal types are the most frequently used for syphilis diagnosis. Treponemal tests are available in wide variety of assay formats; however, limited advances have been made for the improvement of conventional non-treponemal tests. The objective of this work was to develop a novel non-treponemal magnetic particle-based agglutination assay (NT-MAA) and evaluate its feasibility for syphilis testing. METHODS: Cardiolipin was modified and coupled to magnetic microbeads. Serum diluted in phosphate-buffered saline was mixed with cardiolipin-coupled beads and incubated in a round bottom microplate for 90-120 min followed by visual inspection. A panel of reported syphilis (n=127) and non-reactive (n=244) specimens was prepared to evaluate the NT-MAA performance in comparison to conventional rapid plasma reagin (RPR). Treponema pallidum particle agglutination (TP-PA) assay and enzyme immunoassay (EIA) were included. Analytical sensitivity and reproducibility of NT-MAA were also determined. RESULTS: The non-treponemal NT-MAA and RPR showed sensitivity of 90.6% and 88.2% and specificity of 96.7% and 100%, respectively. The treponemal TP-PA and EIA yielded sensitivity of 100% and 99.2%, respectively, and 100% specificity by both assays. The per cent agreement between NT-MAA and RPR was 97% (kappa=0.931, 95% CI 0.891 to 0.971). Analytical sensitivity determined with IgM anticardiolipin antibody (ACA) was 2.6 µg/mL for both NT-MAA and RPR, while IgG ACA yielded 0.9 µg/mL and 1.7 µg/mL for NT-MAA and RPR, respectively. Qualitative results of intra-assay and interassay reproducibility revealed 100% consistency for NT-MAA. CONCLUSION: Preliminary evaluation of the novel NT-MAA validated proof of concept using laboratory-characterised syphilis sera and demonstrated performance comparable to RPR. Further validation of NT-MAA using additional specimens with better clinical staging may broaden the scope of developed test for syphilis diagnosis.

Development of a syphilis serum bank to support research, development, and evaluation of syphilis diagnostic tests in the United States.

The Centers for Disease Control and Prevention's (CDC) Division of STD Prevention, in collaboration with the Association of Public Health Laboratories (APHL), is developing a nationally available syphilis serum repository for research of Food and Drug Administration (FDA)-cleared or investigational syphilis diagnostic assays in the United States. State and local public health laboratories (PHL) submitted de-identified residual sera with information on collection date, volume, storage conditions, freeze-thaw cycles, PHL serology results, reported syphilis stage and demographic details if available. Previous test results were blinded and sera (N = 152 reported syphilis stage, N = 131 unknown status) were tested at CDC using five FDA-cleared and one investigational syphilis tests. Treponemal and nontreponemal test sensitivity ranged from 76.3-100% and 63.2-100%, respectively, among staged specimens. The conventional treponemal assays showed high concordance of 95.4%. By providing syphilis stage and comprehensive serological test data, developed repository may serve as a valuable resource for diagnostic test validation studies.

Laboratory Evaluation of a Commercially Available Rapid Syphilis Test.

Serological diagnosis of syphilis depends on assays that detect treponemal and nontreponemal antibodies. Laboratory certification and trained personnel are needed to perform most of these tests, while high costs and long turnaround time can hinder treatment initiation or linkage to care. A rapid treponemal syphilis test (RST) that is simple to perform, accessible, and inexpensive would be ideal. The Syphilis Health Check (SHC) assay is the only Food and Drug Administration (FDA)-cleared and Clinical Laboratory Improvement Amendments (CLIA)-waived RST in the United States. In this study, 1,406 archived human serum samples were tested using SHC and traditional treponemal and nontreponemal assays. Rapid test results were compared with treponemal data alone and with a laboratory test panel consensus defined as being reactive by both treponemal and nontreponemal assays for a given specimen, or nonreactive by both types of assays. The sensitivity and specificity of the SHC assay compared with treponemal tests alone were 88.7% (95% confidence interval [CI], 86.2 to 90.0%) and 93.1% (95% CI, 90.0 to 94.9%), respectively, while comparison with the laboratory test panel consensus showed 95.7% (95% CI, 93.6 to 97.2%) sensitivity and 93.2% (95% CI, 91.0 to 95.1%) specificity. The data were further stratified based on age, sex, pregnancy, and HIV status. The sensitivity and specificity of the SHC assay ranged from 66.7% (95% CI, 46.0 to 83.5%) to 91.7% (95% CI, 87.7 to 94.7%) and 88% (95% CI, 68.8 to 97.5%) to 100% (95% CI, 47.8 to 100%), respectively, across groups compared to traditional treponemal assays, generally increasing for all groups except the HIV-positive (HIV+) population when factoring in the laboratory test panel consensus. These data contribute to current knowledge of the SHC assay performance for distinct populations and may guide use in various settings.