External quality assessment to support the WHO ProSPeRo study for the evaluation of two dual HIV/syphilis point-of-care tests in seven countries.

BACKGROUND: Sexually transmitted infections (STIs) such as syphilis and HIV remain to be a significant public health issue worldwide. Dual rapid point-of-care tests (POCTs) have shown promise for detecting antibodies to HIV and syphilis but have not been fully evaluated in the field. Our study supported the WHO ProSPeRo study on Sexually Transmitted Infection Point-of-Care Testing (STI POCT) by providing external quality assessment (EQA) for HIV and syphilis testing in reference laboratories and their associated clinical sites in seven countries. METHODS: HIV/syphilis serum liquid and dried tube specimen (DTS) panels were prepared by CDC. Liquid panels were distributed to the reference laboratories for three rounds of testing using commercially and locally available laboratory-based serological tests. DTS panels were sent to the clinical testing sites for 8 rounds of POC testing using the Abbott SD BIOLINE HIV/Syphilis Duo test (hereafter referred to as SD BIOLINE) and the Chembio Dual Path Platform (DPP) HIV-Syphilis assay. EQA panels were tested at CDC using the Rapid Plasma Reagin (RPR) test and the Treponema pallidum Particle Agglutination assay (TP-PA) for syphilis antibodies. Genetic Systems HIV-1/HIV-2 Plus O EIA, Geenius HIV Supplemental Assay and the Oraquick Advance HIV test were used to detect HIV antibodies in the EQA panels. Results from the reference laboratories and POCT sites were compared to those obtained at the CDC and a percentage agreement was calculated. RESULTS: Qualitative RPR and TP-PA performed at the reference laboratories demonstrated 95.4-100% agreement with CDC results while quantitative RPR and TP-PA tests demonstrated 87.7% and 89.2% agreement, respectively. A 93.8% concordance rate was observed for qualitative HIV testing in laboratories. EQA testing at clinical sites using dual tests showed 98.7% and 99.1% agreement for detection of HIV antibodies and eight out of 10 sites had > 95.8% agreement for syphilis testing. However, two clinical sites showed only 65.0-66.7% agreement for SD BIOLINE and 84.0-86.7% for DPP, respectively, for syphilis testing. CONCLUSIONS: Overall, laboratories demonstrated high EQA performance in this study. Both HIV/syphilis POCTs gave expected results in the clinic-based evaluations using DTS. However, testing errors were identified in a few testing sites suggesting the necessity for continuous training and monitoring the quality of POC testing.

Evaluation of Three Automated Nontreponemal Rapid Plasma Reagin (RPR) Tests for the Laboratory Diagnosis of Syphilis.

Automated nontreponemal rapid plasma reagin (RPR) tests were recently introduced in the United States for syphilis testing and limited performance data are available. In collaboration with the Association of Public Health Laboratories, three public health laboratories (PHL) were chosen through a competitive selection process to evaluate the performance of three FDA-cleared automated RPR test systems: BioPlex 2200 Syphilis Total & RPR assay (Bio-Rad Laboratories), AIX 1000 (Gold Standard Diagnostics), and ASI Evolution (Arlington Scientific). Panels prepared at the CDC included: a qualitative panel comprised of 734 syphilis reactive/nonreactive sera; a quantitative panel of 50 syphilis reactive sera (RPR titer 1:64 to 1:1,024); and a reproducibility panel of 15 nonreactive and reactive sera (RPR titer 1:1 to 1:64). Panels were shipped frozen to the PHL and tested on the automated RPR systems following manufacturers' instructions. Prior test results were blinded to all laboratories. When compared to manual RPR (Arlington Scientific) performed at the CDC as a reference test, the qualitative panel results demonstrated an overall concordance of 95.9% for AIX 1000, 94.6% for ASI Evolution, and 92.6% for Bioplex RPR; quantitative panel showed within range titer of 2-fold for 94% of specimens for AIX 1000, 68% for ASI Evolution, and 64% for BioPlex RPR, and the reproducibility testing panel demonstrated point estimates ranging from 69 to 95%. Automated RPR instruments could reduce turnaround time and minimize interpretation errors. However, additional evaluations with more specimens could assist laboratories with implementing automated RPR tests and understanding their limitations.

Evaluation of the effect of extended refrigerated storage of serum and plasma specimens on syphilis serologic test results.

The effect of extended refrigerated storage of 14 serum and plasma specimens on 5 syphilis serologic tests was evaluated for 16 weeks. Higher stability of nontreponemal and treponemal antibodies in serum was recorded compared to plasma. Described work may provide insights on refrigerated specimens' stability and suitability for syphilis tests.

The Traditional or Reverse Algorithm for Diagnosis of Syphilis: Pros and Cons.

We reviewed relevant syphilis diagnostic literature to address the question "What diagnostic considerations should be taken into account when screening for syphilis using the traditional or reverse algorithm?" Improved laboratory diagnosis of syphilis is an important element of the effort to reduce syphilis rates. Screening for syphilis is performed using either a nontreponemal or treponemal test (part of the traditional or reverse algorithm, respectively). Both syphilis algorithms are used by laboratories. However, there are limited data on the performance and cost-effectiveness of the algorithms. An expert panel generated "key questions" in the laboratory diagnosis of syphilis. This paper pertains to the key factors that should be considered when deciding whether to screen for syphilis using either the traditional or the reverse algorithm. A systematic literature review was performed, and tables of evidence were created to address this question.

Development of a novel magnetic particle-based agglutination immunoassay for anticardiolipin antibody detection in syphilis.

OBJECTIVES: Serological tests of non-treponemal and treponemal types are the most frequently used for syphilis diagnosis. Treponemal tests are available in wide variety of assay formats; however, limited advances have been made for the improvement of conventional non-treponemal tests. The objective of this work was to develop a novel non-treponemal magnetic particle-based agglutination assay (NT-MAA) and evaluate its feasibility for syphilis testing. METHODS: Cardiolipin was modified and coupled to magnetic microbeads. Serum diluted in phosphate-buffered saline was mixed with cardiolipin-coupled beads and incubated in a round bottom microplate for 90-120 min followed by visual inspection. A panel of reported syphilis (n=127) and non-reactive (n=244) specimens was prepared to evaluate the NT-MAA performance in comparison to conventional rapid plasma reagin (RPR). Treponema pallidum particle agglutination (TP-PA) assay and enzyme immunoassay (EIA) were included. Analytical sensitivity and reproducibility of NT-MAA were also determined. RESULTS: The non-treponemal NT-MAA and RPR showed sensitivity of 90.6% and 88.2% and specificity of 96.7% and 100%, respectively. The treponemal TP-PA and EIA yielded sensitivity of 100% and 99.2%, respectively, and 100% specificity by both assays. The per cent agreement between NT-MAA and RPR was 97% (kappa=0.931, 95% CI 0.891 to 0.971). Analytical sensitivity determined with IgM anticardiolipin antibody (ACA) was 2.6 µg/mL for both NT-MAA and RPR, while IgG ACA yielded 0.9 µg/mL and 1.7 µg/mL for NT-MAA and RPR, respectively. Qualitative results of intra-assay and interassay reproducibility revealed 100% consistency for NT-MAA. CONCLUSION: Preliminary evaluation of the novel NT-MAA validated proof of concept using laboratory-characterised syphilis sera and demonstrated performance comparable to RPR. Further validation of NT-MAA using additional specimens with better clinical staging may broaden the scope of developed test for syphilis diagnosis.