Testing of the OMERACT 8 draft validation criteria for a soluble biomarker reflecting structural damage in rheumatoid arthritis: a systematic literature search on 5 candidate biomarkers.

OBJECTIVE: To test the OMERACT 8 draft validation criteria for soluble biomarkers by assessing the strength of literature evidence in support of 5 candidate biomarkers. METHODS: A systematic literature search was conducted on the 5 soluble biomarkers RANKL, osteoprotegerin (OPG), matrix metalloprotease (MMP-3), urine C-telopeptide of types I and II collagen (U-CTX-I and U CTX-II), focusing on the 14 OMERACT 8 criteria. Two electronic voting exercises were conducted to address: (1) strength of evidence for each biomarker as reflecting structural damage according to each individual criterion and the importance of each individual criterion; (2) overall strength of evidence in support of each of the 5 candidate biomarkers as reflecting structural damage endpoints in rheumatoid arthritis (RA) and identification of omissions to the criteria set. RESULTS: The search identified 111 articles. The strength of evidence in support of these biomarkers reflecting structural damage was low for all biomarkers and was rated highest for U-CTX-II [score of 6.5 (numerical rating scale 0-10)]. The lowest scores for retention of specific criteria in the draft set went to criteria that refer to the importance of animal studies, correlations with other biomarkers reflecting damage, and an understanding of the metabolism of the biomarker. CONCLUSION: Evidence in support of any of the 5 tested biomarkers (MMP-3, CTX-I, CTX-II, OPG, RANKL) was inadequate to allow their substitution for radiographic endpoints in RA. Three of the criteria in the draft criteria set might not be required, but few omissions were identified.

Reappraisal of OMERACT 8 draft validation criteria for a soluble biomarker reflecting structural damage endpoints in rheumatoid arthritis, psoriatic arthritis, and spondyloarthritis: the OMERACT 9 v2 criteria.

OBJECTIVES: A draft set of criteria for the validation of soluble biomarkers reflecting damage endpoints was proposed at OMERACT 8. At OMERACT 9 we aimed to scrutinize the necessity for each of these criteria according to the objectives of the working group. METHODS: The OMERACT 8 draft criteria and the principle objectives of the validation process were clarified at a meeting of the working group in London, December 2007. A new framework was proposed after the following steps were conducted: (A) A systematic review of the literature focusing on the draft criteria and a preselected group of biomarkers (MMP3, CTX-II, RANKL, OPG, CTX-I) followed by a Delphi consensus exercise addressing the importance of individual criteria and identification of omissions in the draft set. (B) Formal debate as well as group discussion centered on the key arguments for inclusion/exclusion of specific criteria. (C) Onsite interactive electronic voting on the importance of specific criteria. The framework was presented and discussed at OMERACT 9 in both breakout and plenary sessions followed by a vote on its acceptance. RESULTS: The objectives of rheumatoid arthritis, psoriatic arthritis, and ankylosing spondylitis biomarkers in relation to their predictive validity for damage endpoints was clarified and supported by OMERACT 9 participants. The OMERACT 8 draft validation criteria were reformulated into an essential category focused on criteria addressing the OMERACT Filter elements of discrimination (incorporating truth) and feasibility, and a desirable but nonessential category of other criteria addressing truth. This revised draft set was endorsed by participants at OMERACT 9. CONCLUSION: A revised set of validation criteria has been drafted by consensus at OMERACT 9 that focuses on the performance characteristics of biomarker assays, the importance of addressing potential confounders, and the essential requirement for clinical validation studies.

Proposal for levels of evidence schema for validation of a soluble biomarker reflecting damage endpoints in rheumatoid arthritis, psoriatic arthritis, and ankylosing spondylitis, and recommendations for study design.

OBJECTIVE: At OMERACT 8 a framework for levels of evidence was proposed for the validation of biomarkers as surrogate outcome measures. We aimed to adapt this scheme in order to apply it in the setting of soluble biomarkers proposed to replace the measurement of damage endpoints in rheumatoid arthritis (RA), psoriatic arthritis (PsA), and ankylosing spondylitis (AS). We also aimed to generate consensus on minimum standards for the design of longitudinal studies aimed at validating biomarkers. METHODS: Before the meeting, the Soluble Biomarker Working Group prepared a preliminary framework and discussed various models for association and prediction related to the statistical strength domain. In addition, 3 Delphi exercises addressing longitudinal study design for RA, PsA, and AS were conducted within the working group and members of the Assessments in SpondyloArthritis International Society (ASAS) and the Group for Research and Assessment of Psoriasis and Psoriatic Arthritis (GRAPPA). This formed the basis for discussions among OMERACT 9 participants. RESULTS: The proposed framework was accepted by consensus. In the study design domain a requirement for both prospective observational studies and randomized controlled trials (RCT) in different drug classes was noted. A template for determining the level of statistical strength was proposed. The addition of a new domain on biomarker assay performance was considered essential, and participants suggested that for any biomarker this domain should be addressed first, i.e., before starting clinical validation studies. Participants agreed on most elements of a longitudinal study design template. Where consensus was lacking the working group has drafted solutions that constitute a basis for prospective validation studies. CONCLUSION: The OMERACT 9 Soluble Biomarker Group has successfully formulated a levels of evidence scheme and a study design template that will provide guidance to conduct validation studies in the setting of soluble biomarkers proposed to replace the measurement of damage endpoints in RA, PsA, and AS.