ABSTRACT
BACKGROUND: Randomized controlled trials are considered the gold standard in regulatory decision making, as observational studies are known to have important methodological limitations. However, real-world evidence may be helpful in specific situations. This review investigates how the effect estimates obtained from randomized controlled trials compare to those obtained from observational studies, using drug therapy for relapsing-remitting multiple sclerosis as an example. STUDY DESIGN AND SETTING: A systematic review of randomized controlled trials and observational studies was conducted. The primary outcome was the annualized relapse rate. Using (network) meta-analysis together with posterior predictive distributions, the drug-specific rate ratios from the network of randomized controlled trials were compared with those from the network of observational studies. RESULTS: Effect estimates from 26 observational studies showed greater magnitudes and were less precise compared to estimates obtained from 21 randomized controlled trials. Twenty of the 28 treatment comparisons between designs had similar rate ratios. Seven inconsistencies in observed rate ratios could be attributed to two specific disease-modifying therapies. CONCLUSION: In this case study, estimates from observational studies predominantly agreed with estimates from randomized controlled trials given their posterior predictive distributions. Multiple observational studies together may therefore supplement additional pivotal randomized controlled trials in relapsing-remitting multiple sclerosis, for instance facilitating the extrapolation of trial results to the broader patient population.
