Can Electronic Health Records Databases Complement Spontaneous Reporting System Databases? A Historical-Reconstruction of the Association of Rofecoxib and Acute Myocardial Infarction.

Background: Several initiatives have assessed if mining electronic health records (EHRs) may accelerate the process of drug safety signal detection. In Europe, Exploring and Understanding Adverse Drug Reactions (EU-ADR) Project Focused on utilizing clinical data from EHRs of over 30 million patients from several European countries. Rofecoxib is a prescription COX-2 selective Non-Steroidal Anti-Inflammatory Drugs (NSAID) approved in 1999. In September 2004, the manufacturer withdrew rofecoxib from the market because of safety concerns. In this study, we investigated if the signal concerning rofecoxib and acute myocardial infarction (AMI) could have been identified in EHR database (EU-ADR project) earlier than spontaneous reporting system (SRS), and in advance of rofecoxib withdrawal. Methods: Data from the EU-ADR project and WHO-VigiBase (for SRS) were used for the analysis. Signals were identified when respective statistics exceeded defined thresholds. The SRS analyses was conducted two ways- based on the date the AMI events with rofecoxib as a suspect medication were entered into the database and also the date that the AMI event occurred with exposure to rofecoxib. Results: Within the databases participating in EU-ADR it was possible to identify a strong signal concerning rofecoxib and AMI since Q3 2000 [RR LGPS = 4.5 (95% CI: 2.84-6.72)] and peaked to 4.8 in Q4 2000. In WHO-VigiBase, for AMI term grouping, the EB05 threshold of 2 was crossed in the Q4 2004 (EB05 = 2.94). Since then, the EB05 value increased consistently and peaked in Q3 2006 (EB05 = 48.3) and then again in Q2 2008 (EB05 = 48.5). About 93% (2260 out of 2422) of AMIs reported in WHO-VigiBase database actually occurred prior to the product withdrawal, however, they were reported after the risk minimization/risk communication efforts. Conclusion: In this study, EU-EHR databases were able to detect the AMI signal 4 years prior to the SRS database. We believe that for events that are consistently documented in EHR databases, such as serious events or events requiring in-patient medical intervention or hospitalization, the signal detection exercise in EHR would be beneficial for newly introduced medicinal products on the market, in addition to the SRS data.

Evaluating performance of electronic healthcare records and spontaneous reporting data in drug safety signal detection.

BACKGROUND: Electronic reporting and processing of suspected adverse drug reactions (ADRs) is increasing and has facilitated automated screening procedures. It is crucial for healthcare professionals to understand the nature and proper use of data available in pharmacovigilance practice. OBJECTIVES: To (a) compare performance of EU-ADR [electronic healthcare record (EHR) exemplar] and FAERS [spontaneous reporting system (SRS) exemplar] databases in detecting signals using "positive" and "negative" drug-event reference sets; and (b) evaluate the impact of timing bias on sensitivity thresholds by comparing all data to data restricted to the time before a warning/regulatory action. METHODS: Ten events with known positive and negative reference sets were selected. Signals were identified when respective statistics exceeded defined thresholds. Main outcome measure Performance metrics, including sensitivity, specificity, positive predictive value and accuracy were calculated. In addition, the effect of regulatory action on the performance of signal detection in each data source was evaluated. RESULTS: The sensitivity for detecting signals in EHR data varied depending on the nature of the adverse events and increased substantially if the analyses were restricted to the period preceding the first regulatory action. Across all events, using data from all years, a sensitivity of 45-73 % was observed for EU-ADR and 77 % for FAERS. The specificity was high and similar for EU-ADR (82-96 %) and FAERS (98 %). EU-ADR data showed range of PPV (78-91 %) and accuracy (78-72 %) and FAERS data yielded a PPV of 97 % with 88 % accuracy. CONCLUSION: Using all cumulative data, signal detection in SRS data achieved higher specificity and sensitivity than EHR data. However, when data were restricted to time prior to a regulatory action, performance characteristics changed in a manner consistent with both the type of data and nature of the ADR. Further research focusing on prospective validation of is necessary to learn more about the performance and utility of these databases in modern pharmacovigilance practice.

Using real-world healthcare data for pharmacovigilance signal detection - the experience of the EU-ADR project.

A prospective pharmacovigilance signal detection study, comparing the real-world healthcare data (EU-ADR) and two spontaneous reporting system (SRS) databases, US FDA's Adverse Event Reporting System and WHO's Vigibase is reported. The study compared drug safety signals found in the EU-ADR and SRS databases. The potential for signal detection in the EU-ADR system was found to be dependent on frequency of the event and utilization of drugs in the general population. The EU-ADR system may have a greater potential for detecting signals for events occurring at higher frequency in general population and those that are commonly not considered as potentially a drug-induced event. Factors influencing various differences between the datasets are discussed along with potential limitations and applications to pharmacovigilance practice.