Patient safety and computerized medication ordering at Brigham and Women's Hospital.

BACKGROUND: Medications are important therapeutic tools in health care, yet creating safe medication processes is challenging for many reasons. Computerized physician order entry (CPOE), one important way that technology can be used to improve the medication process, has been in place at Brigham and Women's Hospital (BWH; Boston) since 1993. CPOE AT BWH: The CPOE application, designed and developed internally by the BWH information systems team, allows physicians and other clinicians to enter all patient orders into the computer. Physicians enter 85% of orders, with the remainder entered electronically by other clinicians. CPOE AND SAFE MEDICATION USE: The CPOE application at BWH includes several features designed to improve medication safety--structural features (for example, required fields, use of pick lists), enhanced workflow features (order sets, standard scales for insulin and potassium), alerts and reminders (drug-drug and drug-allergy interaction checking), and adjunct features (the pharmacy system, access to online reference information). RESULTS AT BWH: Studies of the impact of CPOE on physician decision making and patient safety at BWH include assessment of CPOE's impact on the serious medication error and the preventable adverse drug event rate, the impact of computer guidelines on the use of vancomycin, the impact of guidelines on the use of heparin in patients at bed rest, and the impact of dosing suggestions on excessive dosing. CONCLUSION: CPOE and several forms of clinical decision support targeted at increasing patient safety have substantially decreased the frequency of serious medication errors and have had an even bigger impact on the overall medication error rate.

Using an electronic medical record to identify opportunities to improve compliance with cholesterol guidelines.

OBJECTIVE: To use an electronic medical record to measure rates of compliance with the National Cholesterol Education Program (NCEP) cholesterol guidelines for secondary prevention, to characterize the patterns of noncompliance, and to identify patient and physician-specific correlates of noncompliance. DESIGN: Cross-sectional descriptive analysis of data extracted from an electronic medical record. SETTING: Nineteen primary care clinics affiliated with a tertiary academic medical center. PATIENTS: All patients who visited their primary care physician in the preceding year who met criteria for secondary prevention of hypercholesterolemia. INTERVENTIONS: None. The main outcome was rate of compliance with NCEP cholesterol guidelines. MAIN RESULTS: Of 2,019 patients who qualified for secondary prevention, only 31% were in compliance with NCEP recommendations, although 44% were on lipid-lowering therapy. There was no low-density lipoprotein cholesterol (LDL-C) on record within the last three years for 771 (38%), and another 809 (40%) had a recent LDL-C that was above the recommended target of 100 mg/dL. Of the latter group, 374 (46%) were not on a statin, including 188 patients with an LDL-C >130 mg/dL. Compliance among secondary prevention patients with cerebrovascular or peripheral vascular disease, but not coronary disease, was even lower: 19% versus 36%, P <.0001. Most of the additional noncompliant patients never had an LDL-C checked. Patient-specific factors associated with compliance included having seen a cardiologist (45% vs 21%); having had a recent admission for myocardial infarction, unstable angina, or angina (41% vs 26%); being male (37% vs 24%); and being white (34% vs 26%). Patients over 79 and under 50 years old also were less likely to be compliant (22% vs 34% for 50-79 year olds). There were no significant differences in compliance rates based on physician-specific factors, such as level of training, gender, or panel size. CONCLUSION: We found poor compliance with nationally published and well-accepted guidelines on diagnosing and treating hypercholesterolemia in secondary prevention patients. Compliance was unrelated to physician or physician-specific characteristics, but it was especially low for women, African Americans, patients without a cardiologist, and patients with cerebrovascular and peripheral vascular disease.

Identifying hospital admissions due to adverse drug events using a computer-based monitor.

BACKGROUND: Hospital admissions due to adverse drug events (ADEs) are expensive, and many may be preventable, yet few institutions have ongoing surveillance for these events. OBJECTIVE: To evaluate the use of a computer-based ADE monitor to identify admissions due to ADEs and to measure the associated costs. DESIGN: Prospective cohort study in one tertiary care hospital. PARTICIPANTS: All patients admitted to nine medical and surgical units in a tertiary care hospital over an 8-month period. MAIN OUTCOME MEASURE: Admissions to the hospital due to an adverse drug event. METHODS: A computer-based monitoring program generated alerts suggesting that an ADE might be present. A trained reviewer then evaluated the record. RESULTS: Among the 3238 admissions, 76 (2.3%, 1.4% after adjusting for sampling) were found to be caused by an ADE. Of these ADEs, 78% were severe and 28% were preventable. Estimated costs were $16,177 per ADE, and $10,375 per preventable ADE; annualized costs to the hospital were $6.3 million per year for all ADEs, and $1.2 million for preventable ADEs. CONCLUSIONS: Many admissions were caused by ADEs, although our point estimate undoubtedly represents a lower bound. These events were mostly severe, often preventable, and expensive. The computer-based monitoring system represents a practical approach for identifying ADEs that occur in outpatients and cause admission to the hospital.

Improving allergy alerting in a computerized physician order entry system.

Computerized physician order entry has been shown to reduce the frequency of serious medication errors. Decision support tools such as alerting functions for patient medication allergy are a key part of these applications. However, optimal performance requires iterative refinement. As systems become increasingly complex, mechanisms to monitor their performance become increasingly critical. We analyzed trend data obtained over a five-year period that showed decreasing compliance to allergy alert functions within computerized order entry. Many medication-allergy pairs were being consistently overridden. Renewal policies affecting reordering narcotics also contributed heavily to this trend. Each factor revealed a system-wide trend that could result in suggestions for policy or software change. Monitoring trends such as these is very important to maintain software correctness and ensure user trust in alerting systems, so users remain responsive to computerized alerts.

Effects of computerized physician order entry on prescribing practices.

BACKGROUND: Computerized order entry systems have the potential to prevent errors, to improve quality of care, and to reduce costs by providing feedback and suggestions to the physician as each order is entered. This study assesses the impact of an inpatient computerized physician order entry system on prescribing practices. METHODS: A time series analysis was performed at an urban academic medical center at which all adult inpatient orders are entered through a computerized system. When physicians enter drug orders, the computer displays drug use guidelines, offers relevant alternatives, and suggests appropriate doses and frequencies. RESULT: For medication selection, use of a computerized guideline resulted in a change in use of the recommended drug (nizatidine) from 15.6% of all histamine(2)-blocker orders to 81.3% (P<.001). Implementation of dose selection menus resulted in a decrease in the SD of drug doses by 11% (P<.001). The proportion of doses that exceeded the recommended maximum decreased from 2.1% before order entry to 0.6% afterward (P<.001). Display of a recommended frequency for ondansetron hydrochloride administration resulted in an increase in the use of the approved frequency from 6% of all ondansetron orders to 75% (P<.001). The use of subcutaneous heparin sodium to prevent thrombosis in patients at bed rest increased from 24% to 47% when the computer suggested this option (P<.001). All these changes persisted at 1- and 2-year follow-up analyses. CONCLUSION: Computerized physician order entry is a powerful and effective tool for improving physician prescribing practices.

Improving response to critical laboratory results with automation: results of a randomized controlled trial.

OBJECTIVE: To evaluate the effect of an automatic alerting system on the time until treatment is ordered for patients with critical laboratory results. DESIGN: Prospective randomized controlled trial. INTERVENTION: A computer system to detect critical conditions and automatically notify the responsible physician via the hospital's paging system. PATIENTS: Medical and surgical inpatients at a large academic medical center. One two-month study period for each service. MAIN OUTCOMES: Interval from when a critical result was available for review until an appropriate treatment was ordered. Secondary outcomes were the time until the critical condition resolved and the frequency of adverse events. METHODS: The alerting system looked for 12 conditions involving laboratory results and medications. For intervention patients, the covering physician was automatically notified about the presence of the results. For control patients, no automatic notification was made. Chart review was performed to determine the outcomes. RESULTS: After exclusions, 192 alerting situations (94 interventions, 98 controls) were analyzed. The intervention group had a 38 percent shorter median time interval (1.0 hours vs. 1.6 hours, P = 0.003; mean, 4.1 vs. 4.6 hours, P = 0.003) until an appropriate treatment was ordered. The time until the alerting condition resolved was less in the intervention group (median, 8.4 hours vs. 8.9 hours, P = 0.11; mean, 14.4 hours vs. 20.2 hours, P = 0.11), although these results did not achieve statistical significance. The impact of the intervention was more pronounced for alerts that did not meet the laboratory's critical reporting criteria. There was no significant difference between the two groups in the number of adverse events. CONCLUSION: An automatic alerting system reduced the time until an appropriate treatment was ordered for patients who had critical laboratory results. Information technologies that facilitate the transmission of important patient data can potentially improve the quality of care.

An information system to promote intravenous-to-oral medication conversion.

Many inpatients remain on expensive intravenous medications, even after they become able to take bioequivalent oral alternatives. We developed a computer intervention to identify such patients and to deliver alerts suggesting a switch to the oral medication. In the first phase of the project, alerts were delivered to pharmacists. The Brigham Integrated Computer System (BICS) was used to produce a daily report of patients receiving any of six targeted intravenous medications, who also had orders for an oral diet or other scheduled oral medications. Staff pharmacists screened the report and suggested IV to PO conversion in appropriate cases to the patient's nurses and/or physicians. Feedback was documented in the BICS system. Analysis of the pilot study showed that in 31.7% of cases, physicians agreed to change (or had just changed) the patient's medication from IV to PO. Further analysis of pilot (Phase I) data was performed against a variety of parameters in order to increase the fraction of alerts deemed appropriate for conversion. These more specific alerts can be sent directly to physicians.

An institution-based process to ensure clinical software quality.

Clinical software can have a major impact on the delivery of care. It is imperative that clinical software undergo regular quality review, to evaluate the clinical correctness of the specification, the technical correctness of the software, problems that have arisen, and maintenance of the software as conditions change. We have developed a process using existing hospital review groups to perform clinical review, and using a project specification form and analysis of likely problem areas to effect technical review.

A computer-based outpatient clinical referral system.

The process of generating a clinical referral for a patient, and the resulting transfer of information from the primary care physician to the specialist and back again, are key components in the struggle to deliver less costly and more effective clinical care. We have created a computer-based, outpatient clinical referral application that facilitates: (1) identifying an appropriate specialist; (2) collecting the clinical, demographic, and financial data required to generate a referral; and (3) transferring the information between the specialist and the primary care physician (PCP). This article describes the development of the application itself and several of the knowledge bases that were created to facilitate this process. Preliminary results indicate that the new computer-based referral process is faster to use than conventional methods.

The Brigham integrated computing system (BICS): advanced clinical systems in an academic hospital environment.

The Brigham integrated computing system (BICS) provides nearly all clinical, administrative, and financial computing services to Brigham and Women's Hospital, an academic tertiary-care hospital in Boston. The BICS clinical information system includes a very wide range of data and applications, including results review, longitudinal medical records, provider order entry, critical pathway management, operating-room dynamic scheduling, critical-event detection and altering, dynamic coverage lists, automated inpatient summaries, and an online reference library. BICS design emphasizes direct physician interaction and extensive clinical decision support. Impact studies have demonstrated significant value of the system in preventing adverse events and in saving costs, particularly for medications.

The impact of computerized physician order entry on medication error prevention.

BACKGROUND: Medication errors are common, and while most such errors have little potential for harm they cause substantial extra work in hospitals. A small proportion do have the potential to cause injury, and some cause preventable adverse drug events. OBJECTIVE: To evaluate the impact of computerized physician order entry (POE) with decision support in reducing the number of medication errors. DESIGN: Prospective time series analysis, with four periods. SETTING AND PARTICIPANTS: All patients admitted to three medical units were studied for seven to ten-week periods in four different years. The baseline period was before implementation of POE, and the remaining three were after. Sophistication of POE increased with each successive period. INTERVENTION: Physician order entry with decision support features such as drug allergy and drug-drug interaction warnings. MAIN OUTCOME MEASURE: Medication errors, excluding missed dose errors. RESULTS: During the study, the non-missed-dose medication error rate fell 81 percent, from 142 per 1,000 patient-days in the baseline period to 26.6 per 1,000 patient-days in the final period (P < 0.0001). Non-intercepted serious medication errors (those with the potential to cause injury) fell 86 percent from baseline to period 3, the final period (P = 0.0003). Large differences were seen for all main types of medication errors: dose errors, frequency errors, route errors, substitution errors, and allergies. For example, in the baseline period there were ten allergy errors, but only two in the following three periods combined (P < 0.0001). CONCLUSIONS: Computerized POE substantially decreased the rate of non-missed-dose medication errors. A major reduction in errors was achieved with the initial version of the system, and further reductions were found with addition of decision support features.

A randomized trial of a computer-based intervention to reduce utilization of redundant laboratory tests.

PURPOSE: To determine the impact of giving physicians computerized reminders about apparently redundant clinical laboratory tests. SUBJECTS AND METHODS: We performed a prospective randomized controlled trial that included all inpatients at a large teaching hospital during a 15-week period. The intervention consisted of computerized reminders at the time a test was ordered that appeared to be redundant. Main outcome measures were the proportions of clinical laboratory orders that were canceled and the proportion of the tests that were actually performed. RESULTS: During the study period, there were 939 apparently redundant laboratory tests among the 77,609 study tests that were ordered among the intervention (n = 5,700 patients) and control (n = 5,886 patients) groups. In the intervention group, 69% (300 of 437) of tests were canceled in response to reminders. Of 137 overrides, 41% appeared to be justified based on chart review. In the control group, 51% of ordered redundant tests were performed, whereas in the intervention group only 27% of ordered redundant tests were performed (P <0.001). However, the estimated annual savings in laboratory charges was only $35,000. This occurred because only 44% of redundant tests performed had computer orders, because only half the computer orders were screened for redundancy, and because almost one-third of the reminders were overridden. CONCLUSIONS: Reminders about orders for apparently redundant laboratory tests were effective when delivered. However, the overall effect was limited because many tests were performed without corresponding computer orders, and many orders were not screened for redundancy.

Using information systems to measure and improve quality.

Information systems (IS) are increasingly important for measuring and improving quality. In this paper, we describe our integrated delivery system's plan for and experiences with measuring and improving quality using IS. Our belief is that for quality measurement to be practical, it must be integrated with the routine provision of care and whenever possible should be done using IS. Thus, at one hospital, we now perform almost all quality measurement using IS. We are also building a clinical data warehouse, which will serve as a repository for quality information across the network. However, IS are not only useful for measuring care, but also represent powerful tools for improving care using decision support. Specific areas in which we have already seen significant benefit include reducing the unnecessary use of laboratory testing, reporting important abnormalities to key providers rapidly, prevention and detection of adverse drug events, initiatives to change prescribing patterns to reduce drug costs and making critical pathways available to providers. Our next major effort will be introduce computerized guidelines on a more widespread basis, which will be challenging. However, the advent of managed care in the US has produced strong incentives to provide high quality care at low cost and our perspective is that only with better IS than exist today will this be possible without compromising quality. Such systems make feasible implementation of quality measurement, care improvement and cost reduction initiatives on a scale which could not previously be considered.

Effect of computerized physician order entry and a team intervention on prevention of serious medication errors.

CONTEXT: Adverse drug events (ADEs) are a significant and costly cause of injury during hospitalization. OBJECTIVES: To evaluate the efficacy of 2 interventions for preventing nonintercepted serious medication errors, defined as those that either resulted in or had potential to result in an ADE and were not intercepted before reaching the patient. DESIGN: Before-after comparison between phase 1 (baseline) and phase 2 (after intervention was implemented) and, within phase 2, a randomized comparison between physician computer order entry (POE) and the combination of POE plus a team intervention. SETTING: Large tertiary care hospital. PARTICIPANTS: For the comparison of phase 1 and 2, all patients admitted to a stratified random sample of 6 medical and surgical units in a tertiary care hospital over a 6-month period, and for the randomized comparison during phase 2, all patients admitted to the same units and 2 randomly selected additional units over a subsequent 9-month period. INTERVENTIONS: A physician computer order entry system (POE) for all units and a team-based intervention that included changing the role of pharmacists, implemented for half the units. MAIN OUTCOME MEASURE: Nonintercepted serious medication errors. RESULTS: Comparing identical units between phases 1 and 2, nonintercepted serious medication errors decreased 55%, from 10.7 events per 1000 patient-days to 4.86 events per 1000 (P=.01). The decline occurred for all stages of the medication-use process. Preventable ADEs declined 17% from 4.69 to 3.88 (P=.37), while nonintercepted potential ADEs declined 84% from 5.99 to 0.98 per 1000 patient-days (P=.002). When POE-only was compared with the POE plus team intervention combined, the team intervention conferred no additional benefit over POE. CONCLUSIONS: Physician computer order entry decreased the rate of nonintercepted serious medication errors by more than half, although this decrease was larger for potential ADEs than for errors that actually resulted in an ADE.

Identifying adverse drug events: development of a computer-based monitor and comparison with chart review and stimulated voluntary report.

BACKGROUND: Adverse drug events (ADEs) are both common and costly. Most hospitals identify ADEs using spontaneous reporting, but this approach lacks sensitivity; chart review identifies more events but is expensive. Computer-based approaches to ADE identification appear promising, but they have not been directly compared with chart review and they are not widely used. OBJECTIVES: To develop a computer-based ADE monitor, and to compare the rate and type of ADEs found with the monitor with those discovered by chart review and by stimulated voluntary report. DESIGN: Prospective cohort study in one tertiary-care hospital. PARTICIPANTS: All patients admitted to nine medical and surgical units in a tertiary-care hospital over an eight-month period. MAIN OUTCOME MEASURE: Adverse drug events identified by the computer-based monitor, by chart review, and by stimulated voluntary report. METHODS: A computer-based monitoring program identified alerts, which were situations suggesting that an ADE might be present (e.g., an order for an antidote such as naloxone). A trained reviewer then examined patients' hospital records to determine whether an ADE had occurred. The results of the computer-based monitoring strategy were compared with two other ADE detection strategies: intensive chart review and stimulated voluntary report by nurses and pharmacists. The monitor and the chart review strategies were independent, and the reviewers were blinded. RESULTS: The computer monitoring strategy identified 2,620 alerts, of which 275 were determined to be ADEs. The chart review found 398 ADEs, whereas voluntary report detected 23. Of the 617 ADEs detected by at least one method, 76 ADEs were detected by both computer monitor and chart review. The computer monitor identified 45 percent; chart review, 65 percent; and voluntary report, 4 percent. The ADEs identified by computer monitor were more likely to be classified as "severe" than were those identified by chart review (51 versus 42 percent, p = .04). The positive predictive value of computer-generated alerts was 16 percent during the first eight weeks of the study; rule modifications increased this to 23 percent in the final eight weeks. The computer strategy required 11 person-hours per week to execute, whereas chart review required 55 person-hours per week and voluntary report strategy required 5. CONCLUSIONS: The computer-based monitor identified fewer ADEs than did chart review but many more ADEs than did stimulated voluntary report. The overlap among the ADEs identified using different methods was small, suggesting that the incidence of ADEs may be higher than previously reported and that different detection methods capture different events. The computer-based monitoring system represents an efficient approach for measuring ADE frequency and gauging the effectiveness of ADE prevention programs.

Asking residents about adverse events in a computer dialogue: how accurate are they?

BACKGROUND: Although retrospective identification of adverse events is time-consuming, whether they are present and/or expected is often readily apparent to providers during the provision of care. METHODS: A computer program to flag admissions with possible adverse events was developed. Readmissions to the hospital within 31 days and admissions including more than one visit to the operating room (OR) were flagged. For surgical site infections, all admissions--including a visit to the OR--were flagged, but only a sample was evaluated in the reliability assessment. Residents in an urban, tertiary care hospital were questioned when inputting computerized discharge orders regarding adverse events among 391 cases sampled from 6,813 admissions for a two-month period. RESULTS: For the 228 readmissions (3.3% of all admissions) identified by the computer program, resident responses had a sensitivity of 57% and a specificity of 73% in detecting an unexpected readmission (nurse responses, 96% and 91%). For the 79 patients with a return to the OR, the residents' responses had a sensitivity of 86% and a specificity of 84% for detecting an unexpected return (versus 75% and 98% for the nurses' responses). For the 209 patients with an OR visit, the sensitivity and specificity for a surgical site infection were 85% and 98% for the residents and 54% and 99% for the nurses. DISCUSSION: Information systems can be used to screen for adverse events and to ask providers whether adverse events are unexpected, although the reliability of this approach is likely to vary by event type.

Using a computerized sign-out program to improve continuity of inpatient care and prevent adverse events.

BACKGROUND: Many medical injuries are preventable, but there are few reported successful strategies to prevent such injuries. Previous work identified coverage by house staff not primarily responsible for the patient (cross-coverage) as a significant correlate of risk for preventable adverse events. A four-month intervention--computerized sign-outs--was introduced in 1993 in an urban teaching hospital to improve continuity of care during cross-coverage and thereby reduce risk for preventable adverse events. MEASUREMENTS: A previously tested confidential self-report system was used to identify adverse events, which were defined as unexpected complications of medical therapy that resulted in increased length of stay or disability at discharge. A panel of three board-certified internists confirmed events and evaluated preventability based on case summaries. RESULTS: After the intervention, the rate of preventable adverse events among the 3,747 patients admitted to the medical service decreased from 1.7% to 1.2% (p < 0.10). Both univariate and multivariate analysis revealed no association between cross coverage and preventable adverse events after the intervention. In the baseline period, the odds ratio (OR) for a patient suffering a preventable adverse event during cross coverage was 5.2 (95% confidence interval [CI], 1.5-18.2; p = 0.01), but was no longer significant after the intervention (OR, 1.5; 95% CI, 0.2-9.0). CONCLUSION: House staff are willing participants in efforts to measure and improve the quality of health care systems. The intervention may have reduced the risk for medical injury associated with discontinuity of inpatients care. Four years after the end of the study, the computerized sign-out program remained an integral part of the computing support system for house staff and was widely used.

Information systems support for emergency medicine.

Information needs for emergency medicine research and for practice are closely related. A well-developed information system can serve both, allowing data gathered in one setting to be used for the other. To produce the best environment for emergency medicine research, providers should support data standards, promote education in data analysis, and understand the informational structure of emergency medicine practice.