Improving the User Experience with Discount Site-Specific User Testing.

OBJECTIVES: Poor electronic health record (EHR) usability is associated with patient safety concerns, user dissatisfaction, and provider burnout. EHR certification requires vendors to perform user testing. However, there are no such requirements for site-specific implementations. Health care organizations customize EHR implementations, potentially introducing usability problems. Site-specific usability evaluations may help to identify these concerns, and "discount" usability methods afford health systems a means of doing so even without dedicated usability specialists. This report characterizes a site-specific discount user testing program launched at an academic medical center. We describe lessons learned and highlight three of the EHR features in detail to demonstrate the impact of testing on implementation decisions and on users. METHODS: Thirteen new EHR features which had already undergone heuristic evaluation and iterative design were evaluated over the course of three user test events. Each event included five to six users. Participants used think aloud technique. Measures of user efficiency, effectiveness, and satisfaction were collected. Usability concerns were characterized by the type of usability heuristic violated and by correctability. RESULTS: Usability concerns occurred at a rate of 2.5 per feature tested. Seventy percent of the usability concerns were deemed correctable prior to implementation. The first highlighted feature was moved to production despite low single ease question (SEQ) scores which may have predicted its subsequent withdrawal from production based on post implementation feedback. Another feature was rebuilt based on usability findings, and a new version was retested and moved to production. A third feature highlights an easily correctable usability concern identified in user testing. Quantitative usability metrics generally reinforced qualitative findings. CONCLUSION: Simplified user testing with a limited number of participants identifies correctable usability concerns, even after heuristic evaluation. Our discount usability approach to site-specific usability has a role in implementations and may improve the usability of the EHR for the end user.

Impact of a Vendor-Developed Opioid Clinical Decision Support Intervention on Adherence to Prescribing Guidelines, Opioid Prescribing, and Rates of Opioid-Related Encounters.

BACKGROUND: Provider prescribing practices contribute to an excess of opioid-related deaths in the United States. Clinical guidelines exist to assist providers with improving prescribing practices and promoting patient safety. Clinical decision support systems (CDSS) may promote adherence to these guidelines and improve prescribing practices. The aim of this project was to improve opioid guideline adherence, prescribing practices, and rates of opioid-related encounters through the implementation of an opioid CDSS. METHODS: A vendor-developed, provider-targeted CDSS package was implemented in a multi-location academic health center. An interrupted time-series analysis was performed, evaluating 30 weeks pre- and post-implementation time periods. Outcomes were derived from vendor-supplied key performance indicators and directly from the electronic health record (EHR) database. Opioid-prescribing outcomes included count of opioid prescriptions, morphine milligram equivalents per prescription, counts of opioids with concurrent benzodiazepines, and counts of short-acting opioids in opioid-naïve patients. Encounter outcomes included rates of encounters for opioid abuse and dependence and rates of encounters for opioid poisoning and overdose. Guideline adherence outcomes included rates of provision of naloxone and documentation of opioid treatment agreements. RESULTS: The opioid CDSS generated an average of 1,637 alerts per week. Rates of provision of naloxone and opioid treatment agreements improved after CDSS implementation. Vendor-supplied prescribing outcomes were consistent with prescribing outcomes derived directly from the EHR, but all prescribing and encounter outcomes were unchanged. CONCLUSION: A vendor-developed, provider-targeted opioid CDSS did not improve opioid-prescribing practices or rates of opioid-related encounters. The CDSS improved some measures of provider adherence to opioid-prescribing guidelines. Further work is needed to determine the optimal configuration of opioid CDSS so that opioid-prescribing patterns are appropriately modified and encounter outcomes are improved.

The Effect of Electronic Health Record Usability Redesign on Annual Screening Rates in an Ambulatory Setting.

OBJECTIVES: Improving the usability of electronic health records (EHR) continues to be a focus of clinicians, vendors, researchers, and regulatory bodies. To understand the impact of usability redesign of an existing, site-configurable feature, we evaluated the user interface (UI) used to screen for depression, alcohol and drug misuse, fall risk, and the existence of advance directive information in ambulatory settings. METHODS: As part of a quality improvement project, based on heuristic analysis, the existing UI was redesigned. Using an iterative, user-centered design process, several usability defects were corrected. Summative usability testing was performed as part of the product development and implementation cycle. Clinical quality measures reflecting rolling 12-month rates of screening were examined over 8 months prior to the implementation of the redesigned UI and 9 months after implementation. RESULTS: Summative usability testing demonstrated improvements in task time, error rates, and System Usability Scale scores. Interrupted time series analysis demonstrated significant improvements in all screening rates after implementation of the redesigned UI compared with the original implementation. CONCLUSION: User-centered redesign of an existing site-specific UI may lead to significant improvements in measures of usability and quality of patient care.