Sex Differences in Electronic Health Record Navigation Strategies: Secondary Data Analysis.

BACKGROUND: Use of electronic health records (EHRs) has increased dramatically over the past decade. Their widespread adoption has been plagued with numerous complaints about usability, with subsequent impacts on patient safety and provider well-being. Data in other fields suggest biological sex impacts basic patterns of navigation in electronic media. OBJECTIVE: This study aimed to determine whether biological sex impacted physicians' navigational strategies while using EHRs. METHODS: This is a secondary analysis of a prior study where physicians were given verbal and written signout, and then, while being monitored with an eye tracker, were asked to review a simulated record in our institution's EHR system, which contained 14 patient safety items. Afterward, the number of safety items recognized was recorded. RESULTS: A total of 93 physicians (female: n=46, male: n=47) participated in the study. Two gaze patterns were identified: one characterized more so by saccadic ("scanning") eye movements and the other characterized more so by longer fixations ("staring"). Female physicians were more likely to use the scanning pattern; they had a shorter mean fixation duration (P=.005), traveled more distance per minute of screen time (P=.03), had more saccades per minute of screen time (P=.02), and had longer periods of saccadic movement (P=.03). The average proportion of time spent staring compared to scanning (the Gaze Index [GI]) across all participants was approximately 3:1. Females were more likely than males to have a GI value <3.0 (P=.003). At the extremes, males were more likely to have a GI value >5, while females were more likely to have a GI value <1. Differences in navigational strategy had no impact on task performance. CONCLUSIONS: Females and males demonstrate fundamentally different navigational strategies while navigating the EHR. This has potentially significant impacts for usability testing in EHR training and design. Further studies are needed to determine if the detected differences in gaze patterns produce meaningful differences in cognitive load while using EHRs.

Use of a Novel, Electronic Health Record-Centered, Interprofessional ICU Rounding Simulation to Understand Latent Safety Issues.

OBJECTIVES: The electronic health record is a primary source of information for all professional groups participating in ICU rounds. We previously demonstrated that, individually, all professional groups involved in rounds have significant blind spots in recognition of patient safety issues in the electronic health record. However, it is unclear how team dynamics impacts identification and verbalization of viewed data. Therefore, we created an ICU rounding simulation to assess how the interprofessional team recognized and reported data and its impact on decision-making. DESIGN: Each member of the ICU team reviewed a simulated ICU chart in the electronic health record which contained embedded patient safety issues. The team conducted simulated rounds according to the ICU's existing rounding script and was assessed for recognition of safety issues. SETTING: Academic medical center. SUBJECTS: ICU residents, nurses, and pharmacists. INTERVENTION: None. MEASUREMENTS AND MAIN RESULTS: Twenty-eight teams recognized 68.6% of safety issues with only 50% teams having the primary diagnosis in their differential. Individually, interns, nurses, and pharmacists recognized 30.4%, 15.6%, and 19.6% of safety items, respectively. However, there was a negative correlation between the intern's performance and the nurse's or the pharmacist's performance within a given team. The wide variance in recognition of data resulted in wide variance in orders. Overall, there were 21.8 orders requested and 21.6 orders placed per case resulting in 3.6 order entry inconsistencies/case. Between the two cases, there were 145 distinct orders place with 43% being unique to a specific team and only 2% placed by all teams. CONCLUSIONS: Although significant blind spots exist in the interprofessional team's ability to recognize safety issues in the electronic health record, the inclusion of other professional groups does serve as a partial safety net to improve recognition. Electronic health record-based, ICU rounding simulations can serve as a test-bed for innovations in ICU rounding structure and data collection.

Use of Simulation Based on an Electronic Health Records Environment to Evaluate the Structure and Accuracy of Notes Generated by Medical Scribes: Proof-of-Concept Study.

BACKGROUND: The increasing adoption of electronic health records (EHRs) has been associated with a number of unintended negative consequences with provider efficiency and job satisfaction. To address this, there has been a dramatic increase in the use of medical scribes to perform many of the required EHR functions. Despite this rapid growth, little has been published on the training or assessment tools to appraise the safety and efficacy of scribe-related EHR activities. Given the number of reports documenting that other professional groups suffer from a number of performance errors in EHR interface and data gathering, scribes likely face similar challenges. This highlights the need for new assessment tools for medical scribes. OBJECTIVE: The objective of this study was to develop a virtual video-based simulation to demonstrate and quantify the variability and accuracy of scribes' transcribed notes in the EHR. METHODS: From a pool of 8 scribes in one department, a total of 5 female scribes, intent on pursuing careers in health care, with at least 6 months of experience were recruited for our simulation study. We created three simulated patient-provider scenarios. Each scenario contained a corresponding medical record in our simulation instance of our EHR. For each scenario, we video-recorded a standardized patient-provider encounter. Five scribes with at least 6 months of experience both with our EHR and in the specialty of the simulated cases were recruited. Each scribe watched the simulated encounter and transcribed notes into a simulated EHR environment. Transcribed notes were evaluated for interscribe variability and compared with a gold standard for accuracy. RESULTS: All scribes completed all simulated cases. There was significant interscribe variability in note structure and content. Overall, only 26% of all data elements were unique to the scribe writing them. The term data element was used to define the individual pieces of data that scribes perceived from the simulation. Note length was determined by counting the number of words varied by 31%, 37%, and 57% between longest and shortest note between the three cases, and word economy ranged between 23% and 71%. Overall, there was a wide inter- and intrascribe variation in accuracy for each section of the notes with ranges from 50% to 76%, resulting in an overall positive predictive value for each note between 38% and 81%. CONCLUSIONS: We created a high-fidelity, video-based EHR simulation, capable of assessing multiple performance indicators in medical scribes. In this cohort, we demonstrate significant variability both in terms of structure and accuracy in clinical documentation. This form of simulation can provide a valuable tool for future development of scribe curriculum and assessment of competency.

The Evolving Role of Medical Scribe: Variation and Implications for Organizational Effectiveness and Safety.

Increasing use of medical scribes is an unintended consequence of electronic health record adoption in the U.S. The role of scribe is not universally defined, leading to variations in scribe training and operations, as well as questions about scribe efficiency, effectiveness, and safety. Studies published since 2009 have primarily focused on the financial aspects of scribe use, but no published studies have taken an organizational view of this phenomenon. This paper describes stakeholder perspectives on scribes working in outpatient settings within an urban tertiary academic medical center. It places factors associated with of scribe systems within an eight-dimension sociotechnical framework for evaluating health information technology, and discusses key aspects of those perspectives.

Professional and interprofessional differences in electronic health records use and recognition of safety issues in critically ill patients.

During interprofessional intensive care unit (ICU) rounds each member of the interprofessional team is responsible for gathering and interpreting information from the electronic health records (EHR) to facilitate effective team decision-making. This study was conducted to determine how each professional group reviews EHR data in preparation for rounds and their ability to identify patient safety issues. Twenty-five physicians, 29 nurses, and 20 pharmacists participated. Individual participants were given verbal and written sign-out and then asked to review a simulated record in our institution's EHR, which contained 14 patient safety items. After reviewing the chart, subjects presented the patient and the number of safety items recognised was recorded. About 40%, 30%, and 26% of safety issues were recognised by physicians, nurses, and pharmacists, respectively (p = 0.0006) and no item recognised 100% of the time. There was little overlap between the three groups with only 50% of items predicted to be recognised 100% of the time by the team. Differential recognition was associated with marked differences in EHR use, with only 3/152 EHR screens utilised by all three groups and the majority of screens used exclusively only by one group. There were significant and non-overlapping differences in individual profession recognition of patient safety issues in the EHR. Preferential identification of safety issues by certain professional groups may be attributed to differences in EHR use. Future studies will be needed to determine if shared decision-making during rounds can improve recognition of safety issues.

Using Simulations to Improve Electronic Health Record Use, Clinician Training and Patient Safety: Recommendations From A Consensus Conference.

A group of informatics experts in simulation, biomedical informatics, patient safety, medical education, and human factors gathered at Corbett, Oregon on April 30 and May 1, 2015. Their objective: to create a consensus statement on best practices for the use of electronic health record (EHR) simulations in education and training, to improve patient safety, and to outline a strategy for future EHR simulation work. A qualitative approach was utilized to analyze data from the conference and generate recommendations in five major categories: (1) Safety, (2) Education and Training, (3) People and Organizations, (4) Usability and Design, and (5) Sociotechnical Aspects.