Changes in Patient Characteristics and Practice Outcomes of a Tele-Urgent Care Clinic Pre- and Post-COVID-19 Telehealth Policy Expansions.

Introduction: The coronavirus 2019 pandemic (COVID-19) has resulted in major changes in lifestyle practices and healthcare delivery. The goal of this study was to examine changes in practice and service outcomes in a telehealth program before and after the federal and private telehealth policy expansion during the COVID-19 pandemic. These findings are particularly useful to understand what may be needed to overcome telehealth challenges in future disasters. Methods: We conducted a cross-sectional analysis of virtual visits through a statewide telehealth center embedded in a large academic healthcare system. Primary outcomes of this study were changes in telehealth visits pre- and post-policy expansions among at-risk populations. Results: A total of 2,132 telehealth visits were conducted: 1,530 (71.8 percent) patients were female, 1,561 (73.2 percent) were between the ages 18-50, 1,576 (74 percent) were uninsured, and 1,225 (57.5 percent) were from rural regions. The average number of telehealth visits per day increased from 14 to 33 visits post-expansion. A significant change in patient characteristics was found among senior, uninsured, and rural patients after the telehealth expansion.There was an 11 percent decrease in telehealth visits from very high vulnerability regions post-expansion compared to pre-expansion. There was a 15 percent decrease in visits resulting in prescription post-expansion (p-value<0.01). Conclusions: COVID-19 policy expansions expanded telehealth utilization among at-risk populations such as senior, uninsured, and rural patients while decompressing hospitals and emergency rooms and maintaining positive patient experiences. Further regulations are needed around virtual visits unintended consequences, software certification, and guidelines for workforce training.

Evaluation of Physicians' Electronic Health Records Experience Using Actual and Perceived Measures.

Background: Inadequate electronic health record (EHR) interface design hinders the physician-EHR experience, which may lead to increase physician frustration and fatigue levels. Objectives: The objective of this study was to examine the physician EHR experience by evaluating the congruency between actual and perceived measures among physicians with different EHR expertise and utilization levels. Methods: We conducted a cross-sectional EHR usability study of intensive care unit (ICU) physicians at a major Southeastern medical center. We used eye-tracking glasses to measure provider EHR-related fatigue and three surveys to measure the perceived EHR experience. Results: Of the 25 ICU physicians, 11 were residents, nine were fellows, and five were attending physicians. No significant differences were found between actual fatigue levels and their perceived EHR usability (p=0.159), workload (p=0.753), and satisfaction (p=0.773). Conclusion: We found that there was low congruency between physicians' EHR-related fatigue and the perceived ratings for usability, satisfaction, and workload, which suggests using actual and perceived measures for a comprehensive assessment of the user experience. EHR-related fatigue may not be instantly felt by some physicians, hence the similar rating of perceived EHR experience among physicians.

Physician experiences of screen-level features in a prominent electronic health record: Design recommendations from a qualitative study.

The goal of this qualitative study was to assess physicians' perceptions around features of key screens within a prominent commercial EHR, and to solicit end-user recommendations for improved retrieval of high-priority clinical information. We conducted a qualitative, descriptive study of 25 physicians in a medical ICU setting. at a tertiary academic medical center. An in-depth, semi-structured interview guide was developed to elicit physician perceptions on information retrieval as well as favorable and unfavorable features of specific EHR screens. Transcripts were independently coded in a qualitative software management tool by at least two trained coders using a common code book. We successfully obtained vendor permission to map physicians perception's on full Epic© screenshots. Among the 25 physician participants (13 female; 5 attending physicians, 9 fellows, 11 residents), the majority of participants reported experiencing challenges finding clinical information in the EHR. We present the most favorable and unfavorable screen-level features for four central EHR screens: Flowsheet, Notes/Chart Review, Results Review, and Vital Signs. We also compiled participants' recommendations for a comprehensive EHR dashboard screen to better support clinical workflow and information retrieval in the medical ICU through User-Centered Design. ICU physicians demonstrated a mix of positive and negative attitudes toward specific screen-level features in a major vendor-based EHR system. Physician perceptions of information overload emerged as a theme across multiple EHR screens. Our findings underscore the importance of qualitative research and end-user feedback in EHR software design and interface optimization at both the vendor and institutional level.

Association between ICU interruptions and physicians trainees' electronic health records efficiency.

The intensive care unit (ICU) is a stressful and complex environment in due to its dynamic nature and severity of admitted patients. EHR interface design can be cumbersome and lead to prolonged times to complete tasks. This paper investigated the relationship between a prominent EHR interface design and interruptions with physician's efficiency during patient chart review at ICU Pre-Rounds. We conducted a live observation of ICU physicians in a 30-bed MICU at a tertiary, southeastern medical center. Directly after the observation sessions, the physicians completed a modified System Usability Scale (SUS) survey. A total of 52 EHR patient chart reviews were observed at the MICU Pre-rounds. There was statistically significant positive correlation between time spent to review patient EHR with both number of scrolling(p-value<0.0001) across EHR interface; and with number of visited EHR  screens (p-value=0.0444). There was positive correlation between number of interruptions with time spent to review patient EHR during ICU prerounds. EHR design and the occurrence of interruptions lead to reduced physician-EHR efficiency levels. We report that the number of scrolling and visited screens executed by physicians to gather the required information was associated with increased screen time and consequently decreased physician efficiency.

Analysing EHR navigation patterns and digital workflows among physicians during ICU pre-rounds.

BACKGROUND: Some physicians in intensive care units (ICUs) report that electronic health records (EHRs) can be cumbersome and disruptive to workflow. There are significant gaps in our understanding of the physician-EHR interaction. OBJECTIVE: To better understand how clinicians use the EHR for chart review during ICU pre-rounds through the characterisation and description of screen navigation pathways and workflow patterns. METHOD: We conducted a live, direct observational study of six physician trainees performing electronic chart review during daily pre-rounds in the 30-bed medical ICU at a large academic medical centre in the Southeastern United States. A tailored checklist was used by observers for data collection. RESULTS: We observed 52 distinct live patient chart review encounters, capturing a total of 2.7 hours of pre-rounding chart review activity by six individual physicians. Physicians reviewed an average of 8.7 patients (range = 5-12), spending a mean of 3:05 minutes per patient (range = 1:34-5:18). On average, physicians visited 6.3 (±3.1) total EHR screens per patient (range = 1-16). Four unique screens were viewed most commonly, accounting for over half (52.7%) of all screen visits: results review (17.9%), summary/overview (13.0%), flowsheet (12.7%), and the chart review tab (9.1%). Navigation pathways were highly variable, but several common screen transition patterns emerged across users. Average interrater reliability for the paired EHR observation was 80.0%. CONCLUSION: We observed the physician-EHR interaction during ICU pre-rounds to be brief and highly focused. Although we observed a high degree of "information sprawl" in physicians' digital navigation, we also identified common launch points for electronic chart review, key high-traffic screens and common screen transition patterns. IMPLICATIONS: From the study findings, we suggest recommendations towards improved EHR design.

A rapidly deployed, interactive, online visualization system to support fatality management during the coronavirus disease 2019 (COVID-19) pandemic.

OBJECTIVE: To create an online visualization to support fatality management in North Carolina. MATERIALS AND METHODS: A web application aggregates online datasets for coronavirus disease 2019 (COVID-19) infection rates and morgue utilization. The data are visualized through an interactive, online dashboard. RESULTS: The web application was shared with state and local public health officials across North Carolina. Users could adjust interactive maps and other statistical charts to view live reports of metrics at multiple aggregation levels (eg, county or region). The application also provides access to detailed tabular data for individual facilities. DISCUSSION: Stakeholders found this tool helpful for providing situational awareness of capacity, hotspots, and utilization fluctuations. Timely reporting of facility and county data were key, and future work can help streamline the data collection process. There is potential to generalize the technology to other use cases. CONCLUSIONS: This dashboard facilitates fatality management by visualizing county and regional aggregate statistics in North Carolina.

Association of Electronic Health Record Use With Physician Fatigue and Efficiency.

Importance: The use of electronic health records (EHRs) is directly associated with physician burnout. An underlying factor associated with burnout may be EHR-related fatigue owing to insufficient user-centered interface design and suboptimal usability. Objective: To examine the association between EHR use and fatigue, as measured by pupillometry, and efficiency, as measured by mouse clicks, time, and number of EHR screens, among intensive care unit (ICU) physicians completing a simulation activity in a prominent EHR. Design, Setting, and Participants: A cross-sectional, simulation-based EHR usability assessment of a leading EHR system was conducted from March 20 to April 5, 2018, among 25 ICU physicians and physician trainees at a southeastern US academic medical center. Participants completed 4 simulation patient cases in the EHR that involved information retrieval and task execution while wearing eye-tracking glasses. Fatigue was quantified through continuous eye pupil data; EHR efficiency was characterized through task completion time, mouse clicks, and EHR screen visits. Data were analyzed from June 1, 2018, to August 31, 2019. Main Outcomes and Measures: Primary outcomes were physician fatigue, measured by pupillometry (with lower scores indicating greater fatigue), and EHR efficiency, measured by task completion times, number of mouse clicks, and number of screens visited during EHR simulation. Results: The 25 ICU physicians (13 women; mean [SD] age, 32.1 [6.1] years) who completed a simulation exercise involving 4 patient cases (mean [SD] completion time, 34:43 [11:41] minutes) recorded a total of 14 hours and 27 minutes of EHR activity. All physician participants experienced physiological fatigue at least once during the exercise, and 20 of 25 participants (80%) experienced physiological fatigue within the first 22 minutes of EHR use. Physicians who experienced EHR-related fatigue in 1 patient case were less efficient in the subsequent patient case, as demonstrated by longer task completion times (r = -0.521; P = .007), higher numbers of mouse clicks (r = -0.562; P = .003), and more EHR screen visits (r = -0.486; P = .01). Conclusions and Relevance: This study reports high rates of fatigue among ICU physicians during short periods of EHR simulation, which were negatively associated with EHR efficiency and included a carryover association across patient cases. More research is needed to investigate the underlying causes of EHR-associated fatigue, to support user-centered EHR design, and to inform safe EHR use policies and guidelines.

Physicians' gender and their use of electronic health records: findings from a mixed-methods usability study.

OBJECTIVE: Physician burnout associated with EHRs is a major concern in health care. A comprehensive assessment of differences among physicians in the areas of EHR performance, efficiency, and satisfaction has not been conducted. The study sought to study relationships among physicians' performance, efficiency, perceived workload, satisfaction, and usability in using the electronic health record (EHR) with comparisons by age, gender, professional role, and years of experience with the EHR. MATERIALS AND METHODS: Mixed-methods assessments of the medical intensivists' EHR use and perceptions. Using simulated cases, we employed standardized scales, performance measures, and extensive interviews. NASA Task Load Index (TLX), System Usability Scale (SUS), and Questionnaire on User Interface Satisfaction surveys were deployed. RESULTS: The study enrolled 25 intensive care unit (ICU) physicians (11 residents, 9 fellows, 5 attendings); 12 (48%) were men, with a mean age of 33 (range, 28-55) years and a mean of 4 (interquartile range, 2.0-5.5) years of Epic experience. Overall task performance scores were similar for men (90% ± 9.3%) and women (92% ± 4.4%), with no statistically significant differences (P = .374). However, female physicians demonstrated higher efficiency in completion time (difference = 7.1 minutes; P = .207) and mouse clicks (difference = 54; P = .13). Overall, men reported significantly higher perceived EHR workload stress compared with women (difference = 17.5; P < .001). Men reported significantly higher levels of frustration with the EHR compared with women (difference = 33.15; P < .001). Women reported significantly higher satisfaction with the ease of use of the EHR interface than men (difference = 0.66; P =.03). The women's perceived overall usability of the EHR is marginally higher than that of the men (difference = 10.31; P =.06). CONCLUSIONS: Among ICU physicians, we measured significant gender-based differences in perceived EHR workload stress, satisfaction, and usability-corresponding to objective patterns in EHR efficiency. Understanding the reasons for these differences may help reduce burnout and guide improvements to physician performance, efficiency, and satisfaction with EHR use. DESIGN: Mixed-methods assessments of the medical intensivists' EHR use and perceptions. Using simulated cases, we employed standardized scales, performance measures, and extensive interviews.

Understanding the Impact of Clinical Training on EHR Use Optimization.

Electronic health records usability creates challenges to the delivery of care. This paper presents a novel approach to user analysis. Fixation counts have been analyzed to identify differences among physicians of 3 experience levels - residents, fellows and attending physicians. The findings indicate that users with different training levels had varied experiences while interacting with the same interface. EHRs will always be used by a variety of user groups, each with their own unique characteristics and therefore user analysis must be an important component of EHR usability testing. Eye tracking technology could serve as a valuable tool in this context.

Novel Eye-Tracking Methods to Evaluate the Usability of Electronic Health Records.

The Electronic Health Record has become a staple today in every hospital and clinic, thanks to policy changes advocating its use. However, its full potential can be realized only when it is easy to use and compliant to the needs of the different user subgroups. This study uses a novel approach of eye tracking to assess and differentiate EHR usability based on gender. Though the findings were not suggestive of a significant gender-based difference, they did indicate that the design and layout of screen elements have a significant influence on the search efficiency for both user groups and this point could be relevant for future EHR design.

A mixed-methods evaluation framework for electronic health records usability studies.

BACKGROUND: Poor EHR design adds further challenges, especially in the areas of order entry and information visualization, with a net effect of increased rates of incidents, accidents, and mortality in ICU settings. OBJECTIVE: The purpose of this study was to propose a novel, mixed-methods framework to understand EHR-related information overload by identifying and characterizing areas of suboptimal usability and clinician frustration within a vendor-based, provider-facing EHR interface. METHODS: A mixed-methods, live observational usability study was conducted at a single, large, tertiary academic medical center in the Southeastern US utilizing a commercial, vendor based EHR. Physicians were asked to complete usability patient cases, provide responses to three surveys, and participant in a semi-structured interview. RESULTS: Of the 25 enrolled ICU physician participants, there were 5(20%) attending physicians, 9 (36%) fellows, and 11 (44%) residents; 52% of participants were females. On average, residents were the quickest in completing the tasks while attending physician took the longest to complete the same task. Poor usability, complex interface screens, and difficulty to navigate the EHR significantly correlated with high frustration levels. Significant association were found between the occurrence of error messages and temporal demand such that more error messages resulted in longer completion time (p = .03). DISCUSSION: Physicians remain frustrated with the EHR due to difficulty in finding patient information. EHR usability remains a critical challenge in healthcare, with implications for medical errors, patient safety, and clinician burnout. There is a need for scientific findings on current information needs and ways to improve EHR-related information overload.

Classifying Provider-EHR Screen Interactions During ICU Pre-Rounds.

Electronic health records (EHR) usability is paramount for high quality of care delivery, clinician productivity and effectiveness, and patient outcomes. This paper investigates clinicians EHR pathways during pre-rounds by characterizing the top EHR screens, duration per screen, and the path taken to complete a task. Structured observations were conducted of ICU providers interacting with the EHR in a real-time, real-world setting to better characterize the information retrieval process. Based on preliminary results of the observations, key areas of information needs have been identified and a preliminary model of EHR workflow has been established. The study highlights that there is a clear discrepancy in usage in EHR screens among ICU residents suggesting that there is a perceived clinician's pathology to finding patient information.

Central hemodynamics and cardiovascular risk in nondippers.

Failure of blood pressure (BP) to decline appropriately overnight (nondipping) is associated with increased risk. This may be due to inappropriately raised supine central BP and this study's first aim was to examine this hypothesis. Secondly, aortic stiffness, central hemodynamics, and left ventricular (LV) mass were measured as other possible mechanisms of higher risk. Brachial and central BP (supine and seated), aortic stiffness, central hemodynamics, and LV dimensions were measured in 95 patients with hypertension (mean age 62 ± 8 standard deviation). Central hemodynamics were recorded by combined radial tonometry and 3-dimensional echocardiography. Seated brachial and central systolic BP (SBP) were similar between dippers (n = 52) and nondippers (n = 43). However, nondippers had higher supine brachial (132 ± 14 mm Hg vs 126 ± 11 mm Hg; P = .029) and central (121 ± 15 mm Hg vs 115 ± 11 mm Hg; P = .024) SBP. Aortic stiffness was not different between groups (P = .76), but LV mass index (33.0 ± 6.2 vs 29.4±7.2 g/m(2.7) ; P=.019), stroke volume index (30.2 ± 6.2 mL/m(2) vs 27.4 ± 6.0 mL/m(2) ; P = .040), and LV stroke work (3246 ± 815 mm Hg/mL/m(2) vs 2778 ± 615 mm Hg/mL/m(2) ; P = .005) were all higher in nondippers. Dipper status independently predicted LV mass index (ß = 3.61; P = .001). Nondippers have higher supine brachial and central SBP, significantly different central hemodynamics, and elevated LV mass index compared with dippers. These cardiovascular anomalies possibly contribute to increased mortality risk.