Real-Time Electronic Patient Portal Use Among Emergency Department Patients.

Importance: Patients with inequitable access to patient portals frequently present to emergency departments (EDs) for care. Little is known about portal use patterns among ED patients. Objectives: To describe real-time patient portal usage trends among ED patients and compare demographic and clinical characteristics between portal users and nonusers. Design, Setting, and Participants: In this cross-sectional study of 12 teaching and 24 academic-affiliated EDs from 8 health systems in California, Connecticut, Massachusetts, Ohio, Tennessee, Texas, and Washington, patient portal access and usage data were evaluated for all ED patients 18 years or older between April 5, 2021, and April 4, 2022. Exposure: Use of the patient portal during ED visit. Main Outcomes and Measures: The primary outcomes were the weekly proportions of ED patients who logged into the portal, viewed test results, and viewed clinical notes in real time. Pooled random-effects models were used to evaluate temporal trends and demographic and clinical characteristics associated with real-time portal use. Results: The study included 1 280 924 unique patient encounters (53.5% female; 0.6% American Indian or Alaska Native, 3.7% Asian, 18.0% Black, 10.7% Hispanic, 0.4% Native Hawaiian or Pacific Islander, 66.5% White, 10.0% other race, and 4.0% with missing race or ethnicity; 91.2% English-speaking patients; mean [SD] age, 51.9 [19.2] years). During the study, 17.4% of patients logged into the portal while in the ED, whereas 14.1% viewed test results and 2.5% viewed clinical notes. The odds of accessing the portal (odds ratio [OR], 1.36; 95% CI, 1.19-1.56), viewing test results (OR, 1.63; 95% CI, 1.30-2.04), and viewing clinical notes (OR, 1.60; 95% CI, 1.19-2.15) were higher at the end of the study vs the beginning. Patients with active portal accounts at ED arrival had a higher odds of logging into the portal (OR, 17.73; 95% CI, 9.37-33.56), viewing test results (OR, 18.50; 95% CI, 9.62-35.57), and viewing clinical notes (OR, 18.40; 95% CI, 10.31-32.86). Patients who were male, Black, or without commercial insurance had lower odds of logging into the portal, viewing results, and viewing clinical notes. Conclusions and Relevance: These findings suggest that real-time patient portal use during ED encounters has increased over time, but disparities exist in portal access that mirror trends in portal usage more generally. Given emergency medicine's role in caring for medically underserved patients, there are opportunities for EDs to enroll and train patients in using patient portals to promote engagement during and after their visits.

Implementable Prediction of Pressure Injuries in Hospitalized Adults: Model Development and Validation.

Background: Numerous pressure injury prediction models have been developed using electronic health record data, yet hospital-acquired pressure injuries (HAPIs) are increasing, which demonstrates the critical challenge of implementing these models in routine care. Objective: To help bridge the gap between development and implementation, we sought to create a model that was feasible, broadly applicable, dynamic, actionable, and rigorously validated and then compare its performance to usual care (ie, the Braden scale). Methods: We extracted electronic health record data from 197,991 adult hospital admissions with 51 candidate features. For risk prediction and feature selection, we used logistic regression with a least absolute shrinkage and selection operator (LASSO) approach. To compare the model with usual care, we used the area under the receiver operating curve (AUC), Brier score, slope, intercept, and integrated calibration index. The model was validated using a temporally staggered cohort. Results: A total of 5458 HAPIs were identified between January 2018 and July 2022. We determined 22 features were necessary to achieve a parsimonious and highly accurate model. The top 5 features included tracheostomy, edema, central line, first albumin measure, and age. Our model achieved higher discrimination than the Braden scale (AUC 0.897, 95% CI 0.893-0.901 vs AUC 0.798, 95% CI 0.791-0.803). Conclusions: We developed and validated an accurate prediction model for HAPIs that surpassed the standard-of-care risk assessment and fulfilled necessary elements for implementation. Future work includes a pragmatic randomized trial to assess whether our model improves patient outcomes.

Development and Validation of a Machine Learning Algorithm Using Clinical Pages to Predict Imminent Clinical Deterioration.

BACKGROUND: Early detection of clinical deterioration among hospitalized patients is a clinical priority for patient safety and quality of care. Current automated approaches for identifying these patients perform poorly at identifying imminent events. OBJECTIVE: Develop a machine learning algorithm using pager messages sent between clinical team members to predict imminent clinical deterioration. DESIGN: We conducted a large observational study using long short-term memory machine learning models on the content and frequency of clinical pages. PARTICIPANTS: We included all hospitalizations between January 1, 2018 and December 31, 2020 at Vanderbilt University Medical Center that included at least one page message to physicians. Exclusion criteria included patients receiving palliative care, hospitalizations with a planned intensive care stay, and hospitalizations in the top 2% longest length of stay. MAIN MEASURES: Model classification performance to identify in-hospital cardiac arrest, transfer to intensive care, or Rapid Response activation in the next 3-, 6-, and 12-hours. We compared model performance against three common early warning scores: Modified Early Warning Score, National Early Warning Score, and the Epic Deterioration Index. KEY RESULTS: There were 87,783 patients (mean [SD] age 54.0 [18.8] years; 45,835 [52.2%] women) who experienced 136,778 hospitalizations. 6214 hospitalized patients experienced a deterioration event. The machine learning model accurately identified 62% of deterioration events within 3-hours prior to the event and 47% of events within 12-hours. Across each time horizon, the model surpassed performance of the best early warning score including area under the receiver operating characteristic curve at 6-hours (0.856 vs. 0.781), sensitivity at 6-hours (0.590 vs. 0.505), specificity at 6-hours (0.900 vs. 0.878), and F-score at 6-hours (0.291 vs. 0.220). CONCLUSIONS: Machine learning applied to the content and frequency of clinical pages improves prediction of imminent deterioration. Using clinical pages to monitor patient acuity supports improved detection of imminent deterioration without requiring changes to clinical workflow or nursing documentation.

The State-of-the-Art of Patient Portals: Adapting to External Factors, Addressing Barriers, and Innovating.

BACKGROUND AND OBJECTIVE: Recent external factors-the 21st Century Cures Act and the coronavirus disease 2019 (COVID-19) pandemic-have stimulated major changes in the patient portal landscape. The objective of this state-of-the-art review is to describe recent developments in the patient portal literature and to identify recommendations and future directions for the design, implementation, and evaluation of portals. METHODS: To focus this review on salient contemporary issues, we elected to center it on four topics: (1) 21st Century Cures Act's impact on patient portals (e.g., Open Notes); (2) COVID-19's pandemic impact on portals; (3) proxy access to portals; and (4) disparities in portal adoption and use. We conducted targeted PubMed searches to identify recent empirical studies addressing these topics, used a two-part screening process to determine relevance, and conducted thematic analyses. RESULTS: Our search identified 174 unique papers, 74 were relevant empirical studies and included in this review. Among these papers, we identified 10 themes within our four a priori topics, including preparing for and understanding the consequences of increased patient access to their electronic health information (Cures Act); developing, deploying, and evaluating new virtual care processes (COVID-19); understanding current barriers to formal proxy use (proxy access); and addressing disparities in portal adoption and use (disparities). CONCLUSION: Our results suggest that the recent trends toward understanding the implications of immediate access to most test results, exploring ways to close gaps in portal adoption and use among different sub-populations, and finding ways to leverage portals to improve health and health care are the next steps in the maturation of patient portals and are key areas that require more research. It is important that health care organizations share their innovative portal efforts, so that successful measures can be tested in other contexts, and progress can continue.

POINT: Pipeline for Offline Conversion and Integration of Geocodes and Neighborhood Data.

OBJECTIVES: Geocoding, the process of converting addresses into precise geographic coordinates, allows researchers and health systems to obtain neighborhood-level estimates of social determinants of health. This information supports opportunities to personalize care and interventions for individual patients based on the environments where they live. We developed an integrated offline geocoding pipeline to streamline the process of obtaining address-based variables, which can be integrated into existing data processing pipelines. METHODS: POINT is a web-based, containerized, application for geocoding addresses that can be deployed offline and made available to multiple users across an organization. Our application supports use through both a graphical user interface and application programming interface to query geographic variables, by census tract, without exposing sensitive patient data. We evaluated our application's performance using two datasets: one consisting of 1 million nationally representative addresses sampled from Open Addresses, and the other consisting of 3,096 previously geocoded patient addresses. RESULTS: A total of 99.4 and 99.8% of addresses in the Open Addresses and patient addresses datasets, respectively, were geocoded successfully. Census tract assignment was concordant with reference in greater than 90% of addresses for both datasets. Among successful geocodes, median (interquartile range) distances from reference coordinates were 52.5 (26.5-119.4) and 14.5 (10.9-24.6) m for the two datasets. CONCLUSION: POINT successfully geocodes more addresses and yields similar accuracy to existing solutions, including the U.S. Census Bureau's official geocoder. Addresses are considered protected health information and cannot be shared with common online geocoding services. POINT is an offline solution that enables scalability to multiple users and integrates downstream mapping to neighborhood-level variables with a pipeline that allows users to incorporate additional datasets as they become available. As health systems and researchers continue to explore and improve health equity, it is essential to quickly and accurately obtain neighborhood variables in a Health Insurance Portability and Accountability Act (HIPAA)-compliant way.

Impact of notification policy on patient-before-clinician review of immediately released test results.

The 21st Century Cures Act mandates immediate availability of test results upon request. The Cures Act does not require that patients be informed of results, but many organizations send notifications when results become available. Our medical center implemented 2 sequential policies: immediate notifications for all results, and notifications only to patients who opt in. We used over 2 years of data from Vanderbilt University Medical Center to measure the effect of these policies on rates of patient-before-clinician result review and patient-initiated messaging using interrupted time series analysis. When releasing test results with immediate notification, the proportion of patient-before-clinician review increased 4-fold and the proportion of patients who sent messages rose 3%. After transition to opt-in notifications, patient-before-clinician review decreased 2.4% and patient-initiated messaging decreased 0.4%. Replacing automated notifications with an opt-in policy provides patients flexibility to indicate their preferences but may not substantially alleviate clinicians' messaging workload.

Perspectives of Patients About Immediate Access to Test Results Through an Online Patient Portal.

Importance: The 21st Century Cures Act Final Rule mandates the immediate electronic availability of test results to patients, likely empowering them to better manage their health. Concerns remain about unintended effects of releasing abnormal test results to patients. Objective: To assess patient and caregiver attitudes and preferences related to receiving immediately released test results through an online patient portal. Design, Setting, and Participants: This large, multisite survey study was conducted at 4 geographically distributed academic medical centers in the US using an instrument adapted from validated surveys. The survey was delivered in May 2022 to adult patients and care partners who had accessed test results via an online patient portal account between April 5, 2021, and April 4, 2022. Exposures: Access to test results via a patient portal between April 5, 2021, and April 4, 2022. Main Outcomes and Measures: Responses to questions related to demographics, test type and result, reaction to result, notification experience and future preferences, and effect on health and well-being were aggregated. To evaluate characteristics associated with patient worry, logistic regression and pooled random-effects models were used to assess level of worry as a function of whether test results were perceived by patients as normal or not normal and whether patients were precounseled. Results: Of 43 380 surveys delivered, there were 8139 respondents (18.8%). Most respondents were female (5129 [63.0%]) and spoke English as their primary language (7690 [94.5%]). The median age was 64 years (IQR, 50-72 years). Most respondents (7520 of 7859 [95.7%]), including 2337 of 2453 individuals (95.3%) who received nonnormal results, preferred to immediately receive test results through the portal. Few respondents (411 of 5473 [7.5%]) reported that reviewing results before they were contacted by a health care practitioner increased worry, though increased worry was more common among respondents who received abnormal results (403 of 2442 [16.5%]) than those whose results were normal (294 of 5918 [5.0%]). The result of the pooled model for worry as a function of test result normality was statistically significant (odds ratio [OR], 2.71; 99% CI, 1.96-3.74), suggesting an association between worry and nonnormal results. The result of the pooled model evaluating the association between worry and precounseling was not significant (OR, 0.70; 99% CI, 0.31-1.59). Conclusions and Relevance: In this multisite survey study of patient attitudes and preferences toward receiving immediately released test results via a patient portal, most respondents preferred to receive test results via the patient portal despite viewing results prior to discussion with a health care professional. This preference persisted among patients with nonnormal results.

Non-Interruptive Clinical Decision Support to Improve Perioperative Electronic Positive Patient Identification.

Positive patient identification (PPID) is an integral step to ensure the correct patient identity prior to a healthcare delivery event. Following implementation of a new EHR in November 2017, Vanderbilt University Medical Center (VUMC) experienced frequent and inconsistent failure of barcode scanners which impacted the electronic PPID (ePPID) and blood verification processes. Following multiple iterations of troubleshooting, vendor engagement, and device upgrades, we developed a clinical decision support (CDS) tool as a visual reminder to perform ePPID. If ePPID was initially bypassed, the clinician received a passive alert which remained visible throughout the procedure or until ePPID was completed successfully. We conducted a retrospective observational study using an interrupted time series analysis and analysis of variance pre- and post- CDS intervention. Following CDS intervention, we observed an immediate 20.8% increase in successful ePPID (p < 0.001). The mean success rate of ePPID attempts increased from 62.0% pre-intervention to 94.4% post-intervention (p < 0.001). There were 108 providers who had less than 80.0% success in the six-months prior to CDS intervention, of whom all improved to an average of 95.9% success. Our CDS approach highlights the utility of non-interruptive but continually visible alerts to improve patient safety workflows. By making errors clearly visible to users and their peers, performance improved to only 5.6% of alerts bypassed.

An Analysis of Electronic Health Record Work to Manage Asynchronous Clinical Messages among Breast Cancer Care Teams.

OBJECTIVE: Asynchronous messaging is an integral aspect of communication in clinical settings, but imposes additional work and potentially leads to inefficiency. The goal of this study was to describe the time spent using the electronic health record (EHR) to manage asynchronous communication to support breast cancer care coordination. METHODS: We analyzed 3 years of audit logs and secure messaging logs from the EHR for care team members involved in breast cancer care at Vanderbilt University Medical Center. To evaluate trends in EHR use, we combined log data into sequences of events that occurred within 15 minutes of any other event by the same employee about the same patient. RESULTS: Our cohort of 9,761 patients were the subject of 430,857 message threads by 7,194 employees over a 3-year period. Breast cancer care team members performed messaging actions in 37.5% of all EHR sessions, averaging 29.8 (standard deviation [SD] = 23.5) messaging sessions per day. Messaging sessions lasted an average of 1.1 (95% confidence interval: 0.99-1.24) minutes longer than nonmessaging sessions. On days when the cancer providers did not otherwise have clinical responsibilities, they still performed messaging actions in an average of 15 (SD = 11.9) sessions per day. CONCLUSION: At our institution, clinical messaging occurred in 35% of all EHR sessions. Clinical messaging, sometimes viewed as a supporting task of clinical work, is important to delivering and coordinating care across roles. Measuring the electronic work of asynchronous communication among care team members affords the opportunity to systematically identify opportunities to improve employee workload.

Classification and analysis of asynchronous communication content between care team members involved in breast cancer treatment.

OBJECTIVE: A growing research literature has highlighted the work of managing and triaging clinical messages as a major contributor to professional exhaustion and burnout. The goal of this study was to discover and quantify the distribution of message content sent among care team members treating patients with breast cancer. MATERIALS AND METHODS: We analyzed nearly two years of communication data from the electronic health record (EHR) between care team members at Vanderbilt University Medical Center. We applied natural language processing to perform sentence-level annotation into one of five information types: clinical, medical logistics, nonmedical logistics, social, and other. We combined sentence-level annotations for each respective message. We evaluated message content by team member role and clinic activity. RESULTS: Our dataset included 81 857 messages containing 613 877 sentences. Across all roles, 63.4% and 21.8% of messages contained logistical information and clinical information, respectively. Individuals in administrative or clinical staff roles sent 81% of all messages containing logistical information. There were 33.2% of messages sent by physicians containing clinical information-the most of any role. DISCUSSION AND CONCLUSION: Our results demonstrate that EHR-based asynchronous communication is integral to coordinate care for patients with breast cancer. By understanding the content of messages sent by care team members, we can devise informatics initiatives to improve physicians' clerical burden and reduce unnecessary interruptions.

Characterizing communication patterns among members of the clinical care team to deliver breast cancer treatment.

OBJECTIVE: Research to date focused on quantifying team collaboration has relied on identifying shared patients but does not incorporate the major role of communication patterns. The goal of this study was to describe the patterns and volume of communication among care team members involved in treating breast cancer patients. MATERIALS AND METHODS: We analyzed 4 years of communications data from the electronic health record between care team members at Vanderbilt University Medical Center (VUMC). Our cohort of patients diagnosed with breast cancer was identified using the VUMC tumor registry. We classified each care team member participating in electronic messaging by their institutional role and classified physicians by specialty. To identify collaborative patterns, we modeled the data as a social network. RESULTS: Our cohort of 1181 patients was the subject of 322 424 messages sent in 104 210 unique communication threads by 5620 employees. On average, each patient was the subject of 88.2 message threads involving 106.4 employees. Each employee, on average, sent 72.9 messages and was connected to 24.6 collaborators. Nurses and physicians were involved in 98% and 44% of all message threads, respectively. DISCUSSION AND CONCLUSION: Our results suggest that many providers in our study may experience a high volume of messaging work. By using data routinely generated through interaction with the electronic health record, we can begin to evaluate how to iteratively implement and assess initiatives to improve the efficiency of care coordination and reduce unnecessary messaging work across all care team roles.

Evaluating the Scope of Clinical Electronic Messaging to Coordinate Care in a Breast Cancer Cohort.

Care coordination has received attention as an opportunity to improve healthcare delivery. Current work to quantify provider coordination has primarily relied on identifying shared patients, but neglects to understand communication patterns. We applied social network analysis to electronic health record (EHR) secure messaging data to compare networks of providers who share patients and networks of providers who communicate about patients. We studied 2175 stage I-III breast cancer patients who received outpatient treatment from 1758 providers at a large academic medical center in the southeastern United States. Patients in our cohort were involved in 94324 appointments and were the subject of 307144 message threads. We found that 9.9% of provider-provider pairs that shared patients were mutually involved in electronic communication about their patients. EHR data sources can be used to evaluate provider communication across a clinical enterprise, which can help identify opportunities to improve collaboration and reduce provider burnout.

Characterizing the impact of health literacy, computer ability, patient demographics, and portal usage on patient satisfaction with a patient portal.

OBJECTIVE: We sought to measure patient portal satisfaction with patient portals and characterize its relationship to attitude towards computers, health literacy, portal usage, and patient demographics. MATERIALS AND METHODS: We invited 13 040 patients from an academic medical center to complete a survey measuring satisfaction, perceived control over computers, and health literacy using validated instruments (End User Computing Satisfaction, Computer Attitude Measure, and Brief Health Literacy Screen). We extracted portal usage and demographic information from the medical center data warehouse. RESULTS: A total of 6026 (46.2%) patients completed the survey. The median (IQR) scores for satisfaction, computer control, and health literacy were 87% (20%), 86% (22%), and 95% (15%), respectively. The normalized mean (SD) usage of messaging, lab, appointment, medication, and immunization functions were 6.6 (2.6), 4.6 (2.4), 3.1 (1.7), 1.5 (1.2), and 0.88 (0.91) times, respectively. Logistic regression yielded significant odds ratios [99% CI] for computer control (3.6 [2.5-5.2]), health literacy (12 [6.9-23]), and immunization function usage (0.84 [0.73-0.96]). DISCUSSION: Respondents were highly satisfied and had high degrees of computer control and health literacy. Statistical analysis revealed that higher computer control and health literacy predicted higher satisfaction, whereas usage of the immunization function predicted lower satisfaction. Overall, the analytical model had low predictive capability, suggesting that we failed to capture the main drivers of satisfaction, or there was inadequate variation in satisfaction to delineate its contributing factors. CONCLUSION: This study provides insight into patient satisfaction with and usage of a patient portal. These data can guide the development of the patient portal, with the ultimate goal of increasing functionality and usability to enhance the patient experience.

Policies and procedures governing patient portal use at an Academic Medical Center.

BACKGROUND AND OBJECTIVE: Patient portal use has increased over the last two decades in response to consumer demand and government regulation. Despite growing adoption, few guidelines exist to direct successful implementation and governance. We describe the policies and procedures that have governed over a decade of continuous My Health at Vanderbilt (MHAV) patient portal use. METHODS: We examined MHAV usage data between May 2007 and November 2017. We classified patient portal activity into eight functional categories: Appointment, Billing, Document Access, Genetics, Health Result, Immunization, Medication, and Messaging. We describe our operating policies and measure portal uptake, patient account activity, and function use over time. RESULTS: By the end of the study period, there were 375 517 registered accounts. Policies made MHAV available to competent adults and adolescents 13 and over. Patients signed up for a limited access account online, which could be upgraded to a full-access account after identity verification. Patients could assign proxy accounts to family and caregivers, which permitted nonpatient access to select MHAV functions. Laboratory and radiology results were accessible via MHAV. Results were classified into three groups based on sensitivity, which govern the length of delay before results appeared in MHAV. DISCUSSION AND CONCLUSION: Patient portals offer significant opportunity to engage patients in their healthcare. However, there remains a need to understand how policies can promote uptake and use. We anticipate that other institutions can apply concepts from our policies to support meaningful patient portal engagement.

Managing and Communicating Operational Workflow: Designing and Implementing an Electronic Outpatient Whiteboard.

BACKGROUND: Healthcare team members in emergency department contexts have used electronic whiteboard solutions to help manage operational workflow for many years. Ambulatory clinic settings have highly complex operational workflow, but are still limited in electronic assistance to communicate and coordinate work activities. OBJECTIVE: To describe and discuss the design, implementation, use, and ongoing evolution of a coordination and collaboration tool supporting ambulatory clinic operational workflow at Vanderbilt University Medical Center (VUMC). METHODS: The outpatient whiteboard tool was initially designed to support healthcare work related to an electronic chemotherapy order-entry application. After a highly successful initial implementation in an oncology context, a high demand emerged across the organization for the outpatient whiteboard implementation. Over the past 10 years, developers have followed an iterative user-centered design process to evolve the tool. RESULTS: The electronic outpatient whiteboard system supports 194 separate whiteboards and is accessed by over 2800 distinct users on a typical day. Clinics can configure their whiteboards to support unique workflow elements. Since initial release, features such as immunization clinical decision support have been integrated into the system, based on requests from end users. CONCLUSIONS: The success of the electronic outpatient whiteboard demonstrates the usefulness of an operational workflow tool within the ambulatory clinic setting. Operational workflow tools can play a significant role in supporting coordination, collaboration, and teamwork in ambulatory healthcare settings.

A Social Network Analysis of Cancer Provider Collaboration.

Cancer treatment often consists of multiple therapeutic modalities delivered by specialists. As changing reimbursement paradigms move towards quality outcomes and bundled payments, extensive care coordination between healthcare providers is imperative. We developed an approach to quantify care coordination relationships among providers treating breast cancer patients at the Vanderbilt University Medical Center. Our cohort of 1285 providers treated 3924 breast cancer patients, and had 1758 unique provider-provider relationships. Providers treating stage III breast cancer patients had the highest ratio of providers to patients, indicating a more tightly connected network than providers treating stage I or II patients. Network analysis can provide quantitative approaches to understanding the relationships of multi-specialty providers and may inform approaches to measuring the impact of care coordination on outcomes.