Clinical Prediction Models for Hospital-Induced Delirium Using Structured and Unstructured Electronic Health Record Data: Protocol for a Development and Validation Study.

BACKGROUND: Hospital-induced delirium is one of the most common and costly iatrogenic conditions, and its incidence is predicted to increase as the population of the United States ages. An academic and clinical interdisciplinary systems approach is needed to reduce the frequency and impact of hospital-induced delirium. OBJECTIVE: The long-term goal of our research is to enhance the safety of hospitalized older adults by reducing iatrogenic conditions through an effective learning health system. In this study, we will develop models for predicting hospital-induced delirium. In order to accomplish this objective, we will create a computable phenotype for our outcome (hospital-induced delirium), design an expert-based traditional logistic regression model, leverage machine learning techniques to generate a model using structured data, and use machine learning and natural language processing to produce an integrated model with components from both structured data and text data. METHODS: This study will explore text-based data, such as nursing notes, to improve the predictive capability of prognostic models for hospital-induced delirium. By using supervised and unsupervised text mining in addition to structured data, we will examine multiple types of information in electronic health record data to predict medical-surgical patient risk of developing delirium. Development and validation will be compliant to the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement. RESULTS: Work on this project will take place through March 2024. For this study, we will use data from approximately 332,230 encounters that occurred between January 2012 to May 2021. Findings from this project will be disseminated at scientific conferences and in peer-reviewed journals. CONCLUSIONS: Success in this study will yield a durable, high-performing research-data infrastructure that will process, extract, and analyze clinical text data in near real time. This model has the potential to be integrated into the electronic health record and provide point-of-care decision support to prevent harm and improve quality of care. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/48521.

Experts' Perspectives on Use of Fast Healthcare Interoperable Resources for Computerized Clinical Decision Support.

Barriers to improving the US healthcare system include a lack of interoperability across digital health information and delays in seeking preventative and recommended care. Interoperability can be seen as the lynch pin to reducing fragmentation and improving outcomes related to digital health systems. The prevailing standard for information exchange to enable interoperability is the Health Level Seven International Fast Healthcare Interoperable Resources standard. To better understand Fast Healthcare Interoperable Resources within the context of computerized clinical decision support expert interviews of health informaticists were conducted and used to create a modified force field analysis. Current barriers and future recommendations to scale adoption of Fast Healthcare Interoperable Resources were explored through qualitative analysis of expert interviews. Identified barriers included variation in electronic health record implementation, limited electronic health record vendor support, ontology variation, limited workforce knowledge, and testing limitations. Experts recommended research funders require Fast Healthcare Interoperable Resource usage, development of an "app store," incentives for clinical organizations and electronic health record vendors, and Fast Healthcare Interoperable Resource certification development.

Management of Fall Risk Among Older Adults in Diverse Primary Care Settings.

OBJECTIVES: Falls are persistent among community-dwelling older adults despite existing prevention guidelines. We described how urban and rural primary care staff and older adults manage fall risk and factors important to integration of computerized clinical decision support (CCDS). METHODS: Interviews, contextual inquiries, and workflow observations were analyzed using content analysis and synthesized into a journey map. Sociotechnical and PRISM domains were applied to identify workflow factors important to sustainable CCDS integration. RESULTS: Participants valued fall prevention and described similar approaches. Available resources differed between rural and urban locations. Participants wanted evidence-based guidance integrated into workflows to bridge skills gaps. DISCUSSION: Sites described similar clinical approaches with differences in resource availability. This implies that a single intervention would need to be flexible to environments with differing resources. Electronic Health Record's inherent ability to provide tailored CCDS is limited. However, CCDS middleware could integrate into different settings and increase evidence use.

Usability Testing of an Interoperable Computerized Clinical Decision Support Tool for Fall Risk Management in Primary Care.

BACKGROUND: Falls are a widespread and persistent problem for community-dwelling older adults. Use of fall prevention guidelines in the primary care setting has been suboptimal. Interoperable computerized clinical decision support systems have the potential to increase engagement with fall risk management at scale. To support fall risk management across organizations, our team developed the ASPIRE tool for use in differing primary care clinics using interoperable standards. OBJECTIVES: Usability testing of ASPIRE was conducted to measure ease of access, overall usability, learnability, and acceptability prior to pilot . METHODS: Participants were recruited using purposive sampling from two sites with different electronic health records and different clinical organizations. Formative testing rooted in user-centered design was followed by summative testing using a simulation approach. During summative testing participants used ASPIRE across two clinical scenarios and were randomized to determine which scenario they saw first. Single Ease Question and System Usability Scale were used in addition to analysis of recorded sessions in NVivo. RESULTS: All 14 participants rated the usability of ASPIRE as above average based on usability benchmarks for the System Usability Scale metric. Time on task decreased significantly between the first and second scenarios indicating good learnability. However, acceptability data were more mixed with some recommendations being consistently accepted while others were adopted less frequently. CONCLUSION: This study described the usability testing of the ASPIRE system within two different organizations using different electronic health records. Overall, the system was rated well, and further pilot testing should be done to validate that these positive results translate into clinical practice. Due to its interoperable design, ASPIRE could be integrated into diverse organizations allowing a tailored implementation without the need to build a new system for each organization. This distinction makes ASPIRE well positioned to impact the challenge of falls at scale.

Fall risk management using clinical decision support in a rural nursing-led primary care practice.

BACKGROUND: The leading cause of injuries among older adults in the United States is unintentional falls. The American Geriatrics Society/British Geriatrics Society promote fall risk management in primary care; however, this is challenging in low-resource settings. LOCAL PROBLEM: Archer Family Health Care (AFHC), an Advanced Practice Registered Nurse (APRN)-managed and federally designated rural health clinic, identified a care gap with falls adherence to guidelines for patients at higher risk for falls. METHODS: The aim of this quality improvement effort was to integrate an evidence-based fall risk management tool in a rural nurse-managed primary care practice. A standardized fall risk management process with a new brief paper-based clinical decision support (CDS) tool was developed and tested in two phases. INTERVENTION: Phase 1 focused on developing a fall risk management CDS tool, identifying the primary care visit workflow, communicating the workflow patterns to the AFHC staff, and collaborating with the staff to identify when and who should implement the tool. Phase 2 focused on implementation of the fall risk management CDS tool into standard practice among older adults aged 65 years and older. RESULTS: We found that integrating the tool did not disrupt the workflow of primary care visits at AFHC. The most common recommended intervention for patients at risk of falling was daily vitamin D supplementation. CONCLUSION: This project revealed that it is feasible to introduce a brief fall risk management decision support tool in an APRN-managed rural primary care practice.

Clinical Decision Support for Fall Prevention: Defining End-User Needs.

BACKGROUND AND SIGNIFICANCE: Falls in community-dwelling older adults are common, and there is a lack of clinical decision support (CDS) to provide health care providers with effective, individualized fall prevention recommendations. OBJECTIVES: The goal of this research is to identify end-user (primary care staff and patients) needs through a human-centered design process for a tool that will generate CDS to protect older adults from falls and injuries. METHODS: Primary care staff (primary care providers, care coordinator nurses, licensed practical nurses, and medical assistants) and community-dwelling patients aged 60 years or older associated with Brigham & Women's Hospital-affiliated primary care clinics and the University of Florida Health Archer Family Health Care primary care clinic were eligible to participate in this study. Through semi-structured and exploratory interviews with participants, our team identified end-user needs through content analysis. RESULTS: User needs for primary care staff (n = 24) and patients (n = 18) were categorized under the following themes: workload burden; systematic communication; in-person assessment of patient condition; personal support networks; motivational tools; patient understanding of fall risk; individualized resources; and evidence-based safe exercises and expert guidance. While some of these themes are specific to either primary care staff or patients, several address needs expressed by both groups of end-users. CONCLUSION: Our findings suggest that there are many care gaps in fall prevention management in primary care and that personalized, actionable, and evidence-based CDS has the potential to address some of these gaps.

Identification of important factors in an inpatient fall risk prediction model to improve the quality of care using EHR and electronic administrative data: A machine-learning approach.

BACKGROUND: Inpatient falls, many resulting in injury or death, are a serious problem in hospital settings. Existing falls risk assessment tools, such as the Morse Fall Scale, give a risk score based on a set of factors, but don't necessarily signal which factors are most important for predicting falls. Artificial intelligence (AI) methods provide an opportunity to improve predictive performance while also identifying the most important risk factors associated with hospital-acquired falls. We can glean insight into these risk factors by applying classification tree, bagging, random forest, and adaptive boosting methods applied to Electronic Health Record (EHR) data. OBJECTIVE: The purpose of this study was to use tree-based machine learning methods to determine the most important predictors of inpatient falls, while also validating each via cross-validation. MATERIALS AND METHODS: A case-control study was designed using EHR and electronic administrative data collected between January 1, 2013 to October 31, 2013 in 14 medical surgical units. The data contained 38 predictor variables which comprised of patient characteristics, admission information, assessment information, clinical data, and organizational characteristics. Classification tree, bagging, random forest, and adaptive boosting methods were used to identify the most important factors of inpatient fall-risk through variable importance measures. Sensitivity, specificity, and area under the ROC curve were computed via ten-fold cross validation and compared via pairwise t-tests. These methods were also compared to a univariate logistic regression of the Morse Fall Scale total score. RESULTS: In terms of AUROC, bagging (0.89), random forest (0.90), and boosting (0.89) all outperformed the Morse Fall Scale (0.86) and the classification tree (0.85), but no differences were measured between bagging, random forest, and adaptive boosting, at a p-value of 0.05. History of Falls, Age, Morse Fall Scale total score, quality of gait, unit type, mental status, and number of high fall risk increasing drugs (FRIDs) were considered the most important features for predicting inpatient fall risk. CONCLUSIONS: Machine learning methods have the potential to identify the most relevant and novel factors for the detection of hospitalized patients at risk of falling, which would improve the quality of patient care, and to more fully support healthcare provider and organizational leadership decision-making. Nurses would be able to enhance their judgement to caring for patients at risk for falls. Our study may also serve as a reference for the development of AI-based prediction models of other iatrogenic conditions. To our knowledge, this is the first study to report the importance of patient, clinical, and organizational features based on the use of AI approaches.