Key Considerations When Developing and Implementing Digital Technology for Early Detection of Dementia-Causing Diseases Among Health Care Professionals: Qualitative Study.

BACKGROUND: The World Health Organization (WHO) promotes using digital technologies to accelerate global attainment of health and well-being. This has led to a growth in research exploring the use of digital technology to aid early detection and preventative interventions for dementia-causing diseases such as Alzheimer disease. The opinions and perspectives of health care professionals must be incorporated into the development and implementation of technology to promote its successful adoption in clinical practice. OBJECTIVE: This study aimed to explore health care professionals' perspectives on the key considerations of developing and implementing digital technologies for the early detection of dementia-causing diseases in the National Health Service (NHS). METHODS: Health care professionals with patient-facing roles in primary or secondary care settings in the NHS were recruited through various web-based NHS clinical networks. Participants were interviewed to explore their experiences of the current dementia diagnostic practices, views on early detection and use of digital technology to aid these practices, and the challenges of implementing such interventions in health care. An inductive thematic analysis approach was applied to identify central concepts and themes in the interviews, allowing the data to determine our themes. A list of central concepts and themes was applied systematically to the whole data set using NVivo (version 1.6.1; QSR International). Using the constant comparison technique, the researchers moved backward and forward between these data and evolving explanations until a fit was made. RESULTS: Eighteen semistructured interviews were conducted, with 11 primary and 7 secondary care health care professionals. We identified 3 main categories of considerations relevant to health care service users, health care professionals, and the digital health technology itself. Health care professionals recognized the potential of using digital technology to collect real-time data and the possible benefits of detecting dementia-causing diseases earlier if an effective intervention were available. However, some were concerned about postdetection management, questioning the point of an early detection of dementia-causing diseases if an effective intervention cannot be provided and feared this would only lead to increased anxiety in patients. Health care professionals also expressed mixed opinions on who should be screened for early detection. Some suggested it should be available to everyone to mitigate the chance of excluding those who are not in touch with their health care or are digitally excluded. Others were concerned about the resources that would be required to make the technology available to everyone. CONCLUSIONS: This study highlights the need to design digital health technology in a way that is accessible to all and does not add burden to health care professionals. Further work is needed to ensure inclusive strategies are used in digital research to promote health equity.

Digital Endpoints for Assessing Instrumental Activities of Daily Living in Mild Cognitive Impairment: Systematic Review.

BACKGROUND: Subtle impairments in instrumental activities of daily living (IADLs) can be a key predictor of disease progression and are considered central to functional independence. Mild cognitive impairment (MCI) is a syndrome associated with significant changes in cognitive function and mild impairment in complex functional abilities. The early detection of functional decline through the identification of IADL impairments can aid early intervention strategies. Digital health technology is an objective method of capturing IADL-related behaviors. However, it is unclear how these IADL-related behaviors have been digitally assessed in the literature and what differences can be observed between MCI and normal aging. OBJECTIVE: This review aimed to identify the digital methods and metrics used to assess IADL-related behaviors in people with MCI and report any statistically significant differences in digital endpoints between MCI and normal aging and how these digital endpoints change over time. METHODS: A total of 16,099 articles were identified from 8 databases (CINAHL, Embase, MEDLINE, ProQuest, PsycINFO, PubMed, Web of Science, and Scopus), out of which 15 were included in this review. The included studies must have used continuous remote digital measures to assess IADL-related behaviors in adults characterized as having MCI by clinical diagnosis or assessment. This review was conducted in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. RESULTS: Ambient technology was the most commonly used digital method to assess IADL-related behaviors in the included studies (14/15, 93%), with passive infrared motion sensors (5/15, 33%) and contact sensors (5/15, 33%) being the most prevalent types of methods. Digital technologies were used to assess IADL-related behaviors across 5 domains: activities outside of the home, everyday technology use, household and personal management, medication management, and orientation. Other recognized domains-culturally specific tasks and socialization and communication-were not assessed. Of the 79 metrics recorded among 11 types of technologies, 65 (82%) were used only once. There were inconsistent findings around differences in digital IADL endpoints across the cognitive spectrum, with limited longitudinal assessment of how they changed over time. CONCLUSIONS: Despite the broad range of metrics and methods used to digitally assess IADL-related behaviors in people with MCI, several IADLs relevant to functional decline were not studied. Measuring multiple IADL-related digital endpoints could offer more value than the measurement of discrete IADL outcomes alone to observe functional decline. Key recommendations include the development of suitable core metrics relevant to IADL-related behaviors that are based on clinically meaningful outcomes to aid the standardization and further validation of digital technologies against existing IADL measures. Increased longitudinal monitoring is necessary to capture changes in digital IADL endpoints over time in people with MCI. TRIAL REGISTRATION: PROSPERO International Prospective Register of Systematic Reviews CRD42022326861; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=326861.

A Retrospective Review of Serious Surgical Incidents in 5 Large UK Teaching Hospitals: A System-Based Approach.

OBJECTIVES: Surgical incidents are the most common serious patient safety incidents worldwide. We conducted a review of serious surgical incidents recorded in 5 large teaching hospitals located in one London NHS trust to identify possible contributing factors and propose recommendations for safer healthcare systems. METHODS: We searched the Datix system for all serious surgical incidents that occurred in any operating room, excluding critical care departments, and were recorded between October 2014 and December 2016. We used the London Protocol system analysis framework, which involved a 2-stage approach. A brief description of each incident was produced, and an expert panel analyzed these incidents to identify the most likely contributing factors and what changes should be recommended. RESULTS: One thousand fifty-one surgical incidents were recorded, 14 of which were categorized as "serious" with contributing factors relating to task, equipment and resources, teamwork, work environmental, and organizational and management. Operating room protocols were found to be unavailable, outdated, or not followed correctly in 8 incidents studied. The World Health Organization surgical safety checklist was not adhered to in 8 incidents, with the surgical and anesthetic team not informed about faulty equipment or product shortages before surgery. The lack of effective communication within multidisciplinary teams and inadequate medical staffing levels were perceived to have contributed. CONCLUSIONS: Multiple factors contributed to the occurrence of serious surgical incidents, many of which related to human failures and faulty equipment. The use of faulty equipment needs to be recognized as a major risk within departments and promptly addressed.

Designing Digital Health Technology to Support Patients Before and After Bariatric Surgery: Qualitative Study Exploring Patient Desires, Suggestions, and Reflections to Support Lifestyle Behavior Change.

BACKGROUND: A patient's capability, motivation, and opportunity to change their lifestyle are determinants of successful outcomes following bariatric surgery. Lifestyle changes before and after surgery, including improved dietary intake and physical activity levels, have been associated with greater postsurgical weight loss and improved long-term health. Integrating patient-centered digital technologies within the bariatric surgical pathway could form part of an innovative strategy to promote and sustain healthier behaviors, and provide holistic patient support, to improve surgical success. Previous research focused on implementing digital technologies and measuring effectiveness in surgical cohorts. However, there is limited work concerning the desires, suggestions, and reflections of patients undergoing bariatric surgery. This qualitative investigation explores patients' perspectives on technology features that would support behavior changes during the pre- and postoperative periods, to potentially maintain long-term healthy lifestyles following surgery. OBJECTIVE: This study aims to understand how digital technologies can be used to support patient care during the perioperative journey to improve weight loss outcomes and surgical success, focusing on what patients want from digital technologies, how they want to use them, and when they would be of most benefit during their surgical journey. METHODS: Patients attending bariatric surgery clinics in one hospital in the North of England were invited to participate. Semistructured interviews were conducted with purposively sampled pre- and postoperative patients to discuss lifestyle changes and the use of digital technologies to complement their care. The interviews were audio recorded and transcribed verbatim. Reflexive thematic analysis enabled the development of themes from the data. Ethical approval was obtained from the National Health Service Health Research Authority. RESULTS: A total of 20 patients were interviewed (preoperative phase: 40% (8/20); postoperative phase: 60% (12/20). A total of 4 overarching themes were developed and related to the optimization of technology functionality. These centered on providing tailored content and support; facilitating self-monitoring and goal setting; delivering information in an accessible, trusted, and usable manner; and meeting patient information-seeking and engagement needs during the surgical pathway. Functionalities that delivered personalized feedback and postoperative follow-up were considered beneficial. Individualized goal setting functionality could support a generation of digitally engaged patients with bariatric conditions as working toward achievable targets was deemed an effective strategy for motivating behavior change. The creation of digital package of care checklists between patients and clinicians was a novel finding from this study. CONCLUSIONS: Perceptions of patients undergoing bariatric surgery validated the integration of digital technologies within the surgical pathway, offering enhanced connectedness and support. Recommendations are made relating to the design, content, and functionality of digital interventions to best address the needs of this cohort. These findings have the potential to influence the co-design and integration of person-centered, perioperative technologies.

The impact of a novel medication scanner on administration errors in the hospital setting: a before and after feasibility study.

OBJECTIVE: The medication administration process is complex and consequently prone to errors. Closed Loop Medication Administration solutions aim to improve patient safety. We assessed the impact of a novel medication scanning device (MedEye) on the rate of medication administration errors in a large UK Hospital. METHODS: We performed a feasibility before and after study on one ward at a tertiary-care teaching hospital that used a commercial electronic prescribing and medication administration system. We conducted direct observations of nursing drug administration rounds before and after the MedEye implementation. We calculated the rate and type ('timing', 'omission' or 'other' error) of medication administration errors (MAEs) before and after the MedEye implementation. RESULTS: We observed a total of 1069 administrations before and 432 after the MedEye intervention was implemented. Data suggested that MedEye could support a reduction in MAEs. After adjusting for heterogeneity, we detected a decreasing effect of MedEye on overall errors (p = 0.0753). Non-timing errors ('omission' and 'other' errors) reduced from 51 (4.77%) to 11 (2.55%), a reduction of 46.5%, which had borderline significance at the 5% level, although this was lost after adjusting for confounders. CONCLUSIONS: This pilot study detected a decreasing effect of MedEye on overall errors and a reduction in non-timing error rates that was clinically important as such errors are more likely to be associated with harm. Further research is needed to investigate the impact on a larger sample of medications.

Eliciting willingness-to-pay to prevent hospital medication administration errors in the UK: a contingent valuation survey.

Medication errors are common in hospitals. These errors can result in adverse drug events (ADEs), which can reduce the health and well-being of patients', and their relatives and caregivers. Interventions have been developed to reduce medication errors, including those that occur at the administration stage. OBJECTIVE: We aimed to elicit willingness-to-pay (WTP) values to prevent hospital medication administration errors. DESIGN AND SETTING: An online, contingent valuation (CV) survey was conducted, using the random card-sort elicitation method, to elicit WTP to prevent medication errors. PARTICIPANTS: A representative sample of the UK public. METHODS: Seven medication error scenarios, varying in the potential for harm and the severity of harm, were valued. Scenarios were developed with input from: clinical experts, focus groups with members of the public and piloting. Mean and median WTP values were calculated, excluding protest responses or those that failed a logic test. A two-part model (logit, generalised linear model) regression analysis was conducted to explore predictive characteristics of WTP. RESULTS: Responses were collected from 1001 individuals. The proportion of respondents willing to pay to prevent a medication error increased as the severity of the ADE increased and was highest for scenarios that described actual harm occurring. Mean WTP across the scenarios ranged from £45 (95% CI £36 to £54) to £278 (95% CI £200 to £355). Several factors influenced both the value and likelihood of WTP, such as: income, known experience of medication errors, sex, field of work, marriage status, education level and employment status. Predictors of WTP were not, however, consistent across scenarios. CONCLUSIONS: This CV study highlights how the UK public value preventing medication errors. The findings from this study could be used to carry out a cost-benefit analysis which could inform implementation decisions on the use of technology to reduce medication administration errors in UK hospitals.

Support for Healthcare Professionals After Surgical Patient Safety Incidents: A Qualitative Descriptive Study in 5 Teaching Hospitals.

OBJECTIVE: Patient safety incidents can have a profound effect on healthcare professionals, with some experiencing emotional and psychological distress. This study explored the support medical and nonmedical operating room staff received after being involved in a surgical patient safety incident(s) in 5 UK teaching hospitals. METHODS: An invitation letter and information sheet were e-mailed to all medical and nonmedical operating room staff (N = 927) across the 5 sites. Semistructured interviews were arranged with a range of different healthcare professionals working in operating rooms across a wide variety of surgical specialities. Interviews were audio recorded, transcribed verbatim, and analyzed using an inductive thematic approach. RESULTS: We conducted 45 interviews with medical and nonmedical operating room staff, who emphasized the importance of receiving personalized support soon after the incident. Operating room staff described how the first "go to" people were their peers and reported feeling comforted when their peers empathized with their own experience(s). Other participants found it very difficult to seek support, perceiving it as a sign of weakness. Although family members played an important role in supporting second victims, some participants felt unable to discuss the incident with them, fearing that they might not understand. CONCLUSIONS: There should be clear support structures in place for operating room staff who have been involved in surgical incidents. Health organizations need to offer timely support to frontline staff after these incidents. Senior clinicians should be proactive in offering support to junior colleagues and empathize with their own experiences, thus shifting the competitive culture to one of openness and support.

Preventing sepsis; how can artificial intelligence inform the clinical decision-making process? A systematic review.

BACKGROUND AND OBJECTIVES: Sepsis is a life-threatening condition that is associated with increased mortality. Artificial intelligence tools can inform clinical decision making by flagging patients at risk of developing infection and subsequent sepsis. This systematic review aims to identify the optimal set of predictors used to train machine learning algorithms to predict the likelihood of an infection and subsequent sepsis. METHODS: This systematic review was registered in PROSPERO database (CRD42020158685). We conducted a systematic literature review across 3 large databases: Medline, Cumulative Index of Nursing and Allied Health Literature, and Embase. Quantitative primary research studies that focused on sepsis prediction associated with bacterial infection in adults in all care settings were eligible for inclusion. RESULTS: Seventeen articles met our inclusion criteria. We identified 194 predictors that were used to train machine learning algorithms, with 13 predictors used on average across all included studies. The most prevalent predictors included age, gender, smoking, alcohol intake, heart rate, blood pressure, lactate level, cardiovascular disease, endocrine disease, cancer, chronic kidney disease (eGFR<60 mL/min), white blood cell count, liver dysfunction, surgical approach (open or minimally invasive), and pre-operative haematocrit < 30 %. All included studies used artificial intelligence techniques, with average sensitivity 75.7 ± 17.88, and average specificity 63.08 ± 22.01. CONCLUSION: The type of predictors influenced the predictive power and predictive timeframe of the developed machine learning algorithm. Predicting the likelihood of sepsis through artificial intelligence can help concentrate finite resources to those patients who are most at risk. Future studies should focus on developing more sensitive and specific algorithms.

Designing the Optimal Digital Health Intervention for Patients' Use Before and After Elective Orthopedic Surgery: Qualitative Study.

BACKGROUND: Health behavior changes made by patients during the perioperative period can impact the outcomes and success of elective surgeries. However, there remains a limited understanding of how best to support patients during this time, particularly through the use of digital health interventions. Recognizing and understanding the potential unmet needs of elective orthopedic surgery patients is central to motivating healthier behavior change, improving recovery, and optimizing overall surgical success in the short and long term. OBJECTIVE: The aim of this study is to explore patient perspectives on technology features that would help support them to change their lifestyle behaviors during the pre- and postoperative periods, and that could potentially maintain long-term healthy lifestyles following recovery. METHODS: Semistructured interviews with pre- and postoperative elective orthopedic patients were conducted between May and June 2020 using telephone and video call-based software. Patient perspectives on the use of digital technologies to complement current surgical care and support with lifestyle behavior changes were discussed. Interviews were audio recorded and transcribed verbatim. Reflexive thematic analysis enabled the development of themes from the data, with QSR NVivo software (version 12) facilitating data management. Ethical approval was obtained from the National Health Service Health Research Authority. RESULTS: A total of 18 participants were interviewed. Four themes were developed from the data regarding the design and functionality of digital technologies to best support the perioperative journey. These center around an intervention's ability to incorporate interactive, user-centered features; direct a descriptive and structured recovery; enable customizable, patient-controlled settings; and deliver both general and specific surgical advice in a timely manner. Interventions that are initiated preoperatively and continued postoperatively were perceived as beneficial. Interventions designed with personalized milestones were found to better guide patients through a structured recovery. Individualized tailoring of preparatory and recovery information was desired by patients with previously high levels of physical activity before surgery. The use of personalized progression-based exercises further encouraged physical recovery; game-like rewards and incentives were regarded as motivational for making and sustaining health behavior change. In-built video calling and messaging features offered connectivity with peers and clinicians for supported care delivery. CONCLUSIONS: Specific intervention design and functionality features can provide better, structured support for elective orthopedic patients across the entire surgical journey and beyond. This study provides much-needed evidence relating to the optimal design and timing of digital interventions for elective orthopedic surgical patients. Findings from this study suggest a desire for personalized perioperative care, in turn, supporting patients to make health behavior changes to optimize surgical success. These findings should be used to influence future co-design projects to enable the design and implementation of patient-focused, tailored, and targeted digital health technologies within modern health care settings.

Learning from safety incidents in high-reliability organizations: a systematic review of learning tools that could be adapted and used in healthcare.

OBJECTIVE: A high-reliability organization (HRO) is an organization that has sustained almost error-free performance, despite operating in hazardous conditions where the consequences of errors could be catastrophic. A number of tools and initiatives have been used within HROs to learn from safety incidents, some of which have the potential to be adapted and used in healthcare. We conducted a systematic review to identify any learning tools deemed to be effective that could be adapted and used by multidisciplinary teams in healthcare following a patient safety incident. METHODS: This review followed the Preferred Reporting Items for Systematic Reviews and MetaAnalyses for Protocols reporting guidelines and was registered with the PROSPERO (CRD42017071528). A search of databases was carried out in January 2021, from the date of their commencement. We conducted a search on electronic databases such as Web of Science, Science Direct, MEDLINE in Process Jan 1950-present, EMBASE Jan 1974-present, CINAHL 1982-present, PsycINFO 1967-present, Scopus and Google Scholar. We also searched the grey literature including reports from government agencies, relevant doctoral dissertations and conference proceedings. A customized data extraction form was used to capture pertinent information from included studies and Critical Appraisal Skills Programme tool to appraise on their quality. RESULTS: A total of 5921 articles were identified, with 964 duplicate articles removed and 4932 excluded at the title (4055), abstract (510) and full-text (367) stages. Twenty-five articles were included in the review. Learning tools identified included debriefing, simulation, crew resource management and reporting systems to disseminate safety messages. Debriefing involved deconstructing incidents using reflective questions, whilst simulation training involved asking staff to relive the event again by performing the task(s) in a role-play scenario. Crew resource management is a set of training procedures that focus on communication, leadership and decision-making. Sophisticated incident-reporting systems provide valuable information on hazards and were widely recommended as a way of disseminating key safety messages following safety incidents. These learning tools were found to have a positive impact on learning if conducted soon after the incident with efficient facilitation. CONCLUSION: Healthcare organizations should find ways to adapt to the learning tools or initiatives used in HROs following safety incidents. It is challenging to recommend any specific one as all learning tools have shown considerable promise. However, the way these tools or initiatives are implemented is critical, and so further work is needed to explore how to successfully embed them into healthcare organizations so that everyone at every level of the organization embraces them.

Relationship between labour force satisfaction, wages and retention within the UK National Health Service: a systematic review of the literature.

OBJECTIVES: A systematic review was undertaken to understand the nature of the relationship between the UK National Health Service (NHS) labour force and satisfaction, retention and wages. DESIGN: Narrative systematic review. DATA SOURCES: The literature was searched using seven databases in January 2020: MEDLINE (1996-present), the Cumulative Index to Nursing and Allied Health Literature (CINAHL via EBSCO) (1984-present), Embase (1996-present), PsycINFO (1987-present), ProQuest (1996-present), Scopus (all years) and Cochrane library (all years). We used medical subject headings and key words relating to 'retention', 'satisfaction' and 'wages'. ELIGIBILITY CRITERIA FOR SELECTING STUDIES: Primary research studies or reviews that focused on the following relationships within the NHS workforce: wages and job satisfaction, job satisfaction and retention or wages and retention. DATA EXTRACTION AND SYNTHESIS: Two independent reviewers screened all titles, abstracts and full texts, with arbitration by a third reviewer. RESULTS: 27 803 articles were identified and after removing duplicates (n=17 156), articles were removed at the title (n=10 421), abstract (n=150) and full-text (n=45) stages. A total of 31 full-text articles were included. They identified three broad themes, low job satisfaction impacting negatively on job retention, poor pay impacting negatively on staff satisfaction and the limitations of increasing pay as a means of improving staff retention. Several factors affected these relationships, including the environment, discrimination, flexibility, autonomy, training and staffing levels. CONCLUSIONS: This review highlighted how multiple factors influence NHS labour force retention. Pay was found to influence satisfaction, which in turn affected retention. An increase in wages alone is unlikely to be sufficient to ameliorate the concerns of NHS workers. More research is needed to identify the role of autonomy on retention. A system leadership approach underpinned by data is required to implement bespoke job satisfaction improvement strategies to improve retention and achieve the goals of the NHS Long Term Plan.

A systematic review of the impact of health information technology on nurses' time.

OBJECTIVE: Nursing time represents one of the highest costs for most health services. We conducted a systematic review of the literature on the impact of health information technology on nurses' time. MATERIALS AND METHODS: We followed PRISMA guidelines and searched 6 large databases for relevant articles published between Jan 2004 and December 2019. Two authors reviewed the titles, abstracts, and full texts. We included articles that included a comparison group in the design, measured the time taken to carry out documentation or medication administration, documented the quantitative estimates of time differences between the 2, had nurses as subjects, and was conducted in either a care home, hospital, or community clinic. RESULTS: We identified a total of 1647 articles, of which 33 met our inclusion criteria. Twenty-one studies reported the impact of 12 different health information technology (HIT) implementations on nurses' documentation time. Weighted averages were calculated for studies that implemented barcode medication administration (BCMA) and 2 weighted averages for those that implemented EHRs, as these studies used different sampling units; both showed an increase in the time spent in documentation (+22% and +46%). However, the time spent carrying out medication administration following BCMA implementation fell by 33% (P < .05). HIT also caused a redistribution of nurses' time which, in some cases, was spent in more "value-adding" activities, such as delivering direct patient care as well as inter-professional communication. DISCUSSION AND CONCLUSIONS: Most of the HIT systems increased nursing documentation time, although time fell for medication administration following BCMA. Many HIT systems also resulted in nurses spending more time in direct care and "value-adding" activities.

Digital Support for Patients Undergoing Bariatric Surgery: Narrative Review of the Roles and Challenges of Online Forums.

BACKGROUND: The internet has become an important medium within health care, giving patients the opportunity to search for information, guidance, and support to manage their health and well-being needs. Online forums and internet-based platforms appear to have changed the way many patients undergoing bariatric surgery view and engage with their health, before and after weight loss surgery. Given that significant health improvements result from sustained weight loss, ensuring patient adherence to recommended preoperative and postoperative guidance is critical for bariatric surgery success. In a patient cohort with high information needs preoperatively, and notoriously high attrition rates postoperatively, online forums may present an underutilized method of support. OBJECTIVE: The aim of this study was to conduct a narrative review focusing on the developing roles that online forums can play for patients with bariatric conditions preoperatively and postoperatively. METHODS: A literature search was conducted in October-November 2019 across 5 electronic databases: Scopus, EMBASE, PsycINFO, CINAHL, and MEDLINE. Qualitative or mixed methods studies were included if they evaluated patients undergoing bariatric surgery (or bariatric surgery health care professionals) engaging with, using, or analyzing online discussion forums or social media platforms. Using thematic analysis, themes were developed from coding patterns within the data to identify the roles and challenges of online forums for patients undergoing bariatric surgery. RESULTS: A total of 8 studies were included in this review, with 5 themes emerging around (1) managing expectations of a new life; (2) decision making and signposting; (3) supporting information seeking; (4) facilitating connectedness: peer-to-peer social and emotional support; and (5) enabling accessibility and connectivity with health care professionals. CONCLUSIONS: Online forums could offer one solution to improving postoperative success by supporting and motivating patients. Future research should consider how best to design and moderate online forums for maximal effectiveness and the sharing of accurate information. The surgical multidisciplinary team may consider recommendations of online peer-support networks to complement care for patients throughout their surgical journey.

Medication errors and adverse drug events in a UK hospital during the optimisation of electronic prescriptions: a prospective observational study.

BACKGROUND: WHO's Third Global Patient Safety Challenge, Medication Without Harm, focused on reducing the substantial burden of iatrogenic harm associated with medications by 50% in the next 5 years. We aimed to assess whether the number and type of medication errors changed as an electronic prescribing system was optimised over time in a UK hospital. METHODS: We did a prospective observational study at a tertiary-care teaching hospital. Eight senior clinical pharmacists reviewed patients' records and collected data across four adult wards (renal, cardiology, general medical, and orthopaedic surgical) over a 2-year period (from Sept 29, 2014, to June 9, 2016). All medication errors and potential and actual adverse drug events were documented and the number of medication errors measured over the course of four time periods 7-10 weeks long. Pharmacists also recorded instances where the electronic prescribing system contributed to an error (system-related errors). A negative-binomial model and a Poisson model were used to identify factors related to medication error rates. FINDINGS: 5796 primary errors were recorded over the four time periods (period 1, 47 days [Sep 29-Dec 2, 2014]; period 2, 38 days [April 20-June 12, 2015, for the renal, medical, and surgical wards and April 20-June 15, 2015, for the cardiology ward]; period 3, 35 days [Sep 28-Nov 27, 2015] for the renal ward, 37 days [Sep 28-Nov 23, 2015] for the medical ward, and 40 days [Sep 28-Nov 20, 2015] for the cardiology and surgical wards; and period 4, 37 days [Feb 22-April 15, 2015] for the renal and medical wards and 39 days for the cardiology [April 13-June 7, 2015] and surgery [April 18-June 9, 2015] wards; unanticipated organisational factors prevented data collection on some days during each time period). There was no change in the rate of primary medication errors per admission over the observation periods: 1·53 medication errors in period 1, 1·44 medication errors in period 2, 1·70 medication errors in period 3, and 1·43 medication errors in period 4, per admission. By contrast, the overall rate of different types of medication errors decreased over the four periods. The most common types of error were medicine-reconciliation, dose, and avoidable delay-of-treatment errors. Some types of errors appeared to reduce over time (eg, dose errors [from 52 errors in period 1 to 19 errors in period 4, per 100 admissions]), whereas others increased (eg, inadequate follow-up of therapy [from 12 errors in period 1 to 24 errors in period 4, per 100 admissions]). We also found a reduction in the rates of potential adverse drug events between the first three periods and period 4. 436 system-related errors were recorded over the study period. INTERPRETATION: Although the overall rates of primary medication errors per admission did not change, we found a reduction in some error types and a significant decrease in the rates of potential adverse drug events over a 2-year period, during which system optimisation occurred. Targeting some error types could have the added benefit of reducing others, which suggests that system optimisation could ultimately help improve patient safety and outcomes. FUNDING: No funding.

Evaluation of Harm Associated with High Dose-Range Clinical Decision Support Overrides in the Intensive Care Unit.

INTRODUCTION: Medication-related clinical decision support (CDS) alerts have been shown to be effective at reducing adverse drug events (ADEs). However, these alerts are frequently overridden, with limited data linking these overrides to harm. Dose-range checking alerts are a type of CDS alert that could have a significant impact on morbidity and mortality, especially in the intensive care unit (ICU) setting. METHODS: We performed a single-center, prospective, observational study of adult ICUs from September 2016 to April 2017. Targeted overridden alerts were triggered when doses greater than or equal to 5% over the maximum dose were prescribed. The primary outcome was the appropriateness of the override, determined by two independent reviewers, using pre-specified criteria formulated by a multidisciplinary group. Overrides which resulted in medication administration were then evaluated for ADEs by chart review. RESULTS: The override rate of high dose-range alerts in the ICU was 93.0% (total n = 1525) during the study period. A total of 1418 overridden alerts from 755 unique patients were evaluated for appropriateness (appropriateness rate 88.8%). The most common medication associated with high dose-range alerts was insulin regular infusion (n = 262, 18.5%). The rates of ADEs for the appropriately and inappropriately overridden alerts per 100 overridden alerts were 1.3 and 5.0, respectively (p < 0.001). CONCLUSIONS: Overriding high dose-range CDS alerts was found to be common and often appropriate, suggesting that more intelligent dose checking is needed. Some alerts were clearly inappropriately presented to the provider. Inappropriate overrides were associated with an increased risk of ADEs, compared to appropriately overridden alerts.

The national cost of adverse drug events resulting from inappropriate medication-related alert overrides in the United States.

Objective: To estimate the national cost of ADEs resulting from inappropriate medication-related alert overrides in the U.S. inpatient setting. Materials and Methods: We used three different regression models (Basic, Model 1, Model 2) with model inputs taken from the medical literature. A random sample of 40 990 adult inpatients at the Brigham and Women's Hospital (BWH) in Boston with a total of 1 639 294 medication orders was taken. We extrapolated BWH medication orders using 2014 National Inpatient Sample (NIS) data. Results: Using three regression models, we estimated that 29.7 million adult inpatient discharges in 2014 resulted in between 1.02 billion and 1.07 billion medication orders, which in turn generated between 75.1 million and 78.8 million medication alerts, respectively. Taking the basic model (78.8 million), we estimated that 5.5 million medication-related alerts might have been inappropriately overridden, resulting in approximately 196 600 ADEs nationally. This was projected to cost between $871 million and $1.8 billion for treating preventable ADEs. We also estimated that clinicians and pharmacists would have jointly spent 175 000 hours responding to 78.8 million alerts with an opportunity cost of $16.9 million. Discussion and Conclusion: These data suggest that further optimization of hospitals computerized provider order entry systems and their associated clinical decision support is needed and would result in substantial savings. We have erred on the side of caution in developing this range, taking two conservative cost estimates for a preventable ADE that did not include malpractice or litigation costs, or costs of injuries to patients.

Prospective evaluation of medication-related clinical decision support over-rides in the intensive care unit.

BACKGROUND: Clinical decision support (CDS) displayed in electronic health records has been found to reduce the incidence of medication errors and adverse drug events (ADE). Recent data suggested that medication-related CDS alerts were frequently over-ridden, often inappropriately. Patients in the intensive care unit (ICU) are at an increased risk of ADEs; however, limited data exist on the benefits of CDS in the ICU. This study aims to evaluate potential harm associated with medication-related CDS over-rides in the ICU. METHODS: This was a prospective observational study of adults admitted to any of six ICUs between July 2016 and April 2017 at our institution. Patients with provider-overridden CDS for dose (orders for scheduled frequency and not pro re nata), drug allergy, drug-drug interaction, geriatric and renal alerts (contraindicated medications for renal function or renal dosing) were included. The primary outcome was the appropriateness of over-rides, which were evaluated by two independent reviewers. Secondary outcomes included incidence of ADEs following alert over-ride and risk of ADEs based on over-ride appropriateness. RESULTS: A total of 2448 over-ridden alerts from 712 unique patient encounters met inclusion criteria. The overall appropriateness rate for over-rides was 81.6% and varied by alert type. More ADEs (potential and definite) were identified following inappropriate over-rides compared with appropriate over-rides (16.5 vs 2.74 per 100 over-ridden alerts, Fisher's exact test P<0.001). An adjusted logistic regression model showed that inappropriate over-rides were associated with an increased risk of ADEs (OR 6.14, 95% CI 4.63 to 7.71, P<0.001). CONCLUSIONS: Approximately four of five identified CDS over-rides were appropriately over-ridden, with the rate varying by alert type. However, inappropriate over-rides were six times as likely to be associated with potential and definite ADEs, compared with appropriate over-rides. Further efforts should be targeted at improving the positive predictive value of CDS such as by suppressing alerts that are appropriately over-ridden.

High-priority and low-priority drug-drug interactions in different international electronic health record systems: A comparative study.

OBJECTIVES: To investigate whether alert warnings for high-priority and low-priority drug-drug interactions (DDIs) were present in five international electronic health record (EHR) systems, to compare and contrast the severity level assigned to them, and to establish the proportion of alerts that were overridden. METHODS: We conducted a comparative, retrospective, multinational study using a convenience sample of 5 EHRs from the U.S., U.K., Republic of Korea and Belgium. RESULTS: Of the 15 previously defined, high-priority, class-based DDIs, alert warnings were found to exist for 11 in both the Korean and UK systems, 9 in the Belgian system, and all 15 in the two US systems. The specific combinations that were included in these class-based DDIs varied considerably in number, type and level of severity amongst systems. Alerts were only active for 8.4% (52/619) and 52.4% (111/212) of the specific drug-drug combinations contained in the Belgian and UK systems, respectively. Hard stops (not possible to override) existed in the US and UK systems only. The override rates for high-priority alerts requiring provider action ranged from 56.7% to 83.3%. Of the 33 previously defined low-priority DDIs, active alerts existed only in the US systems, for three class-based DDIs. The majority were non-interruptive. CONCLUSIONS: Alert warnings existed for most of the high-priority DDIs in the different EHRs but overriding them was easy in most of the systems. In addition to validating the high- and low-priority DDIs, this study reported a lack of standardization in DDI levels across different international knowledge bases.

Improving medication-related clinical decision support.

PURPOSE: Current uses of medication-related clinical decision support (CDS) and recommendations for improving these systems are reviewed. SUMMARY: Using a systematic approach, articles published from 2007 through 2014 were identified in MEDLINE and EMBASE using MeSH terms and keywords relating to the 5 basic medication-related CDS functionalities. A total of 156 full-text articles and 28 conference abstracts were reviewed across each of the 5 areas: drug-drug interaction (DDI) checks (n = 78), drug allergy checks (n = 20), drug dose support (n = 55), drug duplication checks (n = 11), and drug formulary support (n = 20). The success of medication-related CDS depends on users finding the alerts valuable and acting on the information received. Improving alert specificity and sensitivity is important for all domains. Tiering is important for improving the acceptance of DDI alerts. The ability to perform appropriate cross-sensitivity checks is key to producing appropriate drug allergy checks. Drug dosage alerts should be individualized and deliver practical recommendations. How the system is configured to identify certain drug duplications is important to prevent possible patient toxicity. Accurate knowledge databases are needed to produce relevant drug formulary alerts and encourage formulary adherence. Medication-related CDS is still relatively immature in some organizations and has substantial room for improvement. For example, decision support should consider more patient-specific factors, human factors principles should always be considered, and alert specificity must be improved in order to reduce alert fatigue. CONCLUSION: Standardization, integration of patient-specific parameters, and consideration of human factors design principles are central to realizing the potential benefits of medication-related CDS.

Consensus methodology to determine minor ailments appropriate to be directed for management within community pharmacy.

BACKGROUND: National Health Service (NHS) 111, a medical helpline for urgent care used within the England and Scotland, receives significant numbers of patient calls yearly for a range of clinical conditions. Some are considered high acuity and mainly directed to urgent and emergency care. Low acuity conditions are also directed to these costly, overburdened services. Community pharmacy is a recognised setting for effective low acuity condition management and could offer an alternative. OBJECTIVE: To design and evaluate a new NHS111 pathway re-directing patients with low acuity conditions to community pharmacy. METHODS: Two consensus development stakeholder workshops were undertaken. A "low acuity" condition was defined as one that can be clinically assessed by a community pharmacist and requires a treatment and/or advice available within a community pharmacy. Retrospective NHS111 patient data (February-August 2016) from the North East of England and access to the NHS Pathways clinical decision support software were available to stakeholders. The NHS111 data demonstrated the volume of patient calls for these conditions that could have been redirected to community pharmacy. RESULTS: Stakeholders reached consensus that 64 low acuity conditions could be safely redirected to community pharmacy via NHS111. This represented approximately 35,000 patients (11.5% of total) being shifted away from the higher cost settings in the North East region alone during February-August 2016. The stakeholder group discussions provided rationale behind their classifications of conditions to ensure patient safety, the care experience and added value. CONCLUSIONS: The resulting definitive list of low acuity conditions that could be directed to community pharmacy via NHS111 could result in a shift of workload from urgent and emergency care settings. Future work needs to evaluate the cost, clinical outcomes, patient satisfaction of a community pharmacy referral service that has the potential to improve integration of community pharmacy in the wider NHS.