Adoption by clinicians of electronic order communications in NHS secondary care: a descriptive account.

BACKGROUND: Due to the rapid advancement in information technology, changes to communication modalities are increasingly implemented in healthcare. One such modality is Computerised Provider Order Entry (CPOE) systems which replace paper, verbal or telephone orders with electronic booking of requests. We aimed to understand the uptake, and user acceptability, of CPOE in a large National Health Service hospital system. METHODS: This retrospective single-centre study investigates the longitudinal uptake of communications through the Prescribing, Information and Communication System (PICS). The development and configuration of PICS are led by the doctors, nurses and allied health professionals that use it and requests for CPOE driven by clinical need have been described.Records of every request (imaging, specialty review, procedure, laboratory) made through PICS were collected between October 2008 and July 2019 and resulting counts were presented. An estimate of the proportion of completed requests made through the system has been provided for three example requests. User surveys were completed. RESULTS: In the first 6 months of implementation, a total of 832 new request types (imaging types and specialty referrals) were added to the system. Subsequently, an average of 6.6 new request types were added monthly. In total, 8 035 132 orders were requested through PICS. In three example request types (imaging, endoscopy and full blood count), increases in the proportion of requests being made via PICS were seen. User feedback at 6 months reported improved communications using the electronic system. CONCLUSION: CPOE was popular, rapidly adopted and diversified across specialties encompassing wide-ranging requests.

The use of artificial intelligence to optimize medication alerts generated by clinical decision support systems: a scoping review.

OBJECTIVE: Current Clinical Decision Support Systems (CDSSs) generate medication alerts that are of limited clinical value, causing alert fatigue. Artificial Intelligence (AI)-based methods may help in optimizing medication alerts. Therefore, we conducted a scoping review on the current state of the use of AI to optimize medication alerts in a hospital setting. Specifically, we aimed to identify the applied AI methods used together with their performance measures and main outcome measures. MATERIALS AND METHODS: We searched Medline, Embase, and Cochrane Library database on May 25, 2023 for studies of any quantitative design, in which the use of AI-based methods was investigated to optimize medication alerts generated by CDSSs in a hospital setting. The screening process was supported by ASReview software. RESULTS: Out of 5625 citations screened for eligibility, 10 studies were included. Three studies (30%) reported on both statistical performance and clinical outcomes. The most often reported performance measure was positive predictive value ranging from 9% to 100%. Regarding main outcome measures, alerts optimized using AI-based methods resulted in a decreased alert burden, increased identification of inappropriate or atypical prescriptions, and enabled prediction of user responses. In only 2 studies the AI-based alerts were implemented in hospital practice, and none of the studies conducted external validation. DISCUSSION AND CONCLUSION: AI-based methods can be used to optimize medication alerts in a hospital setting. However, reporting on models' development and validation should be improved, and external validation and implementation in hospital practice should be encouraged.

Development and validation of a clinical decision support system to prevent anticoagulant duplications.

BACKGROUND AND OBJECTIVE: Unintended duplicate prescriptions of anticoagulants increase the risk of serious adverse events. Clinical Decision Support Systems (CDSSs) can help prevent such medication errors; however, sophisticated algorithms are needed to avoid alert fatigue. This article describes the steps taken in our hospital to develop a CDSS to prevent anticoagulant duplication (AD). METHODS: The project was composed of three phases. In phase I, the status quo was established. In phase II, a clinical pharmacist developed an algorithm to detect ADs using daily data exports. In phase III, the algorithm was integrated into the hospital's electronic health record system. Alerts were reviewed by clinical pharmacists before being sent to the prescribing physician. We conducted a retrospective analysis of all three phases to assess the impact of the interventions on the occurrence and duration of ADs. Phase III was analyzed in more detail regarding the acceptance rate, sensitivity, and specificity of the alerts. RESULTS: We identified 91 ADs in 1581 patients receiving two or more anticoagulants during phase I, 70 ADs in 1692 patients in phase II, and 57 ADs in 1575 patients in phase III. Mean durations of ADs were 1.8, 1.4, and 1.1 calendar days during phases I, II, and III, respectively. In comparison to the baseline in phase I, the relative risk reduction of AD in patients treated with at least two different anticoagulants during phase III was 42% (RR: 0.58, CI: 0.42-0.81). A total of 429 alerts were generated during phase III, many of which were self-limiting, and 186 alerts were sent to the respective prescribing physician. The acceptance rate was high at 97%. We calculated a sensitivity of 87.4% and a specificity of 87.9%. CONCLUSION: The stepwise development of a CDSS for the detection of AD markedly reduced the frequency and duration of medication errors in our hospital, thereby improving patient safety.

Why do users override alerts? Utilizing large language model to summarize comments and optimize clinical decision support.

OBJECTIVES: To evaluate the capability of using generative artificial intelligence (AI) in summarizing alert comments and to determine if the AI-generated summary could be used to improve clinical decision support (CDS) alerts. MATERIALS AND METHODS: We extracted user comments to alerts generated from September 1, 2022 to September 1, 2023 at Vanderbilt University Medical Center. For a subset of 8 alerts, comment summaries were generated independently by 2 physicians and then separately by GPT-4. We surveyed 5 CDS experts to rate the human-generated and AI-generated summaries on a scale from 1 (strongly disagree) to 5 (strongly agree) for the 4 metrics: clarity, completeness, accuracy, and usefulness. RESULTS: Five CDS experts participated in the survey. A total of 16 human-generated summaries and 8 AI-generated summaries were assessed. Among the top 8 rated summaries, five were generated by GPT-4. AI-generated summaries demonstrated high levels of clarity, accuracy, and usefulness, similar to the human-generated summaries. Moreover, AI-generated summaries exhibited significantly higher completeness and usefulness compared to the human-generated summaries (AI: 3.4 ± 1.2, human: 2.7 ± 1.2, P = .001). CONCLUSION: End-user comments provide clinicians' immediate feedback to CDS alerts and can serve as a direct and valuable data resource for improving CDS delivery. Traditionally, these comments may not be considered in the CDS review process due to their unstructured nature, large volume, and the presence of redundant or irrelevant content. Our study demonstrates that GPT-4 is capable of distilling these comments into summaries characterized by high clarity, accuracy, and completeness. AI-generated summaries are equivalent and potentially better than human-generated summaries. These AI-generated summaries could provide CDS experts with a novel means of reviewing user comments to rapidly optimize CDS alerts both online and offline.

Optimising interruptive clinical decision support alerts for antithrombotic duplicate prescribing in hospital.

INTRODUCTION: Duplicate prescribing clinical decision support alerts can prevent important prescribing errors but are frequently the cause of much alert fatigue. Stat dose prescriptions are a known reason for overriding these alerts. This study aimed to evaluate the effect of excluding stat dose prescriptions from duplicate prescribing alerts for antithrombotic medicines on alert burden, prescriber adherence, and prescribing. MATERIALS AND METHODS: A before (January 1st, 2017 to August 31st, 2022) and after (October 5th, 2022 to September 30th, 2023) study was undertaken of antithrombotic duplicate prescribing alerts and prescribing following a change in alert settings. Alert and prescribing data for antithrombotic medicines were joined, processed, and analysed to compare alert rates, adherence, and prescribing. Alert burden was assessed as alerts per 100 prescriptions. Adherence was measured at the point of the alert as whether the prescriber accepted the alert and following the alert as whether a relevant prescription was ceased within an hour. Co-prescribing of antithrombotic stat dose prescriptions was assessed pre- and post-alert reconfiguration. RESULTS: Reconfiguration of the alerts reduced the alert rate by 29 % (p < 0.001). The proportion of alerts associated with cessation of antithrombotic duplication significantly increased (32.8 % to 44.5 %, p < 0.001). Adherence at the point of the alert increased 1.2 % (4.8 % to 6.0 %, p = 0.012) and 11.5 % (29.4 % to 40.9 %, p < 0.001) within one hour of the alert. When ceased after the alert over 80 % of duplicate prescriptions were ceased within 2 min of overriding. Antithrombotic stat dose co-prescribing was unchanged for 4 out of 5 antithrombotic duplication alert rules. CONCLUSION: By reconfiguring our antithrombotic duplicate prescribing alerts, we reduced alert burden and increased alert adherence. Many prescribers ceased duplicate prescribing within 2 min of alert override highlighting the importance of incorporating post-alert measures in accurately determining prescriber alert adherence.

Detecting atypical alert behavior through statistical process control: Clinical decision support alert frequency visualizations.

Clinical decision support (CDS) alerts are designed to work according to a set of clearly defined criteria and have the potential to improve clinical care. To efficiently and proactively review abnormally functioning CDS alerts, we postulate that the introduction of a dashboard with statistical process control (SPC) charting will lead to effective detection of erratic alert behavior. We identified custom CDS alerts from an academic medical center that were recorded and monitored in a longitudinal fashion and the data warehouses where this information was stored. We created a dashboard of alert frequency using SPC charts, applied SPC rules for classification of variation, and validated dashboard data. From June-August 2022, the dashboard effectively pulled in data to visually depict alert behavior. SPC-defined parameters for standard deviation from the mean were applied to visualizations and allowed for rapid review of alerts with greatest variation. These alerts were subsequently investigated, and it was determined that they were functioning correctly. The most profound abnormalities detected during implementation reflected changes in practice and not system errors, though further investigation into thresholds for statistical significance will benefit this field. We conclude that SPC visualizations are a time-efficient and effective method of identifying CDS malfunctions.

Randomized Comparison of Electronic Health Record Alert Types in Eliciting Responses about Prognosis in Gynecologic Oncology Patients.

OBJECTIVES: To compare the ability of different electronic health record alert types to elicit responses from users caring for cancer patients benefiting from goals of care (GOC) conversations. METHODS: A validated question asking if the user would be surprised by the patient's 6-month mortality was built as an Epic BestPractice Advisory (BPA) alert in three versions-(1) Required on Open chart (pop-up BPA), (2) Required on Close chart (navigator BPA), and (3) Optional Persistent (Storyboard BPA)-randomized using patient medical record number. Meaningful responses were defined as "Yes" or "No," rather than deferral. Data were extracted over 6 months. RESULTS: Alerts appeared for 685 patients during 1,786 outpatient encounters. Measuring encounters where a meaningful response was elicited, rates were highest for Required on Open (94.8% of encounters), compared with Required on Close (90.1%) and Optional Persistent (19.7%) (p < 0.001). Measuring individual alerts to which responses were given, they were most likely meaningful with Optional Persistent (98.3% of responses) and least likely with Required on Open (68.0%) (p < 0.001). Responses of "No," suggesting poor prognosis and prompting GOC, were more likely with Optional Persistent (13.6%) and Required on Open (10.3%) than with Required on Close (7.0%) (p = 0.028). CONCLUSION: Required alerts had response rates almost five times higher than optional alerts. Timing of alerts affects rates of meaningful responses and possibly the response itself. The alert with the most meaningful responses was also associated with the most interruptions and deferral responses. Considering tradeoffs in these metrics is important in designing clinical decision support to maximize success.

Use of Computerized Physician Order Entry with Clinical Decision Support to Prevent Dose Errors in Pediatric Medication Orders: A Systematic Review.

BACKGROUND: Prescribing is a high-risk task within the pediatric medication-use process and requires defenses to prevent errors. Such system-centric defenses include electronic health record systems with computerized physician order entry (CPOE) and clinical decision support (CDS) tools that assist safe prescribing. The objective of this study was to examine the effects of CPOE systems with CDS functions in preventing dose errors in pediatric medication orders. MATERIAL AND METHODS: This study followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 criteria and Synthesis Without Meta-Analysis (SWiM) items. The study protocol was registered in PROSPERO (CRD42021277413). The final literature search on MEDLINE (Ovid), Scopus, Web of Science, and EMB Reviews was conducted on 10 September 2023. Only peer-reviewed studies considering both CPOE and CDS systems in pediatric inpatient or outpatient settings were included. Study selection, data extraction, and evidence quality assessment (JBI critical appraisal tool assessment and GRADE approach) were carried out by two individual reviewers. Vote counting method was used to evaluate the effects of CPOE-CDS systems on dose errors rates. RESULTS: A total of 17 studies published in 2007-2021 met the inclusion criteria. The most used CDS tools were dose range check (n = 14), dose calculator (n = 8), and dosing frequency check (n = 8). Alerts were recorded in 15 studies. A statistically significant reduction in dose errors was found in eight studies, whereas an increase of dose errors was not reported. CONCLUSIONS: The CPOE-CDS systems have the potential to reduce pediatric dose errors. Most beneficial interventions seem to be system customization, implementing CDS alerts, and the use of dose range check. While human factors are still present within the medication use process, further studies and development activities are needed to optimize the usability of CPOE-CDS systems.

Retrospective analysis of the impact of electronic medical record alerts on low value care in a pediatric hospital.

OBJECTIVES: Hospital costs continue to rise unsustainably. Up to 20% of care is wasteful including low value care (LVC). This study aimed to understand whether electronic medical record (EMR) alerts are effective at reducing pediatric LVC and measure the impact on hospital costs. MATERIALS AND METHODS: Using EMR data over a 76-month period, we evaluated changes in 4 LVC practices following the implementation of EMR alerts, using time series analysis to control for underlying time-based trends, in a large pediatric hospital in Australia. The main outcome measure was the change in rate of each LVC practice. Balancing measures included the rate of alert adherence as a proxy measure for risk of alert fatigue. Hospital costs were calculated by the volume of LVC avoided multiplied by the unit costs. Costs of the intervention were calculated from clinician and analyst time required. RESULTS: All 4 LVC practices showed a statistically significant reduction following alert implementation. Two LVC practices (blood tests) showed an abrupt change, associated with high rates of alert adherence. The other 2 LVC practices (bronchodilator use in bronchiolitis and electrocardiogram ordering for sleeping bradycardia) showed an accelerated rate of improvement compared to baseline trends with lower rates of alert adherence. Hospital savings were $325 to $180 000 per alert. DISCUSSION AND CONCLUSION: EMR alerts are effective in reducing pediatric LVC practices and offer a cost-saving opportunity to the hospital. Further efforts to leverage EMR alerts in pediatric settings to reduce LVC are likely to support future sustainable healthcare delivery.

Addressing Alert Fatigue by Replacing a Burdensome Interruptive Alert with Passive Clinical Decision Support.

BACKGROUND: Recognizing that alert fatigue poses risks to patient safety and clinician wellness, there is a growing emphasis on evaluation and governance of electronic health record clinical decision support (CDS). This is particularly critical for interruptive alerts to ensure that they achieve desired clinical outcomes while minimizing the burden on clinicians. This study describes an improvement effort to address a problematic interruptive alert intended to notify clinicians about patients needing coronavirus disease 2019 (COVID) precautions and how we collaborated with operational leaders to develop an alternative passive CDS system in acute care areas. OBJECTIVES: Our dual aim was to reduce the alert burden by redesigning the CDS to adhere to best practices for decision support while also improving the percent of admitted patients with symptoms of possible COVID who had appropriate and timely infection precautions orders. METHODS: Iterative changes to CDS design included adjustment to alert triggers and acknowledgment reasons and development of a noninterruptive rule-based order panel for acute care areas. Data on alert burden and appropriate precautions orders on symptomatic admitted patients were followed over time on run and attribute (p) and individuals-moving range control charts. RESULTS: At baseline, the COVID alert fired on average 8,206 times per week with an alert per encounter rate of 0.36. After our interventions, the alerts per week decreased to 1,449 and alerts per encounter to 0.07 equating to an 80% reduction for both metrics. Concurrently, the percentage of symptomatic admitted patients with COVID precautions ordered increased from 23 to 61% with a reduction in the mean time between COVID test and precautions orders from 19.7 to -1.3 minutes. CONCLUSION: CDS governance, partnering with operational stakeholders, and iterative design led to successful replacement of a frequently firing interruptive alert with less burdensome passive CDS that improved timely ordering of COVID precautions.

[Inability of hospital computerised physician order entry systems to secure the use of concentrated potassium intravenous solutions]. / Incapacité des logiciels d'aide à la prescription hospitaliers à sécuriser l'utilisation des solutions concentrées de potassium injectable.

OBJECTIVES: To determine whether hospital computerised physician order entry (CPOE) systems contribute to securing intravenous potassium chloride (KCl) prescriptions with reference to the recommendations issued by French healthcare agencies. METHODS: We sent a questionnaire to the members of the Association pour le Digital et l'Information en Pharmacie. RESULTS: More than three quarters of the 84 responses received involving 23 CPOE systems indicate that it is possible to: prescribe an ampoule of concentrated potassium chloride 10% 10mL intravenously without any diluents (80%); prescribe 4g of KCl in a bag of 500mL of NaCl 0,9% (98%); prescribe a solution that contains 6 grams of KCl per liter (94%); prescribe the administration of an injectable ampoule orally by means of a free text comment (83%). Nearly half of the responses indicate that it is possible to prescribe: concentrated KCl ampoules as administration solvent (50%); an injectable vial to be administered by oral route (52%). CONCLUSION: At least 23 hospital CPOE systems are unable to secure the prescriptions of injectable KCl. This finding lifts the veil on an unthought, namely the role of CPOE systems in securing high-risk medications. In order to solve this problem, it should be mandatory that health information technology vendors pay particular attention to these drugs. With regard to injectable KCl, the utilisation of a dilution vehicle, maximum concentration and maximum infusion flow rate are the first four constraints to be satisfied.

Sharpening clinical decision support alert and reminder designs with MINDSPACE: A systematic review.

BACKGROUND: Clinical decision support (CDS) alerts and reminders aim to influence clinical decisions, yet they are often designed without considering human decision-making behaviour. While this behaviour is comprehensively described by behavioural economics (BE), the sheer volume of BE literature poses a challenge to designers when identifying behavioural effects with utility to alert and reminder designs. This study tackles this challenge by focusing on the MINDSPACE framework for behaviour change, which collates nine behavioural effects that profoundly influence human decision-making behaviour: Messenger, Incentives, Norms, Defaults, Salience, Priming, Affect, Commitment, and Ego. METHOD: A systematic review searching MEDLINE, Embase, PsycINFO, and CINAHL Plus to explore (i) the usage of MINDSPACE effects in alert and reminder designs and (ii) the efficacy of those alerts and reminders in influencing clinical decisions. The search queries comprised ten Boolean searches, with nine focusing on the MINDSPACE effects and one focusing on the term mindspace. RESULTS: 50 studies were selected from 1791 peer-reviewed journal articles in English from 1970 to 2022. Except for ego, eight of nine MINDSPACE effects were utilised to design alerts and reminders, with defaults and norms utilised the most in alerts and reminders, respectively. Overall, alerts and reminders informed by MINDSPACE effects showed an average 71% success rate in influencing clinical decisions (alerts 73%, reminders 69%). Most studies utilised a single effect in their design, with higher efficacy for alerts (64%) than reminders (41%). Others utilised multiple effects, showing higher efficacy for reminders (28%) than alerts (9%). CONCLUSION: This review presents sufficient evidence demonstrating the MINDSPACE framework's merits for designing CDS alerts and reminders with human decision-making considerations. The framework can adequately address challenges in identifying behavioural effects pertinent to the effective design of CDS alerts and reminders. The review also identified opportunities for future research into other relevant effects (e.g., framing).

Effect of knowledgebase transition of a clinical decision support system on medication order and alert patterns in an emergency department.

A knowledgebase (KB) transition of a clinical decision support (CDS) system occurred at the study site. The transition was made from one commercial database to another, provided by a different vendor. The change was applied to all medications in the institute. The aim of this study was to analyze the effect of KB transition on medication-related orders and alert patterns in an emergency department (ED). Data of patients, medication-related orders and alerts, and physicians in the ED from January 2018 to December 2020 were analyzed in this study. A set of definitions was set to define orders, alerts, and alert overrides. Changes in order and alert patterns before and after the conversion, which took place in May 2019, were assessed. Overall, 101,450 patients visited the ED, and 1325 physicians made 829,474 prescription orders to patients during visit and at discharge. Alert rates (alert count divided by order count) for periods A and B were 12.6% and 14.1%, and override rates (alert override count divided by alert count) were 60.8% and 67.4%, respectively. Of the 296 drugs that were used more than 100 times during each period, 64.5% of the drugs had an increase in alert rate after the transition. Changes in alert rates were tested using chi-squared test and Fisher's exact test. We found that the CDS system knowledgebase transition was associated with a significant change in alert patterns at the medication level in the ED. Careful consideration is advised when such a transition is performed.

Monitoring for adverse drug events of high-risk medications with a computerized clinical decision support system: a prospective cohort study.

Monitoring is recommended to prevent severe adverse drug events, but such examinations are often missed. To increase the number of monitoring that should be ordered for high-risk medications, we introduced a clinical decision support system (CDSS) that alerts and orders the monitoring for high-risk medications in an outpatient setting. We conducted a 2-year prospective cohort study at a tertiary care teaching hospital before (phase 1) and after (phase 2) the activation of a CDSS. The CDSS automatically provided alerts for liver function tests for vildagliptin, thyroid function tests for immune checkpoint inhibitors (ICIs) and multikinase inhibitors (MKIs), and a slit-lamp examination of the eyes for oral amiodarone when outpatients were prescribed the medications but not examined for a fixed period. The order of laboratory tests automatically appeared if alert was accepted. The alerts were hidden and did not appear on the display before activation of the CDSS. The outcomes were the number of prescriptions with alerts and examinations. During the study period, 330 patients in phase 1 and 307 patients in phase 2 were prescribed vildagliptin, 20 patients in phase 1 and 19 patients in phase 2 were prescribed ICIs or MKIs, and 72 patients in phase 1 and 66 patients in phase 2 were prescribed oral amiodarone. The baseline characteristics were similar between the phases. In patients prescribed vildagliptin, the proportion of alerts decreased significantly (38% vs 27%, P < 0.0001), and the proportion of examinations increased significantly (0.9% vs 4.0%, P < 0.0001) after activation of the CDSS. In patients prescribed ICIs or MKIs, the proportion of alerts decreased significantly (43% vs 11%, P < 0.0001), and the proportion of examinations increased numerically, but not significantly (2.6% vs 7.0%, P = 0.13). In patients prescribed oral amiodarone, the proportion of alerts decreased (86% vs 81%, P = 0.055), and the proportion of examinations increased (2.2% and 3.0%, P = 0.47); neither was significant. The CDSS has potential to increase the monitoring for high-risk medications. Our study also highlighted the limited acceptance rate of monitoring by CDSS. Further studies are needed to explore the generalizability to other medications and the cause of the limited acceptance rates among physicians.

Impact of Predictive Text Clinical Decision Support on Imaging Order Entry in the Emergency Department.

PURPOSE: Imaging clinical decision support (CDS) is designed to assist providers in selecting appropriate imaging studies and is now federally required. The aim of this study was to understand the effect of CDS on decisions and workflows in the emergency department (ED). METHODS: The authors' institution's order entry platform serves up structured indications for imaging orders. Imaging orders are scored by CDS on the basis of appropriate use criteria (AUC). CDS triggers alerts for imaging orders with low AUC scores. Because free text alone cannot be scored by CDS, an artificial intelligence predictive text (AIPT) module was implemented to guide the selection of structured indications when free-text indications are entered. A total of 17,355 imaging orders in the ED over 6 months were retrospectively analyzed. RESULTS: CDS alerts for low AUC scores were triggered for 3% of all imaging study orders (522 of 17,355). Providers spent an average of 24 seconds interacting with alerts. In 18 of 522 imaging orders with alerts, alternative studies were ordered. After AIPT implementation, the percentage of unscored studies significantly decreased from 81% to 45% (P < .001). CONCLUSIONS: In a quaternary academic ED, CDS alerts triggered by low AUC scores caused minimal increase in time spent on imaging order entry but had a relatively marginal impact on imaging study selection. AIPT implementation increased the number of scored studies and could potentially enhance CDS effects. CDS implementation enables the collection of novel data regarding which imaging studies receive low AUC scores. Future work could include exploring alternative models of CDS implementation to maximize its impact.

Post-implementation optimization of medication alerts in hospital computerized provider order entry systems: a scoping review.

OBJECTIVES: A scoping review identified interventions for optimizing hospital medication alerts post-implementation, and characterized the methods used, the populations studied, and any effects of optimization. MATERIALS AND METHODS: A structured search was undertaken in the MEDLINE and Embase databases, from inception to August 2023. Articles providing sufficient information to determine whether an intervention was conducted to optimize alerts were included in the analysis. Snowball analysis was conducted to identify additional studies. RESULTS: Sixteen studies were identified. Most were based in the United States and used a wide range of clinical software. Many studies used inpatient cohorts and conducted more than one intervention during the trial period. Alert types studied included drug-drug interactions, drug dosage alerts, and drug allergy alerts. Six types of interventions were identified: alert inactivation, alert severity reclassification, information provision, use of contextual information, threshold adjustment, and encounter suppression. The majority of interventions decreased alert quantity and enhanced alert acceptance. Alert quantity decreased with alert inactivation by 1%-25.3%, and with alert severity reclassification by 1%-16.5% in 6 of 7 studies. Alert severity reclassification increased alert acceptance by 4.2%-50.2% and was associated with a 100% acceptance rate for high-severity alerts when implemented. Clinical errors reported in 4 studies were seen to remain stable or decrease. DISCUSSION: Post-implementation medication optimization interventions have positive effects for clinicians when applied in a variety of settings. Less well reported are the impacts of these interventions on the clinical care of patients, and how endpoints such as alert quantity contribute to changes in clinician and pharmacist perceptions of alert fatigue. CONCLUSION: Well conducted alert optimization can reduce alert fatigue by reducing overall alert quantity, improving clinical acceptance, and enhancing clinical utility.

Barriers to Adoption of Tailored Drug-Drug Interaction Clinical Decision Support.

OBJECTIVE: Despite the benefits of the tailored drug-drug interaction (DDI) alerts and the broad dissemination strategy, the uptake of our tailored DDI alert algorithms that are enhanced with patient-specific and context-specific factors has been limited. The goal of the study was to examine barriers and health care system dynamics related to implementing tailored DDI alerts and identify the factors that would drive optimization and improvement of DDI alerts. METHODS: We employed a qualitative research approach, conducting interviews with a participant interview guide framed based on Proctor's taxonomy of implementation outcomes and informed by the Theoretical Domains Framework. Participants included pharmacists with informatics roles within hospitals, chief medical informatics officers, and associate medical informatics directors/officers. Our data analysis was informed by the technique used in grounded theory analysis, and the reporting of open coding results was based on a modified version of the Safety-Related Electronic Health Record Research Reporting Framework. RESULTS: Our analysis generated 15 barriers, and we mapped the interconnections of these barriers, which clustered around three entities (i.e., users, organizations, and technical stakeholders). Our findings revealed that misaligned interests regarding DDI alert performance and misaligned expectations regarding DDI alert optimizations among these entities within health care organizations could result in system inertia in implementing tailored DDI alerts. CONCLUSION: Health care organizations primarily determine the implementation and optimization of DDI alerts, and it is essential to identify and demonstrate value metrics that health care organizations prioritize to enable tailored DDI alert implementation. This could be achieved via a multifaceted approach, such as partnering with health care organizations that have the capacity to adopt tailored DDI alerts and identifying specialists who know users' needs, liaise with organizations and vendors, and facilitate technical stakeholders' work. In the future, researchers can adopt the systematic approach to study tailored DDI implementation problems from other system perspectives (e.g., the vendors' system).

Beyond the override: Using evidence of previous drug tolerance to suppress drug allergy alerts; a retrospective study of opioid alerts.

OBJECTIVE: Despite the extensive literature exploring alert fatigue, most studies have focused on describing the phenomenon, but not on fixing it. The authors aimed to identify data useful to avert clinically irrelevant alerts to inform future research on clinical decision support (CDS) design. METHODS: We conducted a retrospective observational study of opioid drug allergy alert (DAA) overrides for the calendar year of 2019 at a large academic medical center, to identify data elements useful to find irrelevant alerts to be averted. RESULTS: Overall, 227,815 DAAs were fired in 2019, with an override rate of 91 % (n = 208196). Opioids represented nearly two-thirds of these overrides (n = 129063; 62 %) and were the drug class with the highest override rate (96 %). On average, 29 opioid DAAs were overridden per patient. While most opioid alerts (97.1 %) are fired for a possible match (the drug class of the allergen matches the drug class of the prescribed drug), they are overridden significantly less frequently for definite match (exact match between allergen and prescribed drug) (88 % vs. 95.9 %, p < 0.001). When comparing the triggering drug with previously administered drugs, override rates were equally high for both definite match (95.9 %), no match (95.5 %), and possible match (95.1 %). Likewise, when comparing to home medications, overrides were excessively high for possible match (96.3 %), no match (96 %), and definite match (94.4 %). CONCLUSION: We estimate that 74.5% of opioid DAAs (46.4% of all DAAs) at our institution could be relatively safely averted, since they either have a definite match for previous inpatient administrations suggesting drug tolerance or are fired as possible match with low risk of cross-sensitivity. Future research should focus on identifying other relevant data elements ideally with automated methods and use of emerging standards to empower CDS systems to suppress false-positive alerts while avoiding safety hazards.

Evaluation of clinical decision support systems in oncology: An updated systematic review.

With increasing reliance on technology in oncology, the impact of digital clinical decision support (CDS) tools needs to be examined. A systematic review update was conducted and peer-reviewed literature from 2016 to 2022 were included if CDS tools were used for live decision making and comparatively assessed quantitative outcomes. 3369 studies were screened and 19 were included in this updated review. Combined with a previous review of 24 studies, a total of 43 studies were analyzed. Improvements in outcomes were observed in 42 studies, and 34 of these were of statistical significance. Computerized physician order entry and clinical practice guideline systems comprise the greatest number of evaluated CDS tools (13 and 10 respectively), followed by those that utilize patient-reported outcomes (8), clinical pathway systems (8) and prescriber alerts for best-practice advisories (4). Our review indicates that CDS can improve guideline adherence, patient-centered care, and care delivery processes in oncology.

A systematic review of data elements of computerized physician order entry (CPOE): mapping the data to FHIR.

OBJECTIVE: Medication errors are the third leading cause of death. There are several methods to prevent prescription errors, one of which is to use a Computerized Physician Order Entry system (CPOE). In a CPOE system, necessary data needs to be collected so that making decisions about prescribing medications and treatment plans could be made. Although many CPOE systems have been developed worldwide, studies have yet to identify the necessary data and data elements of CPOE systems. This study aims to identify data elements of CPOE and standardize these data with Fast Healthcare Interoperability Resources (FHIR) to facilitate data sharing and integration with the electronic health record (EHR) system and reduce data diversity. METHODS: PubMed, Web of Science, Embase, and Scopus databases for studies up to October 2019 were searched. Two reviewers independently assessed original articles to determine eligibility for inclusion in this review. All articles describing data elements of a COPE system were included. Data elements were obtained from the included articles' text, tables, and figures.Classification of the extracted data elements and mapping them to FHIR was done to facilitate data sharing and integration with the electronic health record (EHR) system and reduce data diversity. The final data elements of CPOE were categorized into five main categories of FHIR (foundation, base, clinical, financial, and specialized) and 146 resources, where possible. One of the researchers did mapping and checked and verified by the second researcher. If a data element could not be mapped to any FHIR resources, this data element was considered an extension to the most relevant resource. RESULTS: We retrieved 5162 articles through database searches. After the full-text assessment, 21 articles were included. In total, 270 data elements were identified and mapped to the FHIR standard. These elements have been reported in 26 FHIR resources of 146 ones (18%). In total, 71 data elements were considered an extension. CONCLUSIONS: The results of this study showed that the same data elements were not used in the CPOE systems, and the degree of homogeneity of these systems is limited. The mapping of extracted data with data elements used in the FHIR standard shows the extent to which these systems comply with existing standards. Considering the standards in these systems' design helps developers design more coherent systems that can share data with other systems.