Improving computerized decision support system interventions: a qualitative study combining the theoretical domains framework with the GUIDES Checklist.

BACKGROUND: Computerized clinical decision support systems (CDSSs) can improve care by bridging knowledge to practice gaps. However, the real-world uptake of such systems in health care settings has been suboptimal. We sought to: (1) use the Theoretical Domains Framework (TDF) to identify determinants (barriers/enablers) of uptake of the Electronic Asthma Management System (eAMS) CDSS; (2) match identified TDF belief statements to elements in the Guideline Implementation with Decision Support (GUIDES) Checklist; and (3) explore the relationship between the TDF and GUIDES frameworks and the usefulness of this sequential approach for identifying opportunities to improve CDSS uptake. METHODS: In Phase 1, we conducted semistructured interviews with primary care physicians in Toronto, Canada regarding the uptake of the eAMS CDSS. Using content analysis, two coders independently analyzed interview transcripts guided by the TDF to generate themes representing barriers and enablers to CDSS uptake. In Phase 2, the same reviewers independently mapped each belief statement to a GUIDES domain and factor. We calculated the proportion of TDF belief statements that linked to each GUIDES domain and the proportion of TDF domains that linked to GUIDES factors (and vice-versa) and domains. RESULTS: We interviewed 10 participants before data saturation. In Phase 1, we identified 53 belief statements covering 12 TDF domains; 18 (34.0%) were barriers, and 35 (66.0%) were enablers. In Phase 2, 41 statements (77.4%) linked to at least one GUIDES factor, while 12 (22.6%) did not link to any specific factor. The GUIDES Context Domain was linked to the largest number of belief statements (19/53; 35.8%). Each TDF domain linked to one or more GUIDES factor, with 6 TDF domains linking to more than 1 factor and 8 TDF domains linking to more than 1 GUIDES domain. CONCLUSIONS: The TDF provides unique insights into barriers and enablers to CDSS uptake, which can then be mapped to GUIDES domains and factors to identify required changes to CDSS context, content, and system. This can be followed by conventional mapping of TDF domains to behaviour change techniques to optimize CDSS implementation. This novel step-wise approach combines two established frameworks to optimize CDSS interventions, and requires prospective validation.

U"AI" Testing: User Interface and Usability Testing of a Chest X-ray AI Tool in a Simulated Real-World Workflow.

Purpose: To observe interactions of practicing radiologists with a chest x-ray AI tool and evaluate its usability and impact on workflow efficiency. Methods: Using a simulated clinical workflow and remote multi-monitor screensharing, we prospectively assessed the interactions of 10 staff radiologists (5-33 years of experience) with a PACS-embedded, regulatory-approved chest x-ray AI tool. Qualitatively, we collected feedback using a think-aloud method and post-testing semi-structured interview; transcript themes were categorized by: (1) AI tool features, (2) deployment considerations, and (3) broad human-AI interactions. Quantitatively, we used time-stamped video recordings to compare reporting and decision-making efficiency with and without AI assistance. Results: For AI tool features, radiologists appreciated the simple binary classification (normal vs abnormal) and found the heatmap essential to understand what the AI considered abnormal; users were uncertain of how to interpret confidence values. Regarding deployment considerations, radiologists thought the tool would be especially helpful for identifying subtle diagnoses; opinions were mixed on whether the tool impacted perceived efficiency, accuracy, and confidence. Considering general human-AI interactions, radiologists shared concerns about automation bias especially when relying on an automated triage function. Regarding decision-making and workflow efficiency, participants began dictating 5 seconds later (42% increase, P = .02) and took 14 seconds longer to complete cases (33% increase, P = .09) with AI assistance. Conclusions: Radiologist usability testing provided insights into effective AI tool features, deployment considerations, and human-AI interactions that can guide successful AI deployment. Early AI adoption may increase radiologists' decision-making and total reporting time but improves with experience.

Do providers use computerized clinical decision support systems? A systematic review and meta-regression of clinical decision support uptake.

BACKGROUND: Computerized clinical decision support systems (CDSSs) are a promising knowledge translation tool, but often fail to meaningfully influence the outcomes they target. Low CDSS provider uptake is a potential contributor to this problem but has not been systematically studied. The objective of this systematic review and meta-regression was to determine reported CDSS uptake and identify which CDSS features may influence uptake. METHODS: Medline, Embase, CINAHL, and the Cochrane Database of Controlled Trials were searched from January 2000 to August 2020. Randomized, non-randomized, and quasi-experimental trials reporting CDSS uptake in any patient population or setting were included. The main outcome extracted was CDSS uptake, reported as a raw proportion, and representing the number of times the CDSS was used or accessed over the total number of times it could have been interacted with. We also extracted context, content, system, and implementation features that might influence uptake, for each CDSS. Overall weighted uptake was calculated using random-effects meta-analysis and determinants of uptake were investigated using multivariable meta-regression. RESULTS: Among 7995 citations screened, 55 studies involving 373,608 patients and 3607 providers met full inclusion criteria. Meta-analysis revealed that overall CDSS uptake was 34.2% (95% CI 23.2 to 47.1%). Uptake was only reported in 12.4% of studies that otherwise met inclusion criteria. Multivariable meta-regression revealed the following factors significantly associated with uptake: (1) formally evaluating the availability and quality of the patient data needed to inform CDSS advice; and (2) identifying and addressing other barriers to the behaviour change targeted by the CDSS. CONCLUSIONS AND RELEVANCE: System uptake was seldom reported in CDSS trials. When reported, uptake was low. This represents a major and potentially modifiable barrier to overall CDSS effectiveness. We found that features relating to CDSS context and implementation strategy best predicted uptake. Future studies should measure the impact of addressing these features as part of the CDSS implementation strategy. Uptake reporting must also become standard in future studies reporting CDSS intervention effects. REGISTRATION: Pre-registered on PROSPERO, CRD42018092337.

Barriers and Enablers to Objective Testing for Asthma and COPD in Primary Care: A Systematic Review Using the Theoretical Domains Framework.

BACKGROUND: Although guidelines long have recommended objective pulmonary function testing to diagnose asthma and COPD, many primary care patients receive a clinical diagnosis of asthma or COPD without objective testing. This often leads to unnecessary treatment with associated incremental costs and side effects and delays actual diagnosis. RESEARCH QUESTION: What are the barriers and enablers to lung function testing for asthma, COPD, or both in primary care? STUDY DESIGN AND METHODS: We searched the literature for qualitative and quantitative studies reporting barriers, enablers, or both to in-office or out-of-office lung function testing for diagnosing asthma, COPD, or both in primary care. Two reviewers independently screened abstracts and full texts, assessed methodologic quality using the Mixed Methods Appraisal Tool, and extracted data from included studies. Identified barriers and enablers were categorized using the Theoretical Domains Framework (TDF), applying a pre-established coding manual. RESULTS: We identified 7,988 unique articles, reviewed 336 full-text articles, and included 18 studies in this systematic review. Of these 18, 12 were quantitative, three were qualitative, and three used mixed methods. All 18 addressed in-office testing and 11 also addressed out-of-office testing. Barriers and enablers overlapped for asthma and COPD, and in-office and out-of-office settings. We identified more reported barriers (eg, lack of knowledge of the usefulness of spirometry) than enablers (eg, skills for performing reliable spirometry). Barriers mapped to nine (of a possible 14) TDF domains (for both in-office and out-of-office settings). Enablers mapped to three domains for in-office testing and five domains for out-of-office testing. INTERPRETATION: Barriers to objective testing for airway disease in primary care are complex and span many theoretical domains. Correspondingly, a successful intervention must leverage multiple behavior change techniques. A theory-based, multifaceted intervention to address underuse of diagnostic testing for asthma or COPD now should be developed and tested.

A patient decision aid for mild asthma: Navigating a new asthma treatment paradigm.

INTRODUCTION: In mild asthma, as-needed budesonide-formoterol offers similar protection from severe exacerbations as daily inhaled corticosteroids (ICS), with lower ICS exposure but slightly increased symptoms. We sought to develop an electronic decision aid to guide discussions about the pros and cons of these first-line options, while identifying and integrating user preferences. METHODS: Following International Patient Decision Aid Standards, we created a mild asthma decision aid prototype comparing convenience, clinical outcomes, cumulative ICS dose exposure, costs, and side-effects of each option. After face validation, the prototype was iteratively adapted through rapid-cycle development. Each cycle consisted of a patient focus group and a primary care physician interview. We made user preference-based improvements after each round, until reaching a pre-set stopping criterion (no new critical issues identified). We then performed a summative qualitative content analysis. RESULTS: Over 5 cycles, we recruited 21 asthma patients (12/21 women, 10/21 ≥ 60 years old) and 5 physicians. Serial changes included simplification and reduction of text and reading level, inclusion of an ICS "myths" section and elaboration of patient-friendly infographics for numerical comparisons. User preferences fell within Content, Format, and tool use Process themes. In response to decision-making preferences, we created a complementary one-page conversation aid for patient-provider use at the point-of-care. CONCLUSIONS: We present preference-based electronic patient decision and conversation aids for treatment of mild asthma. Our user preference analyses offer useful insights for development of such tools in other chronic diseases. These tools now require integration into point-of-care workflows for measurement of real-world uptake and impact.

Impact of ABO Blood Group on the Development of Venous Thromboembolism in Children With Cancer: A Systematic Review and Meta-Analysis.

BACKGROUND: Few studies have evaluated the impact of ABO blood group on the risk of venous thromboembolism (VTE) in pediatric populations. We performed a systematic review to determine whether children (0 to 18 y old) with non-O blood group have an increased risk of developing VTE compared with those with O blood group. METHODS: We searched Ovid Medline, Embase, PubMed, Cochrane, Web of Science, and CINAHL online databases from inception to December 2018 to find studies involving blood grouping and VTE. Data was collected regarding patients' underlying diseases, sex, age, ABO blood group, and VTE frequency. A meta-analysis using the random effect model was performed, and heterogeneity was assessed with the I2 value. RESULTS: Among 1280 unique articles identified, 7 studies (3 conference abstracts, 4 peer-reviewed journal articles) involving 609 VTE cases were included in the systematic review. Six studies were eligible for a meta-analysis; all involved patients with cancer. Blood group O was protective against VTE (odds ratio, 0.56; 95% confidence interval, 0.43-0.79). Findings were similar across sensitivity analyses. CONCLUSIONS: This systematic review has documented that O blood group is protective against new-onset VTE in children with cancer. Larger studies across different ethnic backgrounds and disease categories are needed to confirm these findings.

A system uptake analysis and GUIDES checklist evaluation of the Electronic Asthma Management System: A point-of-care computerized clinical decision support system.

OBJECTIVE: Computerized clinical decision support systems (CCDSSs) promise improvements in care quality; however, uptake is often suboptimal. We sought to characterize system use, its predictors, and user feedback for the Electronic Asthma Management System (eAMS)-an electronic medical record system-integrated, point-of-care CCDSS for asthma-and applied the GUIDES checklist as a framework to identify areas for improvement. MATERIALS AND METHODS: The eAMS was tested in a 1-year prospective cohort study across 3 Ontario primary care sites. We recorded system usage by clinicians and patient characteristics through system logs and chart reviews. We created multivariable models to identify predictors of (1) CCDSS opening and (2) creation of a self-management asthma action plan (AAP) (final CCDSS step). Electronic questionnaires captured user feedback. RESULTS: Over 1 year, 490 asthma patients saw 121 clinicians. The CCDSS was opened in 205 of 1033 (19.8%) visits and an AAP created in 121 of 1033 (11.7%) visits. Multivariable predictors of opening the CCDSS and producing an AAP included clinic site, having physician-diagnosed asthma, and presenting with an asthma- or respiratory-related complaint. The system usability scale score was 66.3 ± 16.5 (maximum 100). Reported usage barriers included time and system accessibility. DISCUSSION: The eAMS was used in a minority of asthma patient visits. Varying workflows and cultures across clinics, physician beliefs regarding asthma diagnosis, and relevance of the clinical complaint influenced uptake. CONCLUSIONS: Considering our findings in the context of the GUIDES checklist helped to identify improvements to drive uptake and provides lessons relevant to CCDSS design across diseases.

A Role for Alveolar Exhaled Nitric Oxide Measurement in the Diagnosis of Hepatopulmonary Syndrome.

GOALS: The authors sought to characterize predominantly alveolar exhaled nitric oxide (eNO) in hepatopulmonary syndrome (HPS) compared with non-HPS, changes after liver transplantation, and diagnostic properties. BACKGROUND: HPS is defined by liver disease, intrapulmonary vascular dilatations (IPVDs), and hypoxemia. Rat models and small human studies suggest that NO overproduction may cause IPVDs. STUDY: A retrospective review of the Canadian HPS Database (2007 to 2017) and prospective eNO measurement (main outcome) in healthy controls (measurement expiratory flow, 200 mL/s). HPS was defined as: (1) liver disease; (2) contrast echocardiography consistent with IPVDs; and (3) partial pressure of arterial oxygen <70 mm Hg with alveolar-arterial gradient >20 mm Hg; subclinical HPS as criteria (1) and (2) only; and no HPS as criterion (1) only. Current smokers and subjects with asthma or pulmonary hypertension were excluded. A linear mixed effects model was used to compare eNO between groups and before and after transplantation. RESULTS: eNO was 10.4±0.7 ppb in HPS (n=26); 8.3±0.6 ppb in subclinical HPS (n=38); 7.1±1.0 ppb in no HPS (n=15); and 5.6±0.7 ppb in controls (n=30) (P<0.001). eNO decreased from 10.9±0.8 ppb preliver to 6.3±0.8 ppb postliver transplant (n=6 HPS, 6 subclinical HPS) (P<0.001). eNO <6 ppb was 84.4% (73.1% to 92.2%) sensitive and ≥12 ppb was 78.1% (69.4% to 85.3%) specific for HPS (vs. subclinical HPS). CONCLUSIONS: HPS subjects have higher alveolar eNO than non-HPS subjects, levels normalize with liver transplantation. Applying eNO cutoff values may aid in HPS diagnosis.