Classification of Health Information Technology Safety Events in a Pediatric Tertiary Care Hospital.

OBJECTIVE: State agencies have developed reporting systems of safety events that include events related to health information technology (HIT). These data come from hospital reporting systems where staff submit safety reports and nurses, in the role of safety managers, review, and code events. Safety managers may have varying degrees of experience with identifying events related to HIT. Our objective was to review events potentially involving HIT and compare those with what was reported to the state. METHODS: We performed a structured review of 1 year of safety events from an academic pediatric healthcare system. We reviewed the free-text description of each event and applied a classification scheme derived from the AHRQ Health IT Hazard Manager and compared the results with events reported to the state as involving HIT. RESULTS: Of 33,218 safety events for a 1-year period, 1247 included key words related to HIT and/or were indicated by safety managers as involving HIT. Of the 1247 events, the structured review identified 769 as involving HIT. In comparison, safety managers only identified 194 of the 769 events (25%) as involving HIT. Most events, 353 (46%), not identified by safety managers were documentation issues. Of the 1247 events, the structured review identified 478 as not involving HIT while safety managers identified and reported 81 of these 478 events (17%) as involving HIT. CONCLUSIONS: The current process of reporting safety events lacks standardization in identifying health technology contributions to safety events, which may minimize the effectiveness of safety initiatives.

Clinical decision support with a comprehensive in-EHR patient tracking system improves genetic testing follow up.

OBJECTIVE: We sought to develop and evaluate an electronic health record (EHR) genetic testing tracking system to address the barriers and limitations of existing spreadsheet-based workarounds. MATERIALS AND METHODS: We evaluated the spreadsheet-based system using mixed effects logistic regression to identify factors associated with delayed follow up. These factors informed the design of an EHR-integrated genetic testing tracking system. After deployment, we assessed the system in 2 ways. We analyzed EHR access logs and note data to assess patient outcomes and performed semistructured interviews with users to identify impact of the system on work. RESULTS: We found that patient-reported race was a significant predictor of documented genetic testing follow up, indicating a possible inequity in care. We implemented a CDS system including a patient data capture form and management dashboard to facilitate important care tasks. The system significantly sped review of results and significantly increased documentation of follow-up recommendations. Interviews with key system users identified a range of sociotechnical factors (ie, tools, tasks, collaboration) that contribute to safer and more efficient care. DISCUSSION: Our new tracking system ended decades of workarounds for identifying and communicating test results and improved clinical workflows. Interview participants related that the system decreased cognitive and time burden which allowed them to focus on direct patient interaction. CONCLUSION: By assembling a multidisciplinary team, we designed a novel patient tracking system that improves genetic testing follow up. Similar approaches may be effective in other clinical settings.

A Clinical Decision Support System for Motivational Messaging and Tobacco Cessation Treatment for Parents: Pilot Evaluation of Use and Acceptance.

BACKGROUND: Research is needed to identify how clinical decision support (CDS) systems can support communication about and engagement with tobacco use treatment in pediatric settings for parents who smoke. We developed a CDS system that identifies parents who smoke, delivers motivational messages to start treatment, connects parents to treatment, and supports pediatrician-parent discussion. OBJECTIVE: The objective of this study is to assess the performance of this system in clinical practice, including receipt of motivational messages and tobacco use treatment acceptance rates. METHODS: The system was evaluated at one large pediatric practice through a single-arm pilot study from June to November 2021. We collected data on the performance of the CDS system for all parents. Additionally, we surveyed a sample of parents immediately after the clinical encounter who used the system and reported smoking. Measures were: (1) the parent remembered the motivational message, (2) the pediatrician reinforced the message, and (3) treatment acceptance rates. Treatments included nicotine replacement therapy, quitline referral (phone counseling), and/or SmokefreeTXT referral (text message counseling). We described survey response rates overall and with 95% confidence intervals (CIs). RESULTS: During the entire study period, 8,488 parents completed use of the CDS: 9.3% (n = 786) reported smoking and 48.2% (n = 379) accepted at least one treatment. A total of 102 parents who smoke who used the system were approached to survey 100 parents (98% response rate). Most parents self-identified as female (84%), aged 25 to 34 years (56%), and Black/African American (94%), and had children with Medicaid insurance (95%). Of parents surveyed, 54% accepted at least one treatment option. Most parents recalled the motivational message (79%; 95% CI: 71-87%), and 31% (95% CI: 19-44%) reported that the pediatrician reinforced the motivational message. CONCLUSION: A CDS system to support parental tobacco use treatment in pediatric primary care enhanced motivational messaging about smoking cessation and evidence-based treatment initiation.

Evaluation of an Antimicrobial Stewardship Decision Support for Pediatric Infections.

OBJECTIVES: Clinical decision support (CDS) has promise for the implementation of antimicrobial stewardship programs (ASPs) in the emergency department (ED). We sought to assess the usability of a newly developed automated CDS to improve guideline-adherent antibiotic prescribing for pediatric community-acquired pneumonia (CAP) and urinary tract infection (UTI). METHODS: We conducted comparative usability testing between an automated, prototype CDS-enhanced discharge order set and standard order set, for pediatric CAP and UTI antibiotic prescribing. After an extensive user-centered design process, the prototype CDS was integrated into the electronic health record, used passive activation, and embedded locally adapted prescribing guidelines. Participants were randomized to interact with three simulated ED scenarios of children with CAP or UTI, across both systems. Measures included task completion, decision-making and usability errors, clinical actions (order set use and correct antibiotic selection), as well as objective measures of system usability, utility, and workload using the National Aeronautics and Space Administration Task Load Index (NASA-TLX). The prototype CDS was iteratively refined to optimize usability and workflow. RESULTS: Usability testing in 21 ED clinical providers demonstrated that, compared to the standard order sets, providers preferred the prototype CDS, with improvements in domains such as explanations of suggested antibiotic choices (p < 0.001) and provision of additional resources on antibiotic prescription (p < 0.001). Simulated use of the CDS also led to overall improved guideline-adherent prescribing, with a 31% improvement for CAP. A trend was present toward absolute workload reduction. Using the NASA-TLX, workload scores for the current system were median 26, interquartile ranges (IQR): 11 to 41 versus median 25, and IQR: 10.5 to 39.5 for the CDS system (p = 0.117). CONCLUSION: Our CDS-enhanced discharge order set for ED antibiotic prescribing was strongly preferred by users, improved the accuracy of antibiotic prescribing, and trended toward reduced provider workload. The CDS was optimized for impact on guideline-adherent antibiotic prescribing from the ED and end-user acceptability to support future evaluative trials of ED ASPs.

Electronic Health Record-Embedded, Behavioral Science-Informed System for Smoking Cessation for the Parents of Pediatric Patients.

BACKGROUND: Helping parents quit smoking is a public health priority. However, parents are rarely, if ever, offered tobacco use treatment through pediatric settings. Clinical decision support (CDS) systems developed for the workflows of pediatric primary care may support consistent screening, treatment, and referral. OBJECTIVES: This study aimed to develop a CDS system by using human-centered design (HCD) that identifies parents who smoke, provides motivational messages to quit smoking (informed by behavioral science), and supports delivery of evidence-based tobacco treatment. METHODS: Our multidisciplinary team applied a rigorous HCD process involving analysis of the work environment, user involvement in formative design, iterative improvements, and evaluation of the system's use in context with the following three cohorts: (1) parents who smoke, (2) pediatric clinicians, and (3) clinic staff. Participants from each cohort were presented with scenario-based, high-fidelity mockups of system components and then provided input related to their role in using the CDS system. RESULTS: We engaged 70 representative participants including 30 parents, 30 clinicians, and 10 clinic staff. A key theme of the design review sessions across all cohorts was the need to automate functions of the system. Parents emphasized a system that presented information in a simple way, highlighted benefits of quitting smoking, and allowed direct connection to treatment. Pediatric clinicians emphasized automating tobacco treatment. Clinical staff emphasized screening for parent smoking via several modalities prior to the patient's visit. Once the system was developed, most parents (80%) reported that it was easy to use, and the majority of pediatricians reported that they would use the system (97%) and were satisfied with it (97%). CONCLUSION: A CDS system to support parental tobacco cessation in pediatric primary care, developed through an HCD process, proved easy to use and acceptable to parents, clinicians, and office staff. This preliminary work justifies evaluating the impact of the system on helping parents quit smoking.

Clinical Decision Support in the PICU: Implications for Design and Evaluation.

OBJECTIVES: To assess the current landscape of clinical decision support (CDS) tools in PICUs in order to identify priority areas of focus in this field. DESIGN: International, quantitative, cross-sectional survey. SETTING: Role-specific, web-based survey administered in November and December 2020. SUBJECTS: Medical directors, bedside nurses, attending physicians, and residents/advanced practice providers at Pediatric Acute Lung Injury and Sepsis Network-affiliated PICUs. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: The survey was completed by 109 respondents from 45 institutions, primarily attending physicians from university-affiliated PICUs in the United States. The most commonly used CDS tools were people-based resources (93% used always or most of the time) and laboratory result highlighting (86%), with order sets, order-based alerts, and other electronic CDS tools also used frequently. The most important goal providers endorsed for CDS tools were a proven impact on patient safety and an evidence base for their use. Negative perceptions of CDS included concerns about diminished critical thinking and the burden of intrusive processes on providers. Routine assessment of existing CDS was rare, with infrequent reported use of observation to assess CDS impact on workflows or measures of individual alert burden. CONCLUSIONS: Although providers share some consensus over CDS utility, we identified specific priority areas of research focus. Consensus across practitioners exists around the importance of evidence-based CDS tools having a proven impact on patient safety. Despite broad presence of CDS tools in PICUs, practitioners continue to view them as intrusive and with concern for diminished critical thinking. Deimplementing ineffective CDS may mitigate this burden, though postimplementation evaluation of CDS is rare.

User Testing an Information Foraging Tool for Ambulatory Surgical Site Infection Surveillance.

BACKGROUND: Surveillance for surgical site infections (SSIs) after ambulatory surgery in children requires a detailed manual chart review to assess criteria defined by the National Health and Safety Network (NHSN). Electronic health records (EHRs) impose an inefficient search process where infection preventionists must manually review every postsurgical encounter (< 30 days). Using text mining and business intelligence software, we developed an information foraging application, the SSI Workbench, to visually present which postsurgical encounters included SSI-related terms and synonyms, antibiotic, and culture orders. OBJECTIVE: This article compares the Workbench and EHR on four dimensions: (1) effectiveness, (2) efficiency, (3) workload, and (4) usability. METHODS: Comparative usability test of Workbench and EHR. Objective test metrics are time per case, encounters reviewed per case, time per encounter, and retrieval of information meeting NHSN definitions. Subjective measures are cognitive load using the National Aeronautics and Space Administration (NASA) Task Load Index (NASA TLX), and a questionnaire on system usability and utility. RESULTS: Eight infection preventionists participated in the test. There was no difference in effectiveness as subjects retrieved information from all cases, using both systems, to meet the NHSN criteria. There was no difference in efficiency in time per case between the Workbench and EHR (8.58 vs. 7.39 minutes, p = 0.36). However, with the Workbench subjects opened fewer encounters per case (3.0 vs. 7.5, p = 0.002), spent more time per encounter (2.23 vs. 0.92 minutes, p = 0.002), rated the Workbench lower in cognitive load (NASA TLX, 24 vs. 33, p = 0.02), and significantly higher in measures of usability. CONCLUSION: Compared with the EHR, the Workbench was more usable, short, and reduced cognitive load. In overall efficiency, the Workbench did not save time, but demonstrated a shift from between-encounter foraging to within-encounter foraging and was rated as significantly more efficient. Our results suggest that infection surveillance can be better supported by systems applying information foraging theory.

Identifying surgical site infections in electronic health data using predictive models.

Objective: The objective was to prospectively derive and validate a prediction rule for detecting cases warranting investigation for surgical site infections (SSI) after ambulatory surgery. Methods: We analysed electronic health record (EHR) data for children who underwent ambulatory surgery at one of 4 ambulatory surgical facilities. Using regularized logistic regression and random forests, we derived SSI prediction rules using 30 months of data (derivation set) and evaluated performance with data from the subsequent 10 months (validation set). Models were developed both with and without data extracted from free text. We also evaluated the presence of an antibiotic prescription within 60 days after surgery as an independent indicator of SSI evidence. Our goal was to exceed 80% sensitivity and 10% positive predictive value (PPV). Results: We identified 234 surgeries with evidence of SSI among the 7910 surgeries available for analysis. We derived and validated an optimal prediction rule that included free text data using a random forest model (sensitivity = 0.9, PPV = 0.28). Presence of an antibiotic prescription had poor sensitivity (0.65) when applied to the derivation data but performed better when applied to the validation data (sensitivity = 0.84, PPV = 0.28). Conclusions: EHR data can facilitate SSI surveillance with adequate sensitivity and PPV.

Anticipated responses of early adopter genetic specialists and nongenetic specialists to unsolicited genomic secondary findings.

PURPOSE: Secondary findings from genomic sequencing are becoming more common. We compared how health-care providers with and without specialized genetics training anticipated responding to different types of secondary findings. METHODS: Providers with genomic sequencing experience reviewed five secondary-findings reports and reported attitudes and potential clinical follow-up. Analyses compared genetic specialists and physicians without specialized genetics training, and examined how responses varied by secondary finding. RESULTS: Genetic specialists scored higher than other providers on four-point scales assessing understandings of reports (3.89 vs. 3.42, p = 0.0002), and lower on scales assessing reporting obligations (2.60 vs. 3.51, p < 0.0001) and burdens of responding (1.73 vs. 2.70, p < 0.0001). Nearly all attitudes differed between findings, although genetic specialists were more likely to assert that laboratories had no obligations when findings had less-established actionability (p < 0.0001 in interaction tests). The importance of reviewing personal and family histories, documenting findings, learning more about the variant, and recommending familial discussions also varied according to finding (all p < 0.0001). CONCLUSION: Genetic specialists felt better prepared to respond to secondary findings than providers without specialized genetics training, but perceived fewer obligations for laboratories to report them, and the two groups anticipated similar clinical responses. Findings may inform development of targeted education and support.

Genomic decision support needs in pediatric primary care.

Clinical genome and exome sequencing can diagnose pediatric patients with complex conditions that often require follow-up care with multiple specialties. The American Academy of Pediatrics emphasizes the role of the medical home and the primary care pediatrician in coordinating care for patients who need multidisciplinary support. In addition, the electronic health record (EHR) with embedded clinical decision support is recognized as an important component in providing care in this setting. We interviewed 6 clinicians to assess their experience caring for patients with complex and rare genetic findings and hear their opinions about how the EHR currently supports this role. Using these results, we designed a candidate EHR clinical decision support application mock-up and conducted formative exploratory user testing with 26 pediatric primary care providers to capture opinions on its utility in practice with respect to a specific clinical scenario. Our results indicate agreement that the functionality represented by the mock-up would effectively assist with care and warrants further development.

Patient-generated Digital Images after Pediatric Ambulatory Surgery.

OBJECTIVE: To describe the use of digital images captured by parents or guardians and sent to clinicians for assessment of wounds after pediatric ambulatory surgery. METHODS: Subjects with digital images of post-operative wounds were identified as part of an on-going cohort study of infections after ambulatory surgery within a large pediatric healthcare system. We performed a structured review of the electronic health record (EHR) to determine how digital images were documented in the EHR and used in clinical care. RESULTS: We identified 166 patients whose parent or guardian reported sending a digital image of the wound to the clinician after surgery. A corresponding digital image was located in the EHR in only 121 of these encounters. A change in clinical management was documented in 20% of these encounters, including referral for in-person evaluation of the wound and antibiotic prescription. CONCLUSION: Clinical teams have developed ad hoc workflows to use digital images to evaluate post-operative pediatric surgical patients. Because the use of digital images to support follow-up care after ambulatory surgery is likely to increase, it is important that high-quality images are captured and documented appropriately in the EHR to ensure privacy, security, and a high-level of care.

Parent-reported outcomes of a shared decision-making portal in asthma: a practice-based RCT.

BACKGROUND: Electronic health record (EHR)-linked patient portals are a promising approach to facilitate shared decision-making between families of children with chronic conditions and pediatricians. This study evaluated the feasibility, acceptability, and impact of MyAsthma, an EHR-linked patient portal supporting shared decision-making for pediatric asthma. METHODS: We conducted a 6-month randomized controlled trial of MyAsthma at 3 primary care practices. Families were randomized to MyAsthma, which tracks families' asthma treatment concerns and goals, children's asthma symptoms, medication side effects and adherence, and provides decision support, or to standard care. Outcomes included the feasibility and acceptability of MyAsthma for families, child health care utilization and asthma control, and the number of days of missed school (child) and work (parent). Descriptive statistics and longitudinal regression models assessed differences in outcomes between study arms. RESULTS: We enrolled 60 families, 30 in each study arm (mean age 8.3 years); 57% of parents in the intervention group used MyAsthma during at least 5 of the 6 study months. Parents of children with moderate to severe persistent asthma used the portal more than others; 92% were satisfied with MyAsthma. Parents reported that use improved their communication with the office, ability to manage asthma, and awareness of the importance of ongoing attention to treatment. Parents in the intervention group reported that children had a lower frequency of asthma flares and intervention parents missed fewer days of work due to asthma. CONCLUSIONS: Use of an EHR-linked asthma portal was feasible and acceptable to families and improved clinically meaningful outcomes.

Adoption of electronic medical record-based decision support for otitis media in children.

OBJECTIVE: Substantial investment in electronic health records (EHRs) has provided an unprecedented opportunity to use clinical decision support (CDS) to increase guideline adherence. To inform efforts to maximize adoption, we characterized the adoption of an otitis media (OM) CDS system, the impact of performance feedback on adoption, and the effects of adoption on guideline adherence. STUDY SETTING: A total of 41,391 OM visits with 108 clinicians at 16 pediatric practices between February 2009 and August 2010. STUDY DESIGN: Prospective cohort study of EHR-based CDS adoption during OM visits, comparing clinicians receiving performance feedback to none. CDS was available to all physicians; use was voluntary. DATA COLLECTION: Extraction from a common EHR. PRINCIPAL FINDINGS: Clinicians and practices used the CDS system for a mean of 21 percent (range: 0-85 percent) and 17 percent (0-51 percent) of eligible OM visits, respectively. Clinicians who received performance feedback reports summarizing CDS use and guideline adherence had a relative increase in CDS use of 9.0 percentage points compared to others (p = .001). CDS adoption was associated with increased OM guideline adherence. Effects were greatest among clinicians with the lowest adherence prior to the study. CONCLUSIONS: Performance feedback increased CDS adoption, but additional strategies are needed to integrate CDS into primary care workflows.

A shared e-decision support portal for pediatric asthma.

We describe the user-centered development of an electronic medical record-based portal, "MyAsthma," designed to facilitate shared decision making in pediatric asthma. Interviews and focus groups with 7 parents of children with asthma and 51 clinical team members elicited 2 overarching requirements: that the portal should support sustained communication and ensure patient safety. Parents and clinicians prioritized features including collecting parent and child concerns and goals; symptom, side effect, and medication adherence tracking with decision support; and accessible educational materials. Iterative usability testing refined the system. MyAsthma provides a model for using technology to foster shared decision making in ambulatory care settings.

Improving adherence to otitis media guidelines with clinical decision support and physician feedback.

OBJECTIVE: To assess the effects of electronic health record-based clinical decision support (CDS) and physician performance feedback on adherence to guidelines for acute otitis media (AOM) and otitis media with effusion (OME). METHODS: We conducted a factorial-design cluster randomized trial with primary care practices (n = 24) as the unit of randomization and visits as the unit of analysis. Between December 2007 and September 2010, data were collected from 139,305 otitis media visits made by 55,779 children aged 2 months to 12 years. When activated, the CDS system provided guideline-based recommendations individualized to the patient's history and presentation. Monthly physician feedback reported adherence to guideline-based care, changes over time, and comparisons to others in the practice and network. RESULTS: Comprehensive care (all recommended guidelines were adhered to) was accomplished for 15% of AOM and 5% of OME visits during the baseline period. The increase from baseline to intervention periods in adherence to guidelines was larger for CDS compared with non-CDS visits for comprehensive care, pain treatment, adequate diagnostic evaluation for OME, and amoxicillin as first-line therapy for AOM. Although performance feedback was associated with improved antibiotic prescribing for AOM and pain treatment, the joint effects of CDS and feedback on guideline adherence were not additive. There was marked variation in use of the CDS system, ranging from 5% to 45% visits across practices. CONCLUSIONS: Clinical decision support and performance feedback are both effective strategies for improving adherence to otitis media guidelines. However, combining the 2 interventions is no better than either delivered alone.

Effects of end-of-month admission on length of stay and quality of care among inpatients with myocardial infarction.

PURPOSE: We studied whether transfer of care when house staff and faculty switch services affects length of stay or quality of care among hospitalized patients. SUBJECTS AND METHODS: We performed a retrospective analysis in 976 consecutive patients admitted with myocardial infarction from 1995 to 1998. Patients who were admitted within 3 days of change in staff were denoted end-of-month patients. RESULTS: Of 782 eligible patients, 690 (88%) were admitted midmonth and 92 (12%) at the end of the month. The median length of stay was 7 days for midmonth and 8 days for end-of-month patients (P = 0.06). End-of-month admission was an independent predictor of length of stay in multivariate models. In addition, a significant difference in length of stay was noted between patients admitted at the beginning and end of the academic year. There were no statistically significant differences in the use of aspirin, beta-blockers, angiotensin-converting enzyme inhibitors, or lipid-lowering agents at discharge between midmonth and end-of-month patients. Mortality and in-hospital adverse events did not differ between the two groups, with the possible exception of a greater incidence of acute renal failure in the end-of-month patients. CONCLUSIONS: Although admission during the last 3 days of the month is an independent predictor of length of stay, it does not have a large effect on quality of care among patients with myocardial infarction.