Resident Performance of the Rapid Cardiopulmonary Assessment in the Emergency Department.

OBJECTIVES: The rapid cardiopulmonary assessment (RCPA) is an essential first step in effective resuscitation of critically ill children. Pediatric residents may not be achieving competency with resuscitative skills, including RCPA. Our objective was to determine how often pediatric residents complete the RCPA for actual patients. METHODS: This was an observational, cross-sectional study of senior residents (≥postgraduate year 2) performing the RCPA in the resuscitation area of a high-volume pediatric emergency department (PED), where pediatric residents are expected to perform the bedside examination and assessment for all medical (nontrauma) patients. Data were collected primarily by video review on a standard form. The primary outcome was completion of the RCPA, defined as both examination and verbalized assessment of the airway, breathing, and circulation. We explored the association between RCPA completion and both residency year and number of previous PED rotations. RESULTS: Complete data were collected from one randomly selected patient for 71 (95%) of 75 of eligible senior residents who rotated in the PED between January and June 2013. Two residents (3%) performed a complete RCPA. Verbalized assessment of circulation was especially rare (7/71; 10%). There was no association between RCPA completion and year of training or previous PED experience (P > 0.05). CONCLUSIONS: Senior pediatric resident performance of the RCPA in the resuscitation area of a high-volume PED was poor. There was no association between RCPA completion and greater resident experience, including in the PED. These findings add to a growing body of literature suggesting that pediatric residents are not achieving competency with the RCPA and resuscitation skills.

Retention of Basic Neonatal Resuscitation Skills and Bag-Mask Ventilation in Pediatric Residents Using Just-in-Place Simulation of Varying Frequency and Intensity: A Pilot Randomized Controlled Study.

OBJECTIVES: Pediatric residents quickly lose neonatal resuscitation (NR) skills after initial training. Helping Babies Breathe is a skills-based curriculum emphasizing basic NR skills needed within the "Golden Minute" after birth. With this pilot study, we evaluated the feasibility of implementing a Golden Minute review and the impact on overall performance and bag-mask ventilation (BMV) skills in pediatric interns during and/or after their NICU rotation, with varying frequency and/or intensity of "just-in-place" simulation. METHODS: During their NICU rotation, interns at 1 delivery hospital received the Golden Minute module and hands-on simulation practice. All enrolled interns were randomly assigned to weekly retraining or no retraining for their NICU month and every 1- or 3-month retraining post-NICU for the remainder of their intern year, based on a factorial design. The primary measure was the score on a 21-item evaluation tool administered at the end of intern year, which was compared to the scores received by interns at another hospital (controls). RESULTS: Twenty-eight interns were enrolled in the intervention. For the primary outcome, at the end of intern year, the 1- and 3-month groups had higher scores (18.8 vs 18.6 vs 14.4; P < .01) and shorter time to effective BMV (10.6 vs 20.4 vs 52.8 seconds; P < .05 for both comparisons) than those of controls. However, the 1- and 3-month groups had no difference in score or time to BMV. CONCLUSIONS: This pilot study revealed improvement in simulated performance of basic NR skills in interns receiving increased practice intensity and/or frequency than those who received the current standard of NR training.

The Reliability of Computerized Physician Order Entry Data for Research Studies.

OBJECTIVES: In the United States, adolescents account for nearly half of the newly diagnosed sexually transmitted infections annually, and many of these infections are asymptomatic. Adolescents often seek care in pediatric emergency departments; thus, the emergency department is an important setting to implement adolescent sexually transmitted infection screening. Before implementation, baseline data reflecting current screening rates of symptomatic and asymptomatic patients were needed. This study aimed to evaluate the accuracy of provider-reported rates of symptomatic and asymptomatic chlamydia (CT) and gonorrhea (GC) testing in adolescents overall and pre-electronic health record (EHR) and post-EHR order modification in preparation for a research intervention. METHODS: This was a 1-year prospective, observational study. Provider reason for CT/GC testing was added to the existing EHR order. Chart reviews were performed to ensure the accuracy of clinician CT/GC testing choices (symptomatic vs asymptomatic). Frequencies of testing choices were obtained. Order modifications were made to further clarify the definitions. A Student t test was used to compare data preorder and postorder modification. RESULTS: When relying on providers to report reasons for CT/GC testing (symptomatic vs asymptomatic), many patients were misclassified based on a priori defined testing reasons. After order modification, rates of provider-reported symptomatic testing remained unchanged (P = 0.16). Provider-reported asymptomatic testing significantly declined (P = 0.004); however, 23.2% of those tested continued to be misclassified. CONCLUSIONS: Provider-entered EHR data are increasingly being used in research studies; thus, it is important to ensure its accuracy and reliability before study implementation.

A Validation Argument for a Simulation-Based Training Course Centered on Assessment, Recognition, and Early Management of Pediatric Sepsis.

INTRODUCTION: Early recognition of sepsis remains one of the greatest challenges in medicine. Novice clinicians are often responsible for the recognition of sepsis and the initiation of urgent management. The aim of this study was to create a validity argument for the use of a simulation-based training course centered on assessment, recognition, and early management of sepsis in a laboratory-based setting. METHODS: Five unique simulation scenarios were developed integrating critical sepsis cues identified through qualitative interviewing. Scenarios were piloted with groups of novice, intermediate, and expert pediatric physicians. The primary outcome was physician recognition of sepsis, measured with an adapted situation awareness global assessment tool. Secondary outcomes were physician compliance with pediatric advanced life support (PALS) guidelines and early sepsis management (ESM) recommendations, measured by two internally derived tools. Analysis compared recognition of sepsis by levels of expertise and measured association of sepsis recognition with the secondary outcomes. RESULTS: Eighteen physicians were recruited, six per study group. Each physician completed three sepsis simulations. Sepsis was recognized in 19 (35%) of 54 simulations. The odds that experts recognized sepsis was 2.6 [95% confidence interval (CI) = 0.5-13.8] times greater than novices. Adjusted for severity, for every point increase in the PALS global performance score, the odds that sepsis was recognized increased by 11.3 (95% CI = 3.1-41.4). Similarly, the odds ratio for the PALS checklist score was 1.5 (95% CI = 0.8-2.6). Adjusted for severity and level of expertise, the odds of recognizing sepsis was associated with an increase in the ESM checklist score of 1.8 (95% CI = 0.9-3.6) and an increase in ESM global performance score of 4.1 (95% CI = 1.7-10.0). CONCLUSIONS: Although incomplete, evidence from initial testing suggests that the simulations of pediatric sepsis were sufficiently valid to justify their use in training novice pediatric physicians in the assessment, recognition, and management of pediatric sepsis.

A Qualitative Analysis of Adolescent and Caregiver Acceptability of Universally Offered Gonorrhea and Chlamydia Screening in the Pediatric Emergency Department.

STUDY OBJECTIVE: We qualitatively explore adolescent and parent or guardian attitudes about benefits and barriers to universally offered gonorrhea and chlamydia screening and modalities for assessing interest in screening in the pediatric emergency department (ED). METHODS: A convenience sample of forty 14- to 21-year-olds and parents or guardians of adolescents presenting to an urban and community pediatric ED with any chief complaint participated in individual, semistructured, confidential interviews. Topics included support of universally offered gonorrhea and chlamydia screening, barriers and benefits to screening, and modalities for assessing interest in screening. Data were analyzed with framework analysis. RESULTS: Almost all adolescents (37/40; 93%) and parents (39/40; 98%) support offering ED gonorrhea or chlamydia screening. Benefits included earlier diagnosis and treatment, convenience and transmission prevention (cited by both groups), and improved education and long-term health (cited by parents/guardians). Barriers included concerns about confidentiality and cost (cited by both groups), embarrassment (cited by adolescents), and nondisclosure to parents or guardians (cited by parents/guardians). Adolescents preferred that the request for gonorrhea or chlamydia screening be presented in a private room, using tablet technology. Both groups noted that the advantages to tablets included confidentiality and adolescents' familiarity with technology. Adolescents noted that tablet use would address concerns about bringing up gonorrhea or chlamydia screening with clinicians, whereas parents or guardians noted that tablets might increase screening incidence but expressed concern about the lack of personal interaction. CONCLUSION: Universally offered gonorrhea and chlamydia screening in a pediatric ED was acceptable to the adolescents and parents or guardians in this study. Offering a tablet-based method to assess interest in screening may increase participation.

Defining the Simulation Technician Role: Results of a Survey-Based Study.

INTRODUCTION: In health care simulation, simulation technicians perform multiple tasks to support various educational offerings. Technician responsibilities and the tasks that accompany them seem to vary between centers. The objectives were to identify the range and frequency of tasks that technicians perform and to determine if there is a correspondence between what technicians do and what they feel their responsibilities should be. We hypothesized that there is a core set of responsibilities and tasks for the technician position regardless of background, experience, and type of simulation center. METHODS: We conducted a prospective, survey-based study of individuals currently functioning in a simulation technician role in a simulation center. This survey was designed internally and piloted within 3 academic simulation centers. Potential respondents were identified through a national mailing list, and the survey was distributed electronically during a 3-week period. RESULTS: A survey request was sent to 280 potential participants, 136 (49%) responded, and 73 met inclusion criteria. Five core tasks were identified as follows: equipment setup and breakdown, programming scenarios into software, operation of software during simulation, audiovisual support for courses, and on-site simulator maintenance. Independent of background before they were hired, technicians felt unprepared for their role once taking the position. Formal training was identified as a need; however, the majority of technicians felt experience over time was the main contributor toward developing knowledge and skills within their role. CONCLUSIONS: This study represents a first step in defining the technician role within simulation-based education and supports the need for the development of a formal job description to allow recruitment, development, and certification.

Teamwork skills in actual, in situ, and in-center pediatric emergencies: performance levels across settings and perceptions of comparative educational impact.

INTRODUCTION: Pediatric emergencies require effective teamwork. These skills are developed and demonstrated in actual emergencies and in simulated environments, including simulation centers (in center) and the real care environment (in situ). Our aims were to compare teamwork performance across these settings and to identify perceived educational strengths and weaknesses between simulated settings. We hypothesized that teamwork performance in actual emergencies and in situ simulations would be higher than for in-center simulations. METHODS: A retrospective, video-based assessment of teamwork was performed in an academic, pediatric level 1 trauma center, using the Team Emergency Assessment Measure (TEAM) tool (range, 0-44) among emergency department providers (physicians, nurses, respiratory therapists, paramedics, patient care assistants, and pharmacists). A survey-based, cross-sectional assessment was conducted to determine provider perceptions regarding simulation training. RESULTS: One hundred thirty-two videos, 44 from each setting, were reviewed. Mean total TEAM scores were similar and high in all settings (31.2 actual, 31.1 in situ, and 32.3 in-center, P = 0.39). Of 236 providers, 154 (65%) responded to the survey. For teamwork training, in situ simulation was considered more realistic (59% vs. 10%) and more effective (45% vs. 15%) than in-center simulation. DISCUSSION: In a video-based study in an academic pediatric institution, ratings of teamwork were relatively high among actual resuscitations and 2 simulation settings, substantiating the influence of simulation-based training on instilling a culture of communication and teamwork. On the basis of survey results, providers favored the in situ setting for teamwork training and suggested an expansion of our existing in situ program.

Factors associated with participation in research conducted in a pediatric emergency department.

OBJECTIVE: To examine the association of demographic and study characteristics in eligible subjects who agree to participate compared with those who did not participate in clinical research studies in a pediatric emergency department (PED). METHODS: Information for all families approached for participation in PED-based clinical research studies during a 6-year period was recorded in an electronic database. This included demographic factors, decision to participate, primary reason for not participating, and study characteristics. Forty studies were included in this analysis. Differences in participation rate among demographic and study characteristics were examined. Multivariable logistic regression was used to predict the likelihood of participation. RESULTS: Participation rates were similar with respect to sex (50.1% in male vs 49.9% in female), whereas families with younger children were more likely to participate (mean age, 8.5 years vs 10.2 years among nonparticipants P < 0.001). White patients were more likely to participate than African American patients (54.7% vs 45.6% in African Americans, P < 0.001). The presence of compensation, brief time requirement, and older children was negatively associated with participation for moderate to very invasive studies. However, for noninvasive and mildly invasive studies, the presence of compensation and the time required were not associated with participation. CONCLUSIONS: Study characteristics including invasiveness, time required of patients, and whether compensation is offered, along with demographic factors, influence participation in clinical studies conducted in the PED. When designing a research study in the PED, these, along with novel approaches to including all races and ethnicities in PED research, should be considered.

Adolescent patient preferences surrounding partner notification and treatment for sexually transmitted infections.

OBJECTIVES: Important barriers to addressing the sexually transmitted infection (STI) epidemic among adolescents are the inadequate partner notification of positive STI results and insufficient rates of partner testing and treatment. However, adolescent attitudes regarding partner notification and treatment are not well understood. The aim was to qualitatively explore the barriers to and preferences for partner notification and treatment among adolescent males and females tested for STIs in an emergency department (ED) setting and to explore the acceptability of ED personnel notifying their sexual partners. METHODS: This was a descriptive, qualitative study in which a convenience sample of 40 adolescents (18 females, 22 males) 14 to 21 years of age who presented to either adult or pediatric EDs with STI-related complaints participated. Individualized, semistructured, confidential interviews were administered to each participant. Interviews were audiotaped and transcribed verbatim by an independent transcriptionist. Data were analyzed using framework analysis. RESULTS: Barriers to partner notification included fear of retaliation or loss of the relationship, lack of understanding of or concern for the consequences associated with an STI, and social stigma and embarrassment. Participants reported two primary barriers to their partners obtaining STI testing and treatment: lack of transportation to the health care site and the partner's fear of STI positive test results. Most participants preferred to notify their main sexual partners of an STI exposure via a face-to-face interaction or a phone call. Most participants were agreeable with a health care provider (HCP) notifying their main sexual partners of STI exposure and preferred that the HCP notify the partner by phone call. CONCLUSIONS: There are several adolescent preferences and barriers for partner notification and treatment. To be most effective, future interventions to prevent adolescent STIs should incorporate these preferences and address the barriers to partner notification. In an ED setting, using HCPs to provide partner notification of STI exposures is acceptable to adolescent patients; however, the feasibility of this type of program needs further exploration.

Improving sexually transmitted infection results notification via mobile phone technology.

PURPOSE: To improve adolescent notification of positive sexually transmitted infection (STI) tests using mobile phone technology and STI information cards. METHODS: A randomized intervention among 14- to 21-year olds in a pediatric emergency department (PED). A 2 × 3 factorial design with replication was used to evaluate the effectiveness of six combinations of two factors on the proportion of STI-positive adolescents notified within 7 days of testing. Independent factors included method of notification (call, text message, or call + text message) and provision of an STI information card with or without a phone number to obtain results. Covariates for logistic regression included age, empiric STI treatment, days until first attempted notification, and documentation of confidential phone number. RESULTS: Approximately half of the 383 females and 201 males enrolled were ≥18 years of age. Texting only or type of card was not significantly associated with patient notification rates, and there was no significant interaction between card and notification method. For females, successful notification was significantly greater for call + text message (odds ratio, 3.2; 95% confidence interval, 1.4-6.9), and documenting a confidential phone number was independently associated with successful notification (odds ratio, 3.6; 95% confidence interval, 1.7-7.5). We found no significant predictors of successful notification for males. Of patients with a documented confidential phone number who received a call + text message, 94% of females and 83% of males were successfully notified. CONCLUSIONS: Obtaining a confidential phone number and using call + text message improved STI notification rates among female but not male adolescents in a pediatric emergency department.

Identification of latent safety threats using high-fidelity simulation-based training with multidisciplinary neonatology teams.

BACKGROUND: Latent safety threats (LSTs) are errors in design, organization, training, or maintenance that may contribute to medical errors and have a significant impact on patient safety. The investigation described in this article was conducted as part of a larger prospective, longitudinal evaluation using laboratory- and in situ simulation-based training sessions to improve technical and nontechnical skills of neonatal ICU (NICU) providers at a Level III academic NICU. METHODS: Simulations were performed in laboratory (4 scenarios per session) and in situ (1 scenario per session) settings with multidisciplinary neonatology teams. Facilitators and subjects identified LSTs during standardized debriefings immediately following each scenario After enrollment, facilitators classified LSTs into equipment, medication, personnel, resource, or technical skill. Pervasive team knowledge gaps were further subclassified into lack of awareness or understanding, procedure performed incorrectly, omission of necessary action, or inappropriate action. RESULTS: In a 19-month period of enrollment (August 2009-March 2011), 177 subjects of 202 NICU providers were trained in the laboratory, 135 of whom participated in the in situ sessions. In the laboratory, 22 sessions were completed, with 70 LSTs identified (0.8 LSTs per scenario). During the 16 in situ sessions, 29 LSTs (1.8 LSTs per scenario) were identified. The 99 LSTs were reported to NICU leadership, leading to 19 documented improvements. CONCLUSIONS: The NICU setting has a high rate of previously unidentified LSTs. Conducting in situ scenarios allows for the identification of novel LSTs not detected in the simulation laboratory. The subsequent clinical improvements made to the actual clinical care environment are the best objective evidence of the benefits of simulation-based multidisciplinary team training.

Point-of-care testing improves accuracy of STI care in an emergency department.

OBJECTIVES: We aimed to examine the impact of a point-of-care (POC) test on overtreatment and undertreatment of sexually transmitted infections (STIs) by comparing treatment patterns for gonorrhoea (detected with nucleic acid amplification testing (NAAT)) with trichomoniasis (detected by POC test) for young women seen in an emergency department (ED). METHODS: We reviewed the database of a quality improvement (QI) project that aims to improve follow-up care for STIs in the ED. Data included the test result and antibiotic given (if any) during visits by women age 14-21 for whom an STI test was ordered. We generated Shewhart control charts and compared overtreatment and undertreatment rates for gonorrhoea and trichomoniasis using χ(2) testing. RESULTS: Of 1877 visits over 18 months, 8.8% of women had gonorrhoea and 16.5% had trichomoniasis. Overtreatment was higher for women with gonorrhoea than trichomoniasis (54% vs 23%, p<0.001). Overtreatment for gonorrhoea decreased from 58% to 47% (p<0.01) and overtreatment for trichomoniasis decreased from 24% to 18% (p<0.01), which corresponded to improvements in patient follow-up for the QI project. Undertreatment was higher for women with gonorrhoea than trichomoniasis (29% vs 21%, p=0.03), and did not change over time. CONCLUSIONS: A POC test improves the accuracy of STI care in an ED compared with NAAT testing. An unanticipated benefit of QI efforts to improve patient follow-up is the observed decrease in antibiotic use in the ED. Given the ability of gonorrhoea to develop antibiotic resistance, future efforts should focus on development of an accurate POC test for gonorrhoea.

Impact of simulation-based extracorporeal membrane oxygenation training in the simulation laboratory and clinical environment.

INTRODUCTION: Extracorporeal membrane oxygenation (ECMO) is a high-risk, complex therapy. Opportunities to develop teamwork skills and expertise to mitigate risks are few. Our objective was to assess whether simulation would improve technical and nontechnical skills in dealing with ECMO circuit emergencies and allow transfer of skills from the simulated setting to clinical environment. METHODS: Subjects were ECMO circuit providers who performed scenarios utilizing an infant simulator and functional ECMO circuit, followed immediately by video-assisted debriefings. Within the simulation laboratory, outcomes were timed responses, percentage of correct actions, teamwork, safety knowledge, and attitudes. Identification of latent safety threats (LSTs) was the focus of debriefings. Within the clinical setting, translation of learned skills was assessed by measuring circuit readiness and compliance with a cannulation initiation checklist. RESULTS: Nineteen subjects performed 96 simulations during enrollment. In the laboratory, there was no improvement in timed responses or percent correct actions. Teamwork (P = 0.001), knowledge (P = 0.033), and attitudes (P = 0.001) all improved compared with baseline. Debriefing identified 99 LSTs. Clinically, 26 cannulations occurred during enrollment. Median time from blood available to circuit readiness was 17 minutes (range, 5-95), with no improvement during the study. Compliance with the initiation checklist improved compared with prestudy baseline (P < 0.0001). CONCLUSIONS: Simulation-based training is an effective method to improve safety knowledge, attitudes, and teamwork surrounding ECMO emergencies. On-going training is feasible and allows identification of LSTs. Further work is needed to assess translation of learned skills and behaviors into the clinical environment.