Skill Proficiency is Predicted by Intubation Frequency of Emergency Medicine Attending Physicians.

INTRODUCTION: Airway management is a fundamental skill of emergency medicine (EM) practice, and suboptimal management leads to poor outcomes. Endotracheal intubation (ETI) is a procedure that is specifically taught in residency, but little is known how best to maintain proficiency in this skill throughout the practitioner's career. The goal of this study was to identify how the frequency of intubation correlated with measured performance. METHODS: We assessed 44 emergency physicians for proficiency at ETI by direct laryngoscopy on a simulator. The electronic health record was then queried to obtain their average number of annual ETIs and the time since their last ETI, supervised and individually performed, over a two-year period. We evaluated the strength of correlation between these factors and assessment scores, and then conducted a receiver operator characteristic (ROC) curve analysis to identify factors that predicted proficient performance. RESULTS: The mean score was 81% (95% confidence interval, 76% - 86%). Scores correlated well with the mean number of ETIs performed annually and with the mean number supervised annually (r = 0.6, p = 0.001 for both). ROC curve analysis identified that physicians would obtain a proficient score if they had performed an average of at least three ETIs annually (sensitivity = 90%, specificity = 64%, AUC = 0.87, p = 0.001) or supervised an average of at least five ETIs annually (sensitivity = 90%, specificity = 59%, AUC = 0.81, p = 0.006) over the previous two years. CONCLUSION: Performing at least three or supervising at least five ETIs annually, averaged over a two-year period, predicted proficient performance on a simulation-based skills assessment. We advocate for proactive maintenance and enhancement of skills, particularly for those who infrequently perform this procedure.

A Randomized Trial of SMART Goal Enhanced Debriefing after Simulation to Promote Educational Actions.

INTRODUCTION: Goal setting is used in education to promote learning and performance. Debriefing after clinical scenario-based simulation is a well-established practice that provides learners a defined structure to review and improve performance. Our objective was to integrate formal learning goal generation, using the SMART framework (Specific, Measurable, Attainable, Realistic, and Time-bound), into standard debriefing processes (i.e., "SMART Goal Enhanced Debriefing") and subsequently measure the impact on the development of learning goals and execution of educational actions. METHODS: This was a prospective multicenter randomized controlled study of 80 emergency medicine residents at three academic hospitals comparing the effectiveness of SMART Goal Enhanced Debriefing to a standard debriefing. Residents were block randomized on a rolling basis following a simulation case. SMART Goal Enhanced Debriefing included five minutes of formal instruction on the development of SMART learning goals during the summary/application phase of the debrief. Outcome measures included the number of recalled learning goals, self-reported executed educational actions, and quality of each learning goal and educational action after a two-week follow-up period. RESULTS: The mean number of reported learning goals was similar in the standard debriefing group (mean 2.05 goals, SD 1.13, n=37 residents), and in the SMART Goal Enhanced Debriefing group (mean 1.93, SD 0.96, n=43), with no difference in learning goal quality. Residents receiving SMART Goal Enhanced Debriefing completed more educational actions on average (Control group actions completed 0.97 (SD 0.87), SMART debrief group 1.44 (SD 1.03) p=0.03). CONCLUSION: The number and quality of learning goals reported by residents was not improved as a result of SMART Goal Enhanced Debriefing. Residents did, however, execute more educational actions, which is consistent with the overarching intent of any educational intervention.

From Information to Simulation: Improving Competency in ECT Training Using High-Fidelity Simulation.

OBJECTIVE: This study was intended to develop a new educational model that supplements ECT didactics with simulation-based procedural training and to evaluate the learning gains conferred by such a curriculum. METHODS: Two types of curricula were evaluated for educational efficacy in this prospective randomized controlled trial. Psychiatry residents (n = 35) completed surveys to ascertain their baseline experience, knowledge, and proficiency with the ECT procedure. They were then block-randomized to receive either a didactic ECT curriculum (non-SIM) or one augmented by simulation training (SIM). Three months post-completion of the two types of instruction, all residents were re-administered the surveys and a procedural post-assessment. RESULTS: The median number of ECTs performed prior to the study was similar between the two groups (SIM group = 3, non-SIM group = 4.) The SIM group showed significant improvement on pre- and post- survey theoretical knowledge scores: 51% (95% CI = 41 to 61%) and 69% (95% CI = 64 to 74%), respectively, p = .02; this difference was not significant in the non-SIM group, p = .2. Improvement between pre- and post- proficiency scores were seen in the SIM group: 22% (95% CI = 13 to 32%) and 51% (95% CI = 53 to 59%), p < .001 while the effect was less pronounced in the non-SIM group. Inter-rater agreement for the proficiency assessment was excellent: k, = .9. CONCLUSIONS: Residents showed significant improvement in knowledge, comfort, and skills following ECT simulation training. With the proposed curriculum, residents would receive comprehensive education not only in the theory behind ECT but also in procedural skills. This curriculum can be modeled in other programs that do not have extensive ECT facilities.

Influence of surgeon behavior on trainee willingness to speak up: a randomized controlled trial.

BACKGROUND: Our aim was to determine if a surgeon's behaviors can encourage or discourage trainees from speaking up when they witness a surgical mistake. STUDY DESIGN: A randomized clinical trial in which medical students (n = 55) were randomly assigned to an "encouraged" (n = 28) or "discouraged" (n = 27) group. Participants underwent personality tests to assess decision-making styles, and were then trained on basic tasks ("burn" then "cut") on a laparoscopic surgery simulator. After randomization, students assisted at a simulated laparoscopic salpingectomy. The senior surgeon used either an "encourage" script (eg, "Your opinion is important.") or a "discourage" script (eg, "Do what I say. Save questions for next time."). Otherwise, the surgery was conducted identically. Subsequently, a surgical mistake was made by the senior surgeon when he instructed students to cut without burning. Students were considered to have spoken up if they questioned the instruction and did not cut. Potential personality bias was assessed with two validated personality tests before simulation. Data were processed with Mann-Whitney and Fisher exact tests. RESULTS: The students in the encouraged group were significantly more likely to speak up (23 of 28 [82%] vs 8 of 27 [30%]; p < 0.001). There was no statistically significant difference between the two groups in personality traits, student training level (p = 1.0), or sex (p = 0.53). CONCLUSIONS: A discouraging environment decreases the frequency with which trainees speak up when witnessing a surgical error. The senior surgeon plays an important role in improving intraoperative communication between junior and senior clinicians and can enhance patient safety.

Assessment of hospital disaster preparedness for the 2010 FIFA World Cup using an internet-based, long-distance tabletop drill.

INTRODUCTION: The State University of New York at Downstate (SUNY) conducted a web-based long-distance tabletop drill (LDTT) designed to identify vulnerabilities in safety, security, communications, supplies, incident management, and surge capacity for a number of hospitals preceding the 2010 FIFA World Cup. The tabletop drill simulated a stampede and crush-type disaster at the Green Point Stadium in Cape Town, South Africa in anticipation of 2010 FIFA World Cup. The LDTT, entitled "Western Cape-Abilities", was conducted between May and September 2009, and encompassed nine hospitals in the Western Cape of South Africa. The main purpose of this drill was to identify strengths and weaknesses in disaster preparedness among nine state and private hospitals in Cape Town, South Africa. These hospitals were tasked to respond to the ill and injured during the 2010 World Cup. METHODS: This LDTT utilized e-mail to conduct a 10-week, scenario-based drill. Questions focused on areas of disaster preparedness previously identified as standards from the literature. After each scenario stimulus was sent, each hospital had three days to collect answers and submit responses to drill controllers via e-mail. RESULTS: Data collected from the nine participating hospitals met 72% (95%CI = 69%-75%) of the overall criteria examined. The highest scores were attained in areas such as equipment, with 78% (95%CI = 66%-86%) positive responses, and development of a major incident plan with 85% (95% CI = 77%-91%) of criteria met. The lowest scores appeared in the areas of public relations/risk communications; 64% positive responses (95% CI = 56%-72%), and safety, supplies, fire and security meeting also meeting 64% of the assessed criteria (95% CI = 57%-70%). Surge capacity and surge capacity revisited both met 76% (95% CI = 68%-83% and 68%-82%, respectively). CONCLUSIONS: This assessment of disaster preparedness indicated an overall good performance in categories such as hospital equipment and development of major incident plans, but improvement is needed in hospital security, public relations, and communications ahead of the 2010 FIFA World Cup.

Computer-facilitated assessment of disaster preparedness for remote hospitals in a long-distance, virtual tabletop drill model.

INTRODUCTION: Emergency preparedness experts generally are based at academic or governmental institutions. A mechanism for experts to remotely facilitate a distant hospital's disaster readiness is lacking. OBJECTIVE: The objective of this study was to develop and examine the feasibility of an Internet-based software tool to assess disaster preparedness for remote hospitals using a long-distance, virtual, tabletop drill. METHODS: An Internet-based system that remotely acquires information and analyzes disaster preparedness for hospitals at a distance in a virtual, tabletop drill model was piloted. Nine hospitals in Cape Town, South Africa designated as receiving institutions for the 2010 FIFA World Cup Games and its organizers, utilized the system over a 10-week period. At one-week intervals, the system e-mailed each hospital's leadership a description of a stadium disaster and instructed them to login to the system and answer questions relating to their hospital's state of readiness. A total of 169 questions were posed relating to operational and surge capacities, communication, equipment, major incident planning, public relations, staff safety, hospital supplies, and security in each hospital. The system was used to analyze answers and generate a real-time grid that reflected readiness as a percent for each hospital in each of the above categories. It also created individualized recommendations of how to improve preparedness for each hospital. To assess feasibility of such a system, the end users' compliance and response times were examined. RESULTS: Overall, compliance was excellent with an aggregate response rate of 98%. The mean response interval, defined as the time elapsed between sending a stimuli and receiving a response, was eight days (95% CI = 8-9 days). CONCLUSIONS: A web-based data acquisition system using a virtual, tabletop drill to remotely facilitate assessment of disaster preparedness is efficient and feasible. Weekly reinforcement for disaster preparedness resulted in strong compliance.

Randomized controlled trial of high fidelity patient simulators compared to actor patients in a pandemic influenza drill scenario.

During disaster drills hospitals traditionally use actor victims. This has been criticized for underestimating true provider resource burden during surges; however, robotic patient simulators may better approximate the challenges of actual patient care. This study quantifies the disparity between the times required to resuscitate simulators and actors during a drill and compares the times required to perform procedures on simulator patients to published values for real patients. A randomized controlled trial was conducted during an influenza disaster drill. Twelve severe influenza cases were developed for inclusion in the study. Case scenarios were randomized to either human actor patients or simulator patients for drill integration. Clinical staff participating in the drill were blinded to the study objectives. The study was recorded by trained videographers and independently scored using a standardized form by two blinded attending physicians. All critical actions took longer to perform on simulator patients compared to actor patients. The median time to provide a definitive airway (8.9min vs. 3.2min, p=0.013), to initiate vasopressors through a central line (17.4min vs. 5.2min, p=0.01) and time to disposition (16.9min vs. 5.2min, p=0.01) were all significantly longer on simulator patients. Agreement between video reviewers was excellent, ranging between 0.95 and 1 for individual domain scores. Times required to perform procedures on simulators were similar to published results on real-world patients. Patient actors underestimate resource utilization in drills. Integration of high fidelity simulator patients is one way institutions can create more realistic challenges and better evaluate disaster scenario preparedness.

Simulation in a disaster drill: comparison of high-fidelity simulators versus trained actors.

OBJECTIVES: High-fidelity patient simulation provides lifelike medical scenarios with real-time stressors. Mass casualty drills must construct a realistic incident in which providers care for multiple injured patients while simultaneously coping with numerous stressors designed to tax an institution's resources. This study compared the value of high-fidelity simulated patients with live actor-patients. METHODS: A prospective cohort study was conducted during two mass casualty drills in December 2006 and March 2007. The providers' completion of critical actions was tested in live actor-patients and simulators. A posttest survey compared the participants' perception of "reality" between the simulators and live actor victims. RESULTS: The victims (n = 130) of the mass casualty drill all had burn-, blast-, or inhalation-related injuries. The participants consisted of physicians, residents, medical students, clerks, and paramedics. The authors compared the team's execution of the 136 critical actions (17 critical actions x 8 scenarios) between the simulators and the live actor-patients. Only one critical action was missed in the simulator group and one in the live actor group, resulting in a miss rate of 0.74% (95% confidence interval [CI] = 0.01% to 4.5%). All questionnaires were returned and analyzed. The vast majority of participants disagreed or strongly disagreed that the simulators were a distraction from the disaster drill. More than 96% agreed or strongly agreed that they would recommend the simulator as a training tool. The mean survey scores for all participants demonstrated agreement that the simulators closely mimicked real-life scenarios, accurately represented disease states, and heightened the realism of patient assessment and treatment options during the drill with the exception of nurse participants, who agreed slightly less strongly. CONCLUSIONS: This study demonstrated that simulators compared to live actor-patients have equivalent results in prompting critical actions in mass casualty drills and increase the perceived reality of such exercises.

Penile discharge as a presentation of perirectal abscess.

Anorectal abscesses are a common presentation to the Emergency Department, but are frequently misdiagnosed. We report a patient in whom penile discharge was the presenting symptom of an ischiorectal abscess. A 42-year-old man presented with scrotal pain, swelling, and penile discharge. The genitourinary examination revealed a tender scrotum, and a fluctuant mass was identified on digital rectal examination. Computed tomography (CT) scan revealed an ischiorectal abscess with extension into the corpus cavernosum. We believe our patient's penile discharge was a manifestation of this abscess extension. Penile discharge is typically suggestive of sexually transmitted infections. Although rare, perirectal abscess should be considered in the differential diagnosis of penile discharge. A thorough digital rectal examination should be performed seeking the presence of mass or fluctuance.