Differences in safety climate among hospital anesthesia departments and the effect of a realistic simulation-based training program.

BACKGROUND: Safety climate is often measured via surveys to identify appropriate patient safety interventions. The introduction of an insurance premium incentive for simulation-based anesthesia crisis resource management (CRM) training motivated our naturalistic experiment to compare the safety climates of several departments and to assess the impact of the training. METHODS: We administered a 59-item survey to anesthesia providers in six academic anesthesia programs (Phase 1). Faculty in four of the programs subsequently participated in a CRM program using simulation. The survey was readministered 3 yr later (Phase 2). Factor analysis was used to create scales regarding common safety themes. Positive safety climate (% of respondents with positive safety attitudes) was computed for the scales to indicate the safety climate levels. RESULTS: The usable response rate was 44% (309/708) and 38% (293/772) in Phases 1 and 2 respectively. There was wide variation in response rates among hospitals and providers. Eight scales were identified. There were significantly different climate scores among hospitals but no difference between the trained and untrained cohorts. The positive safety climate scores varied from 6% to 94% on specific survey questions. Faculty and residents had significantly different perceptions of the degree to which residents are debriefed about their difficult clinical situations. CONCLUSIONS: Safety climate indicators can vary substantially among anesthesia practice groups. Scale scores and responses to specific questions can suggest practices for improvement. Overall safety climate is probably not a good criterion for assessing the impact of simulation-based CRM training. Training alone was insufficient to alter engrained behaviors in the absence of further reinforcing actions.

Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams project.

OBJECTIVE: To evaluate the effectiveness of training and institutionalizing teamwork behaviors, drawn from aviation crew resource management (CRM) programs, on emergency department (ED) staff organized into caregiver teams. STUDY SETTING: Nine teaching and community hospital EDs. STUDY DESIGN: A prospective multicenter evaluation using a quasi-experimental, untreated control group design with one pretest and two posttests of the Emergency Team Coordination Course (ETCC). The experimental group, comprised of 684 physicians, nurses, and technicians, received the ETCC and implemented formal teamwork structures and processes. Assessments occurred prior to training, and at intervals of four and eight months after training. Three outcome constructs were evaluated: team behavior, ED performance, and attitudes and opinions. Trained observers rated ED staff team behaviors and made observations of clinical errors, a measure of ED performance. Staff and patients in the EDs completed surveys measuring attitudes and opinions. DATA COLLECTION: Hospital EDs were the units of analysis for the seven outcome measures. Prior to aggregating data at the hospital level, scale properties of surveys and event-related observations were evaluated at the respondent or case level. PRINCIPAL FINDINGS: A statistically significant improvement in quality of team behaviors was shown between the experimental and control groups following training (p = .012). Subjective workload was not affected by the intervention (p = .668). The clinical error rate significantly decreased from 30.9 percent to 4.4 percent in the experimental group (p = .039). In the experimental group, the ED staffs' attitudes toward teamwork increased (p = .047) and staff assessments of institutional support showed a significant increase (p = .040). CONCLUSION: Our findings point to the effectiveness of formal teamwork training for improving team behaviors, reducing errors, and improving staff attitudes among the ETCC-trained hospitals.