Deception in simulation-based education: a randomised controlled trial of the effect of deliberate deception on the performance of anaesthesia trainees.

The use of deliberate deception in simulation allows for a level of realism that is not normally feasible. However, the use of deception is controversial, and carries the risk of psychological harm to learners. There are currently no quantitative data on the effect of deception on learner performance, making it difficult to judge its usefulness. The objective of this study was to examine the impact of deception on learners' performance during a life-threatening scenario. In this simulation study, second-year anaesthesia residents were randomly allocated into two groups: the non-deception group was told that the participating consultant was acting a part, while the deception group was told that the consultant was a subject in the study. Learners then participated in a simulated crisis that presented them with situational opportunities to challenge the consultant regarding clearly wrong decisions. Two independent raters scored the performances using the modified advocacy-inquiry scale. Forty-four participants were analysed. The median (IQR [range]) highest scoring modified advocacy-inquiry scale was 5.0 (4.5-5.1 [4.0-5.5]) for the non-deception group and 4.0 (3.0-4.0 [2.5-5.0]) for the deception group, (p < 0.001), and the median total number of challenges per participant was 26.8 (21.0-31.1 [16.5-35.5]) and 18.0 (14.3-23.3 [7.0-33.0]), respectively (p = 0.001). Trainees exposed to deliberate deception, who thought that the consultant anaesthetist was a subject, had a less-effective best challenge, likely mimicking real-life behaviour. Deliberate deception appears to modify behaviour, particularly relating to communication involving hierarchical relationships. This technique may improve authenticity, especially with a steep power gradient, and so has demonstrable value which must be balanced against the ethical considerations.

Gender, power and leadership: the effect of a superior's gender on respiratory therapists' ability to challenge leadership during a life-threatening emergency.

BACKGROUND: Effective communication within teams is crucial, especially in crisis situations. Hierarchy gradients between team members can contribute to communication failures and are influenced by many factors. The effect of gender on team performance has not been well studied. The objective of this study was to examine the effect of the physician's gender on respiratory therapists' ability to effectively challenge clearly incorrect clinical decisions during a life-threatening crisis. METHODS: Respiratory therapists were recruited to take part in a high-fidelity simulation of can't-intubate can't-oxygenate scenarios. They were randomized into two groups, either assisting a male or a female anaesthetist in managing an airway crisis during which the anaesthetist made incorrect clinical decisions. Two independent raters scored the performances using the modified Advocacy-Inquiry Score (min 1, max 6). RESULTS: Twenty-nine subjects completed the study. The median best challenge score when the staff anaesthetist was female was 4 (3-5 IQR [2-6 range]) compared with 3 (3-3[0-3]) for challenges to a male anaesthetist (P=0.017). The median of the total challenges against a female staff member 11 (7.3-14.8 [2-18]) was significantly higher compared with 4 (3.5-7 [2-11.5]) for a male staff (P=0.006). CONCLUSIONS: The study showed a significant effect of superiors' gender on a respiratory therapist's ability to challenge leadership. A female staff anaesthetist was challenged more often and with greater assertiveness and effectiveness. This has implications for an educational intervention targeting the ability to challenge a wrong decision by a supervisor and emphasizing the effect of gender on the willingness to speak up.

Evaluation of the accuracy of common weight estimation formulae in a Zambian paediatric surgical population.

Limited resources and access to healthcare in sub-Saharan Africa are associated with high rates of malnourished children, although many countries globally are demonstrating increasing childhood obesity. This study evaluated how well current age- or height-based formulae estimate the weight of children undergoing surgery in Zambia. All children under 14 years of age presenting for elective surgery at the University Teaching Hospital, Lusaka, had both height and weight measured. Their actual weight was compared against estimated weight from various formulae. The Broselow tape outperformed all the age-based formulae, demonstrating the lowest median percentage error of -5.8%, with 46.0% of estimates falling within 10% of the actual measured weight (p < 0.001). Of the 1111 children who were eligible for World Health Organization growth standard appraisal, 88 (8%) met the weight criteria for severe acute malnutrition. Our results are consistent with other studies in finding that the Broselow tape is the best estimator of weight in a lower middle-income country, followed by the original Advanced Paediatric Life Support formula if the Broselow tape is unavailable.

An evaluation of inpatient morbidity and critical care provision in Zambia.

The aim of this study was to objectively measure demand for critical care services in a southern African tertiary referral centre. We carried out a point prevalence study of medical and surgical admissions over a 48-h period at the University Teaching Hospital, Lusaka, recording the following: age; sex; diagnosis; Human Immunodeficiency Virus (HIV) status and National Early Warning Score. One-hundred and twenty medical and surgical admissions were studied. Fifty-four patients (45%) had objective evidence of a requirement for critical care review and potential or probable admission to an intensive care unit, according to the Royal College of Physicians (UK) guidelines. A greater than expected HIV rate was also noted; 53 of 75 tested patients (71%). When applied to the estimated 17,496 annual acute admissions, this would equate to 7873 patients requiring critical care input annually at this hospital alone. In contrast to this demand, we identified 109 critical care beds nationally, and only eight at this institution.

Power and conflict: the effect of a superior's interpersonal behaviour on trainees' ability to challenge authority during a simulated airway emergency.

A key factor that may contribute to communication failures is status asymmetry between team members. We examined the effect of a consultant anaesthetist's interpersonal behaviour on trainees' ability to effectively challenge clearly incorrect clinical decisions. Thirty-four trainees were recruited to participate in a video-recorded scenario of an airway crisis. They were randomised to a group in which a confederate consultant anaesthetist's interpersonal behaviour was scripted to recreate either a strict/exclusive or an open/inclusive communication dynamic. The scenario allowed trainees four opportunities to challenge clearly wrong decisions. Performances were scored using the modified Advocacy-Inquiry Score. The highest median (IQR [range]) score was 3.0 (2.2-4.0 [1.0-5.0]) in the exclusive communication group, and 3.5 (3.0-4.5 [2.5-6.0]) in the inclusive communication group (p = 0.06). The study did not show a significant effect of consultant behaviour on trainees' ability to challenge their superior. It did demonstrate trainees' inability to challenge their seniors effectively, resulting in critical communication gaps.

Does warm-up using mental practice improve crisis resource management performance? A simulation study.

BACKGROUND: Mental practice (MP) is defined as the 'symbolic rehearsal of a physical activity in the absence of any gross-muscular movements' and has been used in sport and music to enhance performance. In healthcare, MP has been demonstrated to improve technical skill performance of surgical residents. However, its effect on crisis resource management (CRM) skills has yet to be determined. We aimed to investigate the effect of warm-up with MP on CRM skill performance during a simulated crisis scenario. METHODS: Following ethics board approval, 40 anaesthesia residents were randomized. The intervention group performed 20 min of MP of a script based on CRM principles. The control group received a 20 min didactic teaching session on an unrelated topic. Each subject then managed a simulated cardiac arrest. Two CRM experts rated the video recordings of each performance using the previously validated Ottawa GRS. The time to start chest compressions, administer epinephrine, and give blood was recorded. RESULTS: There was no significant difference between the intervention and control groups: total Ottawa GRS score was 24.50 (18.63-28.88 [6.50-34.50]) (median (inter-quartile range [range]) vs 20.50 (13.00-29.13 [6.50-34.50]) (P=0.53); the time to start chest compressions 146.0 s (138.0-231.0 [115.0-323.0]) vs 162.5 s (138.0-231.0 [100.0-460.0]) (P=0.27), the time to epinephrine administration 163.0 s (151.0-187.0 [111.0-337.0]) vs 187.0 s (164.0-244.0 [115.0-310.0]) (P=0.09), and the time to blood administration 220.5 s (130.8-309.0 [92.0-485.0]) vs 252.5 (174.5-398.8 [65.0-527.0]) (P=0.48). CONCLUSION: Unlike technical skills, warm-up with MP does not seem to improve CRM skills in simulated crisis scenarios.

Challenging authority during a life-threatening crisis: the effect of operating theatre hierarchy.

BACKGROUND: Effective operating theatre (OT) communication is important for team function and patient safety. Status asymmetry between team members may contribute to communication breakdown and threaten patient safety. We investigated how hierarchy in the OT team influences an anaesthesia trainee's ability to challenge an unethical decision by a consultant anaesthetist in a simulated crisis scenario. METHODS: We prospectively randomized 49 postgraduate year (PGY) 2-5 anaesthesia trainees at two academic hospitals to participate in a videotaped simulated crisis scenario with a simulated OT team practicing either a hierarchical team structure (Group H) or a non-hierarchical team structure (Group NH). The scenario allowed trainees several opportunities to challenge their consultant anaesthetist when administering blood to a Jehovah's Witness. Three independent, blinded raters scored the performances using a modified advocacy-inquiry score (AIS). The primary outcome was the comparison of the best-response AIS between Groups H vs NH. Secondary outcomes included the comparison of best AIS by PGY and the percentage in each group that checked and administered blood. RESULTS: The AIS did not differ between the groups (P=0.832) but significantly improved from PGY2 to PGY5 (P=0.026). The rates of checking blood (92% vs 76%, P=0.082) and administering blood (62% vs 57%, P=0.721) were high in both groups but not significantly different between the groups. CONCLUSIONS: This study did not show a significant effect of OT team hierarchical structure on trainee's ability to challenge authority; however, the results are concerning. The challenges were suboptimal in quality and there was an alarming high rate of blood checking and administration in both groups. This may reflect lack of training in appropriately and effectively challenging authority within the formal curriculum with implications for patient safety.

Do technical skills correlate with non-technical skills in crisis resource management: a simulation study.

BACKGROUND: Both technical skills (TS) and non-technical skills (NTS) are key to ensuring patient safety in acute care practice and effective crisis management. These skills are often taught and assessed separately. We hypothesized that TS and NTS are not independent of each other, and we aimed to evaluate the relationship between TS and NTS during a simulated intraoperative crisis scenario. METHODS: This study was a retrospective analysis of performances from a previously published work. After institutional ethics approval, 50 anaesthesiology residents managed a simulated crisis scenario of an intraoperative cardiac arrest secondary to a malignant arrhythmia. We used a modified Delphi approach to design a TS checklist, specific for the management of a malignant arrhythmia requiring defibrillation. All scenarios were recorded. Each performance was analysed by four independent experts. For each performance, two experts independently rated the technical performance using the TS checklist, and two other experts independently rated NTS using the Anaesthetists' Non-Technical Skills score. RESULTS: TS and NTS were significantly correlated to each other (r=0.45, P<0.05). CONCLUSIONS: During a simulated 5 min resuscitation requiring crisis resource management, our results indicate that TS and NTS are related to one another. This research provides the basis for future studies evaluating the nature of this relationship, the influence of NTS training on the performance of TS, and to determine whether NTS are generic and transferrable between crises that require different TS.

Self-directed deliberate practice with virtual fiberoptic intubation improves initial skills for anesthesia residents.

BACKGROUND: Fiberoptic intubation is a core skill in anesthesiology. However, this complex psychomotor skill is challenging to learn in the clinical setting. The goal of this study was to evaluate the Virtual Fiberoptic Intubation (VFI) software as an adjunct to the traditional fibreoptic intubation teaching. METHODS: After informed consent, 23 first year anesthesia residents with no previous experience of fiberoptic intubation were randomized to 2 groups. All subjects received an institutional didactic teaching session. The control group (N.=12) was taught by the usual didactic method only, while the VFI group (N.=11) had the same didactic teaching and also the opportunity to practice with VFI software for one week. Each resident was evaluated on their first oro- and nasotracheal fiberoptic intubations on a mannequin head. Each performance was evaluated by an expert bronchoscopist blinded to the previous type of teaching using a checklist score, a global rating scale (GRS) score and procedural time. RESULTS: The VFI group performed significantly better on the checklist and GRS scores compared to the control group for both the oral and nasal routes (all P<0.05). For procedural time, there was a trend towards faster performance in the VFI group compared to the control group for the oral route (P=0.05). There was no significant difference for procedural time between the VFI and the control groups when fiberoptic intubation was performed nasally (P=0.76). CONCLUSION: Self-directed practice using VFI software may improve the initial acquisition of fibreoptic intubation skills for anesthesia residents.

Complex procedural skills are retained for a minimum of 1 yr after a single high-fidelity simulation training session.

BACKGROUND: Simulation has been shown to be effective in teaching complex emergency procedural skills. However, the retention of these skills for a period of up to 1 yr has not been studied. We aimed to investigate the 6 month and 1 yr retention of the complex procedural skill of cricothyroidotomy in attending anaesthetists using a high-fidelity-simulated cannot intubate, cannot ventilate (CICV) scenario. METHODS: Thirty-eight attending anaesthetists participated individually in a high-fidelity-simulated CICV scenario (pretest) that required a cricothyroidotomy for definitive airway management. Immediately after a debriefing and structured teaching session on cricothyroidotomy insertion, subjects managed a second identical CICV scenario (post-test). Each anaesthetist was randomized to either a '6 month retention' or a '12 month retention' group. No further teaching occurred. At their respective retention times, each anaesthetist managed a third identical CICV scenario (retention post-test). Two blinded experts independently rated videos of all performances in a random order, using a specific checklist (CL) score, a global-rating scale (GRS) score, and procedural time (PT). RESULTS: Subjects from both groups improved on their cricothyroidotomy skill performances from pretest to immediate post-test and from pretest to retention post-test, irrespective of the retention interval; CL mean (sd) 8.00 (2.39) vs 8.88 (1.53), P=0.49; GRS 28.00 (7.80) vs 31.25 (5.31), P=0.25; PT 102.83 (63.81) s vs 106.88 (36.68) s, P=0.73. CONCLUSIONS: After a single simulation training session, improvements in cricothyroidotomy skills are retained for at least 1 yr. These findings suggest that high-fidelity simulation training, along with practice and feedback, can be used to maintain complex procedural skills for at least 1 yr.

h-Indices in a university department of anaesthesia: an evaluation of their feasibility, reliability, and validity as an assessment of academic performance.

BACKGROUND: The h-index is a tool that is increasingly used to measure individual research productivity. It is unknown whether its use as an evaluation of individual research impact is reliable and valid within the context of anaesthesia. METHODS: We calculated the h-indices of 268 faculty members of a university department of anaesthesia using Scopus™ and Web of Science(®). Agreement between the databases was investigated with a Bland-Altman plot. The construct validity was examined by comparing the h-indices for faculty grouped by academic rank. RESULTS: The mean bias between the Scopus™ and Web of Science(®) h-indices was 0.09 but 1.96 sd limits of agreement were -5.7 to 5.9. The Web of Science(®)-derived h-indices showed a statistically significant difference between the different academic ranks (P<0.001): median h-indices were 0 for lecturers, 2 for assistant professors, 9 for associate professors, and 16 for full professors. The Scopus™-derived h-indices also showed a statistically significant difference between the different academic ranks (P<0.001): median h-indices were 0 for lecturers, 1 for assistant professors, 9 for associate professors, and 17 for full professors. Post hoc testing found statistically significant differences in all comparisons between academic ranks (all P<0.01). Ignoring self-citations did not affect construct validity of the h-index. We found no evidence that the h-index is superior to counting the total number of publications. CONCLUSIONS: Agreement between the two databases was problematic. There was evidence of construct validity; however, the overlap between academic ranks limits the discriminative power of a low h-index.

National representation in the anaesthesia literature: a bibliometric analysis of highly cited anaesthesia journals.

While previous studies have investigated the country of origin of anaesthetic publications, they have generally used a medline computer search to identify original articles and have often excluded non-English language articles. We undertook a hand-search of journals in the Journal Citation Reports using the subject category of Anesthesiology. We quantified the number of original articles, editorials, review articles, case reports and correspondence attributed to each country. We also calculated the proportion of articles of each type from countries of each national income category. We analysed 9684 articles published in 2007 and 2008. The United States published more original articles than any other country. High-income countries published 89.2% of original articles, middle-income countries 10.5%, and low-income countries just 0.3%. There were more articles published by middle-income countries during the study period than a decade earlier, notably from Turkey, China and India. We discuss barriers to publications from low-income countries.

Assessment of procedural skills in anaesthesia.

A key aspect of the practice of anaesthesia is the ability to perform practical procedures efficiently and safely. Decreased working hours during training, an increasing focus on patient safety, and greater accountability have resulted in a paradigm shift in medical education. The resulting international trend towards competency-based training demands robust methods of evaluation of all domains of learning. The assessment of procedural skills in anaesthesia is poor compared with other domains of learning and has fallen behind surgical fields. Logbooks and procedure lists are best suited to providing information regarding likely opportunities within training programmes. Retrospective global scoring and direct observation without specific criteria are unreliable. The current best evidence for a gold standard for assessment of procedural skills in anaesthesia consists of a combination of previously validated checklists and global rating scales, used prospectively by a trained observer, for a procedure performed in an actual patient. Future research should include core assessment parameters to ensure methodological rigor and facilitate robust comparisons with other studies: (i) reliability, (ii) validity, (iii) feasibility, (iv) cost-effectiveness, and (v) comprehensiveness with varying levels of difficulty. Simulation may become a key part of the future of formative and summative skills assessment in anaesthesia; however, research is required to develop and test simulators that are realistic enough to be suitable for use in high-stakes evaluation.

Cognitive aid for neonatal resuscitation: a prospective single-blinded randomized controlled trial.

BACKGROUND: Retention of skills and knowledge after neonatal resuscitation courses (NRP) is known to be problematic. The use of cognitive aids is mandatory in industries such as aviation, to avoid dependence on memory when decision-making in critical situations. We aimed to prospectively investigate the effect of a cognitive aid on the performance of simulated neonatal resuscitation. METHODS: Thirty-two anaesthesia residents were recruited. The intervention group had a poster detailing the NRP algorithm and the control group did not. Video recordings of each of the performances were analysed using a previously validated checklist by a peer, an expert anaesthetist, and an expert neonatologist. RESULTS: The median (IQR) checklist score in the control group [18.2 (15.0-20.5)] was not significantly different from that in the intervention group [20.3 (18.3-21.3)] (P=0.08). When evaluated by the neonatologist, none of the subjects correctly performed all life-saving interventions necessary to pass the checklist. A minority of the intervention group used the cognitive aid frequently. CONCLUSIONS: Retention of skills after NRP training is poor. The infrequent use of the cognitive aid may be the reason that it did not improve performance. Further research is required to investigate whether cognitive aids can be useful if their use is incorporated into the NRP training.

Techniques for emergency ventilation through a needle cricothyroidotomy.

We examined the pressures produced by a construction intended for emergency ventilation through a needle cricothyroidotomy. This construction consisted of a standard hospital wall oxygen supply, flowmeter, oxygen tubing and a three-way tap. We measured the flow achieved through a transtracheal catheter and compared the construction to a Manujet jet ventilator and to a Sanders injector. The construction performed similarly to the Manujet set at low pressures (0-100 kPa). To achieve similar pressures and flow to the Manujet set at pressures higher than 100 kPa required opening of the flowmeter beyond its calibrated range. The flow through the transtracheal catheter was almost three times higher when the flowmeters were fully opened than when they were opened to the 15 l x min(-1) mark (44.5 vs 15.8 l x min(-1), respectively; p < 0.0001). When the flowmeters were fully opened the pressure measured before the catheter was over four times higher than when they were only opened to the 15 l x min(-1) mark (285.3 vs 66.4 kPa, respectively; p < 0.0001). This system of ventilation is inferior to a Manujet in terms of robustness and calibration throughout its range of pressures and flows, but seems appropriate for emergency use in the absence of a purpose-made jet ventilator.

Bispectral index values during elective rigid bronchoscopy: a prospective observational pilot study.

Rigid bronchoscopy is associated with a high incidence of haemodynamic disturbance and awareness under anaesthesia. Anaesthetic agents are given both to attenuate the sympathetic response to bronchoscopy and to prevent awareness. Use of the Bispectral index to guide anaesthesia has shown to reduce awareness and improve recovery times from general anaesthesia. We undertook a prospective observational study of BIS values in 50 patients during routine anaesthesia for rigid bronchoscopy. BIS values were found to be between 40-60 during bronchoscopy for only 0.5% of the time (0-11.5%[0-98.7%]), median (interquartile range [range]). Patients had a BIS < 40 for 99.6% (87.9-100%[0-100%]) of the duration of bronchoscopy. We identified one case of possible awareness. Few of our patients undergoing general anaesthesia for rigid bronchoscopy had BIS scores in the suggested range of between 40 and 60. BIS < 40 was more frequent than in previous studies of different surgical populations. There was no difference in the BIS values of patients anaesthetised with intermittent boluses or target controlled infusions of propofol.