The Effect of Novel Decision Support Tools on Technical and Non-Technical Performance of Teams in Managing Emergencies.

Cognitive aids have been shown to facilitate adherence to evidence-based guidelines and improve technical performance of teams when managing simulated critical events. Few studies have explored the effect of cognitive aids on non-technical skills, such as teamwork and communication. The current study sought to explore the effects of different decision support tools (DST), a type of cognitive aid, on the technical and non-technical performance of teams. The current study represents a randomized, blinded, control trial of the effects of three versions of an electronic DST on team performance during multiple simulations of perioperative emergencies. The DSTs included a version with only technical information, a version with only non-technical information and a version with both technical and non-technical information. The technical performance of teams was improved when they used the technical DST and the combined technical and non-technical DST when compared to memory alone. The technical performance of teams was significantly worse when using the non-technical DST. All three versions of the DST had a negligible effect on the non-technical performance of teams. The technical performance of teams in the current study was affected by different versions of a DST, yet there was no effect on the teams' non-technical performance. The use of a DST, including those that focused on non-technical information, did not impact the non-technical performance of the teams.

Tools for Assessing the Performance of Pediatric Perioperative Teams During Simulated Crises: A Psychometric Analysis of Clinician Raters' Scores.

INTRODUCTION: The pediatric perioperative setting is a dynamic clinical environment where multidisciplinary interprofessional teams interact to deliver complex care to patients. This environment requires clinical teams to possess high levels of complex technical and nontechnical skills. For perioperative teams to identify and maintain clinical competency, well-developed and easy-to-use measures of competency are needed. METHODS: Tools for measuring the technical and nontechnical performance of perioperative teams were developed and/or identified, and a group of raters were trained to use the instruments. The trained raters used the tools to assess pediatric teams managing simulated emergencies. A psychometric analysis of the trained raters' scores using the different instruments was performed and the agreement between the trained raters' scores and a reference score was determined. RESULTS: Five raters were trained and scored 96 recordings of perioperative teams managing simulated emergencies. Scores from both technical skills assessment tools demonstrated significant reliability within and between ratings with the scenario-specific performance checklist tool demonstrating greater interrater agreement than scores from the global rating scale. Scores from both technical skills assessment tools correlated well with the other and with the reference standard scores. Scores from the Team Emergency Assessment Measure nontechnical assessment tool were more reliable within and between raters and correlated better with the reference standard than scores from the BARS tool. CONCLUSIONS: The clinicians trained in this study were able to use the technical performance assessment tools with reliable results that correlated well with reference scores. There was more variability between the raters' scores and less correlation with the reference standard when the raters used the nontechnical assessment tools. The global rating scale used in this study was able to measure the performance of teams across a variety of scenarios and may be generalizable for assessing teams in other clinical scenarios. The Team Emergency Assessment Measure tool demonstrated reliable measures when used to assess interprofessional perioperative teams in this study.

Systematic review and meta-analyses of tranexamic acid use for bleeding reduction in prostate surgery.

BACKGROUND: Prostate cancer and benign prostatic hyperplasia have an increased incidence with aging. The most effective treatments are radical prostatectomy and transurethral resection of the prostate. To reduce perioperative bleeding in these surgeries, an approach is the use of tranexamic acid (TXA). Studies show that TXA is effective in reducing the blood loss and the need for transfusion in cardiac, orthopedic, and gynecological surgeries. In prostate surgeries, its efficacy and safety have not been established yet. STUDY OBJECTIVE: To determine whether there are differences between TXA versus placebo in terms of intraoperative blood loss, transfusion requirements, hemoglobin levels and the incidence of thromboembolic events. DESIGN: Systematic review with meta-analyses. SETTING: Anesthesia for prostate surgery. PATIENTS: We searched the Medline, Cochrane, EBSCO, and Web of Science databases up to 2017 for randomized controlled trials that compared TXA administration with a control group in patients who submitted to prostate surgery. MEASUREMENTS: The primary outcomes were the intraoperative blood loss and transfusion rate. Data on hemoglobin levels and the incidence of deep vein thrombosis (DVT) and pulmonary embolism (PE) were also collected. RESULTS: Nine comparative studies were included in the meta-analyses. The estimated blood loss and transfusion rate were lower in patients receiving TXA, with a standardized mean difference of -1.93 (95% CI = -2.81 to -1.05, I2 = 96%), and a risk ratio of 0.61 (95% CI = 0.47 to 0.80, I2 = 0%), respectively. The hemoglobin levels and the incidence of DVT and PE did not differ between the groups. CONCLUSIONS: TXA reduced intraoperative blood loss and the need for transfusion, without increasing the risk of DVT and PE in prostate surgeries. Due to the limited number of studies and the high heterogeneity of the results, more clinical trials with a large number of patients are necessary to confirm these findings.

Implementation and Evaluation of the Z-Score System for Normalizing Residency Evaluations.

BACKGROUND: Assessment of clinical competence is essential for residency programs and should be guided by valid, reliable measurements. We implemented Baker's Z-score system, which produces measures of traditional core competency assessments and clinical performance summative scores. Our goal was to validate use of summative scores and estimate the number of evaluations needed for reliable measures. METHODS: We performed generalizability studies to estimate the variance components of raw and Z-transformed absolute and peer-relative scores and decision studies to estimate the evaluations needed to produce at least 90% reliable measures for classification and for high-stakes decisions. A subset of evaluations was selected representing residents who were evaluated frequently by faculty who provided the majority of evaluations. Variance components were estimated using ANOVA. RESULTS: Principal component extraction from 8,754 complete evaluations demonstrated that a single factor explained 91 and 85% of variance for absolute and peer-relative scores, respectively. In total, 1,200 evaluations were selected for generalizability and decision studies. The major variance component for all scores was resident interaction with measurement occasions. Variance due to the resident component was strongest with raw scores, where 30 evaluation occasions produced 90% reliable measurements with absolute scores and 58 for peer-relative scores. For Z-transformed scores, 57 evaluation occasions produced 90% reliable measurements with absolute scores and 55 for peer-relative scores. The results were similar for high-stakes decisions. CONCLUSIONS: The Baker system produced moderately reliable measures at our institution, suggesting that it may be generalizable to other training programs. Raw absolute scores required few assessment occasions to achieve 90% reliable measurements.

Laparoscopic cholecystectomy under neuraxial anesthesia compared with general anesthesia: Systematic review and meta-analyses.

BACKGROUND: Pneumoperitoneum during laparoscopic cholecystectomy (LC) can cause hypercapnia, hypoxemia, hemodynamic changes and shoulder pain. General anesthesia (GA) enables the control of intraoperative pain and ventilation. The need for GA has been questioned by studies suggesting that neuraxial anesthesia (NA) is adequate for LC. STUDY OBJECTIVE: To quantify the prevalence of intraoperative pain and to verify whether evidence on the maintenance of ventilation, circulation and surgical anesthesia during NA compared with GA is consistent. DESIGN: Systematic review with meta-analyses. SETTING: Anesthesia for laparoscopic cholecystectomy. PATIENTS: We searched Medline, Cochrane and EBSCO databases up to 2016 for randomized controlled trials that compared LC in the two groups under study, neuraxial (subarachnoid or epidural) and general anesthesia. MEASUREMENTS: The primary outcome was the prevalence of intraoperative pain referred to the shoulder in the NA group. Hemodynamic and respiratory outcomes and adverse effects in both groups were also collected. MAIN RESULTS: Eleven comparative studies were considered eligible. The pooled prevalence of shoulder pain was 25%. Intraoperative hypotension and bradycardia occurred more frequently in patients who received NA, with a risk ratio of 4.61 (95% confidence interval [CI] 1.70-12.48, p=0.003) and 6.67 (95% CI 2.02-21.96, p=0.002), respectively. Postoperative nausea and vomiting was more prevalent in patients who submitted to GA. The prevalence of postoperative urinary retention did not differ between the techniques. Postoperative headache was more prevalent in patients who received NA, while the postoperative pain intensity was lower in this group. Performing meta-analyses on hypertension, hypercapnia and hypoxemia was not possible. CONCLUSIONS: NA as sole anesthetic technique, although feasible for LC, was associated with intraoperative pain referred to the shoulder, required anesthetic conversion in 3.4% of the cases and did not demonstrate evidence of respiratory benefits for patients with normal pulmonary function.

An instrument designed for faculty supervision evaluation by anesthesia residents and its psychometric properties.

BACKGROUND AND OBJECTIVES: We aimed 1) to develop a valid and reliable instrument for faculty supervision evaluation by anesthesia residents and 2) to disclose the sources of error in residents' ratings. METHODS: A qualitative study involving residents and faculty identified constructs of supervisory ability, which were entered as items in a measurement instrument used by 19 residents to evaluate 39 instructors during a 6-mo period. The instrument was psychometrically tested under classical item and generalizability theories. A decision study, using the parameters of the generalizability (G) study, estimated the number of resident ratings needed to produce dependable measures of a single faculty. RESULTS: Nine dimensions emerged from the qualitative study: planning perianesthesia care, providing feedback ("the instructor provides me timely, informal, non-threatening comments on my performance and shows me ways to improve"); being available ("the instructor is promptly available to help me solve problems with patients and procedures"); giving opportunities/fostering resident autonomy; stimulating patient-based learning; demonstrating professionalism; being present during the critical events; demonstrating interpersonal skills; being concerned about safety. Residents provided 970 evaluations. The instrument exhibited internal consistency (Cronbach's alpha=0.93), content and face validities, and a single-factor structure. Generalizability and dependability coefficients were 0.93. Between-instructors differences accounted for 56% of score variance. Resident-instructor interactions accounted for 44% of score variance, indicating that scores were influenced by each resident's unique perceptions of instructors (halo effect). According to the results of the decision study, dependability of measures within the 75% to 95% range could be expected with 3 to 33 residents rating each faculty member, respectively. CONCLUSIONS: The nine-item instrument produced valid and reliable measures of faculty supervision. However, a significant amount of halo effect biased such measures. G-studies may help identify the type and magnitude of rater biases affecting resident-generated faculty supervision evaluations, and can be useful for interpreting their results, especially if personnel decisions (e.g., tenure, promotion) rely on such measures.

The relationship of learning environment, quality of life, and study strategies measures to anesthesiology resident academic performance.

BACKGROUND: We designed this study to determine the academic performance of anesthesia residents as related to their differential characteristics on some affective-motivational variables, represented by perceptions about their educational environment, subjective quality of life, and learning and study strategies. METHODS: The study sample consisted of 63 anesthesia residents who completed the World Health Organization Quality of Life Inventory, the Dundee Ready Educational Environment Measure, the Learning and Study Strategies Inventory, and a progress test on basic sciences on two to four measurement occasions during a 2-year period. A growth curve model was fit to the academic performance. Mantel-Haenszel tests identified independent predictors of academic performance on progress tests. RESULTS: Mean rating at the first measuring occasion was 41%. There was a statistically significant improvement over time (slope = 7% per 6-m period; P < 0.01). Analysis of the random effects showed significant individual differences in the intercept. The residents' scores improved at an equivalent rate over the course of the residency. The independent predictors of academic performance were anxiety, motivation, and ability in selecting main ideas. CONCLUSIONS: Knowledge growth on basic sciences during anesthesia residency is significantly associated to the level of anxiety related to study and achievement, to the motivation for learning and for personal improvement, and to the ability in selecting main ideas from subject matters to which residents are exposed during learning episodes.

Urinary incontinence after bilateral parasacral sciatic-nerve block: report of two cases.

OBJECTIVE: The authors describe the occurrence of urinary incontinence after bilateral parasacral sciatic-nerve blocks. CASE REPORT: Two female patients scheduled for bilateral hallux valgus corrective surgery under bilateral parasacral sciatic-nerve block developed urinary incontinence manifested by 3 episodes of enuresis in the first 5 hours after surgery. Physical examination revealed bilateral perineal and gluteal anesthesia and no bladder distention in both patients. Ten hours after block placement, both patients had recovered perineal sensibility and were able to control micturition. CONCLUSION: Given the anatomic relations between the sacral plexus and the autonomic and somatic afferent and efferent innervation of the bladder and urethra, the urinary incontinence observed in our 2 patients could be explained by loss of afferent activity by spread of the local-anesthetic solution to pelvic nerves, loss of the efferent innervation of the posterior urethral sphincter by spread of the local-anesthetic solution to the urethral branches of the hypogastric plexus, and loss of external urethral sphincter tonus by block of the pudendal nerves. Anesthesiologists should consider the possibility of occurrence of urinary incontinence when performing bilateral parasacral sciatic-nerve blocks.

Psychometric properties of the Dundee Ready Educational Environment Measure (DREEM) applied to medical residents.

The Dundee Ready Educational Environment Measure (DREEM) is a measure of students' perceptions of the educational environment, but its performance in evaluating the educational environment in the residency setting has not yet been described. This study aimed at describing the psychometric performance of DREEM applied to medical residents. DREEM was applied to 97 residents from 12 training programs on four specialties in six institutions in three Brazilian cities. Psychometric measures included factor analysis, Cronbach's alpha coefficients, item-to-total correlations, t-test comparisons of scores between genders, institutions, specialties, and programs, correlations with the global score of the Quality of School Life Scale (concurrent validity), and test-retest reliability. Generalizability theory procedures were applied to a random subset of data. Programs (8) were the objects of measure, while institutions (6), specialties (4), raters-within-programs (40), and items-on-the-scale (50) were facets. Variance components, generalizability (G) and dependability (D) coefficients were calculated. Cronbach's alpha was 0.93. DREEM showed high discriminant and concurrent validities. Test-retest reliability was moderate. Interactions between programs, raters and items accounted for 68% of the total variance. G and D coefficients were 0.95 and 0.67, respectively. The instrument proved to be useful for relative comparisons at both resident and program level.