Measuring deliberate reflection in residents: validation and psychometric properties of a measurement tool.

PURPOSE: Reflective capacity is "the ability to understand critical analysis of knowledge and experience to achieve deeper meaning." In medicine, there is little provision for post-graduate medical education to teach deliberate reflection. The feasibility, scoring characteristics, reliability, validation, and adaptability of a modified previously validated instrument was examined for its usefulness assessing reflective capacity in residents as a step toward developing interventions for improvement. METHODS: Third-year residents and fellows from four anesthesia training programs were administered a slightly modified version of the Reflection Evaluation for Learners' Enhanced Competencies Tool (REFLECT) in a prospective, observational study at the end of the 2019 academic year. Six written vignettes of imperfect anesthesia situations were created. Subjects recorded their perspectives on two randomly assigned vignettes. Responses were scored using a 5-element rubric; average scores were analyzed for psychometric properties. An independent self-report assessment method, the Cognitive Behavior Survey: Residency Level (rCBS) was used to examine construct validity. Internal consistency (ICR, Cronbach's alpha) and interrater reliability (weighted kappa) were examined. Pearson correlations were used between the two measures of reflective capacity. RESULTS: 46/136 invited subjects completed 2/6 randomly assigned vignettes. Interrater agreement was high (k = 0.85). The overall average REFLECT score was 1.8 (1-4 scale) with good distribution across the range of scores. ICR for both the REFLECT score (mean 1.8, sd 0.5; α = 0.92) and the reflection scale of the rCBS (mean 4.5, sd 1.1; α = 0.94) were excellent. There was a significant correlation between REFLECT score and the rCBS reflection scale (r = .44, p < 0.01). CONCLUSIONS: This study demonstrates feasibility, reliability, and sufficiently robust psychometric properties of a modified REFLECT rubric to assess graduate medical trainees' reflective capacity and established construct/convergent validity to an independent measure. The instrument has the potential to assess the effectiveness of interventions intended to improve reflective capacity.

"You Look Young! Are You a Doctor?" A Qualitative Content Analysis of Anesthesiology Resident Responses to Ageism in Clinical Encounters.

BACKGROUND: Healthcare trainees frequently report facing comments from their patients pertaining to their age. Exposure to ageist comments from patients may be related to greater stress and/or burnout in residents and may impact the quality of the resident-patient relationship. However, little empirical work has examined ageism expressed toward anesthesiology residents in clinical care, and therefore not much is known about how residents respond to these comments in practice. This research sought to determine how anesthesiology residents responded to ageist comments. METHODS: Anesthesiology residents (N = 60) engaged in a preoperative interaction with a standardized patient who was instructed to make an ageist comment to the resident. Resident responses were transcribed and coded using qualitative inductive content analysis to identify response themes. RESULTS: The most common resident response to the ageist comment, across gender and resident year, was to state their own experience. Some also described how they were still in training or that they were under supervision. Residents rarely reassured the patient that they would receive good care or identified the patient's anxiety as a cause of the ageist remark. CONCLUSIONS: These results provide a first step in understanding how ageism may be navigated by residents in clinical encounters. The authors discuss potential avenues for future research and education for responding to ageist remarks for both patients and clinicians.

Characterization of Reflective Capacity of Anesthesiology Trainees in an Irish Tertiary Referral Teaching Hospital.

Background: Reflective practice is associated with improved accuracy of medical diagnosis and superior performance in complex situations. Systematic observation of trainees' reflective capacities constitutes a basis for an effective support of reflective practice within the training paradigm. We set out to examine the reflective capacity among anesthesiology trainees in a tertiary referral hospital. Methods: We invited 61 anesthesiology trainees in Cork University Hospitals, Ireland, to participate. Each trainee was invited to respond to 2 investigator-written vignettes prepared by the investigators and suitable for evaluation using the Reflection Evaluation for Learners' Enhanced Competencies Tool (REFLECT) and to produce and then respond to a written vignette based on their own experience. All responses were assessed by 2 independent assessors who had undergone training in the application of the REFLECT rubric, which gives quantifiable scores. Interrater reliability was assessed by weighted kappa coefficient. Association between years of training in medicine and level of reflective capacity was examined using correlation and multiple regression analyses, controlling for age. Results: Twenty-nine trainees agreed to participate, the overall REFLECT Level was 2.16 (SD 0.7), corresponding to "thoughtful action," indicating low to moderate reflective ability. Cronbach's alpha for the 5 items of the REFLECT scale was excellent (r = 0.92). Weighted kappa was very satisfactory (k = 0.81). A strong association was demonstrated between years in medicine and scores on REFLECT, controlling for age of participant (F = -2.57, Beta coefficient = -0.30). Respondents with less experience had greater mean REFLECT scores than respondents with more experience (F = 5.5, P = .02; post hoc mean difference = 0.7, P = .03 for ≤32 months vs ≥99 months). There was a significant effect for gender (t = -4.3, P = .001), with women's responses receiving greater REFLECT scores than men's responses (mean difference = 0.67, P = .001). Conclusions: Overall, participants demonstrated low to moderate reflective capacity, as assessed by the REFLECT rubric. Reflective capacity of the anesthesiology trainees appears to decrease as years of medical training progress. However, our respondents were not sampled over time to fully support this conclusion. Further research is needed on the psychometric properties of the REFLECT rubric and the generalizability of our findings.

Compassionate and Clinical Behavior of Residents in a Simulated Informed Consent Encounter.

BACKGROUND: Compassionate behavior in clinicians is described as seeking to understand patients' psychosocial, physical and medical needs, timely attending to these needs, and involving patients as they desire. The goal of our study was to evaluate compassionate behavior in patient interactions, pain management, and the informed consent process of anesthesia residents in a simulated preoperative evaluation of a patient in pain scheduled for urgent surgery. METHODS: Forty-nine Clinical Anesthesia residents in year 1 and 16 Clinical Anesthesia residents in year 3 from three residency programs individually obtained informed consent for anesthesia for an urgent laparotomy from a standardized patient complaining of pain. Encounters were assessed for ordering pain medication, for patient-resident interactions by using the Empathic Communication Coding System to code responses to pain and nausea cues, and for the content of the informed consent discussion. RESULTS: Of the 65 residents, 56 (86%) ordered pain medication, at an average of 4.2 min (95% CI, 3.2 to 5.1) into the encounter; 9 (14%) did not order pain medication. Resident responses to the cues averaged between perfunctory recognition and implicit recognition (mean, 1.7 [95% CI, 1.6 to 1.9]) in the 0 (less empathic) to 6 (more empathic) system. Responses were lower for residents who did not order pain medication (mean, 1.2 [95% CI, 0.8 to 1.6]) and similar for those who ordered medication before informed consent signing (mean, 1.9 [95% CI, 1.6 to 2.1]) and after signing (mean, 1.9 [95% CI, 1.6 to 2.0]; F (2, 62) = 4.21; P = 0.019; partial η = 0.120). There were significant differences between residents who ordered pain medication before informed consent and those who did not order pain medication and between residents who ordered pain medication after informed consent signing and those who did not. CONCLUSIONS: In a simulated preoperative evaluation, anesthesia residents have variable and, at times, flawed recognition of patient cues, responsiveness to patient cues, pain management, and patient interactions.

Simulation-based Assessment to Reliably Identify Key Resident Performance Attributes.

BACKGROUND: Obtaining reliable and valid information on resident performance is critical to patient safety and training program improvement. The goals were to characterize important anesthesia resident performance gaps that are not typically evaluated, and to further validate scores from a multiscenario simulation-based assessment. METHODS: Seven high-fidelity scenarios reflecting core anesthesiology skills were administered to 51 first-year residents (CA-1s) and 16 third-year residents (CA-3s) from three residency programs. Twenty trained attending anesthesiologists rated resident performances using a seven-point behaviorally anchored rating scale for five domains: (1) formulate a clear plan, (2) modify the plan under changing conditions, (3) communicate effectively, (4) identify performance improvement opportunities, and (5) recognize limits. A second rater assessed 10% of encounters. Scores and variances for each domain, each scenario, and the total were compared. Low domain ratings (1, 2) were examined in detail. RESULTS: Interrater agreement was 0.76; reliability of the seven-scenario assessment was r = 0.70. CA-3s had a significantly higher average total score (4.9 ± 1.1 vs. 4.6 ± 1.1, P = 0.01, effect size = 0.33). CA-3s significantly outscored CA-1s for five of seven scenarios and domains 1, 2, and 3. CA-1s had a significantly higher proportion of worrisome ratings than CA-3s (chi-square = 24.1, P < 0.01, effect size = 1.50). Ninety-eight percent of residents rated the simulations more educational than an average day in the operating room. CONCLUSIONS: Sensitivity of the assessment to CA-1 versus CA-3 performance differences for most scenarios and domains supports validity. No differences, by experience level, were detected for two domains associated with reflective practice. Smaller score variances for CA-3s likely reflect a training effect; however, worrisome performance scores for both CA-1s and CA-3s suggest room for improvement.

Institutional Policy Changes to Prevent Cardiac Toxicity Associated With Bupivacaine Penile Blockade in Infants.

Dorsal penile nerve block is a widely used method of analgesia for infants undergoing penile surgery. Because of its potency, extended duration of action, and lack of vasoconstriction, bupivacaine remains the most commonly used local anesthetic. Rapid systemic absorption of bupivacaine, however, has been associated with profound central nervous system and cardiovascular side effects, including cardiac arrest. As determined by retrospective medical record analysis, the incidence of complications associated with dorsal penile blockade in our institution was 0.075%. This was significantly higher than previously reported prompting a change in institutional policy that has eliminated penile block complications.

Creation of an integrated outcome database for pediatric anesthesia.

Outcome analysis is essential to health care quality improvement efforts. Pediatric anesthesia faces unique challenges in analyzing outcomes. Anesthesia most often involves a one-time point of care interaction where work flow precludes detailed feedback to care givers. In addition, pediatric outcome evaluations must take into account patients' age, development, and underlying illnesses when attempting to establish benchmarks. The deployment of electronic medical records, including preoperative, operative, and postoperative data, offers an opportunity for creating datasets large and inclusive enough to overcome these potential confounders. At our institution, perioperative data exist in five distinct environments. In this study, we describe a method to integrate these datasets into a single web-based relational database that provides researchers and clinicians with regular anesthesia outcome data that can be reviewed on a daily, weekly, or monthly basis. Because of its complexity, the project also entailed the creation of a 'dashboard,' allowing tracking of data trends and rapid feedback of measured metrics to promote and sustain improvements. We present the first use of such a database and dashboard for pediatric anesthesia professionals as well as successfully demonstrating its capabilities to perform as described above.

Simulation-based assessment to identify critical gaps in safe anesthesia resident performance.

BACKGROUND: Valid methods are needed to identify anesthesia resident performance gaps early in training. However, many assessment tools in medicine have not been properly validated. The authors designed and tested use of a behaviorally anchored scale, as part of a multiscenario simulation-based assessment system, to identify high- and low-performing residents with regard to domains of greatest concern to expert anesthesiology faculty. METHODS: An expert faculty panel derived five key behavioral domains of interest by using a Delphi process (1) Synthesizes information to formulate a clear anesthetic plan; (2) Implements a plan based on changing conditions; (3) Demonstrates effective interpersonal and communication skills with patients and staff; (4) Identifies ways to improve performance; and (5) Recognizes own limits. Seven simulation scenarios spanning pre-to-postoperative encounters were used to assess performances of 22 first-year residents and 8 fellows from two institutions. Two of 10 trained faculty raters blinded to trainee program and training level scored each performance independently by using a behaviorally anchored rating scale. Residents, fellows, facilitators, and raters completed surveys. RESULTS: Evidence supporting the reliability and validity of the assessment scores was procured, including a high generalizability coefficient (ρ = 0.81) and expected performance differences between first-year resident and fellow participants. A majority of trainees, facilitators, and raters judged the assessment to be useful, realistic, and representative of critical skills required for safe practice. CONCLUSION: The study provides initial evidence to support the validity of a simulation-based performance assessment system for identifying critical gaps in safe anesthesia resident performance early in training.

A retrofitted neural recording system with a novel stimulation IC to monitor early neural responses from a stimulating electrode.

Extracellular electrical stimulation is increasingly used for in vitro neural experimentation, including brain slices and cultured cells. Although it is desirable to record directly from the stimulating electrode, relatively high stimulation levels make it extremely difficult to record immediately after the stimulation. We have shown that this is feasible by a stimulation system (analog IC) that includes the feature of active electrode discharge. Here, we piggybacked the new IC onto an existing recording amplifier system, making it possible to record neural responses directly from the stimulating channel as early as 3 ms after the stimulation. We used the retrofitted recording system to stimulate and record from dissociated hippocampal neurons in culture. This new strategy of retrofitting an existing system is a simple but attractive approach for instrumentation designers interested in adding a new feature for extracellular recording without replacing already existing recording systems.

Differences in safety climate among hospital anesthesia departments and the effect of a realistic simulation-based training program.

BACKGROUND: Safety climate is often measured via surveys to identify appropriate patient safety interventions. The introduction of an insurance premium incentive for simulation-based anesthesia crisis resource management (CRM) training motivated our naturalistic experiment to compare the safety climates of several departments and to assess the impact of the training. METHODS: We administered a 59-item survey to anesthesia providers in six academic anesthesia programs (Phase 1). Faculty in four of the programs subsequently participated in a CRM program using simulation. The survey was readministered 3 yr later (Phase 2). Factor analysis was used to create scales regarding common safety themes. Positive safety climate (% of respondents with positive safety attitudes) was computed for the scales to indicate the safety climate levels. RESULTS: The usable response rate was 44% (309/708) and 38% (293/772) in Phases 1 and 2 respectively. There was wide variation in response rates among hospitals and providers. Eight scales were identified. There were significantly different climate scores among hospitals but no difference between the trained and untrained cohorts. The positive safety climate scores varied from 6% to 94% on specific survey questions. Faculty and residents had significantly different perceptions of the degree to which residents are debriefed about their difficult clinical situations. CONCLUSIONS: Safety climate indicators can vary substantially among anesthesia practice groups. Scale scores and responses to specific questions can suggest practices for improvement. Overall safety climate is probably not a good criterion for assessing the impact of simulation-based CRM training. Training alone was insufficient to alter engrained behaviors in the absence of further reinforcing actions.

Crew resource management and team training.

This article reviews medical team training using the principles of crew resource management (CRM). It also briefly discusses crisis resource management, a subset of CRM, as applied to high-acuity medical situations. Guidelines on setting up medical team training programs are presented. Team training programs are classified and examples of simulation-based and classroom-based programs are offered and their merits discussed. Finally, a brief look at the future of team training concludes this review article.

Clinical pharmacology of the appeals and exception process: the interface of the patient, physician, and insurance company to assure appropriate care under Medicare Part D.

Personalized medicine considers factors unique and specific to each patient to make clinical decisions, including selecting pharmacotherapy. Drug formularies, including those available to enrollees in Medicare Part D, are based on group characteristics and financial considerations. Consequently, an appeal of a formulary's preferred drug selection may be necessary to ensure the best care of the patient. Consideration of basic principles of clinical pharmacology can be used to decide whether an exemption should be considered and to document specific reasons for the request.

A method for measuring the effectiveness of simulation-based team training for improving communication skills.

Team behavior and coordination, particularly communication or team information-sharing, are critical for optimizing team performance; research in medicine generally provides no accepted method for measurement of team information-sharing. In a controlled simulator setting, we developed a technique for placing clinical information (probes) with members of a team of trainees participating in a 1-day Anesthesia Crisis Resource Management course and later tested the teams for knowledge of the probes as an indicator of overall team information-sharing. Despite the low level of team information-sharing, we demonstrated construct validity of the probe methodology by the correlation of measured change in team information-sharing from beginning to end of training with self-rated change. There was no statistical difference in "group sharing" from beginning to end of training, despite trainees' survey responses that the course would be useful for their education and practice.

Teaching emergency airway management using medical simulation: a pilot program.

OBJECTIVE: Simulation is a tool that has been used successfully in many high performance fields to permit training in rare and hazardous events. Our goal was to develop and evaluate a program to teach airway crisis management to otolaryngology trainees using medical simulation. METHODS: A full-day curriculum in the management of airway emergencies was developed. The program consists of three airway emergency scenarios, developed in collaboration between attending otolaryngologists and faculty from the Center for Medical Simulation. Following each scenario, the participants are led in a structured, video-assisted debriefing by a trained debriefer. Didactic material on team leadership and crisis management is built into the debriefings. Pediatric otolaryngology fellows, residents, and medical students have participated in the four courses that have been held to date. Participants evaluated the program on a five-point Likert scale. RESULTS: A total of 17 trainees participated in four pilot training courses. The survey data are as follows: overall program, 5.0 (SD, 0.00); course goals, 4.79 (SD, 0.43); realism, 4.36 (SD, 0.63); value of lecture, 4.71 (SD, 0.47); and quality of debriefings, 4.92 (SD, 0.28). Sample comments include: "This is a valuable tool for students and residents since true emergencies in ORL are often life-threatening and infrequent," and "This is a great course-really all physicians should experience it." Overall evaluation was extremely positive and both residents and fellows described the course as filling an important void in their education. CONCLUSION: Medical simulation can be an extremely effective method for teaching airway crisis management and teamwork skills to otolaryngology trainees at all levels.

Crisis resource management training for an anaesthesia faculty: a new approach to continuing education.

BACKGROUND: Human error and system failures continue to play a substantial role in adverse outcomes in health care. Anaesthesia crisis resource management addresses many patient safety issues by teaching behavioural skills for critical events but it has not been systematically utilized to teach experienced faculty. METHODS: An anaesthesia crisis resource management course was created for the faculty of our medical school's anaesthesia teaching programmes. The course objectives were to understand and improve participants' proficiency in crisis resource management (CRM) skills and to learn skills for debriefing residents after critical events. Through surveys, measurement objectives assessed acceptance, utility and need for recurrent training immediately post-course. These were measured again approximately 1 year later along with self-perceived changes in the management of difficult or critical events. RESULTS: The highly rated course was well received in terms of overall course quality, realism, debriefings and didactic presentation. Course usefulness, CRM principles, debriefing skills and communication were highly rated immediately post-course and 1 year later. Approximately half of the faculty staff reported a difficult or critical event following the course; of nine self-reported CRM performance criteria surveyed all claimed improvement in their CRM non-technical skills. CONCLUSIONS: A unique and highly rated anaesthesia faculty course was created; participation made the faculty staff eligible for malpractice premium reductions. Self-reported CRM behaviours in participants' most significant difficult or critical events indicated an improvement in performance. These data provide indirect evidence supporting the contention that this type of training should be more widely promoted, although more definitive measures of improved outcomes are needed.

Chronic upper airway obstruction and cardiac dysfunction: anatomy, pathophysiology and anesthetic implications.

The causes of obstruction to airflow in the pediatric upper airway include craniofacial disorders, subglottic stenosis, choanal atresia, syndromes associated with neuromuscular weakness, and the most common, hypertrophy of the tonsils and adenoids. Abnormal breathing can adversely affect craniofacial growth, and abnormal craniofacial development can promote upper airway obstruction. Chronic upper airway obstruction often presents with evidence of obstructive sleep apnea syndrome; in severe cases these children also present with pulmonary hypertension and cor pulmonale. The development of pulmonary hypertension and right heart dysfunction from chronic upper airway obstruction is complex. Hypoxemia and hypercarbia-induced respiratory acidosis are potent mediators of pulmonary vasoconstriction that can lead to reversible and irreversible chronic changes in the pulmonary vasculature. It is likely that production of various neurohumoral factors in response to hypoxemia and respiratory distress may further promote pulmonary hypertension, right ventricular dysfunction, and consequent impairment of systemic cardiac output. The anesthetic considerations for children undergoing adenotonsillectomy for chronic airway obstruction are significant. These children are at high risk for complications such as laryngospasm, desaturation, stimulation of pulmonary hypertension and cardiac dysfunction, pulmonary edema, postoperative upper airway obstruction, and respiratory arrest. Because of underlying condition(s) (facial abnormalities, neuromuscular disease, etc.), successful adenotonsillar surgery may not improve upper airway obstruction significantly, especially in the immediate postoperative period when edema, bleeding and the effects of anesthetics and analgesics are present.

Models of stimulation artifacts applied to integrated circuit design.

The goal of this research is to develop a monolithic stimulation and recording system capable of simultaneous, multichannel stimulation and recording. Monolithic systems are advantageous for large numbers of recording sites because they scale better than systems composed of discrete amplifiers. A major problem in recording systems is the stimulation artifact, a transient distortion present after stimulation. In order to improve recording systems, we analyze models of the stimulation artifact. Comparisons between model predictions and physical measurements verify the models. We show that the linear model, suitable for inclusion in circuit simulators, can assist in the design of an integrated recording system capable of artifact removal. The proposed design occupies 18,000 micron(2) and is suitable for monolithic integration.