Validity of entrustment scales within anesthesiology residency training.

INTRODUCTION: Competency-based medical education requires robust assessment in authentic clinical environments. Using work-based assessments, entrustment scales have emerged as a means of describing a trainee's ability to perform competently. Nevertheless, psychometric properties of entrustment-based assessment are relatively unknown, particularly in anesthesiology. This study assessed the generalizability and extrapolation evidence for entrustment scales within a program of assessment during anesthesiology training. METHODS: Entrustment scores were collected during the first seven blocks of training for three resident cohorts. Entrustment scores were assessed during daily evaluations using a Clinical Case Assessment Tool (CCAT) within the preoperative, intraoperative, and postoperative setting. The reliability of the entrustment scale was estimated using generalizability theory. Spearman's correlations measured the relationship between median entrustment scores and percentiles scores on the Anesthesia Knowledge Test (AKT)-1 and AKT-6, mean Objective Structured Clinical Examination (OSCE) scores, and rankings of performance by the Clinical Competence Committee (CCC). RESULTS: Analyses were derived from 2,309 CCATs from 35 residents. The reliability or generalizability (G) coefficient of the entrustment scale was 0.73 (95% confidence interval [CI], 0.70 to 0.76), and the internal consistency was 0.86 (95% CI, 0.84 to 0.88). Intraoperative entrustment scores significantly correlated with the AKT-6 (rho = 0.51, P = 0.01), mean OSCE (rho = 0.45, P = 0.04), and CCC performance rankings (rho = 0.52, P = 0.006). CONCLUSION: As part of an assessment program, entrustment scales used early during anesthesiology training showed evidence of validity. Intraoperative entrustment scores had good reliability and showed acceptable internal consistency. Interpreting entrustment scores in this setting may constitute a valuable adjunct complementing traditional summative evaluations.

RéSUMé: INTRODUCTION: La formation médicale fondée sur les compétences nécessite une évaluation rigoureuse dans des environnements cliniques authentiques. Se fondant sur des évaluations basées sur le travail, les échelles de confiance sont apparues comme une méthode pour décrire la capacité d'un résident à performer de façon compétente. Toutefois, les propriétés psychométriques de l'évaluation basée sur la confiance sont relativement peu connues, particulièrement en anesthésiologie. Cette étude a évalué les données de généralisabilité et d'extrapolation des échelles de confiance dans le cadre d'un programme d'évaluation pendant la formation en anesthésiologie. MéTHODE: Les notes sur les échelles de confiance ont été colligées pendant les sept premiers blocs de formation de trois cohortes de résidents. Les notes sur les échelles de confiance ont été évaluées pendant les évaluations quotidiennes à l'aide d'un Outil d'évaluation des compétences cliniques (CCAT ­ Clinical Case Assessment Tool) dans les cadres préopératoire, peropératoire et postopératoire. La fiabilité de l'échelle de confiance a été estimée à l'aide de la théorie de la généralisabilité. Les corrélations de Spearman ont mesuré la relation entre des notes moyennes sur l'échelle de confiance et les scores de percentile aux examens de connaissances en anesthésiologie AKT-1 et AKT-6, les scores moyens à l'Examen clinique objectif structuré (ECOS), et les classements de performance par le Comité de compétences cliniques (CCC). RéSULTATS: Les analyses ont été dérivées à partir de 2309 résultats CCAT de 35 résidents. Le coefficient de fiabilité ou de généralisabilité (G) de l'échelle de confiance était de 0,73 (intervalle de confiance [IC] 95 %, 0,70 à 0,76), et la cohérence interne était de 0,86 (IC 95 %, 0,84 à 0,88). Les scores de confiance peropératoires étaient corrélés de manière significative aux scores sur l'AKT-6 (rho = 0,51, P = 0,01), aux scores moyens à l'ECOS (rho = 0,45, P = 0,04) et aux classements de performance du CCC (rho = 0,52, P = 0,006). CONCLUSION: Dans le cadre d'un programme d'évaluation, la validité des échelles de confiance utilisées en début de la formation en anesthésiologie a été éprouvée. Les scores de confiance peropératoires ont démontré une bonne fiabilité et une cohérence interne acceptable. L'interprétation des scores de confiance dans ce cadre pourrait constituer un ajout précieux qui complèterait les évaluations sommatives.

Logging in: a comparative analysis of electronic health records versus anesthesia resident-driven logbooks.

PURPOSE: Resident logbooks (RLBs) documenting clinical case exposure are widespread in medical education despite evidence of poor accuracy. Electronic health records (e.g., anesthesia information management systems [AIMS]) may provide advantages for auditing longitudinal case exposure. We evaluated the agreement between AIMS and RLBs for tracking case exposure during anesthesiology residency. METHODS: We performed a historical cohort study with anesthesiology residents (2011-2018, all of whom used a RLB contemporaneously with AIMS) working in a multisite academic health sciences network. The primary outcome was total case-load logging; secondary outcomes were volumes for seven surgical specialties (general, gynecology, neuro, orthopedic, thoracic, urology, and vascular surgery). Correlation of case numbers tracked by AIMS vs RLB was assessed using Pearson correlation; agreement was determined using Bland-Altman plots and intraclass correlation coefficients (ICC). RESULTS: Data from 27 anesthesiology residents were collected. Overall, mean (standard deviation) case numbers were generally greater with AIMS vs RLB [649 (103) vs 583 (191); P = 0.049). Total case volumes between systems had moderate correlation (r = 0.50) and agreement (intraclass correlation coefficient [ICC], 0.42; 95% CI, 0.34 to 0.59). Bland-Altman plots showed variable agreement between AIMS and RLB data [mean (SD) bias = 66 (166) cases]. For general, gynecology, neuro, orthopedic, thoracic, urology, and vascular surgery, there was a range of poor to moderate agreement (ICC, 0.23-0.57) between AIMS and RLB. CONCLUSION: For anesthesiology resident case-logging, the number of cases logged in an AIMS was higher with lower variance compared with RLBs. Anesthesia information management systems vs RLB data showed low-moderate correlation and agreement. Given the additional time and resources required for RLBs, AIMS may be a superior method for tracking cases where available.

RéSUMé: OBJECTIF: Les logbooks des résidents documentant leur exposition à des cas cliniques sont répandus dans la formation médicale et ce, malgré des données probantes déplorant leur manque de précision. Les dossiers médicaux informatisés (par ex., les systèmes de gestion de l'information en anesthésie [SGIA]) pourraient présenter des avantages pour le contrôle de l'exposition longitudinale des résidents aux cas. Notre étude a évalué la concordance entre les SGIA et les logbooks pour l'exposition aux cas pendant la résidence en anesthésiologie. MéTHODE: Nous avons réalisé une étude de cohorte historique auprès de résidents en anesthésiologie (2011­2018, tous les résidents ayant utilisé un logbook simultanément aux SGIA) travaillant dans un réseau universitaire de sciences de la santé multisite. Le critère d'évaluation principal était l'enregistrement du nombre de cas total; les critères d'évaluation secondaires comprenaient les volumes pour sept spécialités chirurgicales (soit la chirurgie générale, gynécologique, orthopédique, thoracique, urologique, vasculaire et la neurochirurgie). La corrélation entre le nombre de cas enregistrés dans les SGIA vs les logbooks a été évaluée à l'aide d'une corrélation de Pearson; l'agrément a été déterminé à l'aide d'un graphique de Bland­Altman et de coefficients de corrélation intraclasse (CCI). RéSULTATS: Les données de 27 résidents en anesthésiologie ont été colligées. Globalement, les nombres de cas moyens (écart type) étaient en général plus élevés dans les SGIA que dans les logbooks [649 (103) vs 583 (191); P = 0,049). Les volumes de cas totaux entre les systèmes présentaient une corrélation (r = 0,50) et un agrément (coefficient de corrélation intraclasse [CCI], 0,42; IC 95 %, 0,34 à 0,59) modérés. Les graphiques de Bland­Altman ont démontré un agrément variable entre les données des SGIA et celles des logbooks [biais moyen (ÉT) = 66 (166) cas]. Pour les chirurgies générales, gynécologiques, orthopédiques, thoraciques, urologique, vasculaires et neurochirurgies, l'agrément allait de faible à modéré (CCI, 0,23-0,57) entre les SGIA et les logbooks. CONCLUSION: En ce qui a trait à l'enregistrement des cas des résidents en anesthésiologie, le nombre de cas enregistrés dans un SGIA était plus élevé et présentait une variance moindre que dans les logbooks. Les données des systèmes de gestion de l'information en anesthésie vs des logbooks ont affiché une corrélation et un agrément faible à modéré. Étant donné le temps et les ressources supplémentaires nécessaires pour compléter les logbooks, les SGIA pourraient constituer une méthode supérieure pour le suivi des cas, lorsqu'un tel système est disponible.

Outcomes of Rhegmatogenous Retinal Detachment Repair With Nonrestricted Postoperative Positioning.

Purpose: To investigate the anatomical success rate associated with rhegmatogenous retinal detachment (RRD) repair without postoperative head positioning. Methods: Data on 182 individuals undergoing pars plana vitrectomy (PPV) with or without phacoemulsification or scleral buckle for primary RRD with intraocular tamponade were retrospectively reviewed. The primary outcome was the initial anatomical success rate. Secondary outcome measures were the change in best-corrected visual acuity and the final reattachment rate. Results: A total of 122 eyes from 122 patients who underwent RRD repair without postoperative positioning were included in this study. PPV alone was performed in 39% of cases, whereas the remaining patients had PPV combined with phacoemulsification (35%), with scleral buckle (19%), or both (7%). Inferior breaks between the 4 o'clock and 8 o'clock positions were present in 47% of cases. Primary and final anatomical success was achieved in 86% and 98% of cases, respectively. The most common cause for redetachment was proliferative vitreoretinopathy. Age and combined inferior retinal and superior breaks were predictive of recurrence in the logistic regression model. The mean baseline best-corrected visual acuity improved from 1.2 (Snellen equivalent, 20/320) to 0.76 (Snellen, 20/125) logarithm of the minimum angle of resolution after retinal reattachment (P < .001). Conclusions: PPV combined with or without phacoemulsification or scleral buckle for primary RRD in pseudophakic eyes or those rendered pseudophakic is associated with good anatomical outcomes without restricted postoperative head positioning. Retinal detachment in eyes with combined retinal inferior and superior breaks may have a lower success rate, and whether this is due to lack of postoperative positioning needs further evaluation in prospective, controlled studies.

Comparison of the uniform-field electroretinogram and the pattern electroretinogram to checkerboard and bar gratings.

PURPOSE: To compare the electroretinal response associated with the uniform-field electroretinogram (UF-ERG) to that of the pattern electroretinogram (PERG) to checkerboard and bar-grating stimuli. METHODS: UF-ERG and PERG to bars and checkerboard were recorded for 18 visually normal subjects (36 eyes) of mean age 45 years (range 20-75). UF-ERG was recorded to the increment and decrement of a 200-ms duration luminance modulation. Luminance onset and offset UF-ERG responses were averaged to produce a simulation of the PERG response. The mean amplitude and implicit time for the P50 and N95 potentials of actual and simulated PERG responses were recorded for each eye in the cohort. RESULTS: The simulated PERG waveform resulting from arithmetic averaging of the UF-ERG to luminance increment and decrement was characterized by prominent positive and negative components resembling those of the P50 and N95 PERG potentials. Implicit timing of the P50 potential was lengthened in the actual PERG to bars and checks relative to that of the simulation (P < 0.05, P < 0.001). Amplitude of the N95 potential was greater in the PERG to bars than in the PERG to checks (P < 0.05) or the simulated PERG (P < 0.001). The amplitude and implicit timing of all waveform components were significantly correlated between the actual and simulated PERG. CONCLUSIONS: The UF-ERG to light onset and offset can be reliably recorded in human subjects. The extent to which the simulated PERG recapitulates the actual PERG response is better with checkerboard rather than bar-grating stimuli.

Modification of Peak Plasticity Induced by Brief Dark Exposure.

The capacity for neural plasticity in the mammalian central visual system adheres to a temporal profile in which plasticity peaks early in postnatal development and then declines to reach enduring negligible levels. Early studies to delineate the critical period in cats employed a fixed duration of monocular deprivation to measure the extent of ocular dominance changes induced at different ages. The largest deprivation effects were observed at about 4 weeks postnatal, with a steady decline in plasticity thereafter so that by about 16 weeks only small changes were measured. The capacity for plasticity is regulated by a changing landscape of molecules in the visual system across the lifespan. Studies in rodents and cats have demonstrated that the critical period can be altered by environmental or pharmacological manipulations that enhance plasticity at ages when it would normally be low. Immersion in complete darkness for long durations (dark rearing) has long been known to alter plasticity capacity by modifying plasticity-related molecules and slowing progress of the critical period. In this study, we investigated the possibility that brief darkness (dark exposure) imposed just prior to the critical period peak can enhance the level of plasticity beyond that observed naturally. We examined the level of plasticity by measuring two sensitive markers of monocular deprivation, namely, soma size of neurons and neurofilament labeling within the dorsal lateral geniculate nucleus. Significantly larger modification of soma size, but not neurofilament labeling, was observed at the critical period peak when dark exposure preceded monocular deprivation. This indicated that the natural plasticity ceiling is modifiable and also that brief darkness does not simply slow progress of the critical period. As an antecedent to traditional amblyopia treatment, darkness may increase treatment efficacy even at ages when plasticity is at its highest.

Internal Limiting Membrane Transposition for Persistent Macular Holes Using Double Layers of Viscoelastic.

Internal limiting membrane (ILM) grafting provides a useful option for repair of large and refractory macular holes that fail to close following prior ILM removal. However, current ILM graft techniques are associated with several challenges that may result in failure, most notably the difficulty in maintaining the graft in situ. In this video, the authors describe their modified technique for ILM grafting using a double layer of viscoelastic for stabilization in situ during the procedure. Four of five eyes managed with this technique demonstrated type 1 closure, and all eyes demonstrated improvement in visual acuity.

Mapping of neuron soma size as an effective approach to delineate differences between neural populations.

BACKGROUND: A single histological marker applied to a slice of tissue often reveals myriad cytoarchitectonic characteristics that can obscure differences between neuron populations targeted for study. Isolation and measurement of a single feature from the tissue is possible through a variety of approaches, however, visualizing the data numerically or through graphs alone can preclude being able to identify important features and effects that are not obvious from direct observation of the tissue. NEW METHOD: We demonstrate an efficient, effective, and robust approach to quantify and visualize cytoarchitectural features in histologically prepared brain sections. We demonstrate that this approach is able to reveal small differences between populations of neurons that might otherwise have gone undiscovered. RESULTS & COMPARISON WITH EXISTING METHOD(S): We used stereological methods to record the cross-sectional soma area and in situ position of neurons within sections of the cat, monkey, and human visual system. The two-dimensional coordinate of every measured cell was used to produce a scatter plot that recapitulated the natural spatial distribution of cells, and each point in the plot was color-coded according to its respective soma area. The final graphic display was a multi-dimensional map of neuron soma size that revealed subtle differences across neuron aggregations, permitted delineation of regional boundaries, and identified small differences between populations of neurons modified by a period of sensory deprivation. CONCLUSIONS: This approach to collecting and displaying cytoarchitectonic data is simple, efficient, and provides a means of investigating small differences between neuron populations.

Susceptibility to monocular deprivation following immersion in darkness either late into or beyond the critical period.

An extended duration of darkness starting near the time of birth preserves immature neuronal characteristics and prolongs the accentuated plasticity observed in young animals. Brief periods of complete darkness have emerged as an effective means of restoring a high capacity for neural plasticity and of promoting recovery from the effects of monocular deprivation (MD). We examined whether 10 days of darkness imposed in adulthood or beyond the peak of the critical period could rejuvenate the ability of MD to reduce the size of neuron somata within deprived layers of the cat dorsal lateral geniculate nucleus (dLGN). For adult cats subjected to 10 days of darkness before 7 days of MD, we observed no alteration in neuron size or neurofilament labeling within the dLGN. At 12 weeks of age, MD that followed immediately after 10 days of darkness produced an enhanced reduction of neuron soma size within deprived dLGN layers. For this age we observed that 10 days of darkness also enhanced the loss of neurofilament protein within deprived dLGN layers. These results indicate that, although 10 days of darkness in adulthood does not enhance the susceptibility to 7 days of MD, darkness imposed near the trailing edge of the critical period can restore a heightened susceptibility to MD more typical of an earlier developmental stage. The loss of neurofilament in juveniles exposed to darkness prior to MD suggests that the enhanced capacity for structural plasticity is partially rooted in the ability of darkness to modulate molecules that inhibit plasticity. J. Comp. Neurol. 524:2643-2653, 2016. © 2016 Wiley Periodicals, Inc.