Quality of dictated feedback associated with SIMPL operative assessments of pediatric surgical trainees.

BACKGROUND: SIMPL is a workplace-based operative performance assessment tool which allows for dictated feedback (DF). To better understand the value of DF, we sought to characterize the type and quality of DF generated during SIMPL evaluations. METHODS: Thematic analysis of DF from SIMPL assessments between June 2017 and December 2018 at a single pediatric surgery fellowship program was performed. Comments were categorized as specific, encouraging or corrective. Categories were combined to determine DF quality as effective, mediocre or ineffective. RESULTS: Of 781 SIMPL assessments (21 faculty, 5 trainees), 451 (57%) had DF. Most comments were encouraging (93%) and specific (65%). Only 21% were corrective, 17% had entrustment features, and 8% had an explicit learning plan. Feedback quality was deemed mediocre (45%), ineffective (33%) and effective (21%). CONCLUSION: SIMPL dictated feedback was mostly encouraging and specific. To improve quality, feedback should incorporate learning plans as well as corrective and entrustment features.

Surgery Tutor for Computational Assessment of Technical Proficiency in Soft-Tissue Tumor Resection in a Simulated Setting.

BACKGROUND: In competency-based medical education, progression between milestones requires reliable and valid methods of assessment. Surgery Tutor is an open-source motion tracking platform developed to objectively assess technical proficiency during open soft-tissue tumor resections in a simulated setting. The objective of our study was to provide evidence in support of construct validity of the scores obtained by Surgery Tutor. We hypothesized that Surgery Tutor would discriminate between novice, intermediate, and experienced operators. METHODS: Thirty participants were assigned to novice, intermediate, or experienced groups, based on the number of prior soft-tissue resections performed. Each participant resected 2 palpable and 2 nonpalpable lesions from a soft-tissue phantom. Surgery Tutor was used to track hand and instrument motions, number of tumor breaches, and time to perform each resection. Mass of excised specimens and margin status were also recorded. RESULTS: Surgery Tutor scores demonstrated "moderate" to "good" internal structure (test-retest reliability) for novice, intermediate, and experienced groups (interclass correlation coefficient = 0.596, 0.569, 0.737; p < 0.001). Evidence in support of construct validity (consequences) was demonstrated by comparing scores of novice, intermediate, and experienced participantsfor number of hand and instrument motions (690 ± 190, 597 ± 169, 469 ± 110; p < 0.001), number of tumor breaches (29 ± 34, 16 ± 11, 9 ± 6; p < 0.001), time per resection (677 ± 331 seconds, 561 ± 210 seconds, 449 ± 148 seconds; p < 0.001), mass of completely excised specimens (22 ± 7g, 21 ± 11g, 17 ± 6 g; p = 0.035), and rate of positive margin (68%, 50%, 28%; p < 0.001). There was "strong" and "moderate" relationships between motion scores and Objective Structured Assessment of Technical Skill scores, and time per resection and Objective Structured Assessment of Technical Skill scores respectively (r = -0.60, p < 0.001; r = -0.54, p < 0.001). CONCLUSION: Surgery Tutor scores demonstrate evidenceof construct validity with regards to good internal structure, consequences, and relationship to other variables in the assessment of technical proficiency duringopen soft-tissue tumor resections in a simulated setting. Utilization of Surgery Tutor can provide formative feedback and objective assessment of surgical proficiency in a simulated setting.

The Development and Implementation of New Assessment Tools for the Surgical Clerkship Rotation.

This article was migrated. The article was marked as recommended. Innovation: We developed two new rubrics with explicit behavioural anchors to assess students in the Queen's undergraduate medical education (UGME) surgery clerkship rotation. These rotation rubrics, complemented by a new ambulatory clinic encounter card, improved the quality, consistency, and timeliness of feedback for clerks from faculty preceptors. This innovation was introduced during a comprehensive workplace-based assessment re-design being undertaken in the Department of Surgery as part of the transition to a post-graduate competency-based medical education (CBME) system for post-graduate education (PGME). The core UGME working group, comprised of a faculty surgeon, assessment consultant, and a surgical resident, selected terminology and designed the tool visual structure to be similar to the new post-graduate assessment tools, since most preceptors supervise learners in both programs. This consistency enhanced buy-in from faculty and ensured a smooth transition to the use of the new UGME tools. Development: The new assessment process was developed and piloted in three phases: (1) development of an assessment system based on rubrics with explicit behavioural descriptors as the key assessment tools; (2) implementation of a pilot study to establish the acceptability and feasibility of the use of these rubrics, with iterative revisions based on stakeholder feedback; and (3) development of a validity argument for the use of these assessment tools. The latter is scheduled for 2018. Outcomes: The use of these rotation behaviour-anchored rubrics and corresponding ambulatory clinic encounter card has greatly improved the mid- and final-rotation feedback provided to students on the Surgery Clerkship. The concrete, descriptive information provided by the rubrics allows the course director to provide specific feedback during rotation exit meetings. The course director has the ability to clearly articulate to students the areas where they have met (or exceeded) the expected level of competency, as well as areas which require additional attention.

The elevation of intraocular pressure is associated with apoptosis and increased immunoreactivity for nitric oxide synthase in rat retina whereas the effectiveness of retina derived relaxing factor is unaffected.

Glaucoma is a progressive ocular disease that stands in the upper rank for the cause of blindness in worldwide. In the present study, we aimed to elucidate the possible disturbances occurred in the layers of retina due to an increase in intraocular pressure (IOP) and to verify the effectiveness of retina derived relaxing factor, i.e., RRF in this pathologic condition. The increase in IOP was induced by cauterization of the three of episcleral veins simultaneously in rats. After 8 weeks period, the retinas excised from the vein cauterized eyes were evaluated for the possible histopathological and ultrastructural alterations as well as for the relaxing effects on isolated bovine retinal and rat mesenteric arteries, in comparison with the retinas obtained from contralateral sham-operated eyes. In the retinas of IOP-elevated eyes, profound morphological deteriorations were determined in the ganglion and outer nuclear cell layers which were associated with an increased number of TUNEL positive cells in the ganglion and inner nuclear cell layers. Increased immunohistochemical stainings for three isoforms of nitric oxide synthase (NOS) were defined in almost all layers of the retinas of IOP-elevated eyes, in which eNOS was abundant particularly in the inner plexiform and ganglion cell layers. An irregular basal folding of retinal pigment epithelium (RPE) and an increased inter lamellar space of photoreceptor cell layer furtherly characterized the prominent degeneration of those layers in the retinas of IOP-elevated eyes. On the other hand, the relaxing effects of the retina obtained from IOP-elevated eyes were determined to be unchanged on the retinal and mesenteric arteries precontracted either with prostaglandin F2α (PGF2α, 30 µM) or potassium chloride (K(+), 100 mM), when compared with the relaxations of control retina obtained from contralateral sham-operated eyes. Overall, these findings suggested that the elevation of IOP induces prominent structural changes in rat retina particularly in the ganglion and inner layers that is associated with marked apoptosis and increased immunoreactivity for NOS, while the functional effectiveness of retina derived relaxing factor, i.e., RRF is unaffected.

Validation of a novel intraoperative assessment tool: The Surgical Procedure Feedback Rubric.

BACKGROUND: The Surgical Procedure Feedback Rubric (SPR) is a tool to document resident intraoperative performance and provide targeted feedback to support learning in a competency-based model of surgical education. It differs from other assessment tools because it defines performance criteria by increasing complexity through the use of behavioral anchors, thus embedding standards of performance within the tool. This study explores aspects of validity of the SPR as an assessment tool. METHODS: A 14-month observational study was conducted in 2 surgical training programs. Factor structure of the SPR was examined using exploratory factor analysis. Discriminative ability of the SPR was examined using analysis of variance. RESULTS: The SPR measures 3 factors: Operating Room Preparation, Technical skill, and intrinsic Competencies. Analysis of variance demonstrated the utility of the SPR to discriminate between intraoperative performances of residents by postgraduate training year. CONCLUSIONS: This study contributes to the validity argument for the SPR by providing evidence for construct and discriminative validity.

Binding of acellular, native and cross-linked human hemoglobins to haptoglobin: enhanced distribution and clearance in the rat.

It is well established that hemoglobin resulting from red cell lysis binds to haptoglobin in plasma to form a complex. The increased molecular size precludes its filtration by the kidneys, redirecting it toward hepatocellular entry. Chemically cross-linked hemoglobins are designed to be resistant to renal excretion, even in the absence of haptoglobin. The manner in which binding to haptoglobin influences the pharmacokinetics of acellular cross-linked and native hemoglobins was investigated after intravenous injection of radiolabeled native human hemoglobin and trimesyl-(Lys82)beta-(Lys82)beta cross-linked human hemoglobin, at trace doses, into rats. Under these conditions, there is sufficient plasma haptoglobin for binding with hemoglobin. In vitro binding assayed by size-exclusion chromatography for bound and free hemoglobin revealed that, at <8 muM hemoglobin, native human hemoglobin was completely bound to rat haptoglobin, whereas only approximately 30% of trimesyl-(Lys82)beta-(Lys82)beta cross-linked hemoglobin was bound. Plasma disappearance of low doses (0.31 mumol/kg) of native and cross-linked hemoglobins was monoexponential (half-life = 23 and 33 min, respectively). The volume of distribution (40 vs. 19 ml/kg) and plasma clearance (1.22 vs. 0.4 ml.min(-1).kg(-1)) were higher for native than for cross-linked hemoglobin. Native and cross-linked human hemoglobins were found primarily in the liver, and not in the kidney, heart, lung, or spleen, mostly as degradation products. These pharmacokinetic findings suggest that the binding of hemoglobin to haptoglobin enhances its hepatocellular entry, clearance, and distribution.