ABSTRACT
BACKGROUND: In 2018, a set of entrustable professional activities (EPAs) and procedural skills assessments were developed for anesthesiology training, but they did not assess all the Accreditation Council for Graduate Medical Education (ACGME) milestones. The aims of this study were to (1) remap the 2018 EPA and procedural skills assessments to the revised ACGME Anesthesiology Milestones 2.0, (2) develop new assessments that combined with the original assessments to create a system of assessment that addresses all level 1 to 4 milestones, and (3) provide evidence for the validity of the assessments. METHODS: Using a modified Delphi process, a panel of anesthesiology education experts remapped the original assessments developed in 2018 to the Anesthesiology Milestones 2.0 and developed new assessments to create a system that assessed all level 1 through 4 milestones. Following a 24-month pilot at 7 institutions, the number of EPA and procedural skill assessments and mean scores were computed at the end of the academic year. Milestone achievement and subcompetency data for assessments from a single institution were compared to scores assigned by the institution's clinical competency committee (CCC). RESULTS: New assessment development, 2 months of testing and feedback, and revisions resulted in 5 new EPAs, 11 nontechnical skills assessments (NTSAs), and 6 objective structured clinical examinations (OSCEs). Combined with the original 20 EPAs and procedural skills assessments, the new system of assessment addresses 99% of level 1 to 4 Anesthesiology Milestones 2.0. During the 24-month pilot, aggregate mean EPA and procedural skill scores significantly increased with year in training. System subcompetency scores correlated significantly with 15 of 23 (65.2%) corresponding CCC scores at a single institution, but 8 correlations (36.4%) were <30.0, illustrating poor correlation. CONCLUSIONS: A panel of experts developed a set of EPAs, procedural skill assessment, NTSAs, and OSCEs to form a programmatic system of assessment for anesthesiology residency training in the United States. The method used to develop and pilot test the assessments, the progression of assessment scores with time in training, and the correlation of assessment scores with CCC scoring of milestone achievement provide evidence for the validity of the assessments.
Subject(s)
Anesthesiology , Internship and Residency , United States , Anesthesiology/education , Education, Medical, Graduate , Educational Measurement/methods , Clinical Competence , AccreditationABSTRACT
BACKGROUND: Osteochondritis dissecans (OCD) of the capitellum is a common cause of pain and dysfunction in adolescents that engage in repetitive elbow loading. For large, unstable lesions fresh osteochondral allograft transplantation (FOCAT) from the femoral condyle has been described as an effective treatment. Current practice involves significant guesswork in obtaining an appropriately sized graft, with anatomic variations resulting in poor graft fit. No studies currently exist that analyze and identify the best distal femur FOCAT graft site to repair OCD lesions of the capitellum based on the radius of curvature (ROC) and simulated matching. METHODS: Computed tomography scans of the elbow were used to estimate the subchondral bone ROC of capitella in adolescents aged 11 to 21 years. The capitellar location used corresponds to the most commonly reported site of OCD lesions in the elbow. Computed tomography scans of the lower extremity were used to estimate the subchondral bone ROC of 4 potential donor femoral condyle grafts. ROC from distinct regions at the posterior section of both the medial and lateral femoral condyles were measured: 2 areas representing 10 mm grafts from the center (MC1 and LC1), and 2 areas estimating 10 mm grafts posterior and adjacent to the physeal scar (MC2 and LC2). Intraobserver and interobserver reliability measurements were preformed to corroborate precision and validate the method. RESULTS: The mean ROC of healthy subchondral bone at the region of the capitellum were OCD lesions most commonly occur was 9.79±1.39 mm. The mean ROC of MC1 was 18.61±2.26 mm. The average ROC of the MC2 was 15.23±1.43 mm. The average ROC of LC1 was 16.47±1.34 mm. The average ROC of LC2 was 18.19±3.09 mm. After 15,000 simulated condyle-to-capitellar site matchings based on these measurements, a good fit graft was achieved at a frequency of 15%. DISCUSSION: No site measured from the femoral condyle demonstrated a subchondral ROC that exactly matched the subchondral ROC of the capitellum at the center location where OCD lesions most commonly occur; of the locations measured, a 10 mm section from MC2 demonstrated the closest match. On the basis of this analysis, extracting a graft from MC2 has the potential to further optimize FOCAT fit to the capitellum. LEVEL OF EVIDENCE: Level III.
