Decision-Making Confidence of Clinical Competency Committees for Entrustable Professional Activities.

Importance: A competency-based assessment framework using entrustable professional activities (EPAs) was endorsed by the American Board of Surgery following a 2-year feasibility pilot study. Pilot study programs' clinical competency committees (CCCs) rated residents on EPA entrustment semiannually using this newly developed assessment tool, but factors associated with their decision-making are not yet known. Objective: To identify factors associated with variation in decision-making confidence of CCCs in EPA summative entrustment decisions. Design, Setting, and Participants: This cohort study used deidentified data from the EPA Pilot Study, with participating sites at 28 general surgery residency programs, prospectively collected from July 1, 2018, to June 30, 2020. Data were analyzed from September 27, 2022, to February 15, 2023. Exposure: Microassessments of resident entrustment for pilot EPAs (gallbladder disease, inguinal hernia, right lower quadrant pain, trauma, and consultation) collected within the course of routine clinical care across four 6-month study cycles. Summative entrustment ratings were then determined by program CCCs for each study cycle. Main Outcomes and Measures: The primary outcome was CCC decision-making confidence rating (high, moderate, slight, or no confidence) for summative entrustment decisions, with a secondary outcome of number of EPA microassessments received per summative entrustment decision. Bivariate tests and mixed-effects regression modeling were used to evaluate factors associated with CCC confidence. Results: Among 565 residents receiving at least 1 EPA microassessment, 1765 summative entrustment decisions were reported. Overall, 72.5% (1279 of 1765) of summative entrustment decisions were made with moderate or high confidence. Confidence ratings increased with increasing mean number of EPA microassessments, with 1.7 (95% CI, 1.4-2.0) at no confidence, 1.9 (95% CI, 1.7-2.1) at slight confidence, 2.9 (95% CI, 2.6-3.2) at moderate confidence, and 4.1 (95% CI, 3.8-4.4) at high confidence. Increasing number of EPA microassessments was associated with increased likelihood of higher CCC confidence for all except 1 EPA phase after controlling for program effects (odds ratio range: 1.21 [95% CI, 1.07-1.37] for intraoperative EPA-4 to 2.93 [95% CI, 1.64-5.85] for postoperative EPA-2); for preoperative EPA-3, there was no association. Conclusions and Relevance: In this cohort study, the CCC confidence in EPA summative entrustment decisions increased as the number of EPA microassessments increased, and CCCs endorsed moderate to high confidence in most entrustment decisions. These findings provide early validity evidence for this novel assessment framework and may inform program practices as EPAs are implemented nationally.

The Blue Ribbon Committee II Report and Recommendations on Surgical Education and Training in the United States: 2024.

OBJECTIVE: An expert panel made recommendations to optimize surgical education and training based on the effects of contemporary challenges. BACKGROUND: The inaugural Blue Ribbon Committee (BRC I) proposed sweeping recommendations for surgical education and training in 2004. In light of those findings, a second BRC (BRC II) was convened to make recommendations to optimize surgical training considering the current landscape in medical education. METHODS: BRC II was a panel of 67 experts selected on the basis of experience and leadership in surgical education and training. It was organized into subcommittees which met virtually over the course of a year. They developed recommendations, along with the Steering Committee, based on areas of focus and then presented them to the entire BRC II. The Delphi Method was chosen to obtain consensus, defined as>80% agreement amongst the panel. Cronbach alpha was computed to assess the internal consistency of three Delphi rounds. RESULTS: Of 50 recommendations, 31 obtained consensus in the following aspects of surgical training (# consensus recommendation /# proposed): Workforce (1/5), Medical Student Education (3/8), Work Life Integration (4/6), Resident Education (5/7), Goals, Structure and Financing of Training (5/8), Education Support and Faculty Development (5/6), Research Training (7/9), and Educational Technology and Assessment (1/1). The internal consistency was good in Rounds 1 and 2 and acceptable in Round 3. CONCLUSIONS: BRC II used the Delphi approach to identify and recommend 31 priorities for surgical education in 2024. We advise establishing a multidisciplinary surgical educational group to oversee, monitor and facilitate implementation of these recommendations.

Faculty and Resident Perspectives on the Implementation of Entrustable Professional Activities in General Surgery Residency.

OBJECTIVE: This study aimed to identify what best practices facilitate implementation of Entrustable Professional Activities (EPAs) into surgical training programs. DESIGN: This is a mixed methods study utilizing both survey data as well as semi-structured interviews of faculty and residents involved in the American Board of Surgery (ABS) EPA pilot study. SETTING: From 2018 to 2020, the ABS conducted a pilot that introduced five EPAs across 28 general surgery training programs. PARTICIPANTS: All faculty members and residents at the 28 pilot programs were invited to participate in the study. RESULTS: About 117 faculty members and 79 residents responded to the survey. The majority of faculty (81%) and residents (66%) felt that EPAs were useful and were a valuable addition to training. While neither group felt that EPAs were overly time consuming to complete, residents did report difficulty incorporating them into their daily workflow (44%). Semi-structured interviews found that programs that focused on faculty and resident -development and utilized frequent reminders about the importance and necessity of EPAs tended to perform better. CONCLUSIONS: EPA implementation is feasible in general surgery training programs but requires significant effort and engagement from all levels of program personnel. As EPAs are implemented by the ABS nationally a focus on resident and faculty development will be critical to success.

Validity of Entrustable Professional Activities in a National Sample of General Surgery Residency Programs.

BACKGROUND: The American Board of Surgery has endorsed competency-based education as vital to the assessment of surgical training. From 2018 to 2020, a national pilot study was conducted at 28 general surgery programs to evaluate feasibility of implementing entrustable professional activities (EPAs) for 5 common general surgical conditions. ACGME core competency Milestones were also rated for each resident by program clinical competency committees. This study aimed to evaluate the validity of general surgery EPAs compared with Milestones. STUDY DESIGN: Prospectively collected, de-identified EPA Pilot Study data were analyzed. EPAs studied were EPA-1 (gallbladder), EPA-2 (inguinal hernia), EPA-3 (right lower quadrant pain), EPA-4 (trauma), and EPA-5 (consult). Variables abstracted included levels of EPA entrustment (1 to 5) and corresponding ACGME Milestone subcompetency ratings (1 to 5) for the same study cycle. Spearman's correlations were used to evaluate the relationship between summative EPA scores and corresponding Milestone ratings. RESULTS: A total of 493 unique residents received a summative entrustment decision. EPA summative entrustment scores had moderate-to-strong positive correlation with mapped Milestone subcompetencies, with median rho value of 0.703. Among operation-focused EPAs, median rho values were similar between EPA-1 (0.688) and EPA-2 (0.661), but higher for EPA-3 (0.833). EPA-4 showed a strong positive correlation with diagnosis and communication competencies (0.724), whereas EPA-5, mapped to the most Milestone subcompetencies, had the lowest median rho value (0.455). CONCLUSIONS: Moderate-to-strong positive correlation was noted between EPAs and patient care, medical knowledge, and communication Milestones. These findings support the validity of EPAs in general surgery and suggest that EPA assessments can be used to inform Milestone ratings by clinical competency committees.

How Does the Sequence of the American Board of Surgery Examinations Impact Pass/Fail Outcomes?

OBJECTIVE: Historically, the American Board of Surgery required surgeons to pass the qualifying examination (QE) before taking the certifying examination (CE). However, in the 2020-2021 academic year, with mitigating circumstances related to COVID-19, the ABS removed this sequencing requirement to facilitate the certification process for those candidates who were negatively impacted by a QE delivery failure. This decoupling of the traditional order of exam delivery has provided a natural comparator to the traditional route and an analysis of the impact of examination sequencing on candidate performance. METHODS: All candidates who applied for the canceled July 2020 QE were allowed to take the CE before passing the QE. The sample was then reduced to include only first-time candidates to ensure comparable groups for performance outcomes. Logistic regression was used to analyze the relationship between the order of taking the QE and the CE, controlling for other examination performance, international medical graduate status, and gender. RESULTS: Only first-time candidates who took both examinations were compared (n=947). Examination sequence was not a significant predictor of QE pass/fail outcomes, OR=0.54; 95% CI, 0.19-1.61, P =0.26. However, examination sequence was a significant predictor of CE pass/fail outcomes, OR=2.54; 95% CI, 1.46-4.68, P =0.002. CONCLUSIONS: This important study suggests that preparation for the QE increases the probability of passing the CE and provides evidence that knowledge may be foundational for clinical judgment. The ABS will consider these findings for examination sequencing moving forward.

Evaluating Educational Outcomes Using Patient Outcomes of New Surgeons Performing Partial Colectomy Compared to Cholecystectomy.

PURPOSE: Despite ongoing efforts to improve surgical education, surgical residents face gaps in their training. However, it is unknown if differences in the training of surgeons are reflected in the patient outcomes of those surgeons once they enter practice. This study aimed to compare the patient outcomes among new surgeons performing partial colectomy-a common procedure for which training is limited-and cholecystectomy-a common procedure for which training is robust. METHOD: The authors retrospectively analyzed all adult Medicare claims data for patients undergoing inpatient partial colectomy and inpatient cholecystectomy between 2007 and 2018. Generalized additive mixed models were used to investigate the associations between surgeon years in practice and risk-adjusted rates of 30-day serious complications and death for patients undergoing partial colectomy and cholecystectomy. RESULTS: A total of 14,449 surgeons at 4,011 hospitals performed 340,114 partial colectomy and 355,923 cholecystectomy inpatient operations during the study period. Patients undergoing a partial colectomy by a surgeon in their 1st vs 15th year of practice had higher rates of serious complications (5.22% [95% CI, 4.85%-5.60%] vs 4.37% [95% CI, 4.22%-4.52%]; P < .01) and death (3.05% [95% CI, 2.92%-3.17%] vs 2.83% [95% CI, 2.75%-2.91%]; P < .01). Patients undergoing a cholecystectomy by a surgeon in their 1st vs 15th year of practice had similar rates of 30-day serious complications (4.11% vs 3.89%; P = .11) and death (1.71% vs 1.70%; P = .93). CONCLUSIONS: Patients undergoing partial colectomy faced a higher risk of serious complications and death when the operation was performed by a new surgeon compared to an experienced surgeon. Conversely, patient outcomes following cholecystectomy were similar for new and experienced surgeons. More attention to partial colectomy during residency training may benefit patients.

Implementation of Entrustable Professional Activities in General Surgery: Results of a National Pilot Study.

OBJECTIVE: The ongoing complexity of general surgery training has led to an increased focus on ensuring the competence of graduating residents. Entrustable professional activities (EPAs) are units of professional practice that provide an assessment framework to drive competency-based education. The American Board of Surgery convened a group from the American College of Surgeons, Accreditation Council for Graduate Medical Education (ACGME) Surgery Review Committee, and Association of Program Directors in Surgery to develop and implement EPAs in a pilot group of residency programs across the country. The objective of this pilot study was to determine the feasibility and utility of EPAs in general surgery resident training. METHODS: 5 EPAs were chosen based on the most common procedures reported in ACGME case logs and by practicing general surgeons (right lower quadrant pain, biliary disease, inguinal hernia), along with common activities covering additional ACGME milestones (performing a consult, care of a trauma patient). Levels of entrustment assigned (1 to 5) were observation only, direct supervision, indirect supervision, unsupervised, and teaching others. Participating in site recruitment and faculty development occurred from 2017 to 2018. EPA implementation at individual residency programs began on July 1, 2018, and was completed on June 30, 2020. Each site was assigned 2 EPAs to implement and collected EPA microassessments on residents for those EPAs. The site clinical competency committees (CCC) used these microassessments to make summative entrustment decisions. Data submitted to the independent deidentified data repository every 6 months included the number of microassessments collected per resident per EPA and CCC summative entrustment decisions. RESULTS: Twenty-eight sites were selected to participate in the program and represented geographic and size variability, community, and university-based programs. Over the course of the 2-year pilot programs reported on 14 to 180 residents. Overall, 6,272 formative microassessments were collected (range, 0 to 1144 per site). Each resident had between 0 and 184 microassessments. The mean number of microassessments per resident was 5.6 (SD = 13.4) with a median of 1 [interquartile range (IQR) = 6]. There were 1,763 summative entrustment ratings assigned to 497 unique residents. The average number of observations for entrustment was 3.24 (SD 3.61) with a median of 2 (IQR 3). In general, PGY1 residents were entrusted at the level of direct supervision and PGY5 residents were entrusted at unsupervised practice or teaching others. For each EPA other than the consult EPA, the degree of entrustment reported by the CCC increased by resident level. CONCLUSIONS: These data provide evidence that widespread implementation of EPAs across general surgery programs is possible, but variable. They provide meaningful data that graduating chief residents are entrusted by their faculty to perform without supervision for several common general surgical procedures and highlight areas to target for the successful widespread implementation of EPAs.

Association Between American Board of Surgery Initial Certification and Medical Malpractice Payments.

OBJECTIVE: To measure associations between surgeons' examination performance and obtaining American Board of Surgery certification with the likelihood of having medical malpractice payments. BACKGROUND: Further research is needed to establish a broader understanding of the association of board certification and patient and practice outcomes. METHODS: Retrospective analysis using propensity score-matched surgeons who attempted to obtain American Board of Surgery certification. Surgeons who completed residency between 2000 and 2019 (n=910) and attempted to become certified were categorized as certified or failing to obtain certification. In addition, groups were categorized as either passing or failing their first attempt on the qualifying and certifying examinations. Malpractice payment reports were dichotomized for surgeons who either had a payment report or not. RESULTS: The hazard rate (HR) of malpractice payment reports was significantly greater for surgeons who attempted and failed to obtain certification [HR=1.87; 95% confidence interval (CI), 1.28-2.74] than for surgeons who were certified. Moreover, surgeons who failed either the qualifying (HR=1.64; 95% CI, 1.14-2.37) or certifying examination (HR=1.72; 95% CI, 1.14-2.60) had significantly higher malpractice payment HRs than those who passed the examinations on their first attempt. CONCLUSIONS: Failing to obtain board certification was associated with a higher rate of medical malpractice payments. In addition, failing examinations in the certification examination process on the first attempt was also associated with higher rates of medical malpractice payments. This study provides further evidence that board certification is linked to potential indicators for patient outcomes and practice quality.

Outcomes of the Early Specialization Program in Vascular Operation.

BACKGROUND: The Early Specialization Program (ESP) in vascular surgery (VS) began as a "pilot program" in 2003. There is only one published report on ESP outcomes. STUDY DESIGN: The general surgery (GS) and VS programs of all institutions using the ESP were contacted. Data gathered included demographics of ESP enrollees, participants' case logs (CLs), and CLs of participants' residency graduating classmates. National CLs, program and institutional data, and participants' certification status were publicly available. RESULTS: Nine institutions have enrolled 34 participants. Four withdrew, and four are in the GS component. Of 26 who have completed ESP, residency CLs were available for 20. Participants' percentile rankings among national contemporaries were lower than 13th for surgeon-junior cases (SJCs), higher than 73rd for surgeon-chief cases (SCCs), and 49th for total major cases (TMCs). They were lower than the 40th percentile in all domains except operative trauma (52; SD 23.8) and vascular (84.7; SD 22.1). As a percentage of the mean (% mean) for their own graduating classes, participants performed 91.8% (SD 16.5) as many SJCs, 143.7% (SD 45.1) as many SCCs, and 105% (SD 11.4) as many TMCs. Participants performed more than 79 % mean in every domain, including 213.4% (SD 82.4) as many vascular cases. As fellows, they ranked higher than the 50th percentile nationally in all but two categories. Twenty-four of 26 certified in GS. GS certification has lapsed for 5, 17 remain initially certified, and 2 have re-certified. All have current VS certification. CONCLUSION: Although infrequently employed, ESP remains an effective option for those who seek both GS and VS certification.

Delivering Better Solutions for Women Physicians Who Experience Pregnancy, Childbirth, and Childrearing.

As the number of women physicians entering the field of medicine has increased over the past decades, pregnancy and maternity leave are becoming common place during both training and independent practice. However, the current system is not designed for extended leaves of absence from the clinical environment. In this commentary, the authors review recent changes in regulatory requirements impacting women physicians in postgraduate training who experience pregnancy, childbirth, and childrearing and identify solutions that may result in more optimal work environments for women physicians in practice who experience pregnancy, childbirth, and childrearing.

What They Are Not Telling Us: Analysis of Nonresponders on a National Survey of Resident Well-Being.

To characterize nonrespondents to a national survey about trainee well-being, examine response patterns to questions of sensitive nature, and assess how nonresponse biases prevalence estimates of mistreatment and well-being. Background: Surgical trainees are at risk for burnout and mistreatment, which are discernible only by self-report. Therefore, prevalence estimates may be biased by nonresponse. Methods: A survey was administered with the 2018 and 2019 American Board of Surgery In-Training Examinations assessing demographics, dissatisfaction with education and career, mistreatment, burnout, thoughts of attrition, and suicidality. Responders in 2019 were characterized as survey "Completers," "Discontinuers" (quit before the end), and "Selective Responders" (selectively answered questions throughout). Multivariable logistic regression assessed associations of respondent type with mistreatment and well-being outcomes, adjusting for individual and program characteristics. Longitudinal survey identifiers linked survey responses for eligible trainees between 2018 and 2019 surveys to further inform nonresponse patterns. Results: In 2019, 6956 (85.6%) of 8129 eligible trainees initiated the survey, with 66.5% Completers, 17.5% Discontinuers, and 16.0% Selective Responders. Items with the highest response rates included dissatisfaction with education and career (93.2%), burnout (86.3%), thoughts of attrition (90.8%), and suicidality (94.4%). Discontinuers and Selective Responders were more often junior residents and racially/ethnically minoritized than Completers. No differences were seen in burnout and suicidality rates between Discontinuers, Selective Responders, and Completers. Non-White or Hispanic residents were more likely to skip questions about racial/ethnic discrimination than non-Hispanic White residents (21.2% vs 15.8%; odds ratio [OR], 1.35; 95% confidence interval [CI], 1.19-1.53), particularly when asked to identify the source. Women were not more likely to omit questions regarding gender/gender identity/sexual orientation discrimination (OR, 0.91; 95% CI, 0.79-1.04) or its sources (OR, 1.02; 95% CI, 0.89-1.16). Both Discontinuers and Selective Responders more frequently reported physical abuse (2.5% vs 1.1%; P = 0.001) and racial discrimination (18.3% vs 13.6%; P < 0.001) on the previous survey (2018) than Completers. Conclusions: Overall response rates are high for this survey. Prevalence estimates of burnout, suicidality, and gender discrimination are likely minimally impacted by nonresponse. Nonresponse to survey items about racial/ethnic discrimination by racially/ethnically minoritized residents likely results in underestimation of this type of mistreatment.

Experiences of LGBTQ+ Residents in US General Surgery Training Programs.

Importance: Previous studies have shown high rates of mistreatment among US general surgery residents, leading to poor well-being. Lesbian, gay, bisexual, transgender, queer, and other sexual and gender minority (LGBTQ+) residents represent a high-risk group for mistreatment; however, their experience in general surgery programs is largely unexplored. Objective: To determine the national prevalence of mistreatment and poor well-being for LGBTQ+ surgery residents compared with their non-LGBTQ+ peers. Design, Setting, and Participants: A voluntary, anonymous survey adapting validated survey instruments was administered to all clinically active general surgery residents training in Accreditation Council for Graduate Medical Education-accredited general surgery programs following the 2019 American Board of Surgery In-Training Examination. Main Outcomes and Measures: Self-reported mistreatment, sources of mistreatment, perceptions of learning environment, career satisfaction, burnout, thoughts of attrition, and suicidality. The associations between LGBTQ+ status and (1) mistreatment, (2) burnout, (3) thoughts of attrition, and (4) suicidality were examined using multivariable regression models, accounting for interactions between gender and LGBTQ+ identity. Results: A total of 6956 clinically active residents completed the survey (85.6% response rate). Of 6381 respondents included in this analysis, 305 respondents (4.8%) identified as LGBTQ+ and 6076 (95.2%) as non-LGBTQ+. Discrimination was reported among 161 LGBTQ+ respondents (59.2%) vs 2187 non-LGBTQ+ respondents (42.3%; P < .001); sexual harassment, 131 (47.5%) vs 1551 (29.3%; P < .001); and bullying, 220 (74.8%) vs 3730 (66.9%; P = .005); attending surgeons were the most common overall source. Compared with non-LGBTQ+ men, LGBTQ+ residents were more likely to report discrimination (men: odds ratio [OR], 2.57; 95% CI, 1.78-3.72; women: OR, 25.30; 95% CI, 16.51-38.79), sexual harassment (men: OR, 2.04; 95% CI, 1.39-2.99; women: OR, 5.72; 95% CI, 4.09-8.01), and bullying (men: OR, 1.51; 95% CI, 1.07-2.12; women: OR, 2.00; 95% CI, 1.37-2.91). LGBTQ+ residents reported similar perceptions of the learning environment, career satisfaction, and burnout (OR, 1.22; 95% CI, 0.97-1.52) but had more frequent considerations of leaving their program (OR, 2.04; 95% CI, 1.52-2.74) and suicide (OR, 1.95; 95% CI, 1.26-3.04). This increased risk of suicidality was eliminated after adjusting for mistreatment (OR, 1.47; 95% CI, 0.90-2.39). Conclusions and Relevance: Mistreatment is a common experience for LGBTQ+ surgery residents, with attending surgeons being the most common overall source. Increased suicidality among LGBTQ+ surgery residents is associated with this mistreatment. Multifaceted interventions are necessary to develop safer and more inclusive learning environments.

Experiences of Gender Discrimination and Sexual Harassment Among Residents in General Surgery Programs Across the US.

Importance: Mistreatment is a common experience among surgical residents and is associated with burnout. Women have been found to experience mistreatment at higher rates than men. Further characterization of surgical residents' experiences with gender discrimination and sexual harassment may inform solutions. Objective: To describe the types, sources, and factors associated with (1) discrimination based on gender, gender identity, or sexual orientation and (2) sexual harassment experienced by residents in general surgery programs across the US. Design, Setting, and Participants: This cross-sectional national survey study was conducted after the 2019 American Board of Surgery In-Training Examination (ABSITE). The survey asked respondents about their experiences with gender discrimination and sexual harassment during the academic year starting July 1, 2018, through the testing date in January 2019. All clinical residents enrolled in general surgery programs accredited by the Accreditation Council for Graduate Medical Education were eligible. Exposures: Specific types, sources, and factors associated with gender-based discrimination and sexual harassment. Main Outcomes and Measures: Primary outcome was the prevalence of gender discrimination and sexual harassment. Secondary outcomes included sources of discrimination and harassment and associated individual- and program-level factors using gender-stratified multivariable logistic regression models. Results: The survey was administered to 8129 eligible residents; 6956 responded (85.6% response rate)from 301 general surgery programs. Of those, 6764 residents had gender data available (3968 [58.7%] were male and 2796 [41.3%] were female individuals). In total, 1878 of 2352 female residents (79.8%) vs 562 of 3288 male residents (17.1%) reported experiencing gender discrimination (P < .001), and 1026 of 2415 female residents (42.5%) vs 721 of 3360 male residents (21.5%) reported experiencing sexual harassment (P < .001). The most common type of gender discrimination was being mistaken for a nonphysician (1943 of 5640 residents [34.5%] overall; 1813 of 2352 female residents [77.1%]; 130 of 3288 male residents [4.0%]), with patients and/or families as the most frequent source. The most common form of sexual harassment was crude, demeaning, or explicit comments (1557 of 5775 residents [27.0%] overall; 901 of 2415 female residents [37.3%]; 656 of 3360 male residents [19.5%]); among female residents, the most common source of this harassment was patients and/or families, and among male residents, the most common source was coresidents and/or fellows. Among female residents, gender discrimination was associated with pregnancy (odds ratio [OR], 1.93; 95% CI, 1.03-3.62) and higher ABSITE scores (highest vs lowest quartile: OR, 1.67; 95% CI, 1.14-2.43); among male residents, gender discrimination was associated with parenthood (OR, 1.72; 95% CI, 1.31-2.27) and lower ABSITE scores (highest vs lowest quartile: OR, 0.57; 95% CI, 0.43-0.76). Senior residents were more likely to report experiencing sexual harassment than interns (postgraduate years 4 and 5 vs postgraduate year 1: OR, 1.77 [95% CI, 1.40-2.24] among female residents; 1.31 [95% CI, 1.01-1.70] among male residents). Conclusions and Relevance: In this study, gender discrimination and sexual harassment were common experiences among surgical residents and were frequently reported by women. These phenomena warrant multifaceted context-specific strategies for improvement.

Outcomes of the First Virtual General Surgery Certifying Exam of the American Board of Surgery.

OBJECTIVE: To Study the Outcomes of the First Virtual General Surgery Certifying Exam of the American Board of Surgery. SUMMARY OF BACKGROUND DATA: The ABS General Surgery CE is normally an in-person oral examination. Due to the COVID-19 outbreak, the ABS was required to reschedule these. After 2 small pilots, the CE's October administration represented the first large-scale remote virtual exam. The purpose of this report is to compare the outcomes of this virtual and the previous in-person CEs. METHODS: CE candidates were asked to provide feedback on their experience via a survey. The passing rate was compared to the 1025 candidates who took the 2019-2020 in-person CEs. RESULTS: Of the 308 candidates who registered for the virtual CE, 306 completed the exam (99.4%) and 188 completed the survey (61.4%). The majority had a very positive experience. They rated the virtual CE as very good/excellent in security (90%), ease of exam platform (77%), audio quality (71%), video quality (69%), and overall satisfaction (86%). Notably, when asked their preference, 78% preferred the virtual exam. There were no differences in the passing rates between the virtual or in-person exams. CONCLUSIONS: The first virtual CE by the ABS was completed using available internet technology. There was high satisfaction, with the majority preferring the virtual platform. Compared to past in-person CEs, there was no difference in outcomes as measured by passing rates. These data suggest that expansion of the virtual CE may be desirable.

A Phased Approach: The General Surgery Experience Adopting Entrustable Professional Activities in the United States.

Entrustable professional activities (EPAs) have been increasingly used as an assessment framework to formally capture the myriad ad hoc entrustment decisions that occur on a daily basis in clinical settings with learners present. Following the definition of Core EPAs for Entering Residency by the Association of American Medical Colleges in 2014, the American Board of Surgery (ABS) began to explore the utility of EPAs as a framework to support competency-based resident education within general surgery in 2016. As the complement of EPAs drafted for a specialty serve to define the core tasks of a professional within that discipline, initial efforts to define the entire scope of general surgery were fraught with difficulty as no commonly accepted definition of a general surgeon currently exists. Opting to prioritize a pilot of the EPA conceptual framework within surgical training rather than defining the entirety of the specialty, ABS leaders identified 5 EPAs that represent a core of general surgery with which to begin. This article details the process of choosing the initial set of EPAs and provides a roadmap for other disciplines interested in testing the feasibility of this assessment framework while garnering buy-in among the community of educators. Future steps, including implementation of the existing 5 EPAs beyond the initial pilot sites and drafting and implementation of the additional complement of EPAs, are also described.