Trends in Operative Case Logs of Chief Residents in Surgery by Sex and Race: A 5 - Year National Study.

OBJECTIVES: A recent study of 21 institutions noted significant differences between number of cases reported during general surgery residency by trainees who are Underrepresented in Medicine (URiM) versus trainees who are not Underrepresented in Medicine (non-URiM). This study also identified differences between female residents and male residents. We partnered with the Accreditation Council for Graduate Medical Education to examine case logs reported from all accredited general surgery programs in the United States. This is the first time this data has been examined nationally. METHODS: We examined total case logs submitted by graduating residents between 2017 and 2022. Group differences in mean reported case logs were examined using paired t- tests for female versus male and URiM versus non- URiM overall case numbers. RESULTS: A total of 6,458 residents submitted case logs from 319 accredited programs. Eight-hundred and fifty-four (13%) were URiM and 5,604 (87%) were non-URiM. Over the 5-year study period, URM residents submitted 1096.95 (SD +/- 160.57) major cases versus 1115.96 (+/- 160.53) for non-URiM residents (difference =19 cases, P=0.001). Case logs were submitted by 3,833 (60.1%) male residents and 2,625 (39.9%) female residents over the five-year study period. Male residents reported 1128.56 (SD +/- 168.32) cases versus 1091.38 (+/- 145.98) cases reported by females (difference=37.18, P<0.001). When looking at Surgeon Chief and Teaching Assistant cases, there was no significant difference noted between cases submitted by URiM versus non- URiM residents. However, male residents reported significantly more in both categories than their female peers (P<0.001). CONCLUSIONS: Overall, URiM residents submitted fewer cases in the five- year study period than their non-URiM peers. The gap in submitted cases between male and female residents was more pronounced, with male residents submitting significantly more cases than their female counterparts. This finding was consistent and statistically significant throughout the entire study period, in most case categories, and without narrowing of difference over time. A difference of 30-40 cases can amount to 1-3 months of surgical training and is a concerning national trend deserving the attention of every training program and our governing institutions.

Decision-Making Confidence of Clinical Competency Committees for Entrustable Professional Activities.

Importance: A competency-based assessment framework using entrustable professional activities (EPAs) was endorsed by the American Board of Surgery following a 2-year feasibility pilot study. Pilot study programs' clinical competency committees (CCCs) rated residents on EPA entrustment semiannually using this newly developed assessment tool, but factors associated with their decision-making are not yet known. Objective: To identify factors associated with variation in decision-making confidence of CCCs in EPA summative entrustment decisions. Design, Setting, and Participants: This cohort study used deidentified data from the EPA Pilot Study, with participating sites at 28 general surgery residency programs, prospectively collected from July 1, 2018, to June 30, 2020. Data were analyzed from September 27, 2022, to February 15, 2023. Exposure: Microassessments of resident entrustment for pilot EPAs (gallbladder disease, inguinal hernia, right lower quadrant pain, trauma, and consultation) collected within the course of routine clinical care across four 6-month study cycles. Summative entrustment ratings were then determined by program CCCs for each study cycle. Main Outcomes and Measures: The primary outcome was CCC decision-making confidence rating (high, moderate, slight, or no confidence) for summative entrustment decisions, with a secondary outcome of number of EPA microassessments received per summative entrustment decision. Bivariate tests and mixed-effects regression modeling were used to evaluate factors associated with CCC confidence. Results: Among 565 residents receiving at least 1 EPA microassessment, 1765 summative entrustment decisions were reported. Overall, 72.5% (1279 of 1765) of summative entrustment decisions were made with moderate or high confidence. Confidence ratings increased with increasing mean number of EPA microassessments, with 1.7 (95% CI, 1.4-2.0) at no confidence, 1.9 (95% CI, 1.7-2.1) at slight confidence, 2.9 (95% CI, 2.6-3.2) at moderate confidence, and 4.1 (95% CI, 3.8-4.4) at high confidence. Increasing number of EPA microassessments was associated with increased likelihood of higher CCC confidence for all except 1 EPA phase after controlling for program effects (odds ratio range: 1.21 [95% CI, 1.07-1.37] for intraoperative EPA-4 to 2.93 [95% CI, 1.64-5.85] for postoperative EPA-2); for preoperative EPA-3, there was no association. Conclusions and Relevance: In this cohort study, the CCC confidence in EPA summative entrustment decisions increased as the number of EPA microassessments increased, and CCCs endorsed moderate to high confidence in most entrustment decisions. These findings provide early validity evidence for this novel assessment framework and may inform program practices as EPAs are implemented nationally.

Goals, Structure and Financing of Surgical Residency Training: A Subcommittee Report of the Blue Ribbon Committee II.

OBJECTIVE: As part of the Blue Ribbon Committee II, review current goals, structure and financing of surgical training in Graduate Medical Education (GME) and recommend needed changes. SUMMARY BACKGROUND DATA: Surgical training has continually undergone major transitions with the 80-hour work week, earlier specialization (vascular, plastics and cardiovascular) and now entrustable professional activities (EPAs) as part of competency based medical education (CBME). Changes are needed to ensure the efficiencies of CBME are utilized, that stable graduate medical education funding is secured, and that support for surgeons who teach is made available. METHODS: Convened subcommittee discussions to determine needed focus for recommendations. RESULTS: Five recommendations are offered for changes to GME financing, incorporation of CBME, and support for educators, students and residents in training. CONCLUSIONS: Changes in surgical training related to CBME offer opportunity for change and innovation. Our subcommittee has laid out a potential path forward for improvements in GME funding, training structure, compensation of surgical educators, and support of students and residents in training.

Update on Outcomes of a Novel Pathway for Thoracic Surgery Training.

BACKGROUND: The Joint Surgery-Thoracic Surgery (JS-TS) pathway began as a pilot program to grant both general surgery (GS) residency and thoracic surgery (TS) fellowship credit for 12 months of the PGY-4 and 5 years. This review updates the outcomes of this novel program. STUDY DESIGN: GS and TS programs in all approved JS-TS institutions were contacted for data collection, including JS-TS enrollee demographics and GS and TS case logs (CLs). National GS and TS CL data, and program and institutional data were publicly available. Enrollee case numbers were compared with those of their contemporaries. The American Board of Surgery and American Board of Thoracic Surgery provided certification data. Only enrollees who completed GS through 2019 were included. RESULTS: There were 90 JS-TS enrollees in 14 institutions. Two enrollees withdrew and 1 had not completed TS at the time of data collection leaving 87 for analysis. GS CLs were available for all 87 enrollees. TS CLs were available for all 62 enrollees who completed fellowship in 2016 or later. In GS, enrollees recorded fewer cases than their contemporary PGY-5s nationally in all domains except thoracic and endocrine. In TS, mean enrollee case numbers exceeded those of national contemporaries in every major category. Sixty-two JS-TS enrollees have achieved American Board of Surgery certification. Eighty-two enrollees are American Board of Thoracic Surgery certified with 5 currently in the certification process. CONCLUSIONS: The JS-TS pathway has proven a successful alternative route for TS training and could be a blueprint for other specialties considering novel avenues to specialty training.

Validity of Entrustable Professional Activities in a National Sample of General Surgery Residency Programs.

BACKGROUND: The American Board of Surgery has endorsed competency-based education as vital to the assessment of surgical training. From 2018 to 2020, a national pilot study was conducted at 28 general surgery programs to evaluate feasibility of implementing entrustable professional activities (EPAs) for 5 common general surgical conditions. ACGME core competency Milestones were also rated for each resident by program clinical competency committees. This study aimed to evaluate the validity of general surgery EPAs compared with Milestones. STUDY DESIGN: Prospectively collected, de-identified EPA Pilot Study data were analyzed. EPAs studied were EPA-1 (gallbladder), EPA-2 (inguinal hernia), EPA-3 (right lower quadrant pain), EPA-4 (trauma), and EPA-5 (consult). Variables abstracted included levels of EPA entrustment (1 to 5) and corresponding ACGME Milestone subcompetency ratings (1 to 5) for the same study cycle. Spearman's correlations were used to evaluate the relationship between summative EPA scores and corresponding Milestone ratings. RESULTS: A total of 493 unique residents received a summative entrustment decision. EPA summative entrustment scores had moderate-to-strong positive correlation with mapped Milestone subcompetencies, with median rho value of 0.703. Among operation-focused EPAs, median rho values were similar between EPA-1 (0.688) and EPA-2 (0.661), but higher for EPA-3 (0.833). EPA-4 showed a strong positive correlation with diagnosis and communication competencies (0.724), whereas EPA-5, mapped to the most Milestone subcompetencies, had the lowest median rho value (0.455). CONCLUSIONS: Moderate-to-strong positive correlation was noted between EPAs and patient care, medical knowledge, and communication Milestones. These findings support the validity of EPAs in general surgery and suggest that EPA assessments can be used to inform Milestone ratings by clinical competency committees.

National ABSITE Preparation Practices: A Survey of General Surgery Residency Program Directors.

OBJECTIVE: The American Board of Surgery In-Training Examination (ABSITE) was designed as a low-stakes, medical knowledge examination for US general surgery residency programs. However, in practice, this exam has been utilized for higher stakes purposes, such as resident promotion or remediation, and fellowship selection. Several studies have demonstrated the efficacy of ABSITE preparation resources, but best practices for ABSITE preparation and national preparatory habits are currently unknown. The aim of this work was to determine current residency programs' strategies for ABSITE preparation. DESIGN: We distributed an electronic survey to program directors or program coordinators of US general surgery programs asking them to anonymously report program ABSITE educational practices and ABSITE scores. We analyzed the proportion of responses using descriptive statistics and compared the effect of various strategies using the Mann-Whitney testing for nonparametric data. An average ABSITE percentile score was calculated for each residency based on program self-reported scores. SETTING: Association of Program Directors (APDS) Listserv PARTICIPANTS: General surgery residency programs participating at the time of distribution (278). RESULTS: Response rate was 24% (66/278); 41 programs (62.1%) identified as university-affiliated, and 25 (37.9%) were community-based. Median intern class size was 8 (range: 3-14), including preliminary interns. Average ABSITE percentile score was 52.8% (range 36.9%-67.6%). There were no significant differences in ABSITE scores based on affiliation or program size. Educational resources utilized for ABSITE preparation included SCORE (89.3%), Q-banks (50%), and surgical textbooks (25.8%). The majority (56.1%) of programs reported using a year-long curriculum for ABSITE preparation, and 66.6% used a time-limited curriculum completed in the months immediately prior to ABSITE. Most programs reported that ABSITE scores were a low priority (63.6%) or not a priority (13.6%). The existence of a year-long curriculum for ABSITE was positively correlated with score as compared to programs without a year-long curricula (53.9% vs 48.5%, p <0.01). Programs using a time-limited curriculum demonstrated lower scores as compared to programs without time-limited curricula (51.3% v 56.1%, p < 0.01). CONCLUSION: General surgery programs use a variety of strategies to prepare residents for the ABSITE. Despite reporting that they utilize ABSITE scores for a variety of high stakes purposes including evaluation for promotion and as a predictor of the preparedness for the ABS QE, many programs reported that they consider ABSITE scores as a low priority. A year-long focused curriculum was the only strategy correlated with increased scores, which may reflect the value of encouraging consistent studying and spaced repetition. Additional work is needed to guide programs in optimal utilization of ABSITE scores for remediation and resident evaluation, as well as understanding how ABSITE preparatory strategies correlate with clinical performance.

Implementation of Entrustable Professional Activities in General Surgery: Results of a National Pilot Study.

OBJECTIVE: The ongoing complexity of general surgery training has led to an increased focus on ensuring the competence of graduating residents. Entrustable professional activities (EPAs) are units of professional practice that provide an assessment framework to drive competency-based education. The American Board of Surgery convened a group from the American College of Surgeons, Accreditation Council for Graduate Medical Education (ACGME) Surgery Review Committee, and Association of Program Directors in Surgery to develop and implement EPAs in a pilot group of residency programs across the country. The objective of this pilot study was to determine the feasibility and utility of EPAs in general surgery resident training. METHODS: 5 EPAs were chosen based on the most common procedures reported in ACGME case logs and by practicing general surgeons (right lower quadrant pain, biliary disease, inguinal hernia), along with common activities covering additional ACGME milestones (performing a consult, care of a trauma patient). Levels of entrustment assigned (1 to 5) were observation only, direct supervision, indirect supervision, unsupervised, and teaching others. Participating in site recruitment and faculty development occurred from 2017 to 2018. EPA implementation at individual residency programs began on July 1, 2018, and was completed on June 30, 2020. Each site was assigned 2 EPAs to implement and collected EPA microassessments on residents for those EPAs. The site clinical competency committees (CCC) used these microassessments to make summative entrustment decisions. Data submitted to the independent deidentified data repository every 6 months included the number of microassessments collected per resident per EPA and CCC summative entrustment decisions. RESULTS: Twenty-eight sites were selected to participate in the program and represented geographic and size variability, community, and university-based programs. Over the course of the 2-year pilot programs reported on 14 to 180 residents. Overall, 6,272 formative microassessments were collected (range, 0 to 1144 per site). Each resident had between 0 and 184 microassessments. The mean number of microassessments per resident was 5.6 (SD = 13.4) with a median of 1 [interquartile range (IQR) = 6]. There were 1,763 summative entrustment ratings assigned to 497 unique residents. The average number of observations for entrustment was 3.24 (SD 3.61) with a median of 2 (IQR 3). In general, PGY1 residents were entrusted at the level of direct supervision and PGY5 residents were entrusted at unsupervised practice or teaching others. For each EPA other than the consult EPA, the degree of entrustment reported by the CCC increased by resident level. CONCLUSIONS: These data provide evidence that widespread implementation of EPAs across general surgery programs is possible, but variable. They provide meaningful data that graduating chief residents are entrusted by their faculty to perform without supervision for several common general surgical procedures and highlight areas to target for the successful widespread implementation of EPAs.

Outcomes of the Early Specialization Program in Vascular Operation.

BACKGROUND: The Early Specialization Program (ESP) in vascular surgery (VS) began as a "pilot program" in 2003. There is only one published report on ESP outcomes. STUDY DESIGN: The general surgery (GS) and VS programs of all institutions using the ESP were contacted. Data gathered included demographics of ESP enrollees, participants' case logs (CLs), and CLs of participants' residency graduating classmates. National CLs, program and institutional data, and participants' certification status were publicly available. RESULTS: Nine institutions have enrolled 34 participants. Four withdrew, and four are in the GS component. Of 26 who have completed ESP, residency CLs were available for 20. Participants' percentile rankings among national contemporaries were lower than 13th for surgeon-junior cases (SJCs), higher than 73rd for surgeon-chief cases (SCCs), and 49th for total major cases (TMCs). They were lower than the 40th percentile in all domains except operative trauma (52; SD 23.8) and vascular (84.7; SD 22.1). As a percentage of the mean (% mean) for their own graduating classes, participants performed 91.8% (SD 16.5) as many SJCs, 143.7% (SD 45.1) as many SCCs, and 105% (SD 11.4) as many TMCs. Participants performed more than 79 % mean in every domain, including 213.4% (SD 82.4) as many vascular cases. As fellows, they ranked higher than the 50th percentile nationally in all but two categories. Twenty-four of 26 certified in GS. GS certification has lapsed for 5, 17 remain initially certified, and 2 have re-certified. All have current VS certification. CONCLUSION: Although infrequently employed, ESP remains an effective option for those who seek both GS and VS certification.

Women Empowering Women: Assessing the American College of Surgeons Women in Surgery Committee Mentorship Program.

BACKGROUND: Mentorship is an important factor for career promotion and professional development. The Women in Surgery Committee developed a mentorship program that matched early career female surgeons to senior female surgeons for 1 year. We hypothesized participation in the program would empower junior surgeons by providing opportunities to network and hone skills necessary to attain their career goals. METHODS: Survey was sent 4 to 6 weeks after program completion. Statements about mentorship and value of the Women in Surgery Committee program were ranked on a 5-point Likert scale ranging from strongly disagree (1) to strongly agree (5). Participants were compared based on frequency of encounters using Student's t-test. RESULTS: A total of 105 pairs were identified; response rate was 60%. Results reported as (mean ± SD). Participants believed mentorship was essential for young surgeons (4.5 ± 1.0), and limiting the program to female surgeons added value (4.4 ± 0.6). When compared with mentees who met less than 4 times in a year, those who met 4 or more times perceived the program as beneficial (4.4 ± 0.82, p < 0.001). Mentees who met 4 or more times in a year benefitted from creating and achieving goals (4.3 ± 0.75, p < 0.001), setting expectations (4.5 ± 0.6, p < 0.001), providing networking opportunities (4.1 ± 1.1, p < 0.05), and developing professional skills (3.9 ± 0.98). CONCLUSION: The Women in Surgery Committee Mentorship Program provides an opportunity for young female surgeons; however, perceived benefit is dependent on mentee engagement.

EQIP's First Year: A Step Closer to Higher Quality in Surgical Education.

OBJECTIVE: To describe the first year of the Educational Quality Improvement Program (EQIP) DESIGN: The Educational Quality Improvement Program (EQIP) was formed by the Association of Program Directors in Surgery (APDS) in 2018 as a continuous educational quality improvement program. Over 18 months, thirteen discrete goals for the establishment of EQIP were refined and executed through a collaborative effort involving leaders in surgical education. Alpha and beta pilots were conducted to refine the data queries and collection processes. A highly-secure, doubly-deidentified database was created for the ingestion of resident and program data. SETTING & PARTICIPANTS: 36 surgical training programs with 1264 trainees and 1500 faculty members were included in the dataset. 51,516 ERAS applications to programs were also included. Uni- and multi-variable analysis was then conducted. RESULTS: EQIP was successfully deployed within the timeline described in 2020. Data from the ACGME, ABS, and ERAS were merged with manually entered data by programs and successfully ingested into the EQIP database. Interactive dashboards have been constructed for use by programs to compare to the national cohort. Risk-adjusted multivariable analysis suggests that increased time in a technical skills lab was associated with increased success on the ABS's Qualifying Examination, alone. Increased time in a technical skills lab and the presence of a formal teaching curriculum were associated with increased success on both the ABS's Qualifying and Certifying Examination. Program type may be of some consequence in predicting success on the Qualifying Examination. CONCLUSIONS: The APDS has proved the concept that a highly secure database for the purpose of continuous risk-adjusted quality improvement in surgical education can be successfully deployed. EQIP will continue to improve and hopes to include an increasing number of programs as the barriers to participation are overcome.

The APDS General Surgery Education Quality Improvement Program (EQIP).

BACKGROUND: Although the ACGME has called for outcomes-based evaluation of residency programs, few metrics or benchmarks exist connecting educational processes with resident educational outcomes. To address this deficiency, a national Education Quality Improvement Program (EQIP) for General Surgery training is proposed. METHODS: We describe the initial efforts to create this platform. In addition, a national survey was administered to 330 Program Directors to assess their interest in and concerns about a continuous educational quality improvement project. RESULTS: We demonstrate that through a collaborative process and the support of the Association of Program Directors in Surgery (APDS), we were able to develop the groundwork for a national surgical educational improvement project, now called EQIP. The survey response rate was 45.8% (152 of 332 programs) representing a mix of university (55.3%), university-affiliated (18.4%), independent (24.3%), and military (2.0%) programs. Most respondents (66.2%) had not previously heard of EQIP. Most respondents (69.7%) believe that educational outcomes can be measured. The majority of respondents indicated they believed EQIP could be successful (57%). Only 2.3% thought EQIP would not be successful. Almost all programs (98.7%) expressed a willingness to participate, although 19.1% did not believe that they had adequate resources to participate. CONCLUSION: The APDS EQIP platform holds promise as a useful and achievable method to obtain educational outcomes data. These data can be used as a basis for continuous surgical educational quality improvement. General Surgery Program Directors have expressed enthusiasm for EQIP and are willing to participate in the program examining outcomes of General Surgery training programs, with an ultimate goal of improving overall residency training.

Innovative Social Media Summit: Providing a Path for Physicians on Social Media.

PROBLEM: Physicians' voices are valued in society and should be present in mainstream social media where they can provide valuable public health messaging and patient education as well as increase opportunities for medical education, mentoring, and collaboration. However, lack of formal education on effective use of social media prevents many physicians from using it. APPROACH: The authors developed a physician-led social media training program to address the need for formal instruction on social media use. The program was presented to medical students, trainees, and faculty at an academic medical institution in August and September 2020. The virtual format included 5 hour-long sessions with presentations by peer experts in social media. Peer physicians with experience using social media presented on a range of topics, including introductions to platforms, how to reach and grow audiences, and use of social media to advance patient education, medical education, and advocacy. OUTCOMES: There were 425 cumulative registrations for the 5 sessions of the Social Media Summit. The number of registrants increased for each session, suggesting that interest increased over time. Qualitative and quantitative participant feedback was collected via a brief, voluntary survey. All of the participants who completed the survey (n = 24) reported they were "very satisfied" (58.3%) or "somewhat satisfied" (41.7%) with the Summit. NEXT STEPS: Physician involvement in social media presents opportunities for public health knowledge, medical education, scientific collaboration, and career advancement. Physicians who have been successful in using social media for these purposes are excellent peer educators and can fill the medical education void in social media training. Future plans include building sustainability of the program, collecting additional quantitative and qualitative feedback to guide improvement, and encouraging reproducibility.

Career Advancement for Surgeon-Educators:Findings from a Modified Delphi Process.

OBJECTIVES: Reward and recognition of surgical education as an academic activity remains a highly variable process between institutions. The goal of this study is to provide expert consensus definition of an academic surgical educator, with focus on criteria for academic promotion. STUDY DESIGN AND SETTING: Following IRB approval, a Web-based modified Delphi process was used to generate prioritized academic promotion criteria for surgical educators. PARTICIPANTS AND SETTING: Participants were recruited nationally from a pool of senior academic surgeons who are members of the Society of University Surgeons and the Society of Surgical Chairs. RESULTS: Following a three-round modified Delphi process, the top domains of educational activity for promotion to associate professor and professor were scholarship, teaching, and administration; mentorship was also a priority category for promotion to professor. The top three activities described for promotion to Associate Professor were active participation in conferences/ departmental educational activities for medical students and residents; educational portfolio demonstrating commitment to activities as an educator; and clinical teaching excellence at their home institution. The three activities most highly scored items for promotion to Professor were mentorship of junior surgical educators; active participation in conferences/ departmental educational activities for medical students and residents; and a record of teaching excellence at the medical student and resident levels. CONCLUSIONS: These findings demonstrate a progression from teacher to scholar to leader across a surgical educator's career, with each level incorporating and building upon the prior activities. Identification of categories and criteria may meaningfully inform best practices to be incorporated into the career development and promotion processes for surgeons on an educator academic pathway.

Evaluating chief resident readiness for the teaching assistant role: The Teaching Evaluation assessment of the chief resident (TEACh-R) instrument.

BACKGROUND: The American Board of Surgery has mandated chief residents complete 25 cases in the teaching assistant (TA) role. We developed a structured instrument, the Teaching Evaluation and Assessment of the Chief Resident (TEACh-R), to determine readiness and provide feedback for residents in this role. METHODS: Senior (PGY3-5) residents were scored on technical and teaching performance by faculty observers using the TEACh-R instrument in the simulation lab. Residents were provided with their TEACh-R scores and surveyed on their experience. RESULTS: Scores in technical (p < 0.01) and teaching (p < 0.01) domains increased with PGY. Higher technical, but not teaching, scores correlated with attending-rated readiness for operative independence (p 0.02). Autonomy mismatch was inversely correlated with teaching competence (p < 0.01). Residents reported satisfaction with TEACh-R feedback and desire for use of this instrument in operating room settings. CONCLUSION: Our TEACh-R instrument is an effective way to assess technical and teaching performance in the TA role.

Trainee Utilization of the SCORE Curriculum is Associated With Improved ABSITE Performance: A Multi-institutional Study.

BACKGROUND: The Surgical Council on Resident Education's (SCORE) structured educational curriculum for general surgery residents uses a 2-year repeating cycle of modules and quizzes called "This Week in SCORE" (TWIS) to organize and sequence the curricular content on the SCORE portal. The purpose of this study was to evaluate the impact of using the SCORE content and TWIS curriculum on American Board of Surgery In-Training Examination (ABSITE) performance. To date, no multi-institutional studies have examined this effect. METHODS: Eight residency programs participated, including university and community-based programs. SCORE usage overall, TWIS usage, and ABSITE percentile scores (adjusted for post-graduate year [PGY]) were analyzed for the academic years 2017 to 2020. SCORE usage was defined as number of SCORE logins annually per resident with "low usage" ≤10 times and "high usage" >10 times. TWIS usage was defined as "low usage" (no TWIS quizzes done) or "high usage" (≥1 TWIS quiz per year). RESULTS: Four hundred and twenty-eight trainees were evaluated. Trainees with high SCORE and TWIS usage consistently achieved a higher ABSITE percentile score. This difference was maintained in subgroup analysis by PGY with the greatest impact in PGY-1 and PGY-2 levels. CONCLUSIONS: Utilization of multiple aspects of SCORE content appears to have a significant positive impact on ABSITE performance across all levels of postgraduate training. This multi-institutional study of a large number of users is the first to demonstrate that increased usage of SCORE content appears to be a predictor of ABSITE performance success.