American Board of Emergency Medicine Report on Residency and Fellowship Training Information (2023-2024).

The American Board of Emergency Medicine gathers extensive background information on Accreditation Council of Graduate Medical Education-accredited emergency medicine residency and fellowship programs as well as the residents and fellows training in those programs. We present the 2024 annual report on the status of physicians training in ACGME-accredited emergency medicine training programs in the United States.

Prospective validity evidence for the abbreviated emergency medicine Copenhagen Burnout Inventory.

BACKGROUND: Prior research has provided retrospective validity evidence for an abbreviated Copenhagen Burnout Inventory (CBI) to measure burnout among emergency medicine (EM) residents. We sought to provide additional validity and reliability evidence for the two-factor, six-item abbreviated CBI. METHODS: This cross-sectional study used data from the abbreviated CBI that was administered following the 2022 American Board of Emergency Medicine In-training Examination. Confirmatory factor analysis (CFA) was performed and the prevalence of burnout among EM residents was determined. RESULTS: Of the 8918 eligible residents, 7465 (83.7%) completed the abbreviated CBI. CFA confirmed the previously developed model of two factors using six items answered with a 1- to 5-point Likert scale. The internal factor was derived from personal and work-related burnout and the external factor was related to caring for patients. The reliability was determined using Cronbach's alpha (0.87). The overall prevalence of burnout was 49.4%; the lowest prevalence was at the EM1 level (43.1%) and the highest was at the EM2 level (53.8%). CONCLUSIONS: CFA of the abbreviated CBI demonstrated good reliability and model fit. The two-factor, six-item survey instrument identified an increase in the prevalence of burnout among EM residents that coincided with working in the COVID-19 environment. The abbreviated CBI has sufficient reliability and validity evidence to encourage its broader use.

Association between the American Board of Emergency Medicine Oral Certifying Examination and Future State Medical Board Disciplinary Actions.

Objectives: The American Board of Emergency Medicine (ABEM) requires a written examination (the Qualifying Examination) followed by the Oral Certifying Examination (OCE) to obtain ABEM certification. Maintaining ABEM certification is associated with fewer state medical board (SMB) disciplinary actions. We sought to determine the association between poor initial performance on the OCE and subsequent severe SMB disciplinary action. Methods: We included physicians who completed US categorical emergency medicine residencies in 2016 and earlier. We classified OCE performance as good (passed on first attempt) and poor (never passed or required > 1 attempt to pass). We obtained data on physician SMB disciplinary actions from the National Practitioner Data Bank that were limited to actions that denied licensure or altered the status of a medical license (eg, suspension). We determined the association between poor OCE performance and subsequent severe SMB disciplinary action. Results: Of 34,871, 93.5% passed the OCE on the first attempt, 6.1% required multiple attempts, and 0.3% never passed. Of the physicians (93.5%) with good OCE performance, 1.0% received a severe SMB action. Among physicians with poor OCE performance, 2.3% received a severe action; and of those who never passed, 1.7% received a severe action (Table 1). Poor OCE performance was associated with an increased odds of severe SMB disciplinary action (OR 2.21, 95% CI: 1.57-3.12). Conclusion: Physicians with poor OCE performance exhibited higher odds of experiencing a subsequent severe SMB disciplinary action. The OCE may have utility as a predictor of future professionalism or clinical performance.

American Board of Emergency Medicine Report on Residency and Fellowship Training Information (2022-2023).

The American Board of Emergency Medicine gathers extensive background information on the Accreditation Council of Graduate Medical Education-accredited emergency medicine residency and fellowship programs and the residents and fellows training in those programs. We present the 2023 annual report on the status of physicians training in ACGME-accredited emergency medicine training programs in the United States.

Reliability and validity support for an abbreviated Copenhagen burnout inventory using exploratory and confirmatory factor analysis.

Objective: The Copenhagen Burnout Inventory (CBI) is an open-access, valid, and reliable instrument measuring burnout that includes 19 items distributed across the following 3 domains (factors): personal burnout, work burnout, and patient burnout. The primary objective of this study was to determine the validity and reliability of an abbreviated CBI to assess burnout in emergency medicine residents. Methods: This cross-sectional study used data from the CBI that followed the 2021 American Board of Emergency Medicine In-training Examination. Exploratory factor analysis (EFA) was followed by confirmatory factor analysis (CFA). Results: Of the 8491 eligible residents, 7225 (85.1%) completed the survey; the EFA cohort included 3613 residents and the CFA cohort included 3612 residents. EFA showed 2 eigenvalues ≥1, an internal factor and an external factor. There were 6 CBI items that contributed to the 2 factors. The first factor was related to personal burnout and work-related burnout and the second factor was related to working with patients. There were 4 CBI items that contributed to the internal factor and 2 CBI items that contributed to the external factor. Using the abbreviated CBI, the incidence of a resident having 1 or both types of burnout was 34.1%. Conclusions: This study provides validity evidence and reliability support for the use of a 6-item, 2-factor abbreviated CBI. A shorter, reliable, valid, and publicly accessible burnout inventory provides numerous advantages for burnout research in emergency medicine.

Emergency Medicine Residency Does Not Reduce a Racial Minority-Based Test Performance Gap.

BACKGROUND: Health care inequity is corrected more readily when safe, high-quality care is provided by physicians who reflect the gender, race, and ethnicity of patient communities. It is important to train and evaluate racially diverse physicians involved in residency training. OBJECTIVE: This study sought to determine any test-taking differences for black Emergency Medicine (EM) residents and whether any such differences would narrow as residency progressed. METHODS: This was an observational, cross-sectional study that reviewed performance (scaled scores) on the American Board of Emergency Medicine (ABEM) In-Training Examination (ITE) for 2018, 2019, and 2020. The study included EM residents in 3-year programs who took the ITE. A linear regression model was used for the variables of race, which included black physicians and white physicians (reference group), and level of training (EM resident year 1 [EM1] as the reference group). RESULTS: There were 9591 residents included; 539 were black and 9052 were white. Mean scaled scores were higher as a function of training level. Regression showed a scaled score intercept of 73.51. The ITE score increased for all groups as a function of training level (EM2 ß = +5.45, p < 0.0001; EM3 ß = +8.09, p < 0.0001). The regression coefficient for black residents was -5.87 (p < 0.0001). There was relative improvement by training level compared with improvement in the reference group, but this difference was not materially or statistically significant. CONCLUSION: In this study of the ABEM ITE, a test-taking performance gap identified early in residency for black physicians persisted into late residency.

American Board of Emergency Medicine Report on Residency and Fellowship Training Information (2021-2022).

The American Board of Emergency Medicine gathers extensive background information on the Accreditation Council of Graduate Medical Education-accredited emergency medicine residency and fellowship programs, as well as the residents and fellows training in those programs. We present the 2022 annual report on the status of physicians training in Accreditation Council of Graduate Medical Education-accredited emergency medicine training programs in the United States.

American Board of Emergency Medicine Report on Residency and Fellowship Training Information (2019-2020).

The American Board of Emergency Medicine gathers extensive background information on Accreditation Council for Graduate Medical Education (ACGME)-accredited emergency medicine residency and fellowship programs, as well as the residents and fellows training in those programs. We present the 2020 annual report on the status of physicians training in ACGME-accredited emergency medicine training programs in the United States.

American Board of Emergency Medicine Report on Residency and Fellowship Training Information (2018-2019).

The American Board of Emergency Medicine (ABEM) gathers extensive background information on emergency medicine-sponsored residency and fellowship programs, residents and fellows training in those programs, and all fellows for whom ABEM issues subspecialty certifications. We present the 2019 annual report on the status of US emergency medicine training programs.

Well-Being among Emergency Medicine Resident Physicians: Results from the ABEM Longitudinal Study of Emergency Medicine Residents.

BACKGROUND: The Longitudinal Study of Emergency Medicine Residents (LSEMR) conducted by the American Board of Emergency Medicine queries a randomized cohort of emergency medicine (EM) residents. It is designed to identify residents' perceptions of their training, sources of stress, well-being level, and career choice satisfaction over time. OBJECTIVES: This study utilizes LSEMR to identify resident well-being levels, career satisfaction, factors producing stress, and whether a specific cohort is more stressed than the overall respondent group. METHODS: Data from five longitudinal cohorts were analyzed using descriptive statistics to assess stressors, career satisfaction, and self-reported resident well-being. Participants' answers were reported on a 5-point Likert scale. RESULTS: There were 766 residents who completed the survey in five cohorts. Respondents were 30 years old (median 29), male (66%), and predominantly White (79%). The most frequently encountered problems included "time devoted to documentation and bureaucratic issues," "knowing enough," and "crowding in the emergency department." In contrast, the least frequently reported problems included "gender discrimination," "EMS support," "minority discrimination," and "other residents." Respondents thought being an EM resident was fun and would select EM again. Less than 20% indicated they had seriously considered transferring to another EM program. Resident reports of health concerns changed over time, with fewer residents reporting they were exceptionally healthy in 2016. CONCLUSIONS: Residents are, overall, happy with their career choice. However, concern was expressed regarding continued well-being in training. Sources of stress in training are identified. Strategies should be developed to decrease identified stressors and increase well-being among EM residents.

Physician Age and Performance on the American Board of Emergency Medicine ConCert Examination.

OBJECTIVE: This study was undertaken to expand on results from a 2014 study on the association between physician age and performance on the American Board of Emergency Medicine (ABEM) ConCert examination. METHODS: This was a retrospective, longitudinal growth study comparing performance on the ConCert examination and physicians' ages at the time of examination. All examination attempts from 1990 to 2016 made by residency-trained physicians were eligible for inclusion. Multilevel growth models were constructed to examine the relationship between age at time of examination and performance, controlling for physician characteristics. RESULTS: The study group included 15,533 examination attempts by 12,786 physicians. The mean (±SD) age of the physicians across all examination administrations was 45.02 (±5.18) years (range = 35 to 72 years). The mean (±SD) ConCert examination score across all administrations was 85.39 (±5.71; range = 51 to 100). Among first-time ConCert examination takers, older age was associated with lower examination scores (r = -0.25, p < 0.0001). Across all examination attempts, age was negatively correlated to examination scores (r = -0.24; p < 0.0001). CONCLUSIONS: After physician characteristics were controlled for, there was an association between advancing age and declining performance on the ABEM ConCert examination. This information may be important to the individual physician to develop targeted competency assessment and professional development.

American Board of Emergency Medicine Report on Residency and Fellowship Training Information (2017-2018).

The American Board of Emergency Medicine (ABEM) gathers extensive background information on emergency medicine-sponsored residency and fellowship programs, as well as the residents and fellows training in those programs. We present the 2018 annual report on the status of US emergency medicine training programs.

Evaluating Validity Evidence for USMLE Step 2 Clinical Skills Data Gathering and Data Interpretation Scores: Does Performance Predict History-Taking and Physical Examination Ratings for First-Year Internal Medicine Residents?

PURPOSE: To add to the small body of validity research addressing whether scores from performance assessments of clinical skills are related to performance in supervised patient settings, the authors examined relationships between United States Medical Licensing Examination (USMLE) Step 2 Clinical Skills (CS) data gathering and data interpretation scores and subsequent performance in history taking and physical examination in internal medicine residency training. METHOD: The sample included 6,306 examinees from 238 internal medicine residency programs who completed Step 2 CS for the first time in 2005 and whose performance ratings from their first year of residency training were available. Hierarchical linear modeling techniques were used to examine the relationships among Step 2 CS data gathering and data interpretation scores and history-taking and physical examination ratings. RESULTS: Step 2 CS data interpretation scores were positively related to both history-taking and physical examination ratings. Step 2 CS data gathering scores were not related to either history-taking or physical examination ratings after other USMLE scores were taken into account. CONCLUSIONS: Step 2 CS data interpretation scores provide useful information for predicting subsequent performance in history taking and physical examination in supervised practice and thus provide validity evidence for their intended use as an indication of readiness to enter supervised practice. The results show that there is less evidence to support the usefulness of Step 2 CS data gathering scores. This study provides important information for practitioners interested in Step 2 CS specifically or in performance assessments of medical students' clinical skills more generally.

Association between imposition of a Maintenance of Certification requirement and ambulatory care-sensitive hospitalizations and health care costs.

IMPORTANCE: In 1990, the American Board of Internal Medicine (ABIM) ended lifelong certification by initiating a 10-year Maintenance of Certification (MOC) program that first took effect in 2000. Despite the importance of this change, there has been limited research examining associations between the MOC requirement and patient outcomes. OBJECTIVE: To measure associations between the original ABIM MOC requirement and outcomes of care. DESIGN, SETTING, AND PARTICIPANTS: Quasi-experimental comparison between outcomes for Medicare beneficiaries treated in 2001 by 2 groups of ABIM-certified internal medicine physicians (general internists). One group (n = 956), initially certified in 1991, was required to fulfill the MOC program in 2001 (MOC-required) and treated 84 215 beneficiaries in the sample; the other group (n = 974), initially certified in 1989, was grandfathered out of the MOC requirement (MOC-grandfathered) and treated 69 830 similar beneficiaries in the sample. We compared differences in outcomes for the beneficiary cohort treated by the MOC-required general internists before (1999-2000) and after (2002-2005) they were required to complete MOC, using the beneficiary cohort treated by the MOC-grandfathered general internists as the control. MAIN OUTCOMES AND MEASURES: Quality measures were ambulatory care-sensitive hospitalizations (ACSHs), measured using prevention quality indicators. Ambulatory care-sensitive hospitalizations are hospitalizations triggered by conditions thought to be potentially preventable through better access to and quality of outpatient care. Other outcomes included health care cost measures (adjusted to 2013 dollars). RESULTS: Annual incidence of ACSHs (per 1000 beneficiaries) increased from the pre-MOC period (37.9 for MOC-required beneficiaries vs 37.0 for MOC-grandfathered beneficiaries) to the post-MOC period (61.8 for MOC-required beneficiaries vs 61.4 for MOC-grandfathered beneficiaries) for both cohorts, as did annual per-beneficiary health care costs (pre-MOC period, $5157 for MOC-required beneficiaries vs $5133 for MOC-grandfathered beneficiaries; post-MOC period, $7633 for MOC-required beneficiaries vs $7793 for MOC-grandfathered beneficiaries). The MOC requirement was not statistically associated with cohort differences in the growth of the annual ACSH rate (per 1000 beneficiaries, 0.1 [95% CI, -1.7 to 1.9]; P = .92), but was associated with a cohort difference in the annual, per-beneficiary cost growth of -$167 (95% CI, -$270.5 to -$63.5; P = .002; 2.5% of overall mean cost). CONCLUSION AND RELEVANCE: Imposition of the MOC requirement was not associated with a difference in the increase in ACSHs but was associated with a small reduction in the growth differences of costs for a cohort of Medicare beneficiaries.

Development of an instrument to evaluate residents' confidence in quality improvement.

BACKGROUND: Practice-based learning and improvement is a core competency that all medical residents must demonstrate. Because confidence is important in translating competence into action, effective quality improvement (QI) curricula should evaluate trainees' knowledge and confidence to perform QI. Past efforts to assess educational outcomes in QI have not adequately evaluated trainees' confidence from a multidimensional perspective. METHODS: Participants--732 internal medicine and family medicine residents from 42 training programs in the United States--completed the 31-item Quality Improvement Confidence Instrument (QICI), which was developed to measure confidence in six QI skill domains based on the Institute for Healthcare Improvement model ofQI. Confirmatory factor analysis was performed to support construct validity. Multivariate analysis of covariance was used to examine associations between residents' QI experience and other characteristics with confidence scores. RESULTS: Confirmatory factor analysis supported the QICI's multidimensional structure. Individual items yielded adequate variability, and reliability estimates for all six domains were high (> 0.86). On average, residents rated their confidence lowest for skills pertaining to choosing a target for improvement (specifically, using methods to evaluate interventions and to identify sources of process errors) and for testing a change in practice using specific tools for data collection and analysis. After controlling for program year and other characteristics, residents with previous QI experience reported significantly greater QI confidence. CONCLUSION: The QICI offers a psychometrically rigorous approach to evaluating residents' confidence levels. It can be used to gauge the appropriateness of a trainee's confidence against actual QI performance.

Practice-based learning can improve osteoporosis care.

OBJECTIVES: To examine physician engagement in practice-based learning using a self-evaluation module to assess and improve their care of individuals with or at risk of osteoporosis. DESIGN: Retrospective cohort study. SETTING: Internal medicine and subspecialty clinics. PARTICIPANTS: Eight hundred fifty U.S. physicians with time-limited certification in general internal medicine or a subspecialty. MEASUREMENTS: Performance rates on 23 process measures and seven practice system domain scores were obtained from the American Board of Internal Medicine (ABIM) Osteoporosis Practice Improvement Module (PIM), an Internet-based self-assessment module that physicians use to improve performance on one targeted measure. Physicians remeasured performance on their targeted measures by conducting another medical chart review. RESULTS: Variability in performance on measures was found, with observed differences between general internists, geriatricians, and rheumatologists. Some practice system elements were modestly associated with measure performance; the largest association was between providing patient-centered self-care support and documentation of calcium intake and vitamin D estimation and counseling (correlation coefficients from 0.20 to 0.28, Ps < .002). For all practice types, the most commonly selected measure targeted for improvement was documentation of vitamin D level (38% of physicians). On average, physicians reported significant and large increases in performance on measures targeted for improvement. CONCLUSION: Gaps exist in the quality of osteoporosis care, and physicians can apply practice-based learning using the ABIM PIM to take action to improve the quality of care.

The relationship between communication scores from the USMLE Step 2 Clinical Skills examination and communication ratings for first-year internal medicine residents.

PURPOSE: This study extends available evidence about the relationship between scores on the Step 2 Clinical Skills (CS) component of the United States Medical Licensing Examination and subsequent performance in residency. It focuses on the relationship between Step 2 CS communication and interpersonal skills scores and communication skills ratings that residency directors assign to residents in their first postgraduate year of internal medicine training. It represents the first large-scale evaluation of the extent to which Step 2 CS communication and interpersonal skills scores can be extrapolated to examinee performance in supervised practice. METHOD: Hierarchical linear modeling techniques were used to examine the relationships among examinee characteristics, residency program characteristics, and residency-director-provided ratings. The sample comprised 6,306 examinees from 238 internal medicine residency programs who completed Step 2 CS for the first time in 2005 and received ratings during their first year of internal medicine residency training. RESULTS: Although the relationship is modest, Step 2 CS communication and interpersonal skills scores predict communication skills ratings for first-year internal medicine residents after accounting for other factors. CONCLUSIONS: The results of this study make a reasonable case that Step 2 CS communication and interpersonal skills scores provide useful information for predicting the level of communication skill that examinees will display in their first year of internal medicine residency training. This finding demonstrates some level of extrapolation from the testing context to behavior in supervised practice, thus providing validity-related evidence for using Step 2 CS communication and interpersonal skills scores in high-stakes decisions.