Identifying and Addressing Item Bias in the General Pediatrics Certifying Examination.

This article describes a 2-phase process implemented by the American Board of Pediatrics in 2021 to investigate and remove potential bias on its General Pediatrics Certifying Examination at the item (question) level based on gender or race and ethnicity. Phase 1 used a statistical technique known as differential item functioning (DIF) analysis to identify items in which 1 subgroup of the population outperformed another subgroup after controlling for overall knowledge level. Phase 2 involved a review of items flagged for statistical DIF by the American Board of Pediatrics' Bias and Sensitivity Review (BSR) panel, a diverse group of 12 voluntary subject matter experts tasked with identifying language or other characteristics of those items that may have contributed to the observed performance differences. Results indicated that no items on the 2021 examination were flagged for DIF by gender and 2.8% of the items were flagged for DIF by race and ethnicity. Of those items flagged for race and ethnicity, 14.3% (0.4% of total items administered) were judged by the BSR panel to contain biased language that may have undermined what the item was intending to measure and were therefore recommended to be removed from operational scoring. In addition to removing potentially biased items from the current pool of items, we hope that repeating the DIF/BSR process after each examination cycle will increase our understanding of how language nuances and other characteristics impact item performance so that we can improve our guidelines for developing future items.

Voluntarily Postponing Testing Is Associated with Lower Performance on the Pediatric Board Certifying Examinations.

OBJECTIVE: To investigate whether postponing certification testing, either voluntarily or involuntarily, affects a candidate's performance on pediatric certifying examinations. STUDY DESIGN: Both general pediatrics (GP) and pediatric subspecialty (PS) examination candidates were included in the study. Candidates were classified into 3 groups based on time since the completion of training: no delay (<12 months), short delay (12-24 months), and long delay (≥24 months). Examination scores and pass rates in the first GP and PS certifying examinations were compared to assess between-group differences. RESULTS: Significant differences in scores and pass rates were found for GP candidates who voluntarily waited 1 year or longer to take the certifying examination. Similarly, PS candidates who opted not to take the first examination available had significantly lower scores and pass rates. However, no significant difference was found for PS candidates who had to wait to take their examination owing to the Board's offered examination schedule. CONCLUSION: Candidates who postpone taking the certifying examination are less likely to pass the examination. The longer a candidate elects to wait to take the examination, the less likely he or she is to pass. The availability of the PS examinations once every 2 years does not affect pass rates and scores, as long as PS candidates take the first available examinations after completing fellowship.

Jobs and Career Plans of New Pediatric Subspecialists.

OBJECTIVES: The issues of importance in selecting a first job for new pediatric subspecialists, and their ability to find positions that match their professional and clinical goals, are unknown. The objectives were to (1) describe current employment patterns, practice characteristics, factors influencing choice of first position, and future work goals of new pediatric subspecialists; and (2) examine the relationship of these variables with the actual professional time allocation and clinical responsibilities compared with the desired first job. METHODS: The authors surveyed 3010 individuals sitting for ≥1 of the 14 subspecialty certification exams. The main outcomes were (1) most important factors in choosing employment; (2) ability to gain employment in positions that matched their goals; and (3) variation in employment characteristics among men versus women, time since completion of training, and part-time versus full-time status. RESULTS: Response rate was 97%. Lifestyle/spousal or family considerations was the factor identified as most important in the choice of first position after fellowship training for half of respondents (50%; n = 1277). There was a median of 75% of actual time spent in direct and/or consultative inpatient or outpatient care, with 5% in medical education, 5% in administration, and 5% in research. A majority (74%; n = 1825) reported this proportion to be approximately what they wanted. Most respondents (89%; n = 2194) reported that their allocation of patient care responsibilities (ie, inpatient versus outpatient) was approximately what they wanted. CONCLUSION: A large majority of pediatric subspecialists found initial positions matching their goals for professional responsibilities and clinical care.

Long-term Plans for Those Selecting Hospital Medicine as an Initial Career Choice.

BACKGROUND: The proportion of the newly graduated pediatric workforce that becomes hospitalists has been increasing slightly over the past decade. However, it is unknown what proportion of those who accept hospitalist positions as their first job intend to remain in the field longer term. This is important to workforce projections regarding the magnitude of those who will function in this role. METHODS: The American Board of Pediatrics incorporated a structured questionnaire within the online application process to the General Pediatrics certification application. Respondents identified as residents or chief residents who selected "hospitalist position" as their immediate postresidency plan were the focus this study. We compared survey responses by gender and location of the medical school attended. RESULTS: Since the initiation of the general pediatrics certification examination application survey, 6335 completed the questionnaire. 79% (n=5001) were either in residency training or were a chief resident. Of those, 8% (n=376) reported they planned to work as a pediatric hospitalist immediately after completing residency. Fewer than half (43%; n=161) reported this to be their long-term career plan. This finding varied by both medical school type and by gender. CONCLUSIONS: The majority of pediatric residents and chief residents who take hospitalist positions immediately after training do not intend for hospital practice to be the long-term focus of their careers. As the field of hospital medicine continues to develop, understanding career trajectories can help inform current and future efforts regarding the potential for different mechanisms for training and certification.

New pediatricians: first jobs and future workplace goals.

BACKGROUND AND OBJECTIVES: Concern is often expressed about the satisfaction of new physicians and the potential match of their workplace goals with available positions. We studied the interface of desired professional activities with actual initial positions. METHODS: Survey study of all general pediatricians taking the 2012 General Pediatrics Certifying Examination. RESULTS: Of the 5210 who sat for the General Pediatrics Certifying Examination, 5163 (>99%) completed the survey. Of the total respondents, 45% self- identified as general pediatricians (N = 2327). Of those who completed training <2 years ago (N = 1365), most were currently engaged in clinical care (87%; N = 1190). The most important factor, cited most frequently by both men and women, in the choice of their first job was lifestyle and spousal or family considerations. Most (83%; N = 977) reported that the allocation of time for specific duties in their current position was consistent with their goals, with no differences between men and women. Most had no desire for inpatient activity. CONCLUSIONS: Despite concerns about young general pediatricians being able to find positions that meet their career goals, most were in jobs that approximated their desired allocation of professional time and focus of clinical work.

Longitudinal assessment of the timing of career choice among pediatric residents.

OBJECTIVE: To determine the timing of and key factors in resident decision making to pursue either a career in general pediatrics or subspecialty training. DESIGN: We used a 10-item fixed-choice questionnaire that focused on exploring how and when pediatric residents make career choices. SETTING: The survey was administered to all categorical pediatric residents in the United States and Canada as part of the General Pediatrics In-Training Examination in 2007 and 2009. The 2007 level 1 residents and 2009 level 3 residents were matched by a unique person identifier to create a longitudinal data set. PARTICIPANTS: A total of 2305 individuals completed the survey as level 1 residents in 2007 and level 3 residents in 2009, representing a retention rate of 83.5%. MAIN OUTCOME MEASURES: Change in individual and aggregate pediatric resident response over time. RESULTS: A similar number of individuals planned to pursue fellowship training in 2007 and 2009 (1026 vs 1062). Among this group, 745 (72.6%) of the 2009 residents were the same individuals who had indicated that they planned to pursue fellowship training in 2007. A total of 258 (71.9%) of all residents who reported in 2007 that they intended to pursue careers in general pediatrics with little or no inpatient care were still planning to do so in 2009. CONCLUSIONS: Most pediatricians make their decisions regarding pursuit of a career in primary care or to complete a fellowship before they ever enter residency training. It is unknown whether a similar timeline of decision making is consistent across specialties.

The in-training examination: an analysis of its predictive value on performance on the general pediatrics certification examination.

OBJECTIVE: This study investigates the predictive validity of the In-Training Examination (ITE). Although studies have confirmed the predictive validity of ITEs in other medical specialties, no study has been done for general pediatrics. STUDY DESIGN: Each year, residents in accredited pediatric training programs take the ITE as a self-assessment instrument. The ITE is similar to the American Board of Pediatrics General Pediatrics Certifying Examination. First-time takers of the certifying examination over a 5-year period who took at least 1 ITE examination were included in the sample. Regression models analyzed the predictive value of the ITE. RESULTS: The predictive power of the ITE in the first training year is minimal. However, the predictive power of the ITE increases each year, providing the greatest power in the third year of training. CONCLUSIONS: Even though ITE scores provide information regarding the likelihood of passing the certification examination, the data should be used with caution, particularly in the first training year. Other factors also must be considered when predicting performance on the certification examination. This study continues to support the ITE as an assessment tool for program directors, as well as a means of providing residents with feedback regarding their acquisition of pediatric knowledge.

Characteristics of general and subspecialty pediatricians who choose not to recertify.

OBJECTIVE: The goal was to determine the reasons given for nonparticipation in maintenance of certification by general pediatricians and pediatric subspecialists whose board certification had expired. METHODS: All United States-based pediatricians whose board certification had expired and who had not recertified as a generalist or subspecialist in 2004 or 2005 were surveyed. The total sample included 1001 pediatric generalists and 1237 subspecialists. We conducted a mail survey study, with a total of 3 mailings to nonrespondents. Analyses initially were conducted separately for generalists with expired certificates, subspecialists with active subspecialty but expired general pediatrics certificates, and subspecialists with expired subspecialty certificates (regardless of their general pediatrics certification status). RESULTS: The overall response rates were 68% for generalists and 76% for subspecialists. Of pediatricians who had allowed their certificates to expire, the majority still intended to recertify (65% of the generalists and 86% of the subspecialists, in their primary subspecialty). The most common reasons cited by the 35% of generalists with expired certificates who were not planning to participate in maintenance of certification were the expense, the time required to complete maintenance of certification, and the perceived lack of relevance to their current practice. The 14% of subspecialists who were not planning to recertify in their primary subspecialty most commonly cited the expense, a change in career path making recertification unnecessary, and the time required. CONCLUSIONS: Although the physicians in this study had allowed their certificates to expire, they still overwhelmingly believed that physicians who provide direct patient care should maintain their certification. There was general consensus among our respondents regarding the professional value to patients and peers of participation in the maintenance of certification program.