Impact of Residency Training Redesign on Residents' Clinical Knowledge.

BACKGROUND AND OBJECTIVES: The In-training Examination (ITE) is a frequently used method to evaluate family medicine residents' clinical knowledge. We compared family medicine ITE scores among residents who trained in the 14 programs that participated in the Preparing the Personal Physician for Practice (P4) Project to national averages over time, and according to educational innovations. METHODS: The ITE scores of 802 consenting P4 residents who trained in 2007 through 2011 were obtained from the American Board of Family Medicine. The primary analysis involved comparing scores within each academic year (2007 through 2011), according to program year (PGY) for P4 residents to all residents nationally. A secondary analysis compared ITE scores among residents in programs that experimented with length of training and compared scores among residents in programs that offered individualized education options with those that did not. RESULTS: Release of ITE scores was consented to by 95.5% of residents for this study. Scores of P4 residents were higher compared to national scores in each year. For example, in 2011, the mean P4 score for PGY1 was 401.2, compared to the national average of 386. For PGY2, the mean P4 score was 443.1, compared to the national average of 427, and for PGY3, the mean P4 score was 477.0, compared to the national PGY3 score of 456. Scores of residents in programs that experimented with length of training were similar to those in programs that did not. Scores were also similar between residents in programs with and without individualized education options. CONCLUSIONS: Family medicine residency programs undergoing substantial educational changes, including experiments in length of training and individualized education, did not appear to experience a negative effect on resident's clinical knowledge, as measured by ITE scores. Further research is needed to study the effect of a wide range of residency training innovations on ITE scores over time.

There's education, and then there's education in medicine.

INTRODUCTION: For some time now the field of medical education has been criticized by many of its stakeholders. Countless debates have been presented in the literature regarding the quality of medical education research, adequacy of methodological rigor, and other concerns. METHODS: At present, the views expressed have largely come from physicians and individuals with less familiarity with education science. RESULTS: As prolific educational researchers with Ph.Ds in Education and Psychology, we offer a critique of medical education's apparent identity crisis and address what we believe are some of the most significant problems continuing to impede the field of medical education from catching up with the broader field of education. We close with specific recommendations for improving the overall state of medical education. CONCLUSION: Finally, both editors and reviewers for medical education journals need to abandon the hegemonic views regarding research design. Thus, research designs that many in the clinical sciences often perceive as 'weak' are entirely appropriate in education research fields.

The rise of electronic health record adoption among family physicians.

PURPOSE: Realizing the benefits of adopting electronic health records (EHRs) in large measure depends heavily on clinicians and providers' uptake and meaningful use of the technology. This study examines EHR adoption among family physicians using 2 different data sources, compares family physicians with other office-based medical specialists, assesses variation in EHR adoption among family physicians across states, and shows the possibility for data sharing among various medical boards and federal agencies in monitoring and guiding EHR adoption. METHOD: We undertook a secondary analysis of American Board of Family Medicine (ABFM) administrative data (2005-2011) and data from the National Ambulatory Medical Care Survey (NAMCS) (2001-2011). RESULTS: The EHR adoption rate by family physicians reached 68% nationally in 2011. NAMCS family physician adoption rates and ABFM adoption rates (2005-2011) were similar. Family physicians are adopting EHRs at a higher rate than other office-based physicians as a group; however, significant state-level variation exists, indicating geographical gaps in EHR adoption. CONCLUSION: Two independent data sets yielded convergent results, showing that adoption of EHRs by family physicians has doubled since 2005, exceeds other office-based physicians as a group, and is likely to surpass 80% by 2013. Adoption varies at a state level. Further monitoring of trends in EHR adoption and characterizing their capacities are important to achieve comprehensive data exchange necessary for better, affordable health care.

Declining numbers of family physicians are caring for children.

Despite continued growth of the primary care workforce, profound maldistribution persists among providers available for the care of children. Family physicians (FPs) spend, on average, approximately 10% of their total practice time caring for children; however, given that, among physician specialties, FPs are geographically distributed most evenly across the US population, the self-reported decline in the share of FPs caring for children should be disturbing to policymakers, especially with the looming insurance expansion in 2014.

Rewarding family medicine while penalizing comprehensiveness? Primary care payment incentives and health reform: the Patient Protection and Affordable Care Act (PPACA).

Family physicians' scope of work is exceptionally broad, particularly with increasing rurality. Provisions for Medicare bonus payment specified in the health care reform bill (the Patient Protection and Affordable Care Act) used a narrow definition of primary care that inadvertently offers family physicians disincentives to delivering comprehensive primary care.

Family physician participation in maintenance of certification.

PURPOSE: The American Board of Family Medicine has completed the 7-year transition of all of its diplomates into Maintenance of Certification (MOC). Participation in this voluntary process must be broad-based and balanced for MOC to have any practical national impact on health care. This study explores family physicians' geographic, demographic, and practice characteristics associated with the variations in MOC participation to examine whether MOC has potential as a viable mechanism for dissemination of information or for altering practice. METHODS: To investigate characteristics associated with differential participation in MOC by family physicians, we performed a cross-sectional comparison of all active family physicians using descriptive and multinomial logistic regression analyses. RESULTS: Eighty-five percent of active family physicians in this study (n = 70,323) have current board certification. Ninety-one percent of all active board-certified family physicians eligible for MOC are participating in MOC. Physicians who work in poorer neighborhoods (odds ratio [OR] = 1.105; 95% confidence interval [CI], 1.038-1.176), who are US-born or foreign-born international medical graduates (OR = 1.221; 95% CI, 1.124-1.326; OR = 1.444; 95% CI, 1.238-1.684, respectively), or who are solo practitioners (OR = 1.460; 95% CI, 1.345-1.585) are more likely to have missed initial MOC requirements than those from a large, undifferentiated reference group of certified family physicians. When age is held constant, female physicians are less likely to miss initial MOC requirements (OR = 0.849; 95% CI, 0.794-0.908). Physicians practicing in rural areas were found to be performing similarly in meeting initial MOC requirements to those in urban areas (OR = 0.966; 95% CI, 0.919-1.015, not significant). CONCLUSION: Large numbers of family physicians are participating in MOC. The significant association between practicing in underserved areas and lapsed board certification, however, warrants more research examining causes of differential participation. The penetrance of MOC engagement shows that MOC has the potential to convey substantial practice-relevant medical information to physicians. Thus, it offers a potential channel through which to improve health care knowledge and medical practice.

Establishing a baseline: health information technology adoption among family medicine diplomates.

The Office of the National Coordinator and recent federal policy have dramatically expanded incentives for adoption and "meaningful use" of electronic health records (EHRs). However, little reliable information regarding adoption rates in primary care, and some concern exists about lagging adoption rates beyond large group practices.

American Board of Family Medicine (ABFM) maintenance of certification: variations in self-assessment modules uptake within the 2006 cohort.

INTRODUCTION: In its recent shift to a Maintenance of Certification for Family Physicians (MC-FP) paradigm, the American Board of Family Medicine provides diplomates completing 3 self-assessment modules (SAMs) in the first 3 years (or first stage of MC-FP) a pathway to extend their recertification cycle to 10 years provided additional requirements are met, versus a 7-year cycle for "non-completers." We use geographic information systems to report on variations in SAM participation and completion in a single cohort of diplomates followed during their first stage of MC-FP to better understand the communities impacted, barriers to uptake, and urban-rural differences. METHODS: We merged data from 2006 MC-FP files, association workforce files, and the US Census and completed cross-sectional spatial, descriptive, and regression analyses of the uptake and timely completion of SAMs during a 3-year period. Specifically, we explored characteristics of diplomates who did not meet first-stage MC-FP requirements within 3 years versus those who did. RESULTS: The cohort comprised 10,812 participants who passed their certification or recertification examination in 2005, of which 30.5% did not complete their MC-FP requirements by the end of 2008. Noncompleters were more likely to be older (P < .01), men (P < .0001), and from areas of dense poverty (P < .01) and underserved areas (P < .05). There were no significant differences in MC-FP completion across the rural-urban continuum (P = .7108). CONCLUSIONS: More than two-thirds of eligible, certified family physicians completed stage-one MC-FP requirements. Concerns that technical aspects of the new MC-FP paradigm would leave parts of a widely distributed, poorly resourced primary care workforce disadvantaged may hold true for providers in some underserved areas, but differential completion among rural and remote physicians was not found. Understanding barriers to uptake is essential if the specialty boards are to meet their obligations to the public to promote quality of care through Maintenance of Certification for all physicians.

Maintenance of certification for family physicians (MC-FP) self assessment modules (SAMs): the first year.

INTRODUCTION: In 2000, the American Board of Medical Specialties adopted Maintenance of Certification (MOC) to replace intermittent, periodic recertification. MOC consists of 4 components: demonstration of professionalism (part I); commitment to life-long learning (part II); demonstration of cognitive expertise (part III); and evaluation of performance in practice (part IV). The American Board of Family Medicine (ABFM) implemented Maintenance of Certification for Family Physicians (MC-FP) in 2004, with its MC-FP part II self-assessment modules (SAMs) as the focus of the first year's activities. METHODS: The SAMs use materials and resources provided at the ABFM's website (www.theabfm.org). As of April 2005, approximately 7000 Diplomates had successfully completed SAMs in essential hypertension (N = 2351) and type 2 diabetes mellitus (N = 4648). Participants completed categorical modified Likert scale evaluations to receive continuing education credit, and many offered unstructured free-text comments regarding the clinical simulation component. These free-text comments were entered into the AnSWR qualitative analysis program from the Centers for Disease Control and Prevention. Text coding was performed by 2 authors (MDH, DJI). As no inferential analyses or comparisons were anticipated, the authors conducted no studies of inter-rater consistency. Results are reported as means (SD) and medians for continuous data, and as frequencies for count data. RESULTS: Likert-scale ratings indicated generally favorable responses (predominantly 5 to 6 on a 6-point scale) to the hypertension and diabetes SAMs. In addition, over half (ie, 55% for hypertension and 54% for diabetes participants) of the respondents indicated that the experience would lead to changes in their practices. Navigation and system operation issues predominated in the free-text comments offered for the diabetes and hypertension simulations. CONCLUSION: The MC-FP SAMs received generally favorable ratings in the program's first year. The SAMs underwent a number of modifications and improvements during the first year, largely in response to feedback and suggestions from ABFM Diplomates.

From specialty-based to practice-based: a new blueprint for the American Board of Family Medicine cognitive examination.

The American Board of Family Medicine (ABFM) is committed to offering cognitive examinations that are both pertinent to the specialty of family medicine and psychometrically sound. This article reviews the history of the development of the blueprint of the ABFM certification and recertification cognitive examinations and describes the creation of a new one. The design of the new blueprint represents a significant change. The intention of the new plan is to create a continuously evolving approach that will assure family physicians that the content of their specialty board certification/recertification examination is relevant to their practices and to the discipline. The ABFM anticipates that assessments based on the new blueprint will assist family physicians in attaining and maintaining the knowledge required to practice high quality family medicine by focusing their certification and recertification examinations and, therefore, studies for those examinations on material that is relevant to their practices.

Incremental validity of the MMPI-A content scales in the prediction of self-reported symptoms.

The incremental contribution of the MMPI-A (Butcher et al., 1992) content scales to the prediction of scores on self-report measures of psychopathology was examined in a sample of 62 adolescents in inpatient treatment and 59 adolescents from the community. All participants completed the MMPI-A and a battery of criterion measures. A series of hierarchical regression analyses was conducted in which the MMPI-A clinical and content scales served as the independent variables and the criterion measures as the dependent variables. The content scales were found to have incremental validity beyond the clinical scales in predicting variance in the criterion measures. Similarly, the clinical scales also demonstrated incremental validity over the content scales in making these predictions. Both sets of scales made independent contributions to the prediction of sample membership (clinical vs. nonclinical). Findings suggest that both the clinical and content scales of the MMPI-A make significant contributions to the assessment of adolescents' psychological functioning.