Components of postgraduate competence: analyses of thirty years of longitudinal data.

CONTEXT: The conceptualisation and measurement of competence in patient care are critical to the design of medical education programmes and outcome assessment. OBJECTIVE: We aimed to examine the major components and correlates of postgraduate competence in patient care. METHODS: A 24-item rating form with additional questions about resident doctors' performance and future residency offers was used. Study participants comprised 4560 subjects who graduated from Jefferson Medical College between 1975 and 2004. They pursued their graduate medical education in 508 hospitals. We used a longitudinal study design in which the rating form was completed by programme directors to evaluate residents at the end of the first postgraduate year. Factor analysis was used to identify the underlying components of postgraduate ratings. Multiple regression, t-test and correlational analyses were used to study the validity of the components that emerged. RESULTS: Two major components emerged, which we labelled 'Knowledge and Clinical Capabilities' and 'Professionalism', and which addressed the science and art of medicine, respectively. Performance measures during medical school, scores on medical licensing examinations, and global assessment of Medical Knowledge, Clinical Judgement and Data-gathering Skills showed higher correlations with scores on the Knowledge and Clinical Capabilities component. Global assessments of Professional Attitudes and ratings of Empathic Behaviour showed higher correlations with scores on the Professionalism component. Offers of continued residency and evaluations of desirable qualities were associated with both components. CONCLUSIONS: Psychometric support for measuring the components of Knowledge and Clinical Capabilities, and Professionalism provides an instrument to empirically evaluate educational outcomes to medical educators who are in search of such a tool.

Do global rating forms enable program directors to assess the ACGME competencies?

PURPOSE: In 1999 the Accreditation Council for Graduate Medical Education (ACGME) mandated that GME programs require their residents to be proficient in six general competencies. The purpose of this study was to ascertain whether an existing global rating form could be modified to assess these competencies. METHOD: A rating form covering 23 skills described in the ACGME competencies was developed. The directors of 92 specialty and subspecialty programs at Thomas Jefferson University Hospital and the Albert Einstein Medical Center in Philadelphia were asked to rate residents at the end of the 2001-02 and 2002-03 academic years. RESULTS: Ratings for 1,295 of 1,367 (95%) residents were available. Residents were awarded the highest mean ratings on items tied to professionalism, compassion, and empathy. The lowest mean ratings were assigned for items related to consideration of costs in care and management of resources. Factor analysis indicated that the program directors viewed overall competence in two dimensions of medical knowledge and interpersonal skills. This factor structure was stable for groups of specialties, and residents' gender and training level. Mean ratings in each dimension were progressively higher for residents at advanced levels of training. CONCLUSION: Global rating forms, the tool that program directors use most frequently to document residents' competence, may not be adequate to assess the six general competencies. The results are consistent with earlier published research indicating that physicians view competence in just two broad dimensions, which questions the premise of the six ACGME competencies. Further research is needed to validate and measure six distinct dimensions of clinical competence.