A competency based selection procedure for Dutch postgraduate GP training: a pilot study on validity and reliability.

UNLABELLED: Abstract Background: Historically, semi-structured interviews (SSI) have been the core of the Dutch selection for postgraduate general practice (GP) training. This paper describes a pilot study on a newly designed competency-based selection procedure that assesses whether candidates have the competencies that are required to complete GP training. OBJECTIVES: The objective was to explore reliability and validity aspects of the instruments developed. METHODS: The new selection procedure comprising the National GP Knowledge Test (LHK), a situational judgement tests (SJT), a patterned behaviour descriptive interview (PBDI) and a simulated encounter (SIM) was piloted alongside the current procedure. Forty-seven candidates volunteered in both procedures. Admission decision was based on the results of the current procedure. RESULTS: Study participants did hardly differ from the other candidates. The mean scores of the candidates on the LHK and SJT were 21.9 % (SD 8.7) and 83.8% (SD 3.1), respectively. The mean self-reported competency scores (PBDI) were higher than the observed competencies (SIM): 3.7(SD 0.5) and 2.9(SD 0.6), respectively. Content-related competencies showed low correlations with one another when measured with different instruments, whereas more diverse competencies measured by a single instrument showed strong to moderate correlations. Moreover, a moderate correlation between LHK and SJT was found. The internal consistencies (intraclass correlation, ICC) of LHK and SJT were poor while the ICC of PBDI and SIM showed acceptable levels of reliability. CONCLUSION: Findings on content validity and reliability of these new instruments are promising to realize a competency based procedure. Further development of the instruments and research on predictive validity should be pursued.

Effects of improved patient participation in primary care on health-related outcomes: a systematic review.

BACKGROUND: In primary care, many consultations address symptom-based complaints. Recovery from these complaints seldom exceeds placebo effects. Patient participation, because of its supposed effects on trust and patient expectancies, is assumed to benefit patients' recovery. While the idea is theoretically promising, it is still unclear what the effects of increased patient participation are on patient outcomes. Aim. To review the effects of controlled intervention studies aiming to improve patient participation in face-to-face primary care consultations on patient-oriented and/or disease-oriented outcomes. METHODS: This study is a systematic review. A systematic search was undertaken for randomized controlled trials designed to measure the effects of interventions that aimed to improve adult patients' participation in primary care visits. The CINAHL, Cochrane, EMBASE, PsycINFO and PubMed databases were searched. RESULTS: Seven different trials fulfilled the inclusion criteria. Three of the studies were related to symptom-based complaints. Five studies measured patient-oriented outcomes, the primary outcome of interest for this review. All studies suffered from substantial bias. Studies varied widely in their aims, types of complaints/diseases, strength of the interventions and their outcomes. The effects on patient-oriented outcomes and disease-oriented outcomes were ambiguous. CONCLUSION: Little research has been performed on health outcomes of interventions aiming to increase patient participation in general practice visits among patients suffering from symptom-based complaints. The results still are non-conclusive. The quality of the trials has been weak, possibly due to the complexity of the concept. This weak quality may explain the lack of conclusive results. Proposals for future research designs are offered.

Selection for Dutch postgraduate GP training; time for improvement.

BACKGROUND: In the Netherlands we select candidates for the postgraduate GP training by assessing personal qualities in interviews. Because of differences in the ratio of number of candidates and number of vacancies between the eight departments of GP training we questioned whether the risk of being rejected diverged amongst them. OBJECTIVE: The research question of this study was to which degree department of choice, candidates' characteristics and qualities assessed during interviews explain admission into GP training. METHODS: A nationwide observational study was conducted of all candidates who applied for postgraduate GP training in 2009/ 2010. Application ratio per department, candidates' characteristics (gender, age, region of medical school and times of application) and qualities (motivation, orientation on the job, personal attributes and learning needs) were collected. Outcome measures were admission to interview and admission to GP training. RESULTS: The study population addressed 542 candidates. Sixty three candidates were rejected on application letter (11.6%). So 479 candidates were admitted to the interview, of which 340 were admitted to the GP training (71%). Gender and region of medical school outside North West Europe were associated with admission to the interview. Department of choice had a strong association with admission in both stages (RR: 0.30 to 0.74; 0.20 to 0.79 respectively), while candidates' qualities explained admission (RR: 1.09- 1.25) as well. CONCLUSION: The influence of department of choice yields doubts about fairness of the procedure. So advantages and disadvantages of a national procedure are discussed as well as those of a competency based procedure.