The added value of free preparatory activities for widening access to medical education: a multi-cohort study.

BACKGROUND: Medical schools are reported to be less accessible to students with non-traditional backgrounds. These students face barriers when applying for and transitioning to medical school, which may be reduced by offering free preparatory activities. By equalizing access to resources, these activities are expected to reduce disparities in selection outcomes and early academic performance. In the present study, four free institutionally-provided preparatory activities were evaluated by comparing the demographic composition of participating and non-participating applicants. Additionally, the association between participation and selection outcomes and early academic performance was investigated for subgroups (based on sex, migration background and parental education). METHODS: Participants were applicants to a Dutch medical school in 2016-2019 (N = 3592). Free preparatory activities included Summer School (N = 595), Coaching Day (N = 1794), Pre-Academic Program (N = 217), and Junior Med School (N = 81), supplemented with data on participation in commercial coaching (N = 65). Demographic compositions of participants and non-participants were compared using chi-squared tests. Regression analyses were performed to compare selection outcomes (curriculum vitae [CV], selection test score, probability of enrolment) and early academic performance (first-course grade) between participants and non-participants of demographic subgroups, controlling for pre-university grades and participation in other activities. RESULTS: Generally, no differences in sociodemographic compositions of participants and non-participants were found, but males participated less often in Summer School and Coaching Day. Applicants with a non-Western background participated less often in commercial coaching, but the overall participation rate was low and participation had negligible effects on selection outcomes. Participation in Summer School and Coaching Day were stronger related with selection outcomes. In some cases, this association was even stronger for males and candidates with a migration background. After controlling for pre-university grades, none of the preparatory activities were positively associated with early academic performance. CONCLUSIONS: Free institutionally-provided preparatory activities may contribute to student diversity in medical education, because usage was similar across sociodemographic subgroups, and participation was positively associated with selection outcomes of underrepresented and non-traditional students. However, since participation was not associated with early academic performance, adjustments to activities and/or curricula are needed to ensure inclusion and retention after selection.

Medical students' perception of general practice: a cross-sectional survey.

BACKGROUND: An increase in the demand for general practitioners is expected in many countries, but only a minority of medical students consider a career in general practice. More detailed and up-to-date knowledge about medical student's perception of general practice would be helpful for efforts to encourage medical students to consider a career in general practice. METHODS: We performed a cross-sectional single center survey among Dutch medical students to evaluate their perception of general practice at three different stages in their study: Ba1: first-year bachelor students; Ba3: third-year bachelor students; Ma3: third-year master students. The impact of different factors on their attitudes and perceptions was quantified. A multivariate logistic regression was performed with 'interest in general practice' as the outcome variable. RESULTS: The median age for Ba1 was 18 (IQR: 18-19) and 71.5% were female, for Ba3 the median age was 20 (IQR: 20-21) and 70.6% were female and for Ma3 the median age was 25 years (IQR: 24-26) and 73.3% were female. On average, 31.2% of the respondents had a migration background. The mean response rate for this study was 77.1%. Of the participating Ba1 students (n = 340) only 22.4% considered working as a GP after medical school; for Ba3 students (n = 231) this percentage was 33.8%, and for Ma3 students (n = 210) it was significantly higher at 70.5%; in the final multivariate model this corresponded to an odds ratio (OR) of 4.3 (95%-CI:2.6-6.9) compared to Ba1 students. The strongest predictor in the final model was the opinion that general practice provides a pleasant working environment (OR 9.5; 95%-CI: 6.2-14.5). CONCLUSION: This study showed that multiple factors are significantly related to medical students' interest in general practice. Although students believed that general practice does not have a high status within the medical profession, they acknowledged the social importance and the pleasant working environment of general practice. Knowledge obtained in this study can be used when designing a medical curriculum or a general practice course.

Selection tools and student diversity in health professions education: a multi-site study.

Student diversity in health professions education (HPE) can be affected by selection procedures. Little is known about how different selection tools impact student diversity across programs using different combinations of traditional and broadened selection criteria. The present multi-site study examined the chances in selection of subgroups of applicants to HPE undergraduate programs with distinctive selection procedures, and their performance on corresponding selection tools. Probability of selection of subgroups (based on gender, migration background, prior education, parental education) of applicants (N = 1935) to five selection procedures of corresponding Dutch HPE undergraduate programs was estimated using multilevel logistic regression. Multilevel linear regression was used to analyze performance on four tools: prior-education grade point average (pe-GPA), biomedical knowledge test, curriculum-sampling test, and curriculum vitae (CV). First-generation Western immigrants and applicants with a foreign education background were significantly less likely to be selected than applicants without a migration background and with pre-university education. These effects did not vary across programs. More variability in effects was found between different selection tools. Compared to women, men performed significantly poorer on CVs, while they had higher scores on biomedical knowledge tests. Applicants with a non-Western migration background scored lower on curriculum-sampling tests. First-generation Western immigrants had lower CV-scores. First-generation university applicants had significantly lower pe-GPAs. There was a variety in effects for applicants with different alternative forms of prior education. For curriculum-sampling tests and CVs, effects varied across programs. Our findings highlight the need for continuous evaluation, identifying best practices within existing tools, and applying alternative tools.

Scoring method of a Situational Judgment Test: influence on internal consistency reliability, adverse impact and correlation with personality?

Situational Judgment Tests (SJTs) are increasingly used for medical school selection. Scoring an SJT is more complicated than scoring a knowledge test, because there are no objectively correct answers. The scoring method of an SJT may influence the construct and concurrent validity and the adverse impact with respect to non-traditional students. Previous research has compared only a small number of scoring methods and has not studied the effect of scoring method on internal consistency reliability. This study compared 28 different scoring methods for a rating SJT on internal consistency reliability, adverse impact and correlation with personality. The scoring methods varied on four aspects: the way of controlling for systematic error, and the type of reference group, distance and central tendency statistic. All scoring methods were applied to a previously validated integrity-based SJT, administered to 931 medical school applicants. Internal consistency reliability varied between .33 and .73, which is likely explained by the dependence of coefficient alpha on the total score variance. All scoring methods led to significantly higher scores for the ethnic majority than for the non-Western minorities, with effect sizes ranging from 0.48 to 0.66. Eighteen scoring methods showed a significant small positive correlation with agreeableness. Four scoring methods showed a significant small positive correlation with conscientiousness. The way of controlling for systematic error was the most influential scoring method aspect. These results suggest that the increased use of SJTs for selection into medical school must be accompanied by a thorough examination of the scoring method to be used.

[Impact of ethnicity and social background on examination results of medical students]. / De invloed van afkomst op studieresultaten.

OBJECTIVE: To investigate underperformance across ethnic minority groups and by first-generation university students in different types of examinations during pre-clinical training. DESIGN: Prospective cohort study METHODS: Participants included Erasmus MC students from the 2008-2013 cohorts (n=2432). Outcome measures were pass/fail on three types of written examinations: 1) theoretical knowledge: clinical problem solving tests (CPSTs) (Year 1-3) and end-of-block tests (Year 1c2-c3), 2) language skills test (Year 1) and 3) writing skills tests (Year 1-3), and OSCEs (Year 2-3). Odds ratios with 95% confidence intervals were estimated by logistic regression analysis for ethnic subgroups (Surinamese/Antillean, Turkish/Moroccan/African, Asian, Western) compared with Dutch students, adjusted for age, gender, pre-university Grade Point Average (pu-GPA), additional socio-demographic variables (first-generation immigrant, urban background, first-generation university student, first language, medical doctor as parent). Similar analyses were conducted for first-generation university students. RESULTS: Compared with Dutch students, the three non-Western ethnic minority groups underperformed in the CPSTs, the language test and the OSCEs. Findings on the end-of-block and writing skills tests, and results for Western minority students were less consistent. Age, gender, pu-GPA and additional socio-demographic variables could explain the ethnicity-related differences in theoretical examinations, but not in language, clinical and writing skills examinations. First-generation university students only underperformed in the language test. CONCLUSION: Ethnic minority students underperform in pre-clinical training, but there are differences both across ethnic subgroups and between different types of examinations. In designing assessment programs care should be taken to avoid unintended effects of certain types of examinations for certain groups of students.

Ethnic and social disparities in different types of examinations in undergraduate pre-clinical training.

Medical schools are increasingly faced with a more diverse student population. Generally, ethnic minority students are reported to underperform compared with those from the ethnic majority. However, there are inconsistencies in findings in different types of examinations. Additionally, little is known about the performance of first-generation university students and about performance differences across ethnic minority groups. This study aimed to investigate underperformance across ethnic minority groups and by first-generation university students in different types of written tests and clinical skills examinations during pre-clinical training. A longitudinal prospective cohort study of progress on a 3-year Dutch Bachelor of Medicine course was conducted. Participants included 2432 students who entered the course over a consecutive 6-year period (2008-2013). Compared with Dutch students, the three non-Western ethnic minority groups (Turkish/Moroccan/African, Surinamese/Antillean and Asian) underperformed in the clinical problem solving tests, the language test and the OSCEs. Findings on the theoretical end-of-block tests and writing skills tests, and results for Western minority students were less consistent. Age, gender, pre-university grade point average and additional socio-demographic variables (including first-generation university student, first language, and medical doctor parent) could explain the ethnicity-related differences in theoretical examinations, but not in language, clinical and writing skills examinations. First-generation university students only underperformed in the language test. Apparently, underperformance differs both across ethnic subgroups and between different types of written and clinical examinations. Medical schools should ensure their assessment strategies create a level playing field for all students and explore reasons for underperformance in the clinical and writing skills examinations.