Robust, defensible, and fair: The AMEE guide to selection into medical school: AMEE Guide No. 153.

Selection is the first assessment of medical education and training. Medical schools must select from a pool of academically successful applicants and ensure that the way in which they choose future clinicians is robust, defensible, fair to all who apply and cost-effective. However, there is no comprehensive and evidence-informed guide to help those tasked with setting up or rejuvenating their local selection process. To address this gap, our guide draws on the latest research, international case studies and consideration of common dilemmas to provide practical guidance for designing, implementing and evaluating an effective medical school selection system. We draw on a model from the field of instructional design to frame the many different activities involved in doing so: the ADDIE model. ADDIE provides a systematic framework of Analysis (of the outcomes to be achieved by the selection process, and the barriers and facilitators to achieving these), Design (what tools and content are needed so the goals of selection are achieved), Development (what materials and resources are needed and available), Implementation (plan [including piloting], do study and adjust) and Evaluation (quality assurance is embedded throughout but the last step involves extensive evaluation of the entire process and its outcomes).HIGHLIGHTSRobust, defensible and fair selection into medical school is essential. This guide systematically covers the processes required to achieve this, from needs analysis through design, development and implementation, to evaluation of the success of a selection process.

2018 Ottawa consensus statement: Selection and recruitment to the healthcare professions.

Selection and recruitment into healthcare education and practice is a key area of interest for educators with significant developments in research, policy, and practice in recent years. This updated consensus statement, developed through a multi-stage process, examines future opportunities and challenges in selection and recruitment. There is both a gap in the literature around and a compelling case for further theoretical and empirical literature to underpin the development of overall selection philosophes and policies and their enactment. More consistent evidence has emerged regarding the quality of different selection methods. Approaches to selection are context-dependent, requiring the consideration of an institution's philosophy regarding what they are trying to achieve, the communities it purports to serve, along with the system within which they are used. Diversity and globalization issues continue to be critically important topics. Further research is required to explore differential attainment and explain why there are substantial differences in culturally acceptable ways of approaching diversity and widening access. More sophisticated evaluation approaches using multi-disciplinary theoretical frameworks are required to address the issues. Following a discussion of these areas, 10 recommendations are presented to guide future research and practice and to encourage debate between colleagues across the globe.

Correction to: A systematic review of stakeholder views of selection methods for medical schools admission.

Following publication of the original article [1], the author report typographical errors in the.

A systematic review of stakeholder views of selection methods for medical schools admission.

BACKGROUND: The purpose of this paper is to systematically review the literature with respect to stakeholder views of selection methods for medical school admissions. METHODS: An electronic search of nine databases was conducted between January 2000-July 2014. Two reviewers independently assessed all titles (n = 1017) and retained abstracts (n = 233) for relevance. Methodological quality of quantitative papers was assessed using the MERSQI instrument. The overall quality of evidence in this field was low. Evidence was synthesised in a narrative review. RESULTS: Applicants support interviews, and multiple mini interviews (MMIs). There is emerging evidence that situational judgement tests (SJTs) and selection centres (SCs) are also well regarded, but aptitude tests less so. Selectors endorse the use of interviews in general and in particular MMIs judging them to be fair, relevant and appropriate, with emerging evidence of similarly positive reactions to SCs. Aptitude tests and academic records were valued in decisions of whom to call to interview. Medical students prefer interviews based selection to cognitive aptitude tests. They are unconvinced about the transparency and veracity of written applications. Perceptions of organisational justice, which describe views of fairness in organisational processes, appear to be highly influential on stakeholders' views of the acceptability of selection methods. In particular procedural justice (perceived fairness of selection tools in terms of job relevance and characteristics of the test) and distributive justice (perceived fairness of selection outcomes in terms of equal opportunity and equity), appear to be important considerations when deciding on acceptability of selection methods. There were significant gaps with respect to both key stakeholder groups and the range of selection tools assessed. CONCLUSIONS: Notwithstanding the observed limitations in the quality of research in this field, there appears to be broad concordance of views on the various selection methods, across the diverse stakeholders groups. This review highlights the need for better standards, more appropriate methodologies and for broadening the scope of stakeholder research.

Using a situational judgement test for selection into dental core training: a preliminary analysis.

Objective and setting This paper describes the evaluation of a pilot situational judgement test (SJT) for selection into UK Dental Core Training (DCT). The SJT's psychometric properties, group differences based on gender and ethnicity, and candidate reactions were assessed.Methods The SJT targets four non-academic attributes important for success in DCT. Data were collected alongside live selection processes from five Health Education England local teams in the UK (N = 386). Candidates completed the pilot SJT and an evaluation questionnaire to examine their reactions to the test.Results SJT scores were relatively normally distributed and showed acceptable levels of internal reliability (α = 0.68). Difficulty level and partial correlations between scenarios and SJT total score were in the expected ranges (64.61% to 90.03% and r = 0.06 to 0.41, respectively). No group differences were found for gender, and group differences between White and BME candidates were minimal. Most candidates perceived the SJT as relevant to the target role, appropriate and fair.Conclusions This study demonstrated the potential suitability of an SJT for use in DCT selection. Future research should replicate these preliminary findings in other cohorts, and assess the predictive validity of the SJT for predicting key training and practice-based outcomes.

The value of situational judgement tests for assessing non-academic attributes in dental selection.

Situational judgement tests (SJTs) have been shown to be reliable and valid tools for assessing non-academic attributes across numerous healthcare professions. However, within the context of selection into dental foundation training (DFT) in the UK the introduction of an SJT is relatively new. This expert opinion highlights four key considerations regarding the DFT SJT in order to inform further debate amongst researchers and stakeholders. We clarify that SJTs measure non-academic attributes important for success in dental training, and that their context and content must be updated regularly to ensure their relevance, realism and fairness to current applicants. We outline that SJTs are efficient and cost-effective for high volume selection in the long term, in comparison to face-to-face interviews. Finally we summarise the value of practice material being available for high-stakes SJTs, such as the DFT SJT. Implications for practice are discussed throughout.

Could situational judgement tests be used for selection into dental foundation training?

OBJECTIVE: To pilot and evaluate a machine-markable situational judgement test (SJT) designed to select candidates into UK dental foundation training. DESIGN: Single centre pilot study. SETTING: UK postgraduate deanery in 2010. PARTICIPANTS AND METHODS: Seventy-four candidates attending interview for dental foundation training in Oxford and Wessex Deaneries volunteered to complete the situational judgement test. INTERVENTIONS: The situational judgement test was developed to assess relevant professional attributes for dentistry (for example, empathy and integrity) in a machine-markable format. Test content was developed by subject matter experts working with experienced psychometricians. MAIN OUTCOME MEASURES: Evaluation of psychometric properties of the pilot situational judgement test (for example, reliability, validity and fairness). Scores in the dental foundation training selection process (short-listing and interviews) were used to examine criterion-related validity. Candidates completed an evaluation questionnaire to examine candidate reactions and face validity of the new test. RESULTS: Forty-six candidates were female and 28 male; mean age was 23.5-years-old (range 22-32). Situational judgement test scores were normally distributed and the test showed good internal reliability when corrected for test length (α = 0.74). Situational judgement test scores positively correlated with the management, leadership and professionalism interview (N = 50; r = 0.43, p <0.01) but not with the clinical skills interview, providing initial evidence of criterion-related validity as the situational judgement test is designed to test non-cognitive professional attributes beyond clinical knowledge. Most candidates perceived the situational judgement test as relevant to dentistry, appropriate for their training level, and fair. CONCLUSION: This initial pilot study suggests that a situational judgement test is an appropriate and innovative method to measure professional attributes (eg empathy and integrity) for selection into foundation training. Further research will explore the long-term predictive validity of the situational judgement test once candidates have entered training.

Predictive validity of a selection centre testing non-technical skills for recruitment to training in anaesthesia.

BACKGROUND: Assessment centres are an accepted method of recruitment in industry and are gaining popularity within medicine. We describe the development and validation of a selection centre for recruitment to speciality training in anaesthesia based on an assessment centre model incorporating the rating of candidate's non-technical skills. METHODS: Expert consensus identified non-technical skills suitable for assessment at the point of selection. Four stations-structured interview, portfolio review, presentation, and simulation-were developed, the latter two being realistic scenarios of work-related tasks. Evaluation of the selection centre focused on applicant and assessor feedback ratings, inter-rater agreement, and internal consistency reliability coefficients. Predictive validity was sought via correlations of selection centre scores with subsequent workplace-based ratings of appointed trainees. RESULTS: Two hundred and twenty-four candidates were assessed over two consecutive annual recruitment rounds; 68 were appointed and followed up during training. Candidates and assessors demonstrated strong approval of the selection centre with more than 70% of ratings 'good' or 'excellent'. Mean inter-rater agreement coefficients ranged from 0.62 to 0.77 and internal consistency reliability of the selection centre score was high (Cronbach's α=0.88-0.91). The overall selection centre score was a good predictor of workplace performance during the first year of appointment. CONCLUSIONS: An assessment centre model based on the rating of non-technical skills can produce a reliable and valid selection tool for recruitment to speciality training in anaesthesia. Early results on predictive validity are encouraging and justify further development and evaluation.

Genetic variation in nicotine metabolism predicts the efficacy of extended-duration transdermal nicotine therapy.

In a placebo-controlled trial, we examined the efficacy of a 6-month ("extended") transdermal nicotine therapy vs. the 8-week ("standard") therapy in 471 Caucasian smokers with either normal or reduced rates of nicotine metabolism as determined at pretreatment. Extended therapy was superior to standard therapy in genotypic or phenotypic reduced metabolizers (RMs) of nicotine but not in normal metabolizers (NMs). RMs of nicotine are candidates for extended transdermal nicotine therapy, whereas an alternative therapeutic approach may be needed for those with normal rates of nicotine metabolism.

Effects of atomoxetine on subjective and neurocognitive symptoms of nicotine abstinence.

Nicotine dependence has been linked to attention-deficit hyperactivity disorder (ADHD) symptoms in both clinical and general populations. This behavioural pharmacology study used a within-subject, double-blind, crossover design to test the effects of atomoxetine, a medication for ADHD, on nicotine abstinence symptoms. Fifty non treatment-seeking smokers (>/=15 cigarettes/day) completed a baseline session when they were smoking as usual and then two laboratory testing sessions after overnight abstinence and treatment with 7 days of either atomoxetine (1.2 mg/kg) or placebo. During each laboratory session, participants completed subjective measures of abstinence symptoms and performed neurocognitive tasks. In mixed effects models, atomoxetine, compared with placebo, was found to be associated with a reduction in abstinence-induced subjective withdrawal symptoms. Atomoxetine was also associated with significant reductions in self-reported smoking urges amongst smokers who scored high on a baseline measure of smoking for stimulation. However, atomoxetine had no effect on any of the cognitive tasks employed in the study. Thus, atomoxetine may reduce cravings to smoke among smokers who use nicotine to increase arousal.

Single-bone forearm reconstruction for malignant and aggressive tumors.

UNLABELLED: Limb-salvage surgery for malignant and aggressive forearm tumors presents a unique surgical challenge. We performed single-bone forearm reconstructions after extensive resections of the radius and ulna in four patients for such tumors. Radiocarpal arthrodesis was performed in three patients. We recorded the presence of metastases or local recurrences, Musculoskeletal Tumor Society upper extremity scores, and complications. One patient had local recurrence and one died of metastases. The average Musculoskeletal Tumor Society score at the last followup was 26 of 30 (88%; range, 24-28). Complications included wound infection/necrosis, delayed union, nonunion, and acute carpal tunnel syndrome. Single-bone forearm reconstructive surgery provided satisfactory functional outcomes in these four patients, and we believe it is a reasonable treatment option for individuals with malignant or aggressive tumors of the forearm requiring massive bone resection. LEVEL OF EVIDENCE: Level IV, therapeutic study. See the Guidelines for Authors for a complete description of levels of evidence.

Association of OPRM1 A118G variant with the relative reinforcing value of nicotine.

RATIONALE: The endogenous opioid system has been implicated in substance abuse and response to pharmacotherapies for nicotine and alcohol addiction. We examined (1) the association of the functional OPRM1 A118G variant with the relative reinforcing value of nicotine and (2) the main and interacting effects of the mu-opioid receptor antagonist naltrexone on nicotine reinforcement. METHODS: In a within-subject, double-blind human laboratory study, 30 smokers of each OPRM1 genotype (A/A vs. A/G or G/G) participated in two experimental sessions following 4 days of orally administered naltrexone 50 mg or placebo. Participants completed a validated assessment of the relative reinforcing value of nicotine. This cigarette choice paradigm assesses self-administration of 0.6 mg nicotine vs. 0.05 mg (denicotinized) cigarettes after a brief period of nicotine abstinence. RESULTS: The relative reinforcing value of nicotine (number of nicotine cigarette puffs) was predicted by a significant OPRM1 by gender interaction. Among women, the low-activity G allele (A/G and G/G) was associated with a reduced reinforcing value of nicotine; among male smokers, there was no association with genotype. Smokers carrying a G allele were also significantly less likely to differentiate the nicotine vs. denicotinized cigarettes by subjective ratings of satisfaction and strength. No evidence for an effect of naltrexone on nicotine reinforcement was found in the overall sample or in the genotype or gender subgroups. CONCLUSIONS: This study provides initial evidence for an association of the OPRM1 A118G variant with nicotine reinforcement in women.

Selecting doctors for postgraduate training in paediatrics using a competency based assessment centre.

The design and implementation of an assessment centre in the South Yorkshire and South Humberside deanery for selecting doctors into postgraduate training in paediatric medicine is described. Eleven competency domains were identified in the job analysis. An assessment centre comprising of four exercises was implemented to assess candidates. There were modest relationships between candidates' performance on the various assessment centre exercises. Outcomes based on interview performance were related to, but not the same as, outcomes based on the combined results of the three other assessment centre exercises. Candidates perceived the assessment centre to be a fair selection method. It is concluded that an assessment centre approach to SHO recruitment is feasible and provides a greater breadth and depth of information about candidates than does a structured interview.

Interaction between variation in the D2 dopamine receptor (DRD2) and the neuronal calcium sensor-1 (FREQ) genes in predicting response to nicotine replacement therapy for tobacco dependence.

We have previously demonstrated that a functional dopamine D2 receptor promoter variant (DRD2 -141 Ins/Del) predicts response to nicotine replacement therapy (NRT). The present study extends this finding in the same population of 363 NRT-treated subjects, by examining variation in the gene encoding the neuronal calcium sensor-1 protein (FREQ), which functions to regulate D2 receptor desensitization. The results indicate a statistically significant interaction effect of DRD2-141 and FREQ genotypes on abstinence at the end of the NRT treatment phase; 62% of the smokers with at least one copy of the DRD2 -141 Del allele and two copies of the FREQ rs1054879 A allele were abstinent from smoking, compared to 29-38% abstinence rates for other smokers in the trial. This result suggests that the interaction between variation in the DRD2 and FREQ genes, which both encode components of the D2 dopamine receptor signal transduction pathway, impacts the efficacy of NRT.

Impact of CYP2A6 genotype on pretreatment smoking behaviour and nicotine levels from and usage of nicotine replacement therapy.

We investigated the effect of slow metabolism of nicotine, predicted by CYP2A6 genotypes resulting in less than or equal to 50% activity, on baseline smoking behaviours and treatment variables in an open-label nicotine replacement therapy (NRT) clinical trial. Caucasian smokers with CYP2A6 slow vs normal metabolism had lower metabolic activity, indicated by the 3-hydroxycotinine/cotinine ratio (0.23+/-0.17 vs 0.45+/-0.22, P<0.01, respectively). CYP2A6 slow metabolizers also smoked fewer cigarettes per day compared to normal metabolizers (20+/-7 vs 24+/-10, respectively, P<0.04). With nicotine patch use, slow metabolizers had higher nicotine plasma levels compared to normal metabolizers (22.8+/-4.6 vs 15.8+/-7.6 ng/ml, respectively, P=0.02) while using the same numbers of patches/week. With nicotine spray use, where like in smoking the nicotine intake can be easily adjusted to adapt to rates of metabolism, slow metabolizers achieved similar nicotine levels compared to normal metabolizers (5.8+/-4.1 vs 8.0+/-9.1 ng/ml, P=0.82), by using fewer doses of nicotine spray/day (4.8+/-3.6 vs 10.5+/-8.0, respectively, P<0.02). These findings indicate that CYP2A6 genotype influences smoking behaviour in a Caucasian treatment-seeking population and that CYP2A6 genotype affects plasma levels obtained from, and usage of, NRT.

Treatment of advanced metastatic lesions of the acetabulum using the saddle prosthesis.

Current methods of treating advanced patients with metastatic periacetabular disease are complex and result in high complication rates. The purpose of this study was to show whether the implantation of the saddle prosthesis would serve as an additional tool to help treat metastatic disease in these patients. From 1991 to 2003, 20 patients with advanced metastatic periacetabular lesions (Harrington Class III) were treated using the saddle prosthesis. Goals of surgery were a decrease in pain, functional restoration, and ambulation. The mean age was 61 years. Average length of followup was 20 months. Postoperatively, ambulation was achieved in 16 of 20 patients. There were four postoperative complications (20%) in three patients. Surgical goals were met in 18 of 20 patients. The MSTS-ISOLS emotional score was 2.9 of 5. The average total MSTS-ISOLS score was 16.6 of 30 (55%). Using the Allan scoring system consisting of analgesia, independence and ambulation, and mobility, all scores had significant improvements postoperatively. Careful surgical indications and technique should result in a stable, functional reconstruction allowing patients the ability to ambulate outside the house with a cane. Patients can expect to be emotionally satisfied with the procedure while using nonnarcotic analgesia and can expect an improved quality of life despite bone metastasis.