Assessment and evaluation of prescribing competences: A systematic review and recommendations.

AIMS: Since assessment of prescribing competence is a key promoter of student learning and achievement, we aim to summarize existing national-level approaches, provide a systematic review of current literature, indicate the frequency of various methodologies, and make recommendations to promote and extend existing practice. METHODS: Regulatory body websites were accessed for details of national examinations. PubMed, Embase, the Allied and Complementary Medicine, and CINAHL databases were systematically searched in August 2023 for studies in English from Europe, North America, Australia and New Zealand reporting assessment of prescribing competencies among students/practitioners. Additional articles were identified through citation tracking. RESULTS: National approaches are described for several jurisdictions. A total of 20 514 articles were retrieved, of which 54 met the inclusion criteria. Most articles came from the UK, with medical students and qualified doctors most frequently featured. Multiple choice formats were most common, with short answer questions, calculations and scenario-based skills tests also featured. Direct observations of skills through Objective Structured Clinical Examinations and similar methods were less commonly described. Test reliability generally employed Classical Test Theory. Costs of developing and delivering assessments, differential attainment by demographics, and predictive validity were not indicated. CONCLUSION: We recommend measurement of the predictive validity of prescribing competence assessments, the routine inclusion of performance by demographic characteristics, extension of competence assessments to professions other than medicine, and structured reporting of methods and findings, including costs and cost-effectiveness. Situational judgement tests would be a valuable addition to assessment practices.

Conscientious, competent and caring: producing the junior doctor of the future.

This article is based on the Association for the Study of Medical Education Gold Medal Plenary for 2022, given by the first author. It outlines different ways in which medical training can be approached, based on his career and his work with colleagues. Among the attributes that it would be desirable to promote in future doctors are conscientiousness, competence and care for patients as individuals. This article explores each of these in separate sections. The first demonstrates that the trait of conscientiousness can be observed in first and second year medical students by their compliance in routine low level tasks such as attendance and submission of required work on time. A 'conscientiousness index' calculated on this basis is a statistically significant predictor of later events such as performance in exams, the prescribing safety assessment, and the UK situational judgement test in subsequent years, and also in postgraduate assessments such as Royal college exams and the annual reviews of competence progression. The second proposes that competence in tasks undertaken by junior doctors is better achieved by teaching on medical imaging, clinical skills and living anatomy than by cadaveric dissection. The final section argues that the incorporation of arts and humanities teaching into medical education is likely to lead to better understanding of the patient perspective in later practice.

Teaching, research or balanced? An exploration of the experiences of biomedical scientists working in UK medical schools.

Driven by demand for high standards in university education, efforts have been made in the UK to address the perceived imbalance between teaching and research. However, teaching is still perceived by many as having less credibility and is attributed less importance. The purpose of our research was to explore how distinct types of academic job profiles ('research' or 'education' focused, or 'balanced') impact on biomedical scientists' perceptions of the lecturer role. Specifically, we investigated the experiences of biomedical scientists in 'post-1990' medical schools, which are known for their commitment to excellence in both research and education. We conducted 22 face-to-face, semi-structured interviews with biomedical scientists in five schools. Focusing on experiences of work, the interviews covered: 'motivations', 'role expectations', 'teaching', 'research' and 'career'. The recorded qualitative data were transcribed and then analysed thematically. Our results, offering an insight into the working lives of biomedical scientists in medical education, suggest that in settings with a dual emphasis on education and research, individuals on 'balanced' contracts can experience a strong pull between research and teaching. In addition to posing significant challenges with respect to workload management, this can impact profoundly on professional identity. In contrast to the balanced role, 'research' or 'education' focused roles appear to have clearer requirements, leading to higher employee satisfaction. We conclude that to assist the educational mission of Higher Education, attention should be paid to balanced contracts, to (a) ensure employee support, (b) mitigate against negative perceptions of teaching, and ultimately, (c) guard against staff attrition.

An inexpensive retrospective standard setting method based on item facilities.

BACKGROUND: Standard setting is one of the most challenging aspects of assessment in high-stakes healthcare settings. The Angoff methodology is widely used, but poses a number of challenges, including conceptualisation of the just-passing candidate, and the time-cost of implementing the method. Cohen methodologies are inexpensive and rapid but rely on the performance of an individual candidate. A new method of standard setting, based on the entire cohort and every item, would be valuable. METHODS: We identified Borderline candidates by reviewing their performance across all assessments in an academic year. We plotted the item scores of the Borderline candidates in comparison with Facility for the whole cohort and fitted curves to the resulting distribution. RESULTS: It is observed that for any given Item, an equation of the form y ≈ C. eFx where y is the Facility of Borderline candidates on that Item, x is the observed Item Facility of the whole cohort, and C and F are constants, predicts the probable Facility for Borderline candidates over the test, in other words, the cut score for Borderline candidates. We describe ways of estimating C and F in any given circumstance, and suggest typical values arising from this particular study: that C = 12.3 and F = 0.021. CONCLUSIONS: C and F are relatively stable, and that the equation y = 12.3. e0.021x can rapidly be applied to the item Facility for every item. The average value represents the cut score for the assessment as a whole. This represents a novel retrospective method based on test takers. Compared to the Cohen method which draws on one score and one candidate, this method draws on all items and candidates in a test. We propose that it can be used to standard set a whole test, or a particular item where the predicted Angoff score is very different from the observed Facility.

Predicting fitness to practise events in international medical graduates who registered as UK doctors via the Professional and Linguistic Assessments Board (PLAB) system: a national cohort study.

BACKGROUND: International medical graduates working in the UK are more likely to be censured in relation to fitness to practise compared to home graduates. Performance on the General Medical Council's (GMC's) Professional and Linguistic Assessments Board (PLAB) tests and English fluency have previously been shown to predict later educational performance in this group of doctors. It is unknown whether the PLAB system is also a valid predictor of unprofessional behaviour and malpractice. The findings would have implications for regulatory policy. METHODS: This was an observational study linking data relating to fitness to practise events (referral or censure), PLAB performance, demographic variables and English language competence, as evaluated via the International English Language Test System (IELTS). Data from 27,330 international medical graduates registered with the GMC were analysed, including 210 doctors who had been sanctioned in relation to at least one fitness to practise issue. The main outcome was risk of eventual censure (including a warning). RESULTS: The significant univariable educational predictors of eventual censure (versus no censures or referrals) were lower PLAB part 1 (hazard ratio [HR], 0.99; 95% confidence interval, 0.98 to 1.00) and part 2 scores (HR, 0.94; 0.91 to 0.97) at first sitting, multiple attempts at both parts of the PLAB, lower IELTS reading (HR, 0.79; 0.65 to 0.94) and listening scores (HR, 0.76; 0.62 to 0.93) and higher IELTS speaking scores (HR, 1.28; 1.04 to 1.57). Multiple resits at either part of the PLAB and higher IELTS speaking score (HR, 1.49; 1.20 to 1.84) were also independent predictors of censure. We estimated that the proposed limit of four attempts at both parts of the PLAB would reduce the risk in this entire group by only approximately two censures per 5 years in this group of doctors. CONCLUSIONS: Making the PLAB, or any replacement assessment, more stringent and raising the required standards of English reading and listening may result in fewer fitness to practice events in international medical graduates. However, the number of PLAB resits permitted would have to be further capped to meaningfully impact the risk of sanctions in this group of doctors.

Evaluating the complementary roles of an SJT and academic assessment for entry into clinical practice.

Although there is extensive evidence confirming the predictive validity of situational judgement tests (SJTs) in medical education, there remains a shortage of evidence for their predictive validity for performance of postgraduate trainees in their first role in clinical practice. Moreover, to date few researchers have empirically examined the complementary roles of academic and non-academic selection methods in predicting in-role performance. This is an important area of enquiry as despite it being common practice to use both types of methods within a selection system, there is currently no evidence that this approach translates into increased predictive validity of the selection system as a whole, over that achieved by the use of a single selection method. In this preliminary study, the majority of the range of scores achieved by successful applicants to the UK Foundation Programme provided a unique opportunity to address both of these areas of enquiry. Sampling targeted high (>80th percentile) and low (<20th percentile) scorers on the SJT. Supervisors rated 391 trainees' in-role performance, and incidence of remedial action was collected. SJT and academic performance scores correlated with supervisor ratings (r = .31 and .28, respectively). The relationship was stronger between the SJT and in-role performance for the low scoring group (r = .33, high scoring group r = .11), and between academic performance and in-role performance for the high scoring group (r = .29, low scoring group r = .11). Trainees with low SJT scores were almost five times more likely to receive remedial action. Results indicate that an SJT for entry into trainee physicians' first role in clinical practice has good predictive validity of supervisor-rated performance and incidence of remedial action. In addition, an SJT and a measure of academic performance appeared to be complementary to each other. These initial findings suggest that SJTs may be more predictive at the lower end of a scoring distribution, and academic attainment more predictive at the higher end.

Predictive validity of the UKCAT for medical school undergraduate performance: a national prospective cohort study.

BACKGROUND: The UK Clinical Aptitude Test (UKCAT) has been shown to have a modest but statistically significant ability to predict aspects of academic performance throughout medical school. Previously, this ability has been shown to be incremental to conventional measures of educational performance for the first year of medical school. This study evaluates whether this predictive ability extends throughout the whole of undergraduate medical study and explores the potential impact of using the test as a selection screening tool. METHODS: This was an observational prospective study, linking UKCAT scores, prior educational attainment and sociodemographic variables with subsequent academic outcomes during the 5 years of UK medical undergraduate training. The participants were 6812 entrants to UK medical schools in 2007-8 using the UKCAT. The main outcome was academic performance at each year of medical school. A receiver operating characteristic (ROC) curve analysis was also conducted, treating the UKCAT as a screening test for a negative academic outcome (failing at least 1 year at first attempt). RESULTS: All four of the UKCAT scale scores significantly predicted performance in theory- and skills-based exams. After adjustment for prior educational achievement, the UKCAT scale scores remained significantly predictive for most years. Findings from the ROC analysis suggested that, if used as a sole screening test, with the mean applicant UKCAT score as the cut-off, the test could be used to reject candidates at high risk of failing at least 1 year at first attempt. However, the 'number needed to reject' value would be high (at 1.18), with roughly one candidate who would have been likely to pass all years at first sitting being rejected for every higher risk candidate potentially declined entry on this basis. CONCLUSIONS: The UKCAT scores demonstrate a statistically significant but modest degree of incremental predictive validity throughout undergraduate training. Whilst the UKCAT could be considered a fairly crude screening tool for future academic performance, it may offer added value when used in conjunction with other selection measures. Future work should focus on the optimum role of such tests within the selection process and the prediction of post-graduate performance.

Clinical vignettes improve performance in anatomy practical assessment.

Although medical curricula now adopt an integrated teaching approach, this is not adequately reflected in assessment of anatomy knowledge and skills. In this study, we aimed to explore the impact of the addition of clinical vignette to item stems on students' performance in anatomy practical examinations. In this study, 129 undergraduate medical students of Durham University took part in a 30-item anatomy practical test consisting of those with and without clinical stem, in a crossover design. Classical test theory was used to analyze item difficulty, discrimination index, point biserial, and reliability. Student performance on items with clinical stem and the percentage of students who correctly answered each item was significantly improved by the addition of a clinical stem in the Year 2 cohort. Also, items with a clinical stem showed much better discrimination index than non-clinical items in the Year 2 cohort. In contrast, there was no significant difference in item performance, student performance and discrimination index between items with a clinical and non-clinical stem in Year 1 cohort. Over 65% of test items in both year groups were of good quality with point biserial exceeding 0.2. However, Year 1 test reliability for non-clinical items was better than clinical items. The results raise question as to what level to apply this method of assessment in undergraduate education. Although interpreted on the basis of a relatively small item sample, the findings support the need for improving anatomy practical examinations in line with overriding curricula changes.

Annual Review of Competence Progression (ARCP) performance of doctors who passed Professional and Linguistic Assessments Board (PLAB) tests compared with UK medical graduates: national data linkage study.

OBJECTIVE: To determine whether use of the Professional and Linguistic Assessments Board (PLAB) examination system used to grant registration for international medical graduates results in equivalent postgraduate medical performance, as evaluated at Annual Review of Competence Progression (ARCP), between UK based doctors who qualified overseas and those who obtained their primary medical qualification from UK universities. DESIGN: Observational study linking ARCP outcome data from the UK deaneries with PLAB test performance and demographic data held by the UK General Medical Council (GMC). SETTING: Doctors in postgraduate training for a medical specialty or general practice in the UK and doctors obtaining GMC registration via the PLAB system. PARTICIPANTS: 53,436 UK based trainee doctors with at least one competency related ARCP outcome reported during the study period, of whom 42,017 were UK medical graduates and 11,419 were international medical graduates who were registered following a pass from the PLAB route. MAIN OUTCOME MEASURE: Probability of obtaining a poorer versus a more satisfactory category of outcome at ARCP following successful registration as a doctor in the UK. RESULTS: International medical graduates were more likely to obtain a less satisfactory outcome at ARCP compared with UK graduates. This finding persisted even after adjustment for the potential influence of sex, age, years of UK based practice, and ethnicity and exclusion of outcomes associated with postgraduate examination failure (odds ratio 1.63, 95% confidence interval 1.30 to 2.06). However, international medical graduates who scored in the highest twelfth at part 1 of the PLAB (at least 32 points above the pass mark) had ARCP outcomes that did not differ significantly from those of UK graduates. CONCLUSIONS: These findings suggest that the PLAB test used for registration of international medical graduates is not generally equivalent to the requirements for UK graduates. The differences in postgraduate performance, as captured at ARCP, following the two routes to registration might be levelled out by raising the standards of English language competency required as well as the pass marks for the two parts of the PLAB test. An alternative might be to introduce a different testing system.

Comparison of the sensitivity of the UKCAT and A Levels to sociodemographic characteristics: a national study.

BACKGROUND: The UK Clinical Aptitude Test (UKCAT) was introduced to facilitate widening participation in medical and dental education in the UK by providing universities with a continuous variable to aid selection; one that might be less sensitive to the sociodemographic background of candidates compared to traditional measures of educational attainment. Initial research suggested that males, candidates from more advantaged socioeconomic backgrounds and those who attended independent or grammar schools performed better on the test. The introduction of the A* grade at A level permits more detailed analysis of the relationship between UKCAT scores, secondary educational attainment and sociodemographic variables. Thus, our aim was to further assess whether the UKCAT is likely to add incremental value over A level (predicted or actual) attainment in the selection process. METHODS: Data relating to UKCAT and A level performance from 8,180 candidates applying to medicine in 2009 who had complete information relating to six key sociodemographic variables were analysed. A series of regression analyses were conducted in order to evaluate the ability of sociodemographic status to predict performance on two outcome measures: A level 'best of three' tariff score; and the UKCAT scores. RESULTS: In this sample A level attainment was independently and positively predicted by four sociodemographic variables (independent/grammar schooling, White ethnicity, age and professional social class background). These variables also independently and positively predicted UKCAT scores. There was a suggestion that UKCAT scores were less sensitive to educational background compared to A level attainment. In contrast to A level attainment, UKCAT score was independently and positively predicted by having English as a first language and male sex. CONCLUSIONS: Our findings are consistent with a previous report; most of the sociodemographic factors that predict A level attainment also predict UKCAT performance. However, compared to A levels, males and those speaking English as a first language perform better on UKCAT. Our findings suggest that UKCAT scores may be more influenced by sex and less sensitive to school type compared to A levels. These factors must be considered by institutions utilising the UKCAT as a component of the medical and dental school selection process.

A systematic literature review of undergraduate clinical placements in underserved areas.

CONTEXT: The delivery of undergraduate clinical education in underserved areas is increasing in various contexts across the world in response to local workforce needs. A collective understanding of the impact of these placements is lacking. Previous reviews have often taken a positivist approach by only looking at outcome measures. This review addresses the question: What are the strengths and weaknesses for medical students and supervisors of community placements in underserved areas? METHODS: A systematic literature review was carried out by database searching, citation searching, pearl growing, reference list checking and use of own literature. The databases included MEDLINE, EMBASE, PsycINFO, Web of Science and ERIC. The search terms used were combinations and variations of four key concepts exploring general practitioner (GP) primary care, medical students, placements and location characteristics. The papers were analysed using a textual narrative synthesis. FINDINGS: The initial search identified 4923 results. After the removal of duplicates and the screening of titles and abstracts, 185 met the inclusion criteria. These full articles were obtained and assessed for their relevance to the research question; 54 were then included in the final review. Four main categories were identified: student performance, student perceptions, career pathways and supervisor experiences. CONCLUSIONS: This review reflects the emergent qualitative data as well as the quantitative data used to assess initiatives. Underserved area placements have produced many beneficial implications for students, supervisors and the community. There is a growing amount of evidence regarding rural, underserved areas, but little in relation to inner city, deprived areas, and none in the UK.

Do students learn to be more conscientious at medical school?

BACKGROUND: Professionalism in medical students is not only difficult to define but difficult to teach and measure. As negative behaviour in medical students is associated with post-graduate disciplinary action it would be useful to have a model whereby unprofessional behaviour at the undergraduate level can easily be identified to permit appropriate intervention. We have previously developed a scalar measure of conscientiousness, the Conscientiousness Index (CI), which positively correlates to estimates of professional behaviour in undergraduate medical students. By comparing CI points awarded in year 1 and year 2 of study we were able to use the CI model to determine whether teaching and clinical exposure had any effect on students' conscientiousness. METHODS: CI points were collected by administrative staff from 3 successive cohorts of students in years 1 and 2 of study. Points were awarded to students for activities such as submission of immunisation status and criminal record checks, submission of summative assignments by a specified date and attendance at compulsory teaching sessions. CI points were then converted to a percentage of maximal possible scores (CI %) to permit direct comparison between years 1 and 2 of study. RESULTS: CI % scores were generally high with each year of study for each cohort showing negatively skewed normal distributions with peaks > 89%. There was a high degree of correlation of CI % scores between year 1 and year 2 of study for each cohort alone and when cohort data was combined. When the change in CI % from year 1 to year 2 for all students was compared there was no significant difference in conscientiousness observed. CONCLUSIONS: We have provided evidence that use of a CI model in undergraduate medical students provides a reliable measure of conscientiousness that is easy to implement. Importantly this study shows that measurement of conscientiousness by the CI model in medical students does not change between years 1 and 2 study suggesting that it is a stable characteristic and not modified by teaching and clinical exposure.

Widening access to UK medical education for under-represented socioeconomic groups: modelling the impact of the UKCAT in the 2009 cohort.

OBJECTIVE: To determine whether the use of the UK clinical aptitude test (UKCAT) in the medical schools admissions process reduces the relative disadvantage encountered by certain sociodemographic groups. DESIGN: Prospective cohort study. SETTING: Applicants to 22 UK medical schools in 2009 that were members of the consortium of institutions utilising the UKCAT as a component of their admissions process. PARTICIPANTS: 8459 applicants (24,844 applications) to UKCAT consortium member medical schools where data were available on advanced qualifications and socioeconomic background. MAIN OUTCOME MEASURES: The probability of an application resulting in an offer of a place on a medicine course according to seven educational and sociodemographic variables depending on how the UKCAT was used by the medical school (in borderline cases, as a factor in admissions, or as a threshold). RESULTS: On univariate analysis all educational and sociodemographic variables were significantly associated with the relative odds of an application being successful. The multilevel multiple logistic regression models, however, varied between medical schools according to the way that the UKCAT was used. For example, a candidate from a non-professional background was much less likely to receive a conditional offer of a place compared with an applicant from a higher social class when applying to an institution using the test only in borderline cases (odds ratio 0.51, 95% confidence interval 0.45 to 0.60). No such effect was observed for such candidates applying to medical schools using the threshold approach (1.27, 0.84 to 1.91). These differences were generally reflected in the interactions observed when the analysis was repeated, pooling the data. Notably, candidates from several under-represented groups applying to medical schools that used a threshold approach to the UKCAT were less disadvantaged than those applying to the other institutions in the consortium. These effects were partially reflected in significant differences in the absolute proportion of such candidates finally taking up places in the different types of medical schools; stronger use of the test score (as a factor or threshold) was associated with a significantly increased odds of entrants being male (1.74, 1.25 to 2.41) and from a low socioeconomic background (3.57, 1.03 to 12.39). There was a non-significant trend towards entrants being from a state (non-grammar) school (1.60, 0.97 to 2.62) where a stronger use of the test was employed. Use of the test only in borderline cases was associated with increased odds of entrants having relatively low academic attainment (5.19, 2.02 to 13.33) and English as a second language (2.15, 1.03 to 4.48). CONCLUSIONS: The use of the UKCAT may lead to more equitable provision of offers to those applying to medical school from under-represented sociodemographic groups. This may translate into higher numbers of some, but not all, relatively disadvantaged students entering the UK medical profession.

Evaluating professionalism in medical undergraduates using selected response questions: findings from an item response modelling study.

BACKGROUND: Professionalism is a difficult construct to define in medical students but aspects of this concept may be important in predicting the risk of postgraduate misconduct. For this reason attempts are being made to evaluate medical students' professionalism. This study investigated the psychometric properties of Selected Response Questions (SRQs) relating to the theme of professional conduct and ethics comparing them with two sets of control items: those testing pure knowledge of anatomy, and; items evaluating the ability to integrate and apply knowledge ("skills"). The performance of students on the SRQs was also compared with two external measures estimating aspects of professionalism in students; peer ratings of professionalism and their Conscientiousness Index, an objective measure of behaviours at medical school. METHODS: Item Response Theory (IRT) was used to analyse both question and student performance for SRQs relating to knowledge of professionalism, pure anatomy and skills. The relative difficulties, discrimination and 'guessabilities' of each theme of question were compared with each other using Analysis of Variance (ANOVA). Student performance on each topic was compared with the measures of conscientiousness and professionalism using parametric and non-parametric tests as appropriate. A post-hoc analysis of power for the IRT modelling was conducted using a Monte Carlo simulation. RESULTS: Professionalism items were less difficult compared to the anatomy and skills SRQs, poorer at discriminating between candidates and more erratically answered when compared to anatomy questions. Moreover professionalism item performance was uncorrelated with the standardised Conscientiousness Index scores (rho = 0.009, p = 0.90). In contrast there were modest but significant correlations between standardised Conscientiousness Index scores and performance at anatomy items (rho = 0.20, p = 0.006) though not skills (rho = .11, p = .1). Likewise, students with high peer ratings for professionalism had superior performance on anatomy SRQs but not professionalism themed questions. A trend of borderline significance (p = .07) was observed for performance on skills SRQs and professionalism nomination status. CONCLUSIONS: SRQs related to professionalism are likely to have relatively poor psychometric properties and lack associations with other constructs associated with undergraduate professional behaviour. The findings suggest that such questions should not be included in undergraduate examinations and may raise issues with the introduction of Situational Judgement Tests into Foundation Years selection.

A qualitative study of student responses to body painting.

One hundred and thirty-three preclinical medical students participated in 24 focus groups over the period 2007-2009 at Durham University. Focus groups were conducted to ascertain whether or not medical students found body painting anatomical structures to be an educationally beneficial learning activity. Data were analyzed using a grounded theory approach. Five principal themes emerged: (1) body painting as a fun learning activity, (2) body painting promoting retention of knowledge, (3) factors contributing to the memorability of body painting, (4) removal from comfort zone, and (5) the impact of body painting on students' future clinical practice. Students perceive body painting to be a fun learning activity, which aids their retention of the anatomical knowledge acquired during the session. Sensory factors, such as visual stimuli, especially color, and the tactile nature of the activity, promote recall. Students' preference for painting a peer or being painted is often dependent upon their learning style, but there are educational benefits for both roles. The moderate amounts of undressing involved encouraging students to consider issues surrounding body image; this informs their attitudes towards future patients. Body painting is a useful adjunct to traditional anatomy and clinical skills teaching. The fun element involved in the delivery of this teaching defuses the often formal academic context, which in turn promotes a positive learning environment.

The conscientiousness index: a novel tool to explore students' professionalism.

PURPOSE: Measuring professional behavior is problematic not least because the concept of professionalism is difficult to define. The authors describe a measurement tool that does not rely on qualitative judgments from respondents but, nonetheless, clearly correlates with individuals' subjective views about what constitutes professional behavior. METHOD: The authors devised the Conscientiousness Index (CI) of medical students' performance in years 1 (n = 116) and 2 (n = 108) in 2006-2007. The CI scores were based on a range of objective measures of conscientiousness, including attendance and submission of required information (such as immunization status or summative assessments) by a deadline. The validity of this instrument was tested against (1) staff views of the professional behavior of individual students and (2) critical incident reports. RESULTS: The trait of conscientiousness, as measured by the CI, showed good correlation with the construct of professionalism as perceived by staff views of individual students' professional behavior. There was also a relationship with the frequency of critical incident reporting. Together, these observations support the validity of the approach. Reliability and practicality were also acceptable. CONCLUSIONS: The results suggest that the CI measures a scalar objective trait that corresponds well with professional behavior as perceived by staff members in an undergraduate medical school. The individual decisions making up the CI are objective and easy to collect, making it a relatively simple and uncontroversial method for exploring students' professionalism.