Feasibility, and validity aspects of Entrustable Professional Activity (EPA)-based assessment in general practice training.

INTRODUCTION: Entrustable Professional Activities (EPAs) are developed to support the practical application of competency frameworks in postgraduate medical education (PGME) programmes. EPAs are used for the assessment of the trainees' competence development, which takes place by means of an entrustment decision, aiming to stimulate learning and independent practice in trainees. In this pilot study, we explore the feasibility and validity of EPA-based assessment in a General Practice (GP) training programme. METHODS: We used questionnaires to evaluate trainers' and trainees' experiences with the use of six EPAs for trainee learning, assessment and independent practice at the Out-of-Hours GP Center. Data were analysed quantitatively and qualitatively. Additionally, we examined the inter-item correlation between scores on EPA-based assessment and competency-based assessment using Spearman's Rho. RESULTS: EPA-based assessment provided opportunities for giving concrete feedback and substantiating competency-based assessment. No consistent correlation between EPA-based assessment and competency-based assessment could be detected. Only later in the course of the training programme a correlation was found between the EPA scores and the degree of independence of trainees. DISCUSSION: Results of this pilot study confirm the theories behind EPAs, as well as earlier research on EPAs in the workplace regarding trainee learning, assessment and independent practice. An important limitation of this study was the COVID-19 pandemic, as it influenced the results through reduced inclusion and follow-up, and through the impact on the workplace and trainee learning possibilities. Further research is needed to determine how EPAs support independent practice of trainees, as well as the assessment of trainee competency development.

Benefits of EPAs at risk? The influence of the workplace environment on the uptake of EPAs in EPA-based curricula.

INTRODUCTION: Entrustable Professional Activities (EPAs) have been applied differently in many postgraduate medical education (PGME) programmes, but the reasons for and the consequences of this variation are not well known. Our objective was to investigate how the uptake of EPAs is influenced by the workplace environment and to what extent the benefits of working with EPAs are at risk when the uptake of EPAs is influenced. This knowledge can be used by curriculum developers who intend to apply EPAs in their curricula. METHOD: For this qualitative study, we selected four PGME programmes: General Practice, Clinical Geriatrics, Obstetrics & Gynaecology, and Radiology & Nuclear Medicine. A document analysis was performed on the national training plans, supported by the AMEE Guide for developing EPA-based curricula and relevant EPA-based literature. Interviews were undertaken with medical specialists who had specific involvement in the development of the curricula. Content analysis was employed and illuminated the possible reasons for variation in the uptake of EPAs. RESULTS: An important part of the variation in the uptake of EPAs can be explained by environmental factors, such as patient population, the role of the physician in the health-care system, and the setup of local medical care institutions where the training programme takes place. The variation in uptake of EPAs is specifically reflected in the number and breadth of the EPAs, and in the way the entrustment decision is executed within the PGME programme. DISCUSSION: Due to variation in uptake of EPAs, the opportunities for trainees to work independently during the training programme might be challenging. EPAs can be implemented in the curriculum of PGME programmes in a meaningful way, but only if the quality of an EPA is assessed, future users are involved in the development, and the key feature of EPAs (the entrustment decision) is retained.

Trainers' and trainees' expectations of entrustable professional activities (EPAs) in a primary care training programme.

Introducing Entrustable Professional Activities (EPAs) into primary care postgraduate medical education (PGME) programmes may be challenging, due to the general nature of primary care medicine, but trainers and trainees both stand to benefit from their use. We investigated the expectations of trainers and trainees in a primary care PGME programme regarding the use of EPAs. We held two focus group discussions with trainers and four with trainees from the Dutch General Practice training programme, to explore their views on the use of EPAs in their training programme. Focus group discussions were audio-recorded and transcribed verbatim. The transcripts were analysed using conventional content analysis. Trainers and trainees felt that the large number of EPAs in the training programme, and the general way they are formulated, made them unsuitable for use in formal assessments. However, they felt that EPAs can be a useful aid to trainee learning. EPAs may help trainers to give trainees specific feedback on their performance. While the use of the classic EPA method in primary care PGME programmes may be challenging, EPAs in such programmes might be more suitable as design and learning tools than as a tool for formal assessment.