Quality of the educational environment in postgraduate community pharmacy education and the relationship with trainees’ basic psychological needs

Background: Quality of the educational environment affects trainee performance and well-being in postgraduate healthcare education. In pharmacy practice the quality of the educational environment has not been extensively studied. Self-determination Theory can assist in understanding the underlying mechanisms. Objectives: In this study, the quality of the educational environment and its relationship with satisfaction and frustration of trainees’ basic psychological needs and motivation were investigated in a Dutch community pharmacy postgraduate education programme. Methods: In a cross-sectional study, pharmacists specializing to become community pharmacists completed the Scan of Postgraduate Educational Environment Domains (SPEED), the Basic Psychological Need Satisfaction and Frustration Scale for the Work Domain, and the Academic Motivation Scale. Confirmatory factor analysis followed by path analysis was used to analyse the relationships between the variables. Results: Out of 232 trainees, 205 responded (88%). Most trainees (82%) were positive about the quality of the educational environment. The resulting path model displayed a moderate to good fit. The perceived quality of the educational environment had a moderate positive association with basic psychological needs satisfaction (Factor loading = 0.40) and a similar negative association with basic psychological needs frustration (Factor loading = -0.47). Basic psychological needs frustration had a moderate association with an increased sense of internal and external pressures also known as controlled motivation (Factor loading = 0.31). Intrinsic motivation was not affected by the perceived quality of the educational environment. (AU)

How progress evaluations are used in postgraduate education with longitudinal supervisor-trainee relationships: a mixed method study.

The combination of measuring performance and giving feedback creates tension between formative and summative purposes of progress evaluations and can be challenging for supervisors. There are conflicting perspectives and evidence on the effects supervisor-trainee relationships have on assessing performance. The aim of this study was to learn how progress evaluations are used in postgraduate education with longitudinal supervisor-trainee relationships. Progress evaluations in a two-year community-pharmacy specialization program were studied with a mixed-method approach. An adapted version of the Canadian Medical Education Directives for Specialists (CanMEDS) framework was used. Validity of the performance evaluation scores of 342 trainees was analyzed using repeated measures ANOVA. Semi-structured interviews were held with fifteen supervisors to investigate their response processes, the utility of the progress evaluations, and the influence of supervisor-trainee relationships. Time and CanMEDS roles affected the three-monthly progress evaluation scores. Interviews revealed that supervisors varied in their response processes. They were more committed to stimulating development than to scoring actual performance. Progress evaluations were utilized to discuss and give feedback on trainee development and to add structure to the learning process. A positive supervisor-trainee relationship was seen as the foundation for feedback and supervisors preferred the roles of educator, mentor, and coach over the role of assessor. We found that progress evaluations are a good method for directing feedback in longitudinal supervisor-trainee relationships. The reliability of scoring performance was low. We recommend progress evaluations to be independent of formal assessments in order to minimize roles-conflicts of supervisors.

Validity evidence for summative performance evaluations in postgraduate community pharmacy education.

INTRODUCTION: Workplace-based assessment of competencies is complex. In this study, the validity of summative performance evaluations (SPEs) made by supervisors in a two-year longitudinal supervisor-trainee relationship was investigated in a postgraduate community pharmacy specialization program in the Netherlands. The construct of competence was based on an adapted version of the 2005 Canadian Medical Education Directive for Specialists (CanMEDS) framework. METHODS: The study had a case study design. Both quantitative and qualitative data were collected. The year 1 and year 2 SPE scores of 342 trainees were analyzed using confirmatory factor analysis and generalizability theory. Semi-structured interviews were held with 15 supervisors and the program director to analyze the inferences they made and the impact of SPE scores on the decision-making process. RESULTS: A good model fit was found for the adapted CanMEDS based seven-factor construct. The reliability/precision of the SPE measurements could not be completely isolated, as every trainee was trained in one pharmacy and evaluated by one supervisor. Qualitative analysis revealed that supervisors varied in their standards for scoring competencies. Some supervisors were reluctant to fail trainees. The competency scores had little impact on the high-stakes decision made by the program director. CONCLUSIONS: The adapted CanMEDS competency framework provided a valid structure to measure competence. The reliability/precision of SPE measurements could not be established and the SPE measurements provided limited input for the decision-making process. Indications of a shadow assessment system in the pharmacies need further investigation.

Alignment of CanMEDS-based Undergraduate and Postgraduate Pharmacy Curricula in The Netherlands.

In this article the design of three master programs (MSc in Pharmacy) and two postgraduate specialization programs for community or hospital pharmacist is described. After a preceding BSc in Pharmacy, these programs cover the full pharmacy education capacity for pharmacists in primary and secondary health care in the Netherlands. All programs use the CanMEDS framework, adapted to pharmacy education and specialization, which facilitates the horizontal integration of pharmacists' professional development with other health care professions in the country. Moreover, it is illustrated that crossing the boundary from formal (university) education to experiential (workplace) education is eased by a gradual change in time spent in these two educational environments and by the use of comparable monitoring, feedback, and authentic assessment instruments. A reflection on the curricula, based on the principles of the Integrative Pedagogy Model and the Self-determination Theory, suggests that the alignment of these educational programs facilitates the development of professional expertise and professional identity of Dutch pharmacists.

Development of a Postgraduate Community Pharmacist Specialization Program Using CanMEDS Competencies, and Entrustable Professional Activities.

Objectives. To develop and implement a postgraduate, workplace-based curriculum for community pharmacy specialists in the Netherlands, conduct a thorough evaluation of the program, and revise any deficiencies found. Methods. The experiences of the Dutch Advisory Board for Postgraduate Curriculum Development for Medical Specialists were used as a guideline for the development of a competency-based postgraduate education program for community pharmacists. To ensure that community pharmacists achieved competence in 10 task areas and seven roles defined by the Canadian Medical Education Directions for Specialists (CanMEDS), a two-year workplace-based curriculum was built. A development path along four milestones was constructed using 40 entrustable professional activities (EPAs). The assessment program consisted of 155 workplace-based assessments, with the supervisor serving as the main assessor. Also, 360-degree feedback and 22 days of classroom courses were included in the curriculum. In 2014, the curriculum was evaluated by two focus groups and a review committee. Results. Eighty-two first-year trainees enrolled in the community pharmacy specialist program in 2012. That number increased to 130 trainees by 2016 (a 59% increase). In 2015, based on feedback from pharmacy supervisors, trainees, and other stakeholders, 22.5% of the EPAs were changed and the number of workplace-based assessments was reduced by 48.5%. Conclusion. Using design approaches from the medical field in the development of postgraduate workplace-based pharmacy education programs proved to be feasible and successful. How to address the concerns and challenges encountered in developing and maintaining competency-based postgraduate pharmacy education programs merits further research.