Challenges in engaging patients in feedback conversations for health care professionals' workplace learning.

INTRODUCTION: Patient feedback is relevant information for improvement of health care professionals' performance. Engaging patients in feedback conversations can help to harness patient feedback as a powerful tool for learning. However, health care settings may prevent patients and health care professionals to effectively engage in a feedback dialogue. To advance our understanding of how feedback conversations may support learning in and from practice, we sought to explore patients' and health care providers' perspectives on engaging patients in feedback conversations as informal learning opportunities. METHODS: For this qualitative study, we used a pragmatic approach and conducted semi-structured interviews with 12 health care providers and 10 patient consultants. We applied an inductive approach to thematic analysis to understand interviewees' perceptions regarding patient feedback for workplace learning. RESULTS: Participants attributed importance to patient feedback and described how the feedback may improve treatment relationships, professionals' performance and care processes on the team level and the organisational level. Participants experienced conflicting roles as patient and educator or expert and learner, respectively. Changing relationships, feelings of vulnerability and perceived power dynamics in treatment relationships would affect participants' engagement in feedback conversations. Patients and professionals alike saw a role for themselves in giving or inviting feedback but often missed the tools for engaging in feedback conversations. DISCUSSION: Patient feedback can contribute to professionals' practice-based learning but requires navigating tensions around conflicting roles and power dynamics in the treatment relationship. Both patients and health care professionals need to embrace vulnerability and may need facilitation and guidance to use patient feedback effectively. Attention to power dynamics, if not a shift towards collaborative relationships, is however crucial to engage patients in feedback conversations, thereby capitalising the power patients posses.

Inequity is woven into the fabric: a discourse analysis of assessment in pediatric residency training.

Intrinsic inequity in assessment refers to sources of harmful discrimination inherent in the design of assessment tools and systems. This study seeks to understand intrinsic inequity in assessment systems by studying assessment policies and associated procedures in residency training, using general pediatrics as a discourse case study. Foucauldian discourse analysis (FDA) was conducted on assessment policy and procedure documents. Two authors independently prepared structured analytic notes using guiding questions. Documents and respective analytic notes were subsequently reviewed independently by all authors. Each author prepared further unstructured analytic notes on the documents' discourse. The authors then compared notes and constructed truth statements (i.e., interpretations of what the discourse establishes as true about the construct under study) and sub-strands (i.e., themes) that were repeated and legitimized across the documents via iterative discussion. Based on analysis, the authors constructed two truth statements. These truth statements, "good assessment is equitable assessment," and "everyone is responsible for inequity," conceptualized inequity in assessment as an isolated or individual-level aberration in an otherwise effective or neutral system. Closer examination of the truth statements and sub-strands in the discourse presented an alternative view, suggesting that inequity may in fact not be an aberration but rather an inherent feature of assessment systems.

Supervisory dyads' communication and alignment regarding the use of workplace-based observations: a qualitative study in general practice residency.

BACKGROUND: In medical residency, performance observations are considered an important strategy to monitor competence development, provide feedback and warrant patient safety. The aim of this study was to gain insight into whether and how supervisor-resident dyads build a working repertoire regarding the use of observations, and how they discuss and align goals and approaches to observation in particular. METHODS: We used a qualitative, social constructivist approach to explore if and how supervisory dyads work towards alignment of goals and preferred approaches to performance observations. We conducted semi-structured interviews with supervisor-resident dyads, performing a template analysis of the data thus obtained. RESULTS: The supervisory dyads did not frequently communicate about the use of observations, except at the start of training and unless they were triggered by internal or external factors. Their working repertoire regarding the use of observations seemed to be primarily driven by patient safety goals and institutional assessment requirements rather than by providing developmental feedback. Although intended as formative, the institutional test was perceived as summative by supervisors and residents, and led to teaching to the test rather than educating for purposes of competence development. CONCLUSIONS: To unlock the full educational potential of performance observations, and to foster the development of an educational alliance, it is essential that supervisory dyads and the training institute communicate clearly about these observations and the role of assessment practices of- and for learning, in order to align their goals and respective approaches.

How medical students co-regulate their learning in clinical clerkships: a social network study.

BACKGROUND: Self-regulated learning is a key competence to engage in lifelong learning. Research increasingly acknowledges that medical students in clerkships need others to regulate their learning. The concept of "co-regulated learning" captures this act of regulating one's learning by interacting with others. To effectively cultivate such skills in students, we need to increase our understanding of co-regulated learning. This study aimed to identify the purposes for which students in different phases of clinical training engage others in their networks to regulate their learning. METHODS: In this social network study, we administered a questionnaire to 403 medical students during clinical clerkships (65.5% response rate). The questionnaire probed into the composition of students' co-regulatory networks and the purpose for which they engaged others in specified self-regulated learning activities. We calculated the proportion of students that engaged others in their networks for each regulatory activity. Additionally, we conducted ANOVAs to examine whether first-, second-, and third-year students differed in how they used their networks to support self-regulation. RESULTS: Students used others within their co-regulatory networks to support a range of self-regulated learning activities. Whom students engaged, and the purpose of engagement, seemed to shift as students progressed through clinical training. Over time, the proportion of students engaging workplace supervisors to discuss learning goals, learning strategies, self-reflections and self-evaluations increased, whereas the proportion of students engaging peers to discuss learning strategies and how to work on learning goals in the workplace decreased. Of all purposes for which students engaged others measured, discussing self-reflections and self-evaluations were consistently among the ones most frequently mentioned. CONCLUSIONS: Results reinforce the notion that medical students' regulation of learning is grounded in social interactions within co-regulatory networks students construct during clerkships. Findings elucidate the extent to which students enact self-regulatory learning within their co-regulatory networks and how their co-regulatory learning behaviors develop over time. Explicating the relevance of interactions within co-regulatory networks might help students and supervisors to purposefully engage in meaningful co-regulatory interactions. Additionally, co-regulatory interactions may assist students in regulating their learning in clinical workplaces as well as in honing their self-regulated learning skills.

Relationships between medical students' co-regulatory network characteristics and self-regulated learning: a social network study.

INTRODUCTION: Recent conceptualizations of self-regulated learning acknowledge the importance of co-regulation, i.e., students' interactions with others in their networks to support self-regulation. Using a social network approach, the aim of this study is to explore relationships between characteristics of medical students' co-regulatory networks, perceived learning opportunities, and self-regulated learning. METHODS: The authors surveyed 403 undergraduate medical students during their clinical clerkships (response rate 65.5%). Using multiple regression analysis, structural equation modelling techniques, and analysis of variance, the authors explored relationships between co-regulatory network characteristics (network size, network diversity, and interaction frequency), students' perceptions of learning opportunities in the workplace setting, and self-reported self-regulated learning. RESULTS: Across all clerkships, data showed positive relationships between tie strength and self-regulated learning (ß = 0.095, p < 0.05) and between network size and tie strength (ß = 0.530, p < 0.001), and a negative relationship between network diversity and tie strength (ß = -0.474, p < 0.001). Students' perceptions of learning opportunities showed positive relationships with both self-regulated learning (ß = 0.295, p < 0.001) and co-regulatory network size (ß = 0.134, p < 0.01). Characteristics of clerkship contexts influenced both co-regulatory network characteristics (size and tie strength) and relationships between network characteristics, self-regulated learning, and students' perceptions of learning opportunities. DISCUSSION: The present study reinforces the importance of co-regulatory networks for medical students' self-regulated learning during clinical clerkships. Findings imply that supporting development of strong networks aimed at frequent co-regulatory interactions may enhance medical students' self-regulated learning in challenging clinical learning environments. Social network approaches offer promising ways of further understanding and conceptualising self- and co-regulated learning in clinical workplaces.

Putting self-regulated learning in context: Integrating self-, co-, and socially shared regulation of learning.

Processes involved in the regulation of learning have been researched for decades, because of its impact on academic and workplace performance. In fact, self-regulated learning is the focus of countless studies in health professions education and higher education in general. While we will always need competent individuals who are able to regulate their own learning, developments in healthcare require a shift from a focus on the individual to the collective: collaboration within and between healthcare teams is at the heart of high-quality patient care. Concepts of collaborative learning and collective competence challenge commonly held conceptualisations of regulatory learning and call for a focus on the social embeddedness of regulatory learning and processes regulating the learning of the collective. Therefore, this article questions the alignment of current conceptualisations of regulation of learning with demands for collaboration in current healthcare. We explore different conceptualisations of regulation of learning (self-, co-, and socially shared regulation of learning), and elaborate on how the integration of these conceptualisations adds to our understanding of regulatory learning in healthcare settings. Building on these insights, we furthermore suggest ways forward for research and educational practice.

Exploring residents' perceptions of PA and NP roles and barriers to collaboration.

OBJECTIVE: Developing competencies for interprofessional collaboration, including understanding other professionals' roles on interprofessional teams, is an essential component of medical education. This study explored resident physicians' perceptions of the clinical roles and responsibilities of physician assistants (PAs) and NPs in the clinical learning environment. METHODS: Using a constructivist grounded theory approach, semistructured interviews were conducted with 15 residents in one academic setting. Transcripts were analyzed using an iterative approach to inductive coding. RESULTS: Participants typically perceived PAs' and NPs' roles as being "like a resident," less commonly as independent clinicians, and rarely as collaborators. Barriers to understanding PA and NP roles and perceiving them as collaborators included the lack of preparatory instruction about PAs and NPs, the hierarchical structure of medical education, and inadequate role modeling of interprofessional collaboration. CONCLUSIONS: This study suggests that barriers in the clinical learning environment and the structure of medical education itself may impede residents' learning about PAs and NPs and how to collaborate with them.

Ratings of performance in multisource feedback: comparing performance theories of residents and nurses.

BACKGROUND: Multisource feedback (MSF) is increasingly being used to assess trainee performance, with different assessor groups fulfilling a crucial role in utility of assessment data. However, in health professions education, research on assessor behaviors in MSF is limited. When assessing trainee performance in work settings, assessors use multidimensional conceptualizations of what constitutes effective performance, also called personal performance theories, to distinguish between various behaviors and sub competencies., This may not only explain assessor variability in Multi Source Feedback, but also result in differing acceptance (and use) of assessment data for developmental purposes. The purpose of this study was to explore performance theories of various assessor groups (residents and nurses) when assessing performance of residents. METHODS: A constructivist, inductive qualitative research approach and semi-structured interviews following MSF were used to explore performance theories of 14 nurses and 15 residents in the department of internal medicine at Aga Khan University (AKU). Inductive thematic content analysis of interview transcripts was used to identify and compare key dimensions in residents' and nurses' performance theories used in evaluation of resident performance. RESULTS: Seven major themes, reflecting key dimensions of assessors' performance theories, emerged from the qualitative data, namely; communication skills, patient care, accessibility, teamwork skills, responsibility, medical knowledge and professional attitude. There were considerable overlaps, but also meaningful differences in the performance theories of residents and the nurses, especially with respect to accessibility, teamwork and medical knowledge. CONCLUSION: Residents' and nurses' performance theories for assessing resident performance overlap to some extent, yet also show meaningful differences with respect to the performance dimensions they pay attention to or consider most important. In MSF, different assessor groups may therefore hold different performance theories, depending on their role. Our results further our understanding of assessor source effects in MSF. Implications of our findings are related to implementation of MSF, design of rating scales as well as interpretation and use of MSF data for selection and performance improvement.

Supervisors' intention to observe clinical task performance: an exploratory study using the theory of planned behaviour during postgraduate medical training.

BACKGROUND: Direct observation of clinical task performance plays a pivotal role in competency-based medical education. Although formal guidelines require supervisors to engage in direct observations, research demonstrates that trainees are infrequently observed. Supervisors may not only experience practical and socio-cultural barriers to direct observations in healthcare settings, they may also question usefulness or have low perceived self-efficacy in performing direct observations. A better understanding of how these multiple factors interact to influence supervisors' intention to perform direct observations may help us to more effectively implement the aforementioned guidelines and increase the frequency of direct observations. METHODS: We conducted an exploratory quantitative study, using the Theory of Planned Behaviour (TPB) as our theoretical framework. In applying the TPB, we transfer a psychological theory to medical education to get insight in the influence of cognitive and emotional processes on intentions to use direct observations in workplace based learning and assessment. We developed an instrument to investigate supervisors intention to perform direct observations. The relationships between the TPB measures of our questionnaire were explored by computing bivariate correlations using Pearson's R tests. Hierarchical regression analysis was performed in order to assess the impact of the respective TPB measures as predictors on the intention to perform direct observations. RESULTS: In our study 82 GP supervisors completed our TPB questionnaire. We found that supervisors had a positive attitude towards direct observations. Our TPB model explained 45% of the variance in supervisors' intentions to perform them. Normative beliefs and past behaviour were significant determinants of this intention. CONCLUSION: Our study suggests that supervisors use their past experiences to form intentions to perform direct observations in a careful, thoughtful manner and, in doing so, also take the preferences of the learner and other stakeholders potentially engaged in direct observations into consideration. These findings have potential implications for research into work-based assessments and the development of training interventions to foster a shared mental model on the use of direct observations.

Student perspectives on competency-based portfolios: Does a portfolio reflect their competence development?

INTRODUCTION: Portfolio-based assessments require that learners' competence development is adequately reflected in portfolio documentation. This study explored how students select and document performance data in their portfolios and how they perceive these data to be representative for their competence development. METHODS: Students uploaded performance data in a competency-based portfolio. During one clerkship period, twelve students also recorded an audio diary in which they reflected on experiences and feedback that they perceived to be indicants of their competence development. Afterwards, these students were interviewed to explore the extent to which the performance documentation in the portfolio corresponded with what they considered illustrative evidence of their development. The interviews were analyzed using thematic analysis. RESULTS: Portfolios provide an accurate but fragmented picture of student development. Portfolio documentation was influenced by tensions between learning and assessment, student beliefs about the goal of portfolios, student performance evaluation strategies, the learning environment and portfolio structure. DISCUSSION: This study confirms the importance of taking student perceptions into account when implementing a competency-based portfolio. Students would benefit from coaching on how to select meaningful experiences and performance data for documentation in their portfolios. Flexibility in portfolio structure and requirements is essential to ensure optimal fit between students' experienced competence development and portfolio content.

Learning in the workplace: Use of informal feedback cues in doctor-patient communication.

OBJECTIVES: We expect physicians to be lifelong learners. Participation in clinical practice is an important potential source of that learning. To support physicians in this process, a better understanding of how they learn in clinical practice is necessary. This study investigates how physicians recognise and use informal feedback from interactions with patients in outpatient settings as learning cues to adjust their communication behaviours in daily practice. METHODS: To understand physicians' use of informal feedback, we combined non-participant observations with semi-structured interviews. We enrolled 10 respiratory physicians and observed 100 physician-patient interactions at two teaching hospitals in the Netherlands. Data collection and analysis were performed iteratively according to the principles of constructivist grounded theory. RESULTS: Following stages of open, axial and selective coding, we were able to conceptualise how physicians use cues to reflect on and adjust their communication. In addition to vast variations within and across patient encounters, we observed recurring adjustments in physicians' communication behaviours in response to specific informal feedback cues. Physicians recognised and used these cues to self-monitor communication performance. They had established 'communication repertoires' based on multiple patient interactions, which many saw as learning opportunities contributing to the development of expertise. Our findings, however, show differences in physicians' individual levels of sensitivity in recognising and using learning opportunities in daily practice, which were further influenced by contextual, personal and interpersonal factors. Whereas some described themselves as having little inclination to change, others used critical incidents to fine-tune their communication repertoires, and yet others constantly reshaped them, seeking learning opportunities in their daily work. CONCLUSIONS: There is large variation in how physicians use learning cues from daily practice. To enhance learning in and from daily practice, we propose turning workplace learning into a collaborative effort with the aim of increasing awareness and the use of informal performance-relevant feedback.

ADEA-ADEE Shaping the Future of Dental Education III: Assessment in competency-based dental education: Ways forward.

Assessment in competency-based dental education continues to be a recognized area for growth and development within dental programs around the world. At the joint American Dental Education Association (ADEA) and the Association for Dental Education in Europe (ADEE) 2019 conference, Shaping the Future of Dental Education III, the workshop on assessment was designed to continue the discussion started in 2017 at the ADEA-ADEE Shaping the Future of Dental Education II.1 The focus of the 2019 conference involved examining the potential of entrustable professional activities (EPAs) and current thinking about workplace-based assessment (WBA) within competency-based education in the 21st century. Approximately 30 years ago, George Miller wrote about the assessment of competence in medical education and challenged faculty to reach for higher levels of assessment than knowledge or skill.2 Acknowledging that no one assessment method can result in a valid assessment of competence, Miller proposed a four-level framework for assessment. The lowest level involves measuring what students know ("knows"), followed by assessment of the skill with which knowledge is applied in relevant tasks or problems ("knows how"). Next is an assessment of task performance in standardized settings ("shows how"), and finally, the highest level assesses the student's performance in the unstandardized clinical workplace ("does"). The 2019 assessment workshop focused on advances in the assessment of learners in the unstandardized workplace-the highest level of Miller's assessment pyramid ("does"). Research has shown that dental education has struggled to implement assessment strategies that meet this level.3 The workshop brought together individuals from around the world, with an interest in assessment in dental education, to consider how assessment in the "does" level, specifically EPAs and WBA, factors into competence assessment in dentistry/dental education.

The Construction of Surgical Trust: How Surgeons Judge Residents' Readiness for Operative Independence.

OBJECTIVE: The aim of this study was to explore how trust was constructed between surgeons and residents in the operating room. BACKGROUND: Entrustment is increasingly being used as a key element to assess trainees' competence in the clinical workplace. However, the cognitive process involved in the formulation of surgical trust remains poorly understood. METHODS: In semistructured interviews, 9 general surgeons discussed their experiences in making entrustment decisions during laparoscopic cholecystectomy. Template analysis methodology was employed to develop an explanatory model. RESULTS: Surgeons described the construction of trust as a stepwise process taking place before, during, and after the procedure. The main steps were as follows: (1) an initial propensity to trust based on the perceived risk of the case and trustworthiness of the resident; (2) a decision to initiate trust in the resident to begin the surgery; (3) close observation of preliminary steps; (4) an evolving decision based on whether the surgery is "on-track" or "off-track"; (5) intervention if the surgery was "off-track" (withdrawal of trust); (6) re-evaluation of trust for future cases. The main reasons described for withdrawing trust were: inability to follow instructions, failure to progress, and unsafe manoeuvres. CONCLUSIONS: This study showed that surgical trust is constructed through an iterative process involving gathering and valuing of information, decision-making, close observation, and supervisory intervention. There were strong underlying themes of control and responsibility, and trust was noted to increase over time and over repeated observations. The model presented here may be useful in improving judgements on competence in the surgical workplace.

The impact of entrustment assessments on feedback and learning: Trainee perspectives.

CONTEXT: Assessment for and of learning in workplace settings is at the heart of competency-based medical education. In postgraduate medical education (PGME), entrustable professional activities (EPAs) and entrustment scales are increasingly used to assess competence. However, the educational impacts of these assessment approaches remain unknown. Therefore, this study aimed to explore trainee perceptions regarding the impacts of EPAs and entrustment scales on feedback and learning processes in the clinical setting. METHODS: Four focus groups were conducted with postgraduate trainees in anaesthesia, emergency medicine, general internal medicine and nephrology at McMaster University in Hamilton, Ontario, Canada. Data collection and analysis were informed by principles of constructivist grounded theory. RESULTS: Entrustable professional activities representing well-defined tasks are perceived as potentially effective drivers for feedback and learning. Use of EPAs and entrustment scales, however, may augment existing tensions between developmental (for learning) and decision-making (of learning) assessment functions. Three key dilemmas seem to influence the impact of EPA-based assessment approaches on residents' learning: (a) standardisation of outcomes versus flexibility in assessment to align with individual learning experiences; (b) assessment tasks focusing on performance standards versus opportunities for learning, and (c) feedback focusing on numeric entrustment scores versus narrative and dialogue. Use of entrustment as an assessment outcome may impact trainees' motivation and feelings of self-efficacy, further enhancing tensions between learning and performance. CONCLUSIONS: Entrustable professional activities and entrustment scales may support assessment for learning in PGME. However, their successful implementation requires the careful management of dilemmas that arise in EPA-based assessment in order to support competence development.

Beyond the self: The role of co-regulation in medical students' self-regulated learning.

CONTEXT: Medical students are expected to self-regulate their learning within complex and unpredictable clinical learning environments. Research increasingly focuses on the effects of social interactions on the development of self-regulation in workplace settings, a notion embodied within the concept of co-regulated learning (CRL). Creating workplace learning environments that effectively foster lifelong self-regulated learning (SRL) requires a deeper understanding of the relationship between CRL and SRL. The aim of this study was therefore to explore medical students' perceptions of CRL in clinical clerkships and its perceived impact on the development of their SRL. METHODS: We conducted semi-structured interviews with 11 purposively sampled medical students enrolled in clinical clerkships at one undergraduate competency-based medical school. Data collection and analysis were conducted iteratively, informed by principles of constructivist grounded theory. Data analysis followed stages of open, axial and selective coding, which enabled us to conceptualise how co-regulation influences the development of students' self-regulation. RESULTS: Data revealed three interrelated shifts in CRL and SRL as students progressed through clerkships. First, students' CRL shifted from a focus on peers to co-regulation with clinician role models. Second, self-regulated behaviour shifted from being externally driven to being internally driven. Last, self-regulation shifted from a task-oriented approach towards a more comprehensive approach focusing on professional competence and identity formation. Students indicated that if they felt able to confidently and proactively self-regulate their learning, the threshold for engaging others in meaningful CRL seemed to be lowered, enhancing further development of SRL skills. CONCLUSIONS: Findings from the current study emphasise the notion that SRL and its development are grounded in CRL in clinical settings. To optimally support the development of students' SRL, we need to focus on facilitating and organising learners' engagement in CRL from the start of the medical curriculum.

Perceptions of people with respiratory problems on physician performance evaluation-A qualitative study.

BACKGROUND: Despite increasing calls for patient and public involvement in health-care quality improvement, the question of how patient evaluations can contribute to physician learning and performance assessment has received scant attention. OBJECTIVE: The objective of this study was to explore, amid calls for patient involvement in quality assurance, patients' perspectives on their role in the evaluation of physician performance and to support physicians' learning and decision making on professional competence. DESIGN: A qualitative study based on semi-structured interviews. SETTING AND PARTICIPANTS: The study took place in a secondary care setting in the Netherlands. The authors selected 25 patients from two Dutch hospitals and through the Dutch Lung Foundation, using purposive sampling. METHODS: Data were analysed according to the principles of template analysis, based on an a priori coding framework developed from the literature about patient empowerment, feedback and performance assessment. RESULTS: The analysis unearthed three predominant patient perspectives: the proactive perspective, the restrained perspective and the outsider perspective. These perspectives differed in terms of perceived power dynamics within the doctor-patient relationship, patients' perceived ability, and willingness to provide feedback and evaluate their physician's performance. Patients' perspectives thus affected the role patients envisaged for themselves in evaluating physician performance. DISCUSSION AND CONCLUSION: Although not all patients are equally suitable or willing to be involved, patients can play a role in evaluating physician performance and continuing training through formative approaches. To involve patients successfully, it is imperative to distinguish between different patient perspectives and empower patients by ensuring a safe environment for feedback.

Assessors' interpretations of narrative data on communication skills in a summative OSCE.

OBJECTIVES: Increasingly, narrative assessment data are used to substantiate and enhance the robustness of assessor judgements. However, the interpretation of written assessment comments is inherently complex and relies on human (expert) judgements. The purpose of this study was to explore how expert assessors process and construe or bring meaning to narrative data when interpreting narrative assessment comments written by others in the setting of standardised performance assessment. METHODS: Narrative assessment comments on student communication skills and communication scores across six objective structured clinical examination stations were obtained for 24 final-year pharmacy students. Aggregated narrative data across all stations were sampled for nine students (three good, three average and three poor performers, based on communication scores). A total of 10 expert assessors reviewed the aggregated set of narrative comments for each student. Cognitive (information) processing was captured through think-aloud procedures and verbal protocol analysis. RESULTS: Expert assessors primarily made use of two strategies to interpret the narratives, namely comparing and contrasting, and forming mental images of student performance. Assessors appeared to use three different perspectives when interpreting narrative comments, including those of: (i) the student (placing him- or herself in the shoes of the student); (ii) the examiner (adopting the role of examiner and reinterpreting comments according to his or her own standards or beliefs), and (iii) the professional (acting as the profession's gatekeeper by considering the assessment to be a representation of real-life practice). CONCLUSIONS: The present findings add to current understandings of assessors' interpretations of narrative performance data by identifying the strategies and different perspectives used by expert assessors to frame and bring meaning to written comments. Assessors' perspectives affect assessors' interpretations of assessment comments and are likely to be influenced by their beliefs, interpretations of the assessment setting and personal performance theories. These results call for the use of multiple assessors to account for variations in assessor perspectives in the interpretation of narrative assessment data.

Exploring the effect of PAs on physician trainee learning: An interview study.

BACKGROUND: Physician assistants (PAs) often have been embedded in academic medical centers to help ensure an adequate patient care workforce while supporting compliance with work-hour restrictions for residents and fellows (also called trainees). Limited studies have explored the effect of PAs on trainee learning. This qualitative study explored, from the perspective of physician faculty and PAs, how PAs working in the clinical learning environment can enhance or hinder trainee learning. METHODS: Using purposive sampling, 12 PAs and 12 physician faculty members in one US teaching hospital were selected for semistructured interviews. Data collection and analysis were characterized by an iterative process. Data analysis was informed by principles of conventional content analysis. RESULTS: Participants identified various ways in which PAs may affect trainee learning, intrinsically linked to the roles PAs assume in the clinical learning environment: clinician, teammate, and clinical teacher. Trainee learning may be enhanced because learning time can be optimized by having PAs in the clinical learning environment. Trainees can learn about PAs and how to collaborate with them, and PAs can enculturate and provide clinical instruction to trainees. Trainee learning may be hindered if learning opportunities for trainees go to PAs, trainees feel intimidated by experienced PAs, or trainees become too dependent on PAs. CONCLUSIONS: Our findings demonstrate enhancements and hindrances to trainees' learning linked to three key roles PAs perform in the clinical learning environment. These findings can inform how PAs are integrated into teaching services. Further investigation is needed to understand how PAs can balance their professional roles to foster effective collaborative practice and learning.