A phenomenology of direct observation in residency: Is Miller's 'does' level observable?

INTRODUCTION: Guidelines on direct observation (DO) present DO as an assessment of Miller's 'does' level, that is, the learner's ability to function independently in clinical situations. The literature, however, indicates that residents may behave 'inauthentically' when observed. To minimise this 'observer effect', learners are encouraged to 'do what they would normally do' so that they can receive feedback on their actual work behaviour. Recent phenomenological research on patients' experiences with DO challenges this approach; patients needed-and caused-some participation of the observing supervisor. Although guidelines advise supervisors to minimise their presence, we are poorly informed on how some deliberate supervisor participation affects residents' experience in DO situations. Therefore, we investigated what residents essentially experienced in DO situations. METHODS: We performed an interpretive phenomenological interview study, including six general practice (GP) residents. We collected and analysed our data, using the four phenomenological lenses of lived body, lived space, lived time and lived relationship. We grouped our open codes by interpreting what they revealed about common structures of residents' pre-reflective experiences. RESULTS: Residents experienced the observing supervisor not just as an observer or assessor. They also experienced them as both a senior colleague and as the patient's familiar GP, which led to many additional interactions. When residents tried to act as if the supervisor was not there, they could feel insecure and handicapped because the supervisor was there, changing the situation. DISCUSSION: Our results indicate that the 'observer effect' is much more material than was previously understood. Consequently, observing residents' 'authentic' behaviour at Miller's 'does' level, as if the supervisor was not there, seems impossible and a misleading concept: misleading, because it may frustrate residents and cause supervisors to neglect patients' and residents' needs in DO situations. We suggest that one-way DO is better replaced by bi-directional DO in working-and-learning-together sessions.

Phenomenological Research in Health Professions Education: Tunneling from Both Ends.

Issue: The term "phenomenology" is increasingly being used in Health Professions Education research. Phenomenology refers to a philosophical tradition or discipline. For researchers in Health Professions Education without a philosophical or humanities background, there are two practical problems. The first is that it is not always clear how studies that call themselves "phenomenological" are distinct from studies that use other methods; phenomenology as a label seems to be used for any study that is interested in the experiences of participants. The second problem is that a more in-depth study of phenomenology in the literature yields either abstract definitions such as "examining the underlying structures of consciousness," or contrasting translations of phenomenology to concrete research tools. What would phenomenology in medical education research look like that is both true to its philosophical roots and yields research findings that contribute to the quality of medical education? Evidence: Two medical education researchers, one with a medical background and the other with a philosophy background, engaged in a dialogue with the purpose of formulating an approach for phenomenology in medical education research. The first departed from the practical demands of his research project in which phenomenology was suggested as a methodology, but guidance was lacking. The other departed from the philosophical tradition of phenomenology with the purpose of exploring how phenomenological insights can be valuable for medical education research. The paper presents these journeys and the results of this dialogue where they formulate starting points for an approach to conducting HPE research that has scientific phenomenological integrity and yields practical results. Implications: Phenomenology has been one of the defining developments in philosophy and the humanities in the 20th century. A basic grasp of its insights is useful for medical education researchers since any research today takes place in the light of these insights. Within medical education, there are certain types of phenomena, research questions, and research goals that call for an explicitly phenomenological approach. Rather than prescribing specific methods or methodologies, phenomenology offers signposts for how to think about the relationship between our research object, methods, and data, and our own role as researchers. We suggest that researchers in HPE, when reporting a phenomenological study, instead of claiming to have followed a certain phenomenological method, explain how their research question, methods, and results fit the purposes and standards of phenomenology. We illustrate this with an example of how to use phenomenology in an interview study.

A phenomenological investigation of patients' experiences during direct observation in residency: busting the myth of the fly on the wall.

Direct observation (DO) of residents by supervisors is a highly recommended educational tool in postgraduate medical education, yet its uptake is poor. Residents and supervisors report various reasons for not engaging in DO. Some of these relate to their interaction with patients during DO. We do not know the patient perspectives on these interactions, nor, more broadly, what it is like to be a patient in a DO situation. Understanding the patient perspective may lead to a more complete understanding of the dynamics in DO situations, which may benefit patient wellbeing and improve the use of DO as an educational tool. We conducted a phenomenological interview study to investigate the experience of being a patient in a DO situation. Our analysis included multiple rounds of coding and identifying themes, and a final phase of phenomenological reduction to arrive at the essential elements of the experience. Constant reflexivity was at the heart of this process. Our results provide a new perspective on the role of the supervisor in DO situations. Patients were willing to address the resident, but sought moments of contact with, and some participation by, the supervisor. Consequently, conceptions of DO in which the supervisor thinks she is a fly on the wall rather than a part of the interaction, should be critically reviewed. To that end, we propose the concept of participative direct observation in workplace learning, which also acknowledges the observer's role as participant. Embracing this concept may benefit both patients' wellbeing and residents' learning.

What happens under the flag of direct observation, and how that matters: A qualitative study in general practice residency.

INTRODUCTION: In competency-based medical education, direct observation (DO) of residents' skills is scarce, notwithstanding its undisputed importance for credible feedback and assessment. A growing body of research is investigating this discrepancy. Strikingly, in this research, DO as a concrete educational activity tends to remain vague. In this study, we concretised DO of technical skills in postgraduate longitudinal training relationships. METHODS: Informed by constructivist grounded theory, we performed a focus group study among general practice residents. We asked residents about their experiences with different manifestations of DO of technical skills. A framework describing different DO patterns with their varied impact on learning and the training relationship was constructed and refined until theoretical sufficiency was reached. RESULTS: The dominant DO pattern was ad hoc, one-way DO. Importantly, in this pattern, various unpredictable, and sometimes unwanted, scenarios could occur. Residents hesitated to discuss unwanted scenarios with their supervisors, sometimes instead refraining from future requests for DO or even for help. Planned bi-directional DO sessions, though seldom practiced, contributed much to collaborative learning in a psychologically safe training relationship. DISCUSSION AND CONCLUSION: Patterns matter in DO. Residents and supervisors should be made aware of this and educated in maintaining an open dialogue on how to use DO for the benefit of learning and the training relationship.

Patterns of direct observation and their impact during residency: general practice supervisors' views.

CONTEXT: Direct observation (DO) of residents' performance, despite the importance that is ascribed to it, does not readily fit in with the practice of postgraduate medical education (PGME); it is infrequent and the quality of observation may be poor in spite of ongoing efforts towards improvement. In recent literature, DO is mostly portrayed as a means to gather information on the performance of residents for purposes of feedback and assessment. The role of DO in PGME is likely to be more complex and poorly understood in the era of outcome-based education. By exploring the possible complexity of DO in workplace learning, our research aims to contribute to a better use of DO in the practice of PGME. METHODS: Constructivist grounded theory informed our data collection and analysis. Data collection involved focus group sessions with supervisors in Dutch general practice who were invited to discuss the manifestations, meanings and effects of DO of technical skills. Theoretical sufficiency was achieved after four focus groups, with a total of 28 participants being included. RESULTS: We found four patterns of DO of technical skills: initial planned DO sessions; resident-initiated ad hoc DO; supervisor-initiated ad hoc DO, and continued planned DO sessions. Different patterns of DO related to varying meanings, such as checking or trusting, and effects, such as learning a new skill or experiencing emotional discomfort, all of them concerning the training relationship, patient safety or residents' learning. CONCLUSIONS: Direct observation, to supervisors, means much more than gathering information for purposes of feedback and assessment. Planned DO sessions are an important routine during the initiation phase of a training relationship. Continued planned bidirectional DO sessions, although infrequently practised, potentially combine most benefits with least side-effects of DO. Ad hoc DO, although much relied upon, is often hampered by internal tensions in supervisors, residents or both.

Perceived health profiles of Dutch university students living with their parents, alone or with peers.

Students report a lower health status compared with working peers. This discrepancy may be the result of differences in their living situation, such as student housing. The aim of this study was to compare students who were living with their parents with students who were not living with their parents but rather with peers, alone, or with a partner using logistic regression analyses. We hypothesized that students who were living with their parents would report better health outcomes than students who were living with peers or alone or with a partner. A group of 8,258 students studying at the University of Amsterdam, the Netherlands were invited to complete an internet-distributed questionnaire, consisting of questions about general health, fatigue, psychological health, support, study-related issues, study-related problem solving, time pressure, perceived study delay and program study delay, and living situation. Students who are living with their parents reported a lower health status compared with students living with peers or alone/with a partner. Students living with their parents were less often using tobacco, alcohol, or drugs compared with the other two groups. Our hypothesis is not supported by the results of the present study. Students living alone or with a partner and students who are living with peers reported a better general health status than students living with their parents.