An Interprofessional Faculty Development Program for Workplace-Based Learning.

Background: Most faculty development programs in health professions education, pivotal in cultivating competent and effective teachers, focus on systematic, planned and formal learning opportunities. A large part of clinical teaching however, encompasses ad-hoc, informal and interprofessional workplace-based learning whereby individuals learn as part of everyday work activities. To fully harness the educational potential embedded in daily healthcare practices, prioritizing interprofessional faculty development for workplace-based learning is crucial. Approach: Utilizing the 'ADDIE' instructional design framework we developed, implemented and evaluated an interprofessional faculty development program for workplace-based learning. This program, encompassing seven formal training sessions each with a different theme and five individual workplace-based assignments, aimed to support clinical teachers in recognizing and optimizing informal learning. Outcomes: The pilot program (n = 10) and first two regular courses (n = 13 each) were evaluated using questionnaires containing Likert scale items and open textboxes for narrative comments. The quality and relevance of the program to the clinical work-place were highly appreciated. Additional valued elements included practical knowledge provided and tools for informal workplace-based teaching, the interprofessional aspect of the program and the workplace-based assignments. Since its development, the program has undergone minor revisions twice and has now become a successful interprofessional workplace-based alternative to existing faculty development programs. Reflection: This faculty development program addresses the specific needs of healthcare professionals teaching in clinical settings. It stands out by prioritizing informal learning, fostering collaboration, and supporting integration of formal training into daily practice, ensuring practical application of learned knowledge and skills. Furthermore, it emphasizes interprofessional teaching and learning, enhancing workplace environments.

Medical Students' General Beliefs and Specific Perceptions about Patient Feedback Before and after Training in a Clinical Context.

Introduction: Despite its high potential, patient feedback does not always result in learning. For feedback to be effective students must engage with it, which partly depends on their perceptions of feedback. To better understand student engagement with patient feedback in a clinical context, this study explored the following research questions: 1) What are medical students' general beliefs about patient feedback and what are their specific perceptions of feedback messages? 2) What is the difference between these general beliefs and feedback message perceptions before and after patient feedback training? Methods: The study context was a 12-week clerkship combining Pediatrics and Gynecology, which included feedback training for students and asking for patient feedback. Ninety 4th-year medical students completed pre- and post-clerkship questionnaires. The questionnaires (Beliefs about Patient Feedback Questionnaire, Feedback Perception Questionnaire) were adapted from validated peer-feedback questionnaires. Questionnaires were quantitatively analyzed. Results: Both pre- and post-clerkship, students had positive general beliefs about patient feedback and positive perceptions of the feedback messages they received. However, paired t-tests showed that students' general beliefs and feedback message perceptions became less positive after feedback training and experience. Discussion: Patient feedback is not an easy means to learn and students do not become feedback literate in terms of patient feedback overnight. We suggest that future researchers further explore reasons for the decline in positive perceptions of patient feedback. We suggest implementing longitudinal feedback training in medical curricula, where students are guided and supported in the complex task of learning from patients through feedback.

Why Medical Residents Do (and Don't) Speak Up About Organizational Barriers and Opportunities to Improve the Quality of Care.

PURPOSE: Medical residents are valuable sources of information about the quality of frontline service delivery, but if they do not speak up, their ideas, opinions, and suggestions for improving their work practices cannot be considered. However, speaking up can be difficult for residents. Therefore, the authors have explored both what helps residents speak up about organizational barriers and opportunities to improve the quality of their work and what hinders them from doing so. METHOD: The authors conducted an exploratory qualitative interview study with 27 Dutch medical residents in the Netherlands in 2016. They used the critical incident technique for data collection and the constant comparison method of the Qualitative Analysis Guide of Leuven for data analysis. RESULTS: Three types of incidents in which residents considered speaking up are described. The authors identified 2 main considerations that influenced residents' decisions about speaking up: Is it safe to speak up, and is speaking up likely to be effective? Residents' decisions were influenced by personal, team, and organizational aspects of their situations, such as supervisors' open attitudes, hierarchy, duration of clinical rotations, organization size, and experiences (either vicarious or their own). CONCLUSIONS: Findings from this study indicate that residents tend to be silent when they encounter organizational barriers or opportunities to improve the quality of their work. Perceived effectiveness and safety are important forces that drive and constrain speaking up. The authors provide important starting points to empower medical residents to speak up about their suggestions for change.

Speaking up, support, control and work engagement of medical residents. A structural equation modelling analysis.

OBJECTIVES: Medical residents can play key roles in improving health care quality by speaking up and giving suggestions for improvements. However, previous research on speaking up by medical residents has shown that speaking up is difficult for residents. This study explored: (i) whether two main aspects of medical residents' work context (job control and supervisor support) are associated with speaking up by medical residents, and (ii) whether these associations differ between in-hospital and out-of-hospital settings. METHODS: Speaking up was operationalised and measured as voice behaviour. Structural equation modelling using a cross-sectional survey design was used to identify and test factors pertaining to speaking up and to compare hospital settings. RESULTS: A total of 499 medical residents in the Netherlands participated in the study. Correlational analysis showed significant positive associations between each of support and control, and voice behaviour. The authors assumed that the associations between support and control, and voice behaviour would be partially mediated by engagement. This partial mediation model fitted the data best, but showed no association between support and voice. However, multi-group analysis showed that for residents in hospital settings, support is associated with voice behaviour. For residents outside hospital settings, control is more important. Engagement mediated the effects of control and support outside hospital settings, but not within the hospital. CONCLUSIONS: This study shows that in order to enable medical residents to share their suggestions for improvement, it is beneficial to invest in supportive supervision and to increase their sense of control. Boosting medical residents' support would be most effective in hospital settings, whereas in other health care organisations it would be more effective to focus on job control.

Volumetric image interpretation in radiology: scroll behavior and cognitive processes.

The interpretation of medical images is a primary task for radiologists. Besides two-dimensional (2D) images, current imaging technologies allow for volumetric display of medical images. Whereas current radiology practice increasingly uses volumetric images, the majority of studies on medical image interpretation is conducted on 2D images. The current study aimed to gain deeper insight into the volumetric image interpretation process by examining this process in twenty radiology trainees who all completed four volumetric image cases. Two types of data were obtained concerning scroll behaviors and think-aloud data. Types of scroll behavior concerned oscillations, half runs, full runs, image manipulations, and interruptions. Think-aloud data were coded by a framework of knowledge and skills in radiology including three cognitive processes: perception, analysis, and synthesis. Relating scroll behavior to cognitive processes showed that oscillations and half runs coincided more often with analysis and synthesis than full runs, whereas full runs coincided more often with perception than oscillations and half runs. Interruptions were characterized by synthesis and image manipulations by perception. In addition, we investigated relations between cognitive processes and found an overall bottom-up way of reasoning with dynamic interactions between cognitive processes, especially between perception and analysis. In sum, our results highlight the dynamic interactions between these processes and the grounding of cognitive processes in scroll behavior. It suggests, that the types of scroll behavior are relevant to describe how radiologists interact with and manipulate volumetric images.

Women in Translational Medicine: Tools to Break the Glass Ceiling.

Despite the recent movements for female equality and empowerment, few women occupy top positions in scientific decision-making. The challenges women face during their career may arise from societal biases and the current scientific culture. We discuss the effect of such biases at three different levels of the career and provide suggestions to tackle them. At the societal level, gender roles can create a negative feedback loop in which women are discouraged from attaining top positions and men are discouraged from choosing a home-centred lifestyle. This loop can be broken early in life by providing children with female role models that have a work-centred life and opening up the discussion about gender roles at a young age. At the level of hiring, unconscious biases can lead to a preference for male candidates. The introduction of (unbiased) artificial intelligence algorithms and gender champions in the hiring process may restore the balance and give men and women an equal chance. At the level of coaching and evaluation, barriers that women face should be addressed on a personal level through the introduction of coaching and mentoring programmes. In addition, women may play a pivotal role in shifting the perception of scientific success away from bibliometric outcomes only towards a more diverse assessment of quality and societal relevance. Taken together, these suggestions may break the glass ceiling in the scientific world for women; create more gender diversity at the top and improve translational science in medicine.

Increasing Authenticity of Simulation-Based Assessment in Diagnostic Radiology.

INTRODUCTION: Clinical reasoning in diagnostic imaging professions is a complex skill that requires processing of visual information and image manipulation skills. We developed a digital simulation-based test method to increase authenticity of image interpretation skill assessment. METHODS: A digital application, allowing volumetric image viewing and manipulation, was used for three test administrations of the national Dutch Radiology Progress Test for residents. This study describes the development and implementation process in three phases. To assess authenticity of the digital tests, perceived image quality and correspondence to clinical practice were evaluated and compared with previous paper-based tests (PTs). Quantitative and qualitative evaluation results were used to improve subsequent tests. RESULTS: Authenticity of the first digital test was not rated higher than the PTs. Test characteristics and environmental conditions, such as image manipulation options and ambient lighting, were optimized based on participants' comments. After adjustments in the third digital test, participants favored the image quality and clinical correspondence of the digital image questions over paper-based image questions. CONCLUSIONS: Digital simulations can increase authenticity of diagnostic radiology assessments compared with paper-based testing. However, authenticity does not necessarily increase with higher fidelity. It can be challenging to simulate the image interpretation task of clinical practice in a large-scale assessment setting, because of technological limitations. Optimizing image manipulation options, the level of ambient light, time limits, and question types can help improve authenticity of simulation-based radiology assessments.

Predictors of Knowledge and Image Interpretation Skill Development in Radiology Residents.

Purpose To investigate knowledge and image interpretation skill development in residency by studying scores on knowledge and image questions on radiology tests, mediated by the training environment. Materials and Methods Ethical approval for the study was obtained from the ethical review board of the Netherlands Association for Medical Education. Longitudinal test data of 577 of 2884 radiology residents who took semiannual progress tests during 5 years were retrospectively analyzed by using a nonlinear mixed-effects model taking training length as input variable. Tests included nonimage and image questions that assessed knowledge and image interpretation skill. Hypothesized predictors were hospital type (academic or nonacademic), training hospital, enrollment age, sex, and test date. Results Scores showed a curvilinear growth during residency. Image scores increased faster during the first 3 years of residency and reached a higher maximum than knowledge scores (55.8% vs 45.1%). The slope of image score development versus knowledge question scores of 1st-year residents was 16.8% versus 12.4%, respectively. Training hospital environment appeared to be an important predictor in both knowledge and image interpretation skill development (maximum score difference between training hospitals was 23.2%; P < .001). Conclusion Expertise developed rapidly in the initial years of radiology residency and leveled off in the 3rd and 4th training year. The shape of the curve was mainly influenced by the specific training hospital. © RSNA, 2017 Online supplemental material is available for this article.

Touchscreen Tablets: Coordinating Action and Perception for Mathematical Cognition.

Proportional reasoning is important and yet difficult for many students, who often use additive strategies, where multiplicative strategies are better suited. In our research we explore the potential of an interactive touchscreen tablet application to promote proportional reasoning by creating conditions that steer students toward multiplicative strategies. The design of this application (Mathematical Imagery Trainer) was inspired by arguments from embodied-cognition theory that mathematical understanding is grounded in sensorimotor schemes. This study draws on a corpus of previously treated data of 9-11 year-old students, who participated individually in semi-structured clinical interviews, in which they solved a manipulation task that required moving two vertical bars at a constant ratio of heights (1:2). Qualitative analyses revealed the frequent emergence of visual attention to the screen location halfway along the bar that was twice as high as the short bar. The hypothesis arose that students used so-called "attentional anchors" (AAs)-psychological constructions of new perceptual structures in the environment that people invent spontaneously as their heuristic means of guiding effective manual actions for managing an otherwise overwhelming task, in this case keeping vertical bars at the same proportion while moving them. We assumed that students' AAs on the mathematically relevant points were crucial in progressing from additive to multiplicative strategies. Here we seek farther to promote this line of research by reanalyzing data from 38 students (aged 9-11). We ask: (1) What quantitative evidence is there for the emergence of AAs?; and (2) How does the transition from additive to multiplicative reasoning take place when solving embodied proportions tasks in interaction with the touchscreen tablet app? We found that: (a) AAs appeared for all students; (b) the AA-types were few across the students; (c) the AAs were mathematically relevant (top of the bars and halfway along the tall bar); (d) interacting with the tablet was crucial for the AAs' emergence; and (e) the vast majority of students progressed from additive to multiplicative strategies (as corroborated with oral utterances). We conclude that touchscreen applications have the potential to create interaction conditions for coordinating action and perception into mathematical cognition.

Identifying error types in visual diagnostic skill assessment.

BACKGROUND: Misinterpretation of medical images is an important source of diagnostic error. Errors can occur in different phases of the diagnostic process. Insight in the error types made by learners is crucial for training and giving effective feedback. Most diagnostic skill tests however penalize diagnostic mistakes without an eye for the diagnostic process and the type of error. A radiology test with stepwise reasoning questions was used to distinguish error types in the visual diagnostic process. We evaluated the additional value of a stepwise question-format, in comparison with only diagnostic questions in radiology tests. METHODS: Medical students in a radiology elective (n=109) took a radiology test including 11-13 cases in stepwise question-format: marking an abnormality, describing the abnormality and giving a diagnosis. Errors were coded by two independent researchers as perception, analysis, diagnosis, or undefined. Erroneous cases were further evaluated for the presence of latent errors or partial knowledge. Inter-rater reliabilities and percentages of cases with latent errors and partial knowledge were calculated. RESULTS: The stepwise question-format procedure applied to 1351 cases completed by 109 medical students revealed 828 errors. Mean inter-rater reliability of error type coding was Cohen's κ=0.79. Six hundred and fifty errors (79%) could be coded as perception, analysis or diagnosis errors. The stepwise question-format revealed latent errors in 9% and partial knowledge in 18% of cases. CONCLUSIONS: A stepwise question-format can reliably distinguish error types in the visual diagnostic process, and reveals latent errors and partial knowledge.

Building bridges: engaging medical residents in quality improvement and medical leadership.

OBJECTIVE: To develop an educational intervention that targets residents' beliefs and attitudes to quality Improvement (QI) and leadership in order to demonstrate proactive behaviour. DESIGN: Theory-driven, mixed methods study including document analysis, interviews, observations and open-ended questionnaires. SETTING: Six Dutch teaching hospitals. INTERVENTION: Using expertise from medicine, psychology, organizational and educational sciences we developed a situated learning programme named Ponder and IMProve (PIMP). The acronym PIMP reflects the original upbeat name in Dutch, Verwonder & Verbeter. It has a modern, positive meaning that relates to improving your current circumstances. In quarterly 1-h sessions residents are challenged to identify daily workplace frustrations and translate them into small-scale QI activities. MAIN OUTCOME MEASURES: Organizational awareness, beliefs and attitudes to QI and organizational responsibilities, resident behaviour, barriers and facilitators to successful learning and the programme's potential impact on the organization. RESULTS: Overall, 19 PIMP meetings were held over a period of 3 years. Residents defined 119 PIMP goals, resolved 37 projects and are currently working on another 39 projects. Interviews show that PIMP sessions make residents more aware of the organizational aspects of their daily work. Moreover, residents feel empowered to take up the role of change agent. Facilitators for success include a positive cost-benefit trade-off, a valuable group process and a safe learning environment. CONCLUSION: This article demonstrates the added value of multidisciplinary theory-driven research for the design, development and evaluation of educational programmes. Residents can be encouraged to develop organizational awareness and reshape their daily frustrations in QI work.

Support for external validity of radiological anatomy tests using volumetric images.

RATIONALE AND OBJECTIVES: Radiology practice has become increasingly based on volumetric images (VIs), but tests in medical education still mainly involve two-dimensional (2D) images. We created a novel, digital, VI test and hypothesized that scores on this test would better reflect radiological anatomy skills than scores on a traditional 2D image test. To evaluate external validity we correlated VI and 2D image test scores with anatomy cadaver-based test scores. MATERIALS AND METHODS: In 2012, 246 medical students completed one of two comparable versions (A and B) of a digital radiology test, each containing 20 2D image and 20 VI questions. Thirty-three of these participants also took a human cadaver anatomy test. Mean scores and reliabilities of the 2D image and VI subtests were compared and correlated with human cadaver anatomy test scores. Participants received a questionnaire about perceived representativeness and difficulty of the radiology test. RESULTS: Human cadaver test scores were not correlated with 2D image scores, but significantly correlated with VI scores (r = 0.44, P < .05). Cronbach's α reliability was 0.49 (A) and 0.65 (B) for the 2D image subtests and 0.65 (A) and 0.71 (B) for VI subtests. Mean VI scores (74.4%, standard deviation 2.9) were significantly lower than 2D image scores (83.8%, standard deviation 2.4) in version A (P < .001). VI questions were considered more representative of clinical practice and education than 2D image questions and less difficult (both P < .001). CONCLUSIONS: VI tests show higher reliability, a significant correlation with human cadaver test scores, and are considered more representative for clinical practice than tests with 2D images.

Volumetric and two-dimensional image interpretation show different cognitive processes in learners.

RATIONALE AND OBJECTIVES: In current practice, radiologists interpret digital images, including a substantial amount of volumetric images. We hypothesized that interpretation of a stack of a volumetric data set demands different skills than interpretation of two-dimensional (2D) cross-sectional images. This study aimed to investigate and compare knowledge and skills used for interpretation of volumetric versus 2D images. MATERIALS AND METHODS: Twenty radiology clerks were asked to think out loud while reading four or five volumetric computed tomography (CT) images in stack mode and four or five 2D CT images. Cases were presented in a digital testing program allowing stack viewing of volumetric data sets and changing views and window settings. Thoughts verbalized by the participants were registered and coded by a framework of knowledge and skills concerning three components: perception, analysis, and synthesis. The components were subdivided into 16 discrete knowledge and skill elements. A within-subject analysis was performed to compare cognitive processes during volumetric image readings versus 2D cross-sectional image readings. RESULTS: Most utterances contained knowledge and skills concerning perception (46%). A smaller part involved synthesis (31%) and analysis (23%). More utterances regarded perception in volumetric image interpretation than in 2D image interpretation (Median 48% vs 35%; z = -3.9; P < .001). Synthesis was less prominent in volumetric than in 2D image interpretation (Median 28% vs 42%; z = -3.9; P < .001). No differences were found in analysis utterances. CONCLUSIONS: Cognitive processes in volumetric and 2D cross-sectional image interpretation differ substantially. Volumetric image interpretation draws predominantly on perceptual processes, whereas 2D image interpretation is mainly characterized by synthesis. The results encourage the use of volumetric images for teaching and testing perceptual skills.

Volumetric CT-images improve testing of radiological image interpretation skills.

RATIONALE AND OBJECTIVES: Current radiology practice increasingly involves interpretation of volumetric data sets. In contrast, most radiology tests still contain only 2D images. We introduced a new testing tool that allows for stack viewing of volumetric images in our undergraduate radiology program. We hypothesized that tests with volumetric CT-images enhance test quality, in comparison with traditional completely 2D image-based tests, because they might better reflect required skills for clinical practice. MATERIALS AND METHODS: Two groups of medical students (n=139; n=143), trained with 2D and volumetric CT-images, took a digital radiology test in two versions (A and B), each containing both 2D and volumetric CT-image questions. In a questionnaire, they were asked to comment on the representativeness for clinical practice, difficulty and user-friendliness of the test questions and testing program. Students' test scores and reliabilities, measured with Cronbach's alpha, of 2D and volumetric CT-image tests were compared. RESULTS: Estimated reliabilities (Cronbach's alphas) were higher for volumetric CT-image scores (version A: .51 and version B: .54), than for 2D CT-image scores (version A: .24 and version B: .37). Participants found volumetric CT-image tests more representative of clinical practice, and considered them to be less difficult than volumetric CT-image questions. However, in one version (A), volumetric CT-image scores (M 80.9, SD 14.8) were significantly lower than 2D CT-image scores (M 88.4, SD 10.4) (p<.001). The volumetric CT-image testing program was considered user-friendly. CONCLUSION: This study shows that volumetric image questions can be successfully integrated in students' radiology testing. Results suggests that the inclusion of volumetric CT-images might improve the quality of radiology tests by positively impacting perceived representativeness for clinical practice and increasing reliability of the test.

Teacher competences required for developing reflection skills of nursing students.

AIM: This paper is a report of a study in senior secondary vocational education designed to develop a framework for teacher competences to support nursing students in developing their reflection skills. BACKGROUND: For healthcare-related professions such as nursing, there is a growing attention for developing reflection skills. Little is known about teacher competences required to support the development of reflection skills in nursing students. Developing a framework of teacher competences can contribute to filling up this gap. These competences are described in 91 indicators distributed over six task domains. METHODS: A Delphi study was conducted in the first half year of 2008 to get consensus on a framework of teacher competences required for creating the learning environment needed for developing reflection skills in nursing students. Experts judged teacher competences on a seven-point Likert-type scale. FINDINGS: In the first round, mean scores on the teacher competences were already high. Minor revisions were needed. In the second round, mean scores increased, whereas standard deviations decreased in round 2 compared with round 1. These changes were statistically significant. Coaching was seen as most important task domain. CONCLUSION: Consensus has been reached on teacher competences to be used in nursing education to develop students' reflection skills. The framework of competences may be a source for curriculum development concerning reflection skills and for teacher training programmes to coach nursing students' reflections.