Adapting standardized patient training to improve patients' understanding and preparedness for health care encounters.

OBJECTIVE: To examine the impact of standardized patient (SP) training on SPs' real-life healthcare encounters and explore whether SP training elements can be adapted to increase actual patients' understanding, communication and participation in a patient-centered care model. METHODS: Data were collected from surveys and focus groups with standardized patients and a survey of primary care physicians. Findings were used to create an educational video with pre- and post-viewing surveys of patients' understanding of engagement strategies and plans to use them in future encounters. RESULTS: SPs reported medical visits were more productive because of their ability to understand the visit's framework; crediting their SP training. Patients reported the video will help in planning future medical visits by providing information that increases their understanding of their role in the care process. CONCLUSIONS: SPs' understanding of the visit and its impact on knowledge, skills and affective domains can be transferred to patients in the form of specific strategies that enhance communication and patient participation during medical visits. PRACTICE IMPLICATIONS: A brief educational intervention for patients using SPs' understanding of the medical visit may contribute to enhanced patient participation in future health care encounters and could increase patient engagement in patient-centered models of care.

Evaluating governance in a clinical and translational research organization.

Institutional Development Awards for Clinical and Translational Research (IDeA-CTR) networks, funded by NIH/NIGMS, aim to advance CTR infrastructure to address historically unmet state and regional health needs. Success depends on the response to actionable feedback to IDeA-CTR leadership from network partners and governance groups through annual surveys, interviews, and governance body recommendations. The Great Plains IDeA-CTR applied internal formative meta-evaluation to evaluate dispositions of 172 governance recommendations from 2017 to 2021. Results provided insights to improve the classification and quality of recommendations, credibility of evaluation processes, responsiveness to recommendations, and communications and governance in a complex CTR network comprising multiple coalitions.

Responsiveness to societal needs in postgraduate medical education: the role of accreditation.

BACKGROUND: Social accountability in medical education has been defined as an obligation to direct education, research, and service activities toward the most important health concerns of communities, regions, and nations. Drawing from the results of a summit of international experts on postgraduate medical education and accreditation, we highlight the importance of local contexts in meeting societal aims and present different approaches to ensuring societal input into medical education systems around the globe. MAIN TEXT: We describe four priorities for social responsiveness that postgraduate medical education needs to address in local and regional contexts: (1) optimizing the size, specialty mix, and geographic distribution of the physician workforce; (2) ensuring graduates' competence in meeting societal goals for health care, population health, and sustainability; (3) promoting a diverse physician workforce and equitable access to graduate medical education; and (4) ensuring a safe and supportive learning environment that promotes the professional development of physicians along with safe and effective patient care in settings where trainees participate in care. We relate these priorities to the values proposed by the World Health Organization for social accountability: relevance, quality, cost-effectiveness, and equity; discuss accreditation as a lever for change; and describe existing and evolving efforts to make postgraduate medical education socially responsive. CONCLUSION: Achieving social responsiveness in a competency-based postgraduate medical education system requires accrediting organizations to ensure that learning emphasizes relevant competencies in postgraduate curricula and educational experiences, and that graduates possess desired attributes. At the same time, institutions sponsoring graduate medical education need to provide safe and effective patient care, along with a supportive learning and working environment.

Effective accreditation in postgraduate medical education: from process to outcomes and back.

BACKGROUND: The accreditation of medical educational programs is thought to be important in supporting program improvement, ensuring the quality of the education, and promoting diversity, equity, and population health. It has long been recognized that accreditation systems will need to shift their focus from processes to outcomes, particularly those related to the end goals of medical education: the creation of broadly competent, confident professionals and the improvement of health for individuals and populations. An international group of experts in accreditation convened in 2013 to discuss this shift. MAIN TEXT: Participants unequivocally supported the inclusion of more outcomes-based criteria in medical education accreditation, specifically those related to the societal accountability of the institutions in which the education occurs. Meaningful and feasible outcome metrics, however, are hard to identify. They are regionally variable, often temporally remote from the educational program, difficult to measure, and susceptible to confounding factors. The group identified the importance of health outcomes of the clinical milieu in which education takes place in influencing outcomes of its graduates. The ability to link clinical data with individual practice over time is becoming feasible with large repositories of assessment data linked to patient outcomes. This was seen as a key opportunity to provide more continuous oversight and monitoring of program impact. The discussants identified several risks that might arise should outcomes measures completely replace process issues. Some outcomes can be measured only by proxy process elements, and some learner experience issues may best be measured by such process elements: in brief, the "how" still matters. CONCLUSIONS: Accrediting bodies are beginning to view the use of practice outcome measures as an important step toward better continuous educational quality improvement. The use of outcomes will present challenges in data collection, aggregation, and interpretation. Large datasets that capture clinical outcomes, experience of care, and health system performance may enable the assessment of multiple dimensions of program quality, assure the public that the social contract is being upheld, and allow identification of exemplary programs such that all may improve. There remains a need to retain some focus on process, particularly those related to the learner experience.

The International Literature on Teaching Faculty Development in English-Language Journals: A Scoping Review and Recommendations for Core Topics.

BACKGROUND: With increasing physician mobility, there is interest in how medical schools and postgraduate medical education institutions across the world develop and maintain the competence of medical teachers. Published reviews of faculty development (FD) have predominantly included studies from the United States and Canada. OBJECTIVE: We synthesized the international FD literature (beyond the US and Canada), focusing on FD type, intended audience, study format, effectiveness, differences among countries, and potential unique features. METHODS: We identified English-language publications that addressed FD for medical faculty for teaching and related activities, excluding US and Canadian publications. RESULTS: A search of 4 databases identified 149 publications, including 83 intervention studies. There was significant growth in international FD publications for the most recent decade, and a sizable number of studies were from developing economies and/or resulted from international collaborations. Focal areas echo those in earlier published reviews, suggesting the international FD literature addresses similar faculty needs and organizational concerns. CONCLUSIONS: The growth in publications in recent years and a higher proportion of reporting on participant reactions, coupled with less frequent reporting of results, transfer to practice, and impact on learners and the organization, suggest this is an evolving field. To enhance international FD, educators and researchers should focus on addressing common needs expressed by faculty, including curriculum design and evaluation, small group teaching, assessing professionalism and providing feedback. Future research should focus on approaches for developing comprehensive institutional FD programs that include communities of learning and practice and evaluating their impact.

The education avenue of the clinical learning environment: A pragmatic approach.

Aim: This perspective is part of a series of articles that are outcomes of a consensus conference, that seek to offer a comprehensive examination of the clinical learning environment (CLE), using different academic disciplines and areas of focus termed "avenues." The education dimensions of the CLE are discussed in detail in this perspective, along with critical linkages to the other avenues. Methods: Using iterative presentations, discussion and small group work, in October 2018, the consensus conference participants explored the education, psychological, sociocultural, diversity and inclusion, digital and architectural aspects of the CLE. Results: The education avenue of the CLE includes elements of teaching and learning such as the curriculum, clinical experiences, the assessment system, educational program governance, trainee selection, faculty development, and program evaluation and improvement. Within the educational domain, we focus on organizational and personal/social aspects of the CLE, including (1) curriculum design and deployment, including placement of trainees in clinical settings, organizational culture, practices and policies, and accreditation and regulatory requirements from the organizational domain (2) the education system, including assessment, program evaluation and organization and governance; and (3) elements from the personal and social domains, including peer-to-peer, trainee-faculty, and trainee-patient relationships that influence how and what postgraduate trainees learn, trainee selection, informal and hidden curricula, and trainees' perceptions of their learning environment. Conclusions: We provide suggestions for further research and recommendations for addressing challenges and facilitating improvement in the educational aspects of the CLE, along with actionable practice points.

The clinical learning environment.

Learning in a clinical context is foundational in the training of health professionals; there is simply no alternative. The subject of the clinical learning environment (CLE) is at the forefront of discussions. In this introduction to a themed issue on the CLE, we present an expanded conceptual model that approaches the CLE through six different lenses, termed "avenues:" architectural, digital, diversity and inclusion, education, psychological, and sociocultural, with each avenue represented by a paper. The aim is to facilitate dialog around the contributions of different academic disciplines to research on the CLE. Collectively the papers highlight the overlap between the various "avenues" in how they influence each other, and how they collectively have shaped the work to understand and improve the CLE. The expectation is that the various avenues can add to existing knowledge and create new ideas for interventions to improve the clinical learning environment across nations for learners and teachers with the ultimate aim of improving patient care. Research and efforts to improve the CLE are critical to learning, professional socialization and well-being for trainees as they learn and participate in patient care, and to the quality of care they will deliver over decades of practice after graduation.

Inclusion in the clinical learning environment: Building the conditions for diverse human flourishing.

Aim: While diversity, equity, and inclusion are much proclaimed aspirational goals in education programs, the clinical learning environment (CLE) frequently falls short of meaningful incorporation of these concepts in processes, policies, and local culture. In this paper, we explore how inclusion, diversity, and equity can and should be defined and operationalized within medical education. Methods: Three cases, organized around Hafferty's curricular framework (formal, informal, and hidden), we illustrate lapses and potential best practices in inclusion in the CLE. Results: The essential "best-practice" of programs inclusive of diverse individuals is the design of policies, processes, and behavioral norms co-creatively with all community members. Potential pitfalls to greater inclusion include nostalgic reference to "the past", a neutrality that is operationalized without the rudder of explicit values and not recognizing that ethical obligations between teachers, learners, and programs are at the heart of the discussion of how inclusive learning and work environments are built. Conclusion: Inclusive CLE's provide space for co-creation, understand the need to ensure the voices of the vulnerable (i.e. learners) are heard and valued and through this promote the flourishing of diverse human capital, in keeping with a model that views diversity as a key attribute or organizational excellence.

Learning and professional acculturation through work: Examining the clinical learning environment through the sociocultural lens.

Purpose: We examined studies of the clinical learning environment from the fields of sociology and organizational culture to (i) offer insight into how workplace culture has informed research on postgraduate trainee learning and professional development; (ii) highlight limitations of the literature; and (iii) suggest practical ways to apply sociocultural concepts to challenges in the learning environment. Materials and methods: Concepts were explored by participants at a consensus conference in October 2018. Results: We identified three enduring foci for research using a sociocultural lens: the hidden curriculum, exploration of medical errors, and the impact of time pressures on the relational nature of clinical education. Limitations included the lower value attributed to informal learning and a pejorative valuation of the hidden curriculum; and disconnect between practices in clinical settings and the priorities of the larger organization. Conclusions: Research on the learning environment using a sociocultural lens suggest workplace goals, norms and practices determined which learners engage in learning-relevant activities, to what extent, and the degree of guidance provided, with these factors creating "tacit" curricula that may support or compete with formal learning goals. We close with guidance on how sociocultural constructs could inform research to improve the learning environment.

Residents' Ratings of Their Clinical Supervision and Their Self-Reported Medical Errors: Analysis of Data From 2009.

BACKGROUND: Medical errors and patient safety are major concerns for the medical and medical education communities. Improving clinical supervision for residents is important in avoiding errors, yet little is known about how residents perceive the adequacy of their supervision and how this relates to medical errors and other education outcomes, such as learning and satisfaction. METHODS: We analyzed data from a 2009 survey of residents in 4 large specialties regarding the adequacy and quality of supervision they receive as well as associations with self-reported data on medical errors and residents' perceptions of their learning environment. RESULTS: Residents' reports of working without adequate supervision were lower than data from a 1999 survey for all 4 specialties, and residents were least likely to rate "lack of supervision" as a problem. While few residents reported that they received inadequate supervision, problems with supervision were negatively correlated with sufficient time for clinical activities, overall ratings of the residency experience, and attending physicians as a source of learning. Problems with supervision were positively correlated with resident reports that they had made a significant medical error, had been belittled or humiliated, or had observed others falsifying medical records. CONCLUSIONS: Although working without supervision was not a pervasive problem in 2009, when it happened, it appeared to have negative consequences. The association between inadequate supervision and medical errors is of particular concern.

Improvement in Context: Exploring Aims, Improvement Priorities, and Environmental Considerations in a National Sample of Programs Using "Small Data".

BACKGROUND: In 2013, the Accreditation Council for Graduate Medical Education (ACGME) transitioned into a new accreditation system to reduce burden, focus on outcomes, and promote innovation and improvement. One component is a self-study that includes aims, an environmental assessment, and setting improvement priorities. The ACGME initiated voluntary site visits following the self-study. OBJECTIVE: We explored common themes in program aims and assessment of their environment. METHODS: Using grounded theory, inductive and deductive qualitative methods, and truth grounding, we analyzed data from voluntary site visits of 396 core and subspecialty programs between June 2015 and September 2017, with a focus on common themes. RESULTS: We report common themes for aims and the dimensions of the environmental assessment. Themes for strengths include a collegial, supportive learning environment; responsive leaders; and experiences that prepare residents for unsupervised practice. Improvement priorities encompass low learner engagement and "content mismatch" in didactic education, balancing education and service at a time of growing clinical volumes, and improving the utility of assessment systems. Common opportunities encompass collaborations that improve education, involving alumni and harnessing technology to enrich education, while threats include an unsustainable effort for many program leaders, clinical pressures on faculty, and loss of external sites important for education. Linked dimensions of the environmental assessment suggest benefit in a growing focus on learners, and approaches to ensure a humanistic learning environment that allows for growth, self-determination, and inclusion. CONCLUSIONS: The findings highlight actionable themes for the environmental assessment. We discuss implications for programs, institutions, and the ACGME.

Causes of Death of Residents in ACGME-Accredited Programs 2000 Through 2014: Implications for the Learning Environment.

PURPOSE: To systematically study the number of U.S. resident deaths from all causes, including suicide. METHOD: The more than 9,900 programs accredited by the Accreditation Council for Graduate Medical Education (ACGME) annually report the status of residents. The authors aggregated ACGME data on 381,614 residents in training during years 2000 through 2014. Names of residents reported as deceased were submitted to the National Death Index to learn causes of death. Person-year calculations were used to establish resident death rates and compare them with those in the general population. RESULTS: Between 2000 and 2014, 324 individuals (220 men, 104 women) died while in residency. The leading cause of death was neoplastic disease, followed by suicide, accidents, and other diseases. For male residents the leading cause was suicide, and for female residents, malignancies. Resident death rates were lower than in the age- and gender-matched general population. Temporal patterns showed higher rates of death early in residency. Deaths by suicide were higher early in training, and during the first and third quarters of the academic year. There was no upward or downward trend in resident deaths over the 15 years of this study. CONCLUSIONS: Neoplastic disease and suicide were the leading causes of death in residents. Data for death by suicide suggest added risk early in residency and during certain months of the academic year. Providing trainees with a supportive environment and with medical and mental health services is integral to reducing preventable deaths and fostering a healthy physician workforce.