Acute otitis media symptoms and symptom scales in research with Aboriginal and Torres Strait Islander children.

BACKGROUND: Aboriginal and Torres Strait Islander children experience a high burden of otitis media. We collected data on symptoms associated with acute otitis media (AOM) in a clinical trial involving children receiving primary care at urban Aboriginal Medical Services. Two scales were employed to monitor symptoms over time: the AOM-Severity of Symptoms scale (AOM-SOS) and the AOM-Faces Scale (AOM-FS). This study took place at a mid-point of the un-blinded trial. METHODS: We examined symptoms at enrolment and day 7, and compared the scales for trends, and bivariate correlation (Spearman's rho) over 14 days. Responsiveness of the scales to clinical change was determined by Friedman's test of trend in two subgroups stratified by day 7 AOM status. We interviewed parents/carers and research officers regarding their experience of the scales and analysed data thematically. RESULTS: Data derived from 224 children (18 months to 16 years; median 3.6 years). Common symptoms associated with AOM at baseline were runny nose (40%), cough (38%) and irritability (36%). More than one third had no or minimal symptoms at baseline according to AOM-SOS (1-2/10) and AOM-FS scores (1-2/7). The scales performed similarly, and were moderately correlated, at all study points. Although scores decreased from day 0 to 14, trends and mean scores were the same whether AOM was persistent or resolved at day 7. Users preferred the simplicity of the AOM-FS but encountered challenges when interpreting it. CONCLUSION: We found minimally symptomatic AOM was common among Aboriginal and Torres Strait Islander children in urban settings. The AOM-SOS and AOM-FS functioned similarly. However, it is likely the scales measured concurrent symptoms related to upper respiratory tract infections, given they did not differentiate children with persistent or resolved AOM based on stringent diagnostic criteria. This appears to limit the research and clinical value of the scales in monitoring AOM treatment among Aboriginal and Torres Strait Islander children.

Educators as Judges: Applying Judicial Decision-Making Principles to High-Stakes Education Assessment Decisions.

Phenomenon: Programmatic assessment and competency-based education have highlighted the need to make robust high-stakes assessment decisions on learner performance from evidence of varying types and quality. Without guidance, lengthy deliberations by decision makers and competence committees can end inconclusively with unresolved concerns. These decisional dilemmas are heightened by their potential impacts. For learners, erroneous decisions may lead to an unjustified exit from a long-desired career, or premature promotion to clinical responsibilities. For educators, there is the risk of wrongful decision-making, leading to successful appeals and mistrust. For communities, ill-prepared graduates risk the quality and safety of care. Approaches such as psychometric analyses are limited when decision-makers are faced with seemingly contradictory qualitative and quantitative evidence about the same individual. Expertise in using such evidence to make fair and defensible decisions is well established in judicial practice but is yet to be practically applied to assessment decision-making. Approach: Through interdisciplinary exchange, we investigated medical education and judicial perspectives on decision-making to explore whether principles of decision-making in law could be applied to educational assessment decision-making. Using Dialogic Inquiry, an iterative process of scholarly and mutual critique, we contrasted assessment decision making in medical education with judicial practice to identify key principles in judicial decision-making relevant to educational assessment decisions. We developed vignettes about common but problematic high-stakes decision-making scenarios to test how these principles could apply. Findings: Over 14 sessions, we identified, described, and applied four principles for fair, reasonable, and transparent assessment decision-making. These were: The person whose interests are affected has a right to know the case against them, and to be heard.Reasons for the decision should be given.Rules should be transparent and consistently applied.Like cases should be treated alike and unlike cases treated differently.Reflecting our dialogic process, we report findings by separately presenting the medical educator and judicial perspectives, followed by a synthesis describing a preferred approach to decision-making in three vignettes. Insights: Judicial principles remind educators to consider both sides of arguments, to be consistent, and to demonstrate transparency when making assessment decisions. Dialogic Inquiry is a useful approach for generating interdisciplinary insights on challenges in medical education by critiquing difference (e.g., the meaning of objectivity) and achieving synthesis where possible (e.g., fairness is not equal treatment of all cases). Our principles and exemplars provide groundwork for promoting good practice and furthering assessment research toward fairer and more robust decisions that will assist learning.

Supporting medical students to support peers: a qualitative interview study.

BACKGROUND: Students may be the first to recognise and respond to psychological distress in other students. Peer support could overcome medical student reluctance to seek help despite their high rates of mental ill-health. Yet, despite the adoption of peer support programs, there is little evidence of impact on students. Peer support programs may assume that medical students accept and view peer support positively. We explored these assumptions by asking students about their experiences and views on peer support. METHODS: Qualitative semi-structured interviews exploring peer support experiences and views on peer support were conducted with ten medical students at two contrasting medical schools. Informed by a constructivist stance, interview transcripts underwent thematic analysis. RESULTS: Three groups of themes were identified: participants' experiences of peer support encounters, concerns about providing support, and views on students' roles in peer support. Participants readily recalled signs of peer distress. Encounters were ad hoc, informal, and occurred within relationships based on friendship or by being co-located in the same classes or placements. Concerns about initiating and offering support included lack of expertise, maintaining confidentiality, stigma from a mental health diagnosis, and unclear role boundaries, with implications for acceptance of student roles in peer support. CONCLUSIONS: Our study emphasised the centrality of social relationships in enabling or discouraging peer support. Relationships developed during medical studies may anticipate the collegial relationships between medical professionals. Nevertheless, only some students are willing to undertake peer support roles. We suggest different strategies for promoting informal peer support that can be offered by any student, to those promoting formal support roles for selected students. Future research focusing on the impact for both the students who receive, and on the students who provide peer support is called for.

Medical Students' Socialization Tactics When Entering a New Clinical Clerkship: A Mixed Methods Study of Proactivity.

PURPOSE: Socialization into clinical clerkships is difficult in part due to ambiguity around students' new roles and expected behaviors. Being proactive reduces ambiguity and is essential to socialization. Proactive behavior can be taught and goes beyond having a proactive personality. Among students entering new undergraduate clinical clerkships, this study aimed to investigate (1) reported proactive behaviors and their association with social integration and (2) enabling and inhibiting factors for proactive behavior. METHOD: This study was conducted at the 5-year MBBS program at Western Sydney University during academic year 2019-2020. Using a convergent mixed methods approach, survey and interview data from third-, fourth-, and fifth-year students were collected. Surveys explored 5 proactive behaviors: feedback seeking, information seeking, task negotiation, positive framing, and relationship building. Interviews elicited descriptions of how students described their proactivity and what influenced students to be proactive when entering a new clerkship. Data were integrated using the following the thread and mixed methods matrix techniques. RESULTS: Students exhibited all 5 proactive behaviors. Survey data showed positive framing and task negotiation had the highest and lowest scores, respectively. Only positive framing correlated significantly with social integration scores (r = 0.27; P < .01), but this contrasted to interviews, in which students described how other proactive behaviors also led to social integration. Proactive behavior scores decreased across academic years. Integrated data showed 3 linked antecedents to whether students exhibited proactive behavior: feeling capable of being proactive, individual intention to be proactive, and the immediate environment and system-level factors. CONCLUSIONS: Students who framed the experience positively were more likely to report increased social integration. Initiating task negotiation was challenging for most students. The authors propose a conceptual model for proactivity and social integration to support socialization and learning during clinical transitions for future research and interventional design.

Advancing the science of health professions education through a shared understanding of terminology: a content analysis of terms for "faculty".

INTRODUCTION: Health professions educators risk misunderstandings where terms and concepts are not clearly defined, hampering the field's progress. This risk is especially pronounced with ambiguity in describing roles. This study explores the variety of terms used by researchers and educators to describe "faculty", with the aim to facilitate definitional clarity, and create a shared terminology and approach to describing this term. METHODS: The authors analyzed journal article abstracts to identify the specific words and phrases used to describe individuals or groups of people referred to as faculty. To identify abstracts, PubMed articles indexed with the Medical Subject Heading "faculty" published between 2007 and 2017 were retrieved. Authors iteratively extracted data and used content analysis to identify patterns and themes. RESULTS: A total of 5,436 citations were retrieved, of which 3,354 were deemed eligible. Based on a sample of 594 abstracts (17.7%), we found 279 unique terms. The most commonly used terms accounted for approximately one-third of the sample and included faculty or faculty member/s (n = 252; 26.4%); teacher/s (n = 59; 6.2%) and medical educator/s (n = 26; 2.7%) were also well represented. Content analysis highlighted that the different descriptors authors used referred to four role types: healthcare (e.g., doctor, physician), education (e.g., educator, teacher), academia (e.g., professor), and/or relationship to the learner (e.g., mentor). DISCUSSION: Faculty are described using a wide variety of terms, which can be linked to four role descriptions. The authors propose a template for researchers and educators who want to refer to faculty in their papers. This is important to advance the field and increase readers' assessment of transferability.

Welcomeness for people with substance use disorders to general practice: a qualitative study.

BACKGROUND: Good primary care for people with substance use disorders (SUDs) is crucial given the high prevalence of SUDs and overdose deaths. OBJECTIVE: To explore general practice care for people with a history of SUDs from the perspectives of women involved with the criminal justice system. METHODS: Qualitative interview study with pre- and postrelease interviews, undertaken in Australian prisons and community settings. We utilized thematic analysis informed by constructivist grounded theory. RESULTS: We undertook 65 interviews with 39 women. Access to and experience of general practitioner (GP) care was affected by perceived welcomeness, decisions around disclosure, and consultation experiences related to medication prescription. Participants reported that they were not as welcome as other patients, welcome could be conditional on not disclosing SUDs or only requesting unrelated healthcare, and GPs did not always differentiate between past and current drug use. Participants perceived difficulty finding general practices where the potential benefit of disclosing SUDs outweighed the risks of stigmatized reactions and lack of GP skills and interest. Participants did not always recognize that care beyond physical health could occur in general practice. The pejorative implications of labelling patients as "doctor shoppers" were challenged by participants, as they considered it could be necessary to attend multiple GPs to find a welcoming practice. CONCLUSIONS: People with histories of SUDs do not uniformly experience welcomeness in general practice, perpetuating poor engagement in healthcare and poor outcomes related to SUDs. Programmes targeting prescription drug misuse through general practice should also promote welcomeness for people with SUDs.

Advancing careers in medical education: 'Practice architectures' for success in a resource-constrained setting.

INTRODUCTION: Advancement of careers in medical education remains a challenge around the world and is under-researched in resource-constrained contexts. Using the Theory of Practice Architectures (TPA) as a conceptual lens, we investigated the emergence and subsequent development of medical education careers in a resource-constrained country. METHODS: Qualitative semi-structured interviews were conducted with a purposive sample of 14 early-career and leading medical educators from all 9 medical schools and the 1 postgraduate institute in Sri Lanka. Thematic analysis was performed, informed by the three conceptual lenses of TPA: discursive-cultural, material-economic, and socio-political. RESULTS: Three themes were identified: faculty development as a career-building discourse (discursive-cultural); leadership focused on creating a workforce with expertise in medical education, equal to clinical medicine specialties (material-economic); and collaborative professional networks in health professions education originating from faculty development activities (socio-political). CONCLUSION: Using TPA, our findings highlight that faculty development can foster a powerful discourse for promoting academic careers in medical education. Medical education leaders can also play a critical role by establishing formal training programmes in medical education, and collaborative professional networks can improve visibility of careers in medical education, particularly when participants share expertise and resources between institutions and health professions, across the continuum of undergraduate to postgraduate training. TPA can also be used to better understand how cultural, material-economic and socio-political factors can enhance or hinder career development in different contexts, whether resource-limited or well-resourced.

Differences between medical school and PGY1 learning outcomes: An explanation for new graduates not being "work ready"?

Background: Widespread concerns about new medical graduates' 'work readiness' may reflect, in part, differences in mandatory learning outcomes for medical students and new medical graduates.Purpose: To examine differences between required medical student and PGY1 (first year resident) training program outcomes, and the nature and magnitude of these differences.Method: Comparison, systematic identification and thematic analysis of differences between the graduate outcomes in the Australian Medical Council Standards for the Assessment and Accreditation of Primary Medical Programs and those in the New Zealand Curriculum Framework for Prevocational Training.Results: The relationship between these outcome statements were categorized as: essentially similar; continuity; partial discontinuity; and complete discontinuity of learning trajectory. Areas requiring substantial new learning may reflect medical schools' focus on individual student performance, and on learning and assessments based on single episodes of often uncomplicated illness. This contrasted with a post-graduate focus on integrated health care delivery by teams and management of complex illnesses over the whole patient care journey.Conclusions: Characterizing these marked differences between pre-graduate and postgraduate standards, within a trajectory of learning, explains some of the difficulties in students' preparation for work readiness. These could inform learning interventions to support new graduates' professional development to ensure patient safety. Development and revision of accreditation standards should include formal review against the expectations of the preceding and succeeding phases of learning.

Determining Expected Research Skills of Medical Students on Graduation: a Systematic Review.

BACKGROUND: Global interest in research skills in undergraduate medical education is growing. There is no consensus regarding expected research skills of medical students on graduation. We conducted a systematic review to determine the aims and intended learning outcomes (ILOs) of mandatory research components of undergraduate medical curricula incorporating the teaching, assessment, and evaluation methods of these programs. METHODS: Using the PRISMA protocol, MEDLINE and ERIC databases were searched with keywords related to "medical student research programs" for relevant articles published up until February 2020. Thematic analysis was conducted according to student experience/reactions, mentoring/career development, and knowledge/skill development. RESULTS: Of 4880 citations, 41 studies from 30 institutions met the inclusion criteria. Programs were project-based in 24 (80%) and coursework only-based in 6 (20%). Program aims/ILOs were stated in 24 programs (80%). Twenty-seven different aims/ILOs were identified: 19 focused on knowledge/skill development, 4 on experience/reactions, and 4 on mentoring/career development. Project-based programs aimed to provide an in-depth research experience, foster/increase research skills, and critically appraise scientific literature. Coursework-based programs aimed to foster/apply analytical skills for decision-making in healthcare and critically appraise scientific literature. Reporting of interventions was often incomplete, short term, and single institution. There was poor alignment between aims, teaching, assessment, and evaluation methods in most. CONCLUSIONS: The diversity of teaching programs highlights challenges in defining core competencies in research skills for medical graduates. Incomplete reporting limits the evidence for effective research skills education; we recommend those designing and reporting educational interventions adopt recognized educational reporting criteria when describing their findings. Whether students learn by "doing", "proposing to do", or "critiquing", good curriculum design requires constructive alignment between teaching, assessment, and evaluation methods, aims, and outcomes. Peer-reviewed publications and presentations only evaluate one aspect of the student research experience.

Educator as Diagnostician, Judge and Confidant: a positioning analysis of medical student support encounters.

Medical schools, programs and educators are increasingly expected to address medical student stress and wellbeing, yet also ensure student competence and fitness to practice. Educators play a central role in supporting students when evaluating a student's concerns and in deciding whether support and/or sanction should be offered. It is not known how educators approach or resolve such potentially contradictory responses. We conducted an interview study of 21 medical educators from a range of  professional backgrounds across 11 on-campus and clinical teaching sites. Using Positioning Theory to inform our thematic analysis, we found that participants adopted an overarching position of Diagnostician, and at times, two alternative positions, the Judge and the Confidant when supporting students. In their narratives of support encounters, individual students were positioned as Good Students or Troubling Students. For most, educator positions were fluid and responsive to the storylines enacted in encounters. Rigidly adopting Judge or Confidant positions could lead to "failure to fail" and violations of professional boundaries. Positioning Theory locates student support in a moral space and helps explain the consternation experienced by educators when support is not effective. Positioning analysis offers a language, and metaphors which are meaningful to educators, for framing discussion and reviews of support practices and progression decisions. Such insights could encourage reflective practice and guide further research to inform practice when students with troubling concerns and persistently borderline performances require support.

Boyer and Beyond: An Interview Study of Health Professions Education Scholarship Units in the United States and a Synthetic Framework for Scholarship at the Unit Level.

PURPOSE: Health professions education scholarship units (HPESUs) in the United States are large in number and diverse in purpose, activities, and contributions. Although each of these units shares a commitment to scholarship, there is no synthetic framework to accurately represent and evaluate their activities and contributions. This study aimed to provide such a framework. METHOD: The authors examined data collected from 11 U.S. HPESU directors. Interviews occurred between April 2015 and February 2016. The research team used a combination of deductive and inductive qualitative techniques to analyze the interview transcripts. The deductive portion drew on Boyer's four-part framework of scholarship; the inductive portion produced a new conceptualization of scholarship at the HPESU level. RESULTS: The scholarly activities of HPESUs generally align with Boyer's four types of scholarship-discovery, integration, application, and teaching. However, this categorization fails to capture the interconnectedness and variety of purposes served by these activities. Both are important when considering how best to represent the scholarly contributions made by HPESUs. From their analysis of interviews, the authors developed a three-part framework characterizing HPESU scholarly activities: supporting a scholarly approach to education, supporting educational scholarship within the institution, and supporting HPESU members' scholarship. CONCLUSIONS: The authors contend that the three-part, unit-level framework for scholarship constructed in this study brings clarity and understanding to the purpose, activities, and contributions made by HPESUs in the United States. The proposed framework may allow unit directors to better justify and advocate for the resources needed to further promote the work of HPESUs.

From paperwork to parenting: experiences of professional staff in student support.

CONTEXT: For academic staff, responding to student concerns is an important responsibility. Professional staff, or non-academic staff who do administrative work in medical schools, are often the first to be approached by students, yet there is little research on how they manage student issues. Informed by the conceptual framework of emotional labour, we examined the experiences of professional staff, aiming to identify theoretical and practical insights for improving the provision of student support. We examined the scope of support provided, the impact of providing this support on staff and how these impacts can be managed. METHODS: Professional staff at two medical schools were invited to participate in semi-structured qualitative interviews. Interviews were transcribed and independently analysed for emergent themes. Data analysis continued with purposive sampling for maximum variation until thematic saturation was reached. Findings were returned to participants in writing and via oral presentations for member checking and refinement. RESULTS: Twenty-two female staff from clinical, teaching and commercial backgrounds at nine urban and rural teaching sites were interviewed. Participants described providing support for diverse concerns, from routine requests to life-threatening emergencies. Four major themes emerged: firstly, all described roles consistent with emotional labour. Secondly, student support was regarded as informal work, and not well recognised or defined. Consequently, many drew upon their personal orientation to provide support. Finally, we identified both positive and negative personal impacts, including ongoing distress after critical events. CONCLUSIONS: Professional staff perform a range of student support work, leading to emotional, personal and work impacts. In turn, they need support, recognition and training in this essential but under-recognised role. Emotional labour offers a conceptual framework for understanding the gendered nature and impact of this work and how it may be managed. We suggest practical strategies for promoting positive and preventing negative effects on staff from supporting medical students.

Bridging the gap: a five stage approach for developing specialty-specific entrustable professional activities.

BACKGROUND: Entrustable Professional Activities (EPAs) are increasingly used as a focus for assessment in graduate medical education (GME). However, a consistent approach to guide EPA design is currently lacking, in particular concerning the actual content (knowledge, skills and attitude required for specific tasks) for EPAs. This paper describes a comprehensive five stage approach, which was used to develop two specialty-specific EPAs in emergency medicine focused on the first year of GME. METHODS: The five stage approach was used to gain consensus on the task, content and entrustment scale for two specialty-specific EPAs in emergency medicine. The participants consisted of twelve clinical supervisors working in the emergency department. The five stages were: 1) Selecting the EPA topic; 2) Developing the EPA content by collecting data from participants using focus group and individual interviews; 3) Drafting the EPAs based on analysis of collected data; 4) Seeking feedback on the draft EPAs from the participants and other stakeholders; 5) Refining and finalising the EPAs based on feedback. RESULTS: Two specialty-specific EPAs were developed using the five stage approach. The participants reached consensus on the specific tasks and criteria for performance for the two EPAs. They also agreed that both day-to-day (ad hoc) and formal (summative) entrustment decisions were put into practice through the intensity of supervision provided to PGY1 doctors. As a result, a three level entrustment and supervision scale consisting of direct active, indirect active, passive was developed reflecting the shift in the intensity of supervision from close supervision to minimal supervision. CONCLUSIONS: The five stage approach described in this paper was used successfully to develop two specialty-specific EPAs in emergency medicine along with a three level entrustment scale.We propose that the five stage approach is transferable to a range of medical training contexts to design specialty-specific EPAs.

'It was serendipity': a qualitative study of academic careers in medical education.

CONTEXT: Despite a demand for educational expertise in medical universities, little is known of the roles of medical educators and the sustainability of academic careers in medical education. We examined the experiences and career paths of medical educators from diverse professional backgrounds seeking to establish, maintain and strengthen their careers in medical schools. METHODS: Semi-structured interviews were conducted with 44 lead and early-career medical educators from all 21 Australian and New Zealand medical schools. Questions explored career beginnings, rewards and challenges. Transcripts underwent systematic coding and independent thematic analysis. Final themes were confirmed by iterative review and member checking. Analysis was informed by Bourdieu's concepts of field (a social space for hierarchical interactions), habitus (individual dispositions which influence social interactions) and capital (economic, symbolic, social and cultural forms of power). RESULTS: Participants provided diverse accounts of what constitutes the practice of medical education. Serendipitous career entry and little commonality of professional backgrounds and responsibilities suggest an ambiguous habitus with ill-defined career pathways. Within the field of medicine as enacted in medical schools, educators have invisible yet essential roles, experiencing tension between service expectations, a lesser form of capital, and demands for more highly valued forms of scholarship. Participants reported increasing expectations to produce research and obtain postgraduate qualifications to enter and maintain their careers. Unable to draw upon cultural capital accrued from clinical work, non-clinician educators faced additional challenges. To strengthen their position, educators consciously built social capital through essential service relationships, capitalising on times when education takes precedence, such as curriculum renewal and accreditation. CONCLUSIONS: Bourdieu's theory provides insight into medical educator career paths and the positioning of medical education within medical schools. Medical educators have an indistinct practice, and limited cultural capital in the form of research outputs. In order to maintain and strengthen their careers, educators must create alternative sources of capital, through fostering collaborative alliances.

Medical school benchmarking - from tools to programmes.

BACKGROUND: Benchmarking among medical schools is essential, but may result in unwanted effects. AIM: To apply a conceptual framework to selected benchmarking activities of medical schools. METHODS: We present an analogy between the effects of assessment on student learning and the effects of benchmarking on medical school educational activities. A framework by which benchmarking can be evaluated was developed and applied to key current benchmarking activities in Australia and New Zealand. RESULTS: The analogy generated a conceptual framework that tested five questions to be considered in relation to benchmarking: what is the purpose? what are the attributes of value? what are the best tools to assess the attributes of value? what happens to the results? and, what is the likely "institutional impact" of the results? If the activities were compared against a blueprint of desirable medical graduate outcomes, notable omissions would emerge. CONCLUSION: Medical schools should benchmark their performance on a range of educational activities to ensure quality improvement and to assure stakeholders that standards are being met. Although benchmarking potentially has positive benefits, it could also result in perverse incentives with unforeseen and detrimental effects on learning if it is undertaken using only a few selected assessment tools.