Physical and biophysical markers of assessment in medical training: A scoping review of the literature.

PURPOSE: Assessment in medical education has changed over time to measure the evolving skills required of current medical practice. Physical and biophysical markers of assessment attempt to use technology to gain insight into medical trainees' knowledge, skills, and attitudes. The authors conducted a scoping review to map the literature on the use of physical and biophysical markers of assessment in medical training. MATERIALS AND METHODS: The authors searched seven databases on 1 August 2022, for publications that utilized physical or biophysical markers in the assessment of medical trainees (medical students, residents, fellows, and synonymous terms used in other countries). Physical or biophysical markers included: heart rate and heart rate variability, visual tracking and attention, pupillometry, hand motion analysis, skin conductivity, salivary cortisol, functional magnetic resonance imaging (fMRI), and functional near-infrared spectroscopy (fNIRS). The authors mapped the relevant literature using Bloom's taxonomy of knowledge, skills, and attitudes and extracted additional data including study design, study environment, and novice vs. expert differentiation from February to June 2023. RESULTS: Of 6,069 unique articles, 443 met inclusion criteria. The majority of studies assessed trainees using heart rate variability (n = 160, 36%) followed by visual attention (n = 143, 32%), hand motion analysis (n = 67, 15%), salivary cortisol (n = 67, 15%), fMRI (n = 29, 7%), skin conductivity (n = 26, 6%), fNIRs (n = 19, 4%), and pupillometry (n = 16, 4%). The majority of studies (n = 167, 38%) analyzed non-technical skills, followed by studies that analyzed technical skills (n = 155, 35%), knowledge (n = 114, 26%), and attitudinal skills (n = 61, 14%). 169 studies (38%) attempted to use physical or biophysical markers to differentiate between novice and expert. CONCLUSION: This review provides a comprehensive description of the current use of physical and biophysical markers in medical education training, including the current technology and skills assessed. Additionally, while physical and biophysical markers have the potential to augment current assessment in medical education, there remains significant gaps in research surrounding reliability, validity, cost, practicality, and educational impact of implementing these markers of assessment.

Implementation of dedicated social worker coaching for emergency medicine residents - Lessons learned.

Emergency medicine training is associated with high levels of stress and burnout, which were exacerbated by the COVID-19 pandemic. The pandemic further exposed a mismatch between trainees' mental health needs and timely support services; therefore, the objective of our innovation was to create an opportunity for residents to access a social worker who could provide consistent coaching. The residency leadership team partnered with our graduate medical education (GME) office to identify a clinical social worker and professionally-trained coach to lead sessions. The project was budgeted at an initial cost of $15,000 over 1 year. Residents participated in 49 group and 73 individual sessions. Post implementation in 2021, we compared this intervention to all other wellness initiatives. Resident response rate was 80.88% (n = 55/68) and median interquartile range (IQR) score of the initiative was 2 (1 = detrimental and 4 = beneficial) versus 3.79 (3.69-3.88) the median IQR of all wellness initiatives. A notable number, 22%, rated the program as detrimental, which could be related to summary comments regarding ability to attend sessions, lack of session structure, loss of personal/educational time, and capacity of the social worker to relate with them. Summary comments also revealed the innovation was useful, with individual sessions preferred to group sessions. Application of a social worker coaching program in an emergency medicine residency program appears to be a feasible novel intervention. Lessons learned after implementation include the importance of recruiting someone with emergency department/GME experience, orienting them to culture before implementation and framing coaching as an integrated residency resource.

The Alberta Pregnancy Outcomes and Nutrition (APrON) longitudinal study: cohort profile and key findings from the first three years.

PURPOSE: The objectives of the ongoing Canadian longitudinal cohort called the Alberta Pregnancy Outcomes and Nutrition (APrON) study are to: (1) determine the relationship between maternal nutrient intake and status before, during, after pregnancy, and (a) maternal mental health, (b) pregnancy and birth outcomes, and (c) infant/child neurodevelopment and behavior; (2) identify maternal mental health and nutrient predictors of child behaviour; and (3) establish a DNA biobank to explore genomic predictors of children's neurodevelopment and behavior. The purpose of this paper is to describe the participants, measures, and key findings on maternal and paternal mental health, maternal nutrition, and child outcomes to when children are 3 years of age. PARTICIPANTS: Participants included mothers and their children (n=2189) and mothers' partners (usually fathers; n=1325) from whom data were collected during the period from pregnancy to when children were 3 years of age, in Alberta, Canada. More than 88% of families have been retained to take part in completed data collection at 8 years of age. FINDINGS TO DATE: Data comprise: questionnaires completed by pregnant women/mothers and their partners on mothers', fathers' and children's health; dietary interviews; clinical assessments; linkage to hospital obstetrical records; and biological samples such as DNA. Key findings on mental health, nutrition and child outcomes are presented. APrON women who consumed more selenium and omega-3 were less likely to develop symptoms of perinatal depression. Higher prenatal consumption of choline rich foods such as eggs and milk were recommended as was vitamin D supplementation for both mothers and children to meet guidelines. Couples in which both mothers and fathers were affected by perinatal depression reported lower incomes and higher maternal prenatal depressive symptoms and lower support from fathers postnatally and their children presented with the most behavioural problems. Maternal experiences of early adversity predicted increased likelihood of perinatal depression and anxiety and children's behavioural problems. FUTURE PLANS: The APrON cohort offers a unique opportunity to advance understanding of the developmental origins of health and disease. There is a planned follow-up to collect data at 12 years of age.

Ethics, Guidelines, Standards, and Policy: Telemedicine, COVID-19, and Broadening the Ethical Scope.

The coronavirus crisis is causing considerable disruption and anguish. However, the COVID-19 pandemic and consequent explosion of telehealth services also provide an unparalleled opportunity to consider ethical, legal, and social issues (ELSI) beyond immediate needs. Ethicists, informaticians, and others can learn from experience, and evaluate information technology practices and evidence on which to base policy and standards, identify significant values and issues, and revise ethical guidelines. This paper builds on professional organizations' guidelines and ELSI scholarship to develop emerging concerns illuminated by current experience. Four ethical themes characterized previous literature: quality of care and the doctor-patient relationship, access, consent, and privacy. More attention is needed to these and to expanding the scope of ethical analysis to include health information technologies. An applied ethics approach to ELSI would addresses context-specific issues and the relationships between people and technologies, and facilitate effective and ethical institutionalization of telehealth and other health information technologies.

Legal Matters: The Legal Context of Health Informatics in Global Pandemics.

Law and regulation have not received much attention as part of the context shaping and being shaped by health informatics. Telemedicine, data, devices and software, and electronic health records (EHRs) are examples of how technologies are affected by privacy, intellectual property protections, and other law and regulation.

Implementation of holistic review into emergency medicine residency application screening to improve recruitment of underrepresented in medicine applicants.

INTRODUCTION: Increasing the diversity of the emergency medicine (EM) workforce is imperative, with more diverse teams showing improved patient care and increased innovation. Holistic review, adapted from the Association of American Medical Colleges (AAMC), focuses on screening applicants with a balanced method, valuing their experiences, attributes, and academic metrics equally. A core tenet to holistic review is that diversity is essential to excellence. OBJECTIVE: Implementation of holistic review into the residency application screening process is effective at improving exposure to underrepresented in medicine (URiM) applicants. METHODS: After adjustment of our residency application screening rubric, improving our balance across the experience, attributes, and metrics domains, we conducted a retrospective cohort study comparing the representation of URiM applicants invited to interview, interviewed, and ranked by composite score compared to our previous primarily metric-based process. RESULTS: A total of 8,343 applicants were included in the study. Following implementation of holistic review, we saw an increase in the absolute percent of URiM applicants invited to interview (+11%, 95% confidence interview [CI] = 6.9% to 15.4%, p < 0.01), interviewed (+7.9%, 95% CI = 3.6% to 12.2%, p < 0.01), and represented in the top 75 through top 200 cutpoints based on composite score rank. The mean composite score for URiM applicants increased significantly compared to non-URiM applicants (+9.7, 95% CI = 8.2 to 11.2, p < 0.01 vs. +4.7, 95% CI = 3.5 to 5.9, p < 0.01). CONCLUSION: Holistic review can be used as a systematic and equitable tool to increase the exposure and recruitment of URiM applicants in EM training programs.

Unheard Voices: A Qualitative Study of Resident Perspectives on Remediation.

BACKGROUND: Remediation is an important component of residency training that ensures residents are progressing toward competency and unsupervised practice. There is literature describing educators' attitudes about remediation; however, little is known about residents' perspectives regarding peers who are struggling and remediation. Understanding this perspective is critical to supporting struggling residents and developing successful remediation programs. OBJECTIVE: The objective of this study was to describe residents' perspectives on peers who are struggling and remediation processes within graduate medical education programs. METHODS: In 2015, we conducted focus groups of residents in a multi-institutional exploratory qualitative study designed to investigate resident perspectives on remediation. Focus groups included questions on identification of residents who are struggling, reasons residents face difficulty in training, attitudes toward remediation, and understanding of the remediation process. Using conventional content analysis, we analyzed the focus group data to discover common themes. RESULTS: Eight focus groups were performed at 3 geographically distinct institutions. A total of 68 residents participated, representing 12 distinct medical specialties. Four major themes emerged from the participants' discussion: lack of transparency, negative stigma, overwhelming emotions, and a need for change. CONCLUSIONS: Resident perspectives on remediation are affected by communication, culture, and emotions. The resident participants called for change, seeking greater understanding and transparency about what it means to struggle and the process of remediation. The residents also believed that remediation can be embraced and normalized.

Ethics and informatics in the age of COVID-19: challenges and recommendations for public health organization and public policy.

The COVID-19 pandemic response in the United States has exposed significant gaps in information systems and processes that prevent timely clinical and public health decision-making. Specifically, the use of informatics to mitigate the spread of SARS-CoV-2, support COVID-19 care delivery, and accelerate knowledge discovery bring to the forefront issues of privacy, surveillance, limits of state powers, and interoperability between public health and clinical information systems. Using a consensus-building process, we critically analyze informatics-related ethical issues in light of the pandemic across 3 themes: (1) public health reporting and data sharing, (2) contact tracing and tracking, and (3) clinical scoring tools for critical care. We provide context and rationale for ethical considerations and recommendations that are actionable during the pandemic and conclude with recommendations calling for longer-term, broader change (beyond the pandemic) for public health organization and policy reform.

REVISITING HEALTH INFORMATION TECHNOLOGY ETHICAL, LEGAL, and SOCIAL ISSUES and EVALUATION: TELEHEALTH/TELEMEDICINE and COVID-19.

BACKGROUND: Information technologies have been vital during the COVID-19 pandemic. Telehealth and telemedicine services, especially, fulfilled their promise by allowing patients to receive advice and care at a distance, making it safer for all concerned. Over the preceding years, professional societies, governments, and scholars examined ethical, legal, and social issues (ELSI) related to telemedicine and telehealth. Primary concerns evident from reviewing this literature have been quality of care, access, consent, and privacy. OBJECTIVES: To identify and summarize ethical, legal, and social issues related to information technology in healthcare, as exemplified by telehealth and telemedicine. To expand on prior analyses and address gaps illuminated by the COVID-19 experience. To propose future research directions. METHODS: Literature was identified through searches, forward and backward citation chaining, and the author's knowledge of scholars and works in the area. EU and professional organizations' guidelines, and nineteen scholarly papers were examined and categories created to identify ethical, legal, and social issues they addressed. A synthesis matrix was developed to categorize issues addressed by each source. RESULTS: A synthesis matrix was developed and issues categorized as: quality of care, consent and autonomy, access to care and technology, legal and regulatory, clinician responsibilities, patient responsibilities, changed relationships, commercialization, policy, information needs, and evaluation, with subcategories that fleshed out each category. The literature primarily addressed quality of care, access, consent, and privacy. Other identified considerations were little discussed. These and newer concerns include: usability, tailoring services to each patient, curriculum and training, implementation, commercialization, and licensing and liability. The need for interoperability, data availability, cybersecurity, and informatics infrastructure also is more apparent. These issues are applicable to other information technologies in healthcare. CONCLUSIONS: Clinicians and organizations need updated guidelines for ethical use of telemedicine and telehealth care, and decision- and policy-makers need evidence to inform decisions. The variety of newly implemented telemedicine services is an on-going natural experiment presenting an unparalleled opportunity to develop an evidence-based way forward. The paper recommends evaluation using an applied ethics, context-sensitive approach that explores interactions among multiple factors and considerations. It suggests evaluation questions to investigate ethical, social, and legal issues through multi-method, sociotechnical, interpretive and ethnographic, and interactionist evaluation approaches. Such evaluation can help telehealth, and other information technologies, be integrated into healthcare ethically and effectively.

Stigma, biomarkers, and algorithmic bias: recommendations for precision behavioral health with artificial intelligence.

Effective implementation of artificial intelligence in behavioral healthcare delivery depends on overcoming challenges that are pronounced in this domain. Self and social stigma contribute to under-reported symptoms, and under-coding worsens ascertainment. Health disparities contribute to algorithmic bias. Lack of reliable biological and clinical markers hinders model development, and model explainability challenges impede trust among users. In this perspective, we describe these challenges and discuss design and implementation recommendations to overcome them in intelligent systems for behavioral and mental health.

Effect of Audience Response System on Morbidity and Mortality Conference Engagement.

This article was migrated. The article was marked as recommended. Objectives: Morbidity and mortality (M & M) conference is a central part of emergency medicine residency training. While audience response systems have become popular in traditional didactic teaching, little research has looked at effects in the unique M & M conference setting. We aimed to evaluate the effects of an audience response system on engagement in emergency medicine morbidity and mortality conference. Methods: An SMS text and internet-based audience response system was integrated into the M & M conference at one site in our emergency medicine residency. Anonymous, quantitative data about respondents use of the system was collected. Conference attendees were also surveyed to assess their evaluation of the ease of engagement in conference, effects of audience response system on engagement in conference and on perceived audience distractions. Results: The number of participants varied by conference and ranged from 37 to 63 respondents who responded from 1 to 21 times per conference (median 2 responses per respondent per conference). Subjects who used the audience response system were significantly more likely to report improved engagement in conference (p = .002). Subjects with more seniority (Assistant, Associate and Full Professors) reported easier engagement with M&M conference in general (p = .003). The audience response system did not result in significant reduction in audience distractions. Unexpected benefits of the audience response system included increased opportunity for engagement as well as quality of feedback for speakers. Conclusions: The integration of an audience response system into our M&M conference resulted in increased engagement and improved quality of speaker feedback. Further research is needed to evaluate effects on learning retention and clarify effects on audience distractions and behavior.

A qualitative study of medical educators' perspectives on remediation: Adopting a holistic approach to struggling residents.

INTRODUCTION: During residency, some trainees require the identification and remediation of deficiencies to achieve the knowledge, skills and attitudes necessary for independent practice. Given the limited published frameworks for remediation, we characterize remediation from the perspective of educators and propose a holistic framework to guide the approach to remediation. METHODS: We conducted semistructured focus groups to: explore methods for identifying struggling residents; categorize common domains of struggle; describe personal factors that contribute to difficulties; define remediation interventions and understand what constitutes successful completion. Data were analyzed through conventional content analysis. RESULTS: Nineteen physicians across multiple specialties and institutions participated in seven focus groups. Thirteen categories emerged around remediation. Some themes addressed practical components of remediation, while others reflected barriers to the process and the impact of remediation on the resident and program. The themes were used to inform development of a novel holistic framework for remediation. CONCLUSIONS: The approach to remediation requires comprehensive identification of individual factors impacting performance. The intervention should not only include a tailored learning plan but also address confounders that impact likelihood of remediation success. Our holistic framework intends to guide educators creating remediation plans to ensure all domains are addressed.

The High Prevalence of Vitamin D Insufficiency in Cord Blood in Calgary, Alberta (APrON-D Study).

OBJECTIVE: Vitamin D is important in promoting healthy pregnancy and fetal development. We undertook this study to measure 25-hydroxyvitamin D in maternal and cord blood and to identify maternal factors related to vitamin D status in Calgary. METHODS: Blood samples collected at the time of delivery from the Alberta Pregnancy Outcomes and Nutrition study cohort (ApronStudy.ca) participants were processed for plasma and assayed using liquid chromatography mass spectrometry methodology for 25(OH)D3. RESULTS: Ninety-two pairs of maternal and cord blood samples were obtained. The prevalence of 25(OH)D3 insufficiency-25(OH)D3 <75 nmol/L-was 38% and 80% in women and neonates, respectively. Vitamin D supplementation was the only clinical factor associated with 25(OH)D3 sufficiency, and the odds of sufficiency were 3.75 (95% CI 1.00 to 14.07) higher for women and 5.27 (95% CI 1.37 to 20.27) when over 2000 IU/day were used. CONCLUSION: Using liquid chromatography mass spectrometry, we demonstrated a very high prevalence of vitamin D insufficiency in cord blood and that the use of high dose vitamin D was associated with greater odds of sufficiency in pregnant women and cord blood in Alberta.

Food Insecurity, Poor Diet Quality, and Suboptimal Intakes of Folate and Iron Are Independently Associated with Perceived Mental Health in Canadian Adults.

BACKGROUND: To address nutrition-related population mental health data gaps, we examined relationships among food insecurity, diet quality, and perceived mental health. METHODS: Stratified and logistic regression analyses of respondents aged 19-70 years from the Canadian Community Health Survey, Cycle 2.2 were conducted (n = 15,546). Measures included the Household Food Security Survey Module, diet quality (i.e., comparisons to the Dietary Reference Intakes, Healthy Eating Index), perceived mental health (poor versus good), sociodemographics, and smoking. RESULTS: In this sample, 6.9% were food insecure and 4.5% reported poor mental health. Stratified analysis of food security and mental health status by age/gender found associations for poor diet quality, protein, fat, fibre, and several micronutrients (p-values < 0.05); those who were food insecure tended to have higher suboptimal intakes (p-values < 0.05). After adjustment for covariates, associations in relation to mental health emerged for food insecurity (OR = 1.60, 95% CI 1.45-1.71), poor diet quality (1.61, 95% CI 1.34-1.81), and suboptimal intakes of folate (OR = 1.58, 95% CI 1.17-1.90) and iron (OR = 1.45, 95% CI 1.23-1.88). CONCLUSIONS: Population approaches that improve food security and intakes of high quality diets may protect people from poor mental health.