Designing a Checklist for Directly Observing Use of One-Minute Preceptor Steps on Inpatient Rounds: A Pilot Study.

BACKGROUND: "One-minute preceptor" (OMP) is a well-established educational technique; however, primary literature on OMP lacks a tool to assess behavioral change after delivery of curricula.Primary aim of this pilot study was to design a checklist for direct observation of teachers using OMP on general medicine rounds and obtain inter-rater reliability evidence for the checklist. METHODS: This study pilots an internally designed 6-item checklist to assess change in directly observed behavior. We describe the process of developing the checklist and training the observers. We calculated a percent agreement and Cohen's kappa to assess inter-rater reliability. RESULTS: Raters had a high percent agreement ranging from 0.8 to 0.9 for each step of OMP. Cohen's kappa ranged from 0.49 to 0.77 for the five OMP steps. The highest kappa obtained was for getting a commitment (κ = 0.77) step, whereas the lowest agreement was for correcting mistakes (κ = 0.49). CONCLUSION: We showed a percent agreement ≥0.8 and moderate agreement based on Cohen's kappa with most steps of OMP on our checklist. A reliable OMP checklist is an important step in further improving the assessment and feedback of resident teaching skills on general medicine wards.

Exploring US internal medicine resident career preferences: a Q-methodology study.

Career selection in medicine is a complex and underexplored process. Most medical career studies performed in the U.S. focused on the effect of demographic variables and medical education debt on career choice. Considering ongoing U.S. physician workforce shortages and the trilateral adaptive model of career decision making, a robust assessment of professional attitudes and work-life preferences is necessary. The objective of this study was to explore and define the dominant viewpoints related to career choice selection in a cohort of U.S. IM residents. We administered an electronic Q-sort in which 218 IM residents sorted 50 statements reflecting the spectrum of opinions that influence postgraduate career choice decisions. Participants provided comments that explained the reasoning behind their individual responses. In the final year of residency training, we ascertained participating residents' chosen career. Factor analysis grouped similar sorts and revealed four distinct viewpoints. We characterized the viewpoints as "Fellowship-Bound-Academic," "Altruistic-Longitudinal-Generalist," "Inpatient-Burnout-Aware," and "Lifestyle-Focused-Consultant." There is concordance between residents who loaded significantly onto a viewpoint and their ultimate career choice. Four dominant career choice viewpoints were found among contemporary U.S. IM residents. These viewpoints reflect the intersection of competing priorities, personal interests, professional identity, socio-economic factors, and work/life satisfaction. Better appreciation of determinants of IM residents' career choices may help address workforce shortages and enhance professional satisfaction.

Evidence-Based Clinical Practice Guidelines for Laser-Assisted Drug Delivery.

Importance: Laser-assisted drug delivery (LADD) is used for various medical and cosmetic applications. However, there is insufficient evidence-based guidance to assist clinicians performing LADD. Objective: To develop recommendations for the safe and effective use of LADD. Evidence Review: A systematic literature review of Cochrane Central Register of Controlled Trials, Embase, and MEDLINE was conducted in December 2019 to identify publications reporting research on LADD. A multidisciplinary panel was convened to draft recommendations informed by the systematic review; they were refined through 2 rounds of Delphi survey, 2 consensus meetings, and iterative review by all panelists until unanimous consensus was achieved. Findings: Of the 48 published studies of ablative fractional LADD that met inclusion criteria, 4 were cosmetic studies; 21, oncologic; and 23, medical (not cosmetic/oncologic), and 6 publications of nonablative fractional LADD were included at the request of the expert panel, producing a total of 54 studies. Thirty-four studies (63.0%) were deemed to have low risk of bias, 17 studies (31.5%) had moderate risk, and 3 (5.5%) had serious risk. The key findings that informed the guidelines developed by the expert panel were as follows: LADD is safe in adults and adolescents (≥12 years) with all Fitzpatrick skin types and in patients with immunosuppression; it is an effective treatment for actinic keratosis, cutaneous squamous cell carcinoma in situ, actinic cheilitis, hypertrophic scars, and keloids; it is useful for epidermal and dermal analgesia; drug delivery may be increased through the application of heat, pressure, or occlusion, or by using an aqueous drug solution; laser settings should be selected to ensure that channel diameter is greater than the delivered molecule; antibiotic prophylaxis is not recommended, except with impaired wound healing; antiviral prophylaxis is recommended when treating the face and genitalia; and antifungal prophylaxis is not recommended. The guideline's 15 recommendations address 5 areas of LADD use: (I) indications and contraindications; (II) parameters to report; (III) optimization of drug delivery; (IV) safety considerations; and (V) prophylaxis for bacterial, viral, and fungal infections. Conclusions and Relevance: This systematic review and Delphi consensus approach culminated in an evidence-based clinical practice guideline for safe and effective use of LADD in a variety of applications. Future research will further improve our understanding of this novel treatment technique.

Association Between Internal Medicine Residency Applicant Characteristics and Performance on ACGME Milestones During Intern Year.

BACKGROUND: Residency programs apply varying criteria to the resident selection process. However, it is unclear which applicant characteristics reflect preparedness for residency. OBJECTIVE: We determined the applicant characteristics associated with first-year performance in internal medicine residency as assessed by performance on Accreditation Council for Graduate Medical Education (ACGME) Milestones. METHODS: We examined the association between applicant characteristics and performance on ACGME Milestones during intern year for individuals entering Northwestern University's internal medicine residency between 2013 and 2018. We used bivariate analysis and a multivariable linear regression model to determine the association between individual factors and Milestone performance. RESULTS: Of 203 eligible residents, 198 (98%) were included in the final sample. One hundred fourteen residents (58%) were female, and 116 residents (59%) were White. Mean Step 1 and Step 2 CK scores were 245.5 (SD 12.0) and 258 (SD 10.8) respectively. Step 1 scores, Alpha Omega Alpha membership, medicine clerkship grades, and interview scores were not associated with Milestone performance in the bivariate analysis and were not included in the multivariable model. In the multivariable model, overall clerkship grades, ranking of the medical school, and year entering residency were significantly associated with Milestone performance (P ≤ .04). CONCLUSIONS: Most traditional metrics used in residency selection were not associated with early performance on ACGME Milestones during internal medicine residency.

Relationship Between Confidence, Gender, and Career Choice in Internal Medicine.

BACKGROUND: Understanding factors in internal medicine (IM) resident career choice may reveal important needed interventions for recruitment and diversity in IM primary care and its subspecialties. Self-reported learner confidence is higher in men than in women in certain areas of practicing medicine, but has never been explored as a factor in career choice. OBJECTIVE: The purpose of this study is to elucidate associations between confidence, gender, and career choice. DESIGN: IM residents completed a 31-item survey rating confidence in procedural, clinical, and communication skills on a 9-point Likert scale. Residents also reported anticipated career choice and rated influence of factors. Associations between gender and confidence scale scores, gender and career choice, and confidence and career choice were analyzed using t tests, ANOVA, and multiple linear regression controlled for postgraduate year (PGY), institution, and specialty choice. PARTICIPANTS: 292 IM residents at Northwestern and University of Texas (UT) Southwestern MAIN MEASURES: Resident gender, self-reported confidence, career choice KEY RESULTS: Response rate was 79.6% (n = 292), of them 50.3% women. Overall self-reported confidence increased with training (PGY-1 4.9 (1.1); PGY-2 6.2 (1.0); PGY-3 7.4 (1.0); p < 0.001). Men had higher confidence than women (men 6.6 (1.5); women 6.3 (1.4), p = 0.06), with the greatest difference in procedures. High confidence in men was associated with choice of procedural careers, whereas there was no association between confidence and career in women. CONCLUSIONS: This is the first study demonstrating a gender difference in self-reported confidence and career choice. There is a positive correlation in men: higher self-reported confidence with procedural specialties, lower with general internal medicine. Women's self-reported confidence had no association. Further investigation is needed to elucidate causative factors for differences in self-reported confidence by gender, and whether alterations in level of self-reported confidence produce a downstream effect on career choice.

The STRIVE Initiative: A Resident-Led Mentorship Framework for Underrepresented Minority Medical Students.

BACKGROUND: Underrepresented minority (URM) trainees face unique challenges in academic medicine. Near-peer mentorship is an under-described method to support URM trainees. OBJECTIVE: We created and evaluated the Student to Resident Institutional Vehicle for Excellence (STRIVE) program in a large urban medical school and associated residency programs. METHODS: All URM residents were invited to participate in the STRIVE mentorship program consisting of 3 pillars of programming: medical school curriculum review sessions, panel discussions, and social events for medical students. The program was evaluated through participation rates and a 7-item survey delivered in May 2019 after 3 years of implementation. RESULTS: The STRIVE initiative conducted 25 events. Thirty-five of 151 eligible (23%) URM residents participated as mentors for an average of 50 of 110 eligible (45%) URM medical students annually. Resident mentors participated for an average of 3 to 4 hours each year. Twenty of 32 eligible resident mentors (63%) completed the survey. Ninety-five percent (19 of 20) of survey respondents agreed that STRIVE made them a better mentor; 90% (18 of 20) reported that they would have appreciated an equivalent program during their medical school training; and 75% (15 of 20) agreed that the program helped them address the challenges of underrepresentation in medicine. CONCLUSIONS: Over a 3-year period, STRIVE required a modest amount of resident time and was valued by the URM residents and medical students who participated in the program.

Preliminary Efficacy of a Brief Mindfulness Intervention for Procedural Stress in Medical Intern Simulated Performance: A Randomized Controlled Pilot Trial.

Objectives: Simulation-based mastery learning (SBML) programs have been shown to be beneficial to improve procedural skill acquisition. However, simulated procedure performance can be affected by a host of factors, including stress. This investigation examined the preliminary efficacy of bolstering an established SBML program for medical residents with a brief mindfulness intervention (called a PITSTOP) to reduce procedural stress and improve simulator performance. Design: The study employed a partially blinded, parallel-group, randomized, repeated-measures intention-to-treat design. Participants were blinded to the primary outcome (simulator performance) and instead were informed of the study's secondary outcome (stress prevention). The SBML faculty instructors and study investigators were blinded to participants' group assignment. Settings/location: Northwestern Memorial Hospitals of Chicago. Subjects: Twenty-six postgraduate year (PGY) 1 internal medicine residents enrolled in a required SBML central venous catheter (CVC) insertion training from June 2015 to January 2018 participated in the study. Interventions: SBML consists of a simulated skills pretest, deliberate practice, and a simulated skills post-test (within 1 week of pretest). PGY 1 participants were randomly assigned to the PITSTOP intervention (12-min PITSTOP mindfulness training video) or control group (12-min control video on ways to increase physical activity) before the SBML pretest. Outcome measures: The primary outcome was a comparison of each group's simulator performance during pre- and post-tests. Secondary outcomes were changes in groups' procedural stress during these tests (assessed using self-reported, instructor-rated, and physiologic indicators), and self-reported self-regulation outcomes. Results: Residents who watched the PITSTOP video before their SBML training made fewer procedural errors relative to controls during their pretest for intrajugular CVC insertion (p = 0.03). PITSTOP participants also had lower heart rate (p = 0.03) and less visible trembling (p = 0.003) relative to controls at the post-test. Conclusions: This study provides preliminary evidence that a brief, mindfulness intervention may reduce stress during SBML training.

Identifying and addressing social determinants of health in outpatient practice: results of a program-wide survey of internal and family medicine residents.

BACKGROUND: Up to 60% of preventable mortality is attributable to social determinants of health (SDOH), yet training on SDOH competencies is not widely implemented in residency. The objective of this study was to assess internal and family medicine residents' competence at identifying and addressing SDOH. METHODS: Residents' perceived competence at identifying, discussing, and addressing SDOH in outpatient settings was assessed using a single questionnaire administered in March 2017. In this cross-sectional analysis, bivariate associations of resident characteristics with the following outcomes were examined: identifying, discussing, and addressing patients' challenges related to SDOH through referrals. RESULTS: The survey was completed by 129 (84%) residents. Twenty residents (16%) reported an annual income of less than $50,000 during childhood. Overall, 108 residents (84%) reported previous SDOH training. Two-thirds had outpatient practices in Veterans Affairs or safety-net clinics. Thirty-nine (30%) intended to pursue a career in primary care. The following numbers of residents reported high levels of competence for performing these outcomes: identifying patients' challenges related to SDOH: 37 (29%); discussing them with patients: 18 (14%); and addressing these challenges through referrals to internal and external resources: 13 (10%) and 11 (9%), respectively. Factors associated with higher competence included older age, lower childhood household income, prior education about SDOH, primary practice site and intention to practice primary care. CONCLUSIONS: Most residents had previous SDOH training, yet only a small proportion of residents reported being highly competent at identifying or addressing SDOH. Providing opportunities for practical training may be a key component in preparing medical residents to identify and address SDOH effectively in outpatient practice.

Health Equity in Graduate Medical Education: Exploring Internal Medicine Residents' Perspectives on a Social Determinants of Health Curriculum.

BACKGROUND: There is a clear mandate for resident training in social determinants of health (SDOH) and health equity stemming from patients' needs and program accreditation requirements. OBJECTIVE: To explore residents' perspectives on the impact of an SDOH curriculum. METHODS: In 2017, we developed an SDOH curriculum for 38 PGY-2 Internal medicine residents at our institution. Half of the residents completed semi-structured interviews and online reflections. We conducted a thematic analysis of the transcripts to identify common themes in their perspectives on the curriculum and its impact. RESULTS: Residents valued the curriculum and were motivated to change their practice. Participants cited lack of time and resources as important barriers limiting advocacy to the patient level. CONCLUSIONS: Graduate medical education training in SDOH is critical. By addressing the learner-defined barriers to advocacy and incorporating curricular elements learners have identified, residency programs can structure their SDOH curriculum to optimize the impact for patients and trainees.

Developing Equity Report Cards for Residents Training in Primary Care.

BACKGROUND: Most residency programs do not provide trainees with health equity data for their clinic patients. METHODS: Equity report cards were developed for internal and family medicine residents in a large health system. After considering which equity indictors were available, how to attribute patients to residents, and what level of granularity was feasible, equity reports were created for five ambulatory quality measures. Chi-square tests were used to test the significance of differences in quality measure satisfaction between groups. RESULTS: Attributing patients to the physician who had seen them for the greatest proportion of encounters performed best. Creating equity reports for individual resident panels was not possible due to insufficient numbers. Most measures had sufficient patients when combining all residents' patients. Inequities were identified for four of five examined measures. CONCLUSION: Creating aggregate equity reports for all primary care residents across multiple equity indicators was feasible, documenting disparities in health care quality.

Immediate and long-term effects of a team-based quality improvement training programme.

BACKGROUND: Although many studies of quality improvement (QI) education programmes report improvement in learners' knowledge and confidence, the impact on learners' future engagement in QI activities is largely unknown and few studies report project measures beyond completion of the programme. METHOD: We developed the Academy for Quality and Safety Improvement (AQSI) to prepare individuals, across multiple departments and professions, to lead QI. The 7-month programme consisted of class work and team-based project work. We assessed participants' knowledge using a multiple choice test and an adapted Quality Improvement Knowledge Assessment Test (QIKAT) before and after the programme. We evaluated participants' postprogramme QI activity and project status using surveys at 6 and 18 months. RESULTS: Over 5 years, 172 individuals and 32 teams participated. Participants had higher multiple choice test (71.9±12.7 vs 79.4±13.2; p<0.001) and adapted QIKAT scores (55.7±16.3 vs 61.8±14.7; p<0.001) after the programme. The majority of participants at 6 months indicated that they had applied knowledge and skills learnt to improve quality in their clinical area (129/148; 87.2%) and to implement QI interventions (92/148; 62.2%). At 18 months, nearly half (48/101; 47.5%) had led other QI projects and many (41/101; 40.6%) had provided QI mentorship to others. Overall, 14 (43.8%) teams had positive postintervention results at AQSI completion and 20 (62.5%) had positive results at some point (ie, completion, 6 months or 18 months after AQSI). CONCLUSIONS: A team-based QI training programme resulted in a high degree of participants' involvement in QI activities beyond completion of the programme. A majority of team projects showed improvement in project measures, often occurring after completion of the programme.

Social Determinants of Health Training in U.S. Primary Care Residency Programs: A Scoping Review.

PURPOSE: Medical training has traditionally focused on the proximate determinants of disease, with little focus on how social conditions influence health. The authors conducted a scoping review of existing curricula to understand the current programs designed to teach primary care residents about the social determinants of health (SDH). METHOD: In January and March 2017, the authors searched seven databases. Eligible articles focused on primary care residents, described a curriculum related to SDH, were published between January 2007 and January 2017, and were based in the United States. RESULTS: Of the initial 5,523 articles identified, 43 met study eligibility criteria. Most programs (29; 67%) were in internal medicine. Sixteen studies (37%) described the curriculum development process. Overall, 20 programs (47%) were short or one-time sessions, and 15 (35%) were longitudinal programs lasting at least 6 months. Thirty-two programs (74%) reported teaching SDH content using didactics, 22 (51%) incorporated experiential learning, and many programs (n = 38; 88%) employed both. Most studies reported satisfaction and/or self-perceived changes in knowledge or attitudes. CONCLUSIONS: The authors identified wide variation in curriculum development, implementation, and evaluation. They highlight curricula that considered community and resident needs, used conceptual frameworks or engaged multiple stakeholders to select content, used multiple delivery methods, and focused evaluation on changes in skills or behaviors. This review highlights the need not only for systematic, standardized approaches to developing and delivering SDH curricula but also for developing rigorous evaluation of the curricula, particularly effects on resident behavior.

Effect of Trainee Performance Data on Standard-Setting Judgments Using the Mastery Angoff Method.

BACKGROUND: Mastery learning in health professions education requires learners to learn and undergo assessment until they demonstrate a high level of competence. Setting defensible standards is key to accurately assessing educational outcomes in mastery learning. The Mastery Angoff method was proposed recently to set a minimum passing standard (MPS) for mastery learning curricula. However, it is unknown whether prior knowledge of trainee performance affects judges' decisions about setting an MPS using the Mastery Angoff method. OBJECTIVE: We sought to determine the effect of introducing baseline data about trainee performance on faculty judges' decisions about the Mastery Angoff MPS for a written examination. METHODS: We developed a mastery learning curriculum to train internal medicine residents and cardiology fellows about the correct interpretation of inpatient telemetry monitoring. All learners were required to meet or exceed an MPS on a 35-item written examination at the end of training. The MPS was set in 2017 by judges who used the item-based Mastery Angoff method without prior examinee performance information. The judges subsequently reevaluated the test items after receiving baseline data about trainee performance collected during pilot testing. Mastery Angoff MPSs with and without baseline performance data were compared. RESULTS: Twelve judges participated in the standard-setting exercise. The initial MPS was similar to the repeat MPS set after judges received trainee performance data (86.2% versus 86.9%, P = .23). CONCLUSIONS: Prior knowledge about medical trainee performance data did not affect MPS as determined by the Mastery Angoff procedure.

Interactive Multimodal Curriculum on Use and Interpretation of Inpatient Telemetry.

Introduction: Inpatient telemetry monitoring is a commonly used technology designed to detect and monitor life-threatening arrhythmias. However, residents are rarely educated in the proper use and interpretation of telemetry monitoring. Methods: We developed a training module containing an educational video, PowerPoint presentation, and hands-on interactive learning session with a telemetry expert. The module highlights proper use of telemetry monitoring, recognition of telemetry artifact, and interrogation of telemetry to identify clinically significant arrhythmias. Learners completed pre- and postcurriculum knowledge-based assessments and a postcurriculum survey on their experience with the module. In total, the educational curriculum had three 60-minute sessions. Results: Thirty-two residents participated in the training module. Residents scored higher on the posttest (77% ± 12%) than on the pretest (70% ± 12%), t(31) = -4.3, p < .001. Wilcoxon signed rank tests indicated PGY-3s performed better on the posttest (Mdn = 0.86) than on the pretest (Mdn = 0.72), z = -2.19, p = .031. PGY-2s also performed better on the posttest (Mdn = 0.86) than on the pretest (Mdn = 0.76), z = -2.04, p = .042. There was no difference between pretest (Mdn = 0.66) and posttest (Mdn = 0.71) scores for PGY-1s, z = -1.50, p = .142. The majority of residents reported that the telemetry curriculum boosted their self-confidence, helped prepare them to analyze telemetry on their patients, and should be a required component of the residency. Discussion: This module represents a new paradigm for teaching residents how to successfully and confidently interpret and use inpatient telemetry.

Impact of a Video-Based Interactive Workshop on Unprofessional Behaviors Among Internal Medicine Residents.

BACKGROUND: Unprofessional behaviors undermine the hospital learning environment and the quality of patient care. OBJECTIVE: To assess the impact of an interactive workshop on the perceptions of and self-reported participation in unprofessional behaviors. METHODS: We conducted a pre-post survey study at 3 internal medicine residency programs. For the workshop we identified unprofessional behaviors related to on-call etiquette: "blocking" an admission, disparaging a colleague, and misrepresenting a test as urgent. Formal debriefing tools were utilized to guide the discussion. We fielded an internally developed 20-item survey on perception and participation in unprofessional behaviors prior to the workshop. An online "booster" quiz was delivered at 4 months postworkshop, and the 20-item survey was repeated at 9 months postworkshop. Results were compared to a previously published control from the same institutions, which showed that perceptions of unprofessional behavior did not change and participation in the behaviors worsened over the internship. RESULTS: Of 237 eligible residents, 181 (76%) completed both pre- and postsurvey. Residents perceived blocking an admission and the misrepresentation of a test as urgent to be more unprofessional at a 9-month follow-up (2.0 versus 1.74 and 2.63 versus 2.28, respectively; P < .05), with no change in perception for disparaging a colleague. Participation in unprofessional behaviors did not decrease after the workshop, with the exception of misrepresenting a test as urgent (61% versus 50%, P = .019). CONCLUSIONS: The results of this multi-site study indicate that an interactive workshop can change perception and may lower participation in some unprofessional behaviors.

Promoting professionalism via a video-based educational workshop for academic hospitalists and housestaff.

BACKGROUND: Unprofessional behavior can compromise care and detract from the hospital learning environment. Discrepancy between professional behaviors formally taught and what is witnessed has become increasingly evident. METHODS: With funding from the American Board of Internal Medicine Foundation, a workshop was developed to address unprofessional behaviors related to inpatient care previously identified in a multi-institution survey. The aims were to utilize video-based education to illustrate unprofessional behaviors, how faculty play a role in promoting such behaviors, and facilitate reflection regarding motivation for and prevention of these behaviors. Hospitalists and housestaff at 3 Chicago-area academic hospitals and 1 community teaching affiliate participated. Videos were debriefed, identifying barriers to professional behavior and improvement strategies. A postworkshop survey assessed beliefs on behaviors and intent to change practice. RESULTS: Forty-four (53%) faculty and 244 (68%) residents (postgraduate year 1 and greater) participated. The workshop was well received, with 89% reporting it "useful and effective." Two-thirds expressed intent to change behavior. Most (86%) believed videos were realistic and effective. Those who perceived videos as "very realistic" were more likely to report intent to change behavior (93% vs 53%, P = 0.01). CONCLUSIONS: Video-based education is a feasible way to promote reflection and address unprofessional behaviors among providers and may positively impact the learning environment.