Virtual interviewing in the COVID-19 era: A survey of graduate program directors.

PURPOSE/OBJECTIVE: Due to the coronavirus pandemic, virtual interviews became a mainstay of graduate dental and medical education selection processes. To gain a handle on how to navigate lingering uncertainties about how interviews should be conducted in the future, this study examined the benefits and pitfalls of the virtual interview process (VIP) and assessed program plans to implement in the next interview cycle. METHODS: An anonymous online survey, for completion by one program representative (director or associate director), was sent to graduate medical education (GME) and advanced dental education programs at West Virginia University (N = 74). RESULTS: Fifty-two (52) of the programs (70%) completed the survey. Zoom was the most frequently used interview platform (78.8%). Approximately two thirds (65.4%) of the interviewers thought VIP allowed the program to promote the university, the school, and their program and also reported experiencing video-conferencing fatigue. About six in 10 perceive VIP can introduce bias in selecting applicants (59.6%) and potentially disadvantage some applicants (67.3%). Compared to the previous in-person cycle, 67.4% of programs invited more applicants, and 73.1% interviewed more applicants. Regarding the 2021-2022 interview cycle, 55.8% of programs plan to offer either an in-person or VIP, while 7.7% plan to keep their process completely virtual. CONCLUSION: Graduate programs in this study demonstrated the indispensability of technology in transitioning from in-person to virtual interviews during COVID-19 pandemic. VIP has several advantages and disadvantages; this style of interview is forecasted to have a presence in applicant selection in the future.

Lower-Third SLOE Rankings Impede, But Do Not Prevent, A Match in Emergency Medicine Residency Training.

OBJECTIVE: Emergency medicine program directors (PD) value the standardized letter of evaluation (SLOE) as the most important aspect of a residency application when making both invitation and ranking decisions. This study aims to determine whether the presence of any lower-third in either SLOE global assessment (GA) question impacted the ability of an applicant to match into EM. We hypothesized that any lower-third ranking would be associated with increased odds of not matching into EM. METHODS: We conducted a retrospective cohort study evaluating allopathic applicants from medical schools in the United States (US allopathic applicants) to a single EM residency program during the 2018/2019 match cycles. GA SLOE rankings from all applications were tabulated and compared to the applicant's National Resident Matching Program (NRMP) match outcome. Comparative analyses were conducted between SLOE groupings and odds ratios (OR) were calculated. RESULTS: A total of 2,017 SLOEs from 781 US allopathic applicants were analyzed during the study period. Of the total, 277 (35%) applicants in our sample had any lower-third GA ranking, which significantly decreased an applicant's odds of matching in EM by 79% (OR 0.21, 95% CI, 0.12-0.34). Having more than one lower-third GA ranking did not further statistically decrease the odds of a successful EM match (OR 0.60, 95% CI 0.31-1.17). As a secondary finding of the study, results demonstrate that those applicants having no lower-third GA rankings had a nearly 5 times increased odds of an EM match (OR 4.84, 95% CI, 2.91-8.03). CONCLUSION: Having any lower-third GA ranking significantly reduced an applicant's chances of matching into an EM program. Faculty advisors should be aware of the increased risk of not matching for any applicant with any lower-third GA ranking and advise students appropriately, while maintaining the integrity of the SLOE and not divulging the confidential information contained within.

A Review of Continuous Quality Improvement Processes at Ten Medical Schools.

The Liaison Committee on Medical Education now expects all allopathic medical schools to develop and adhere to a documentable continuous quality improvement (CQI) process. Medical schools must consider how to establish a defensible process that monitors compliance with accreditation standards between site visits. The purpose of this descriptive study is to detail how ten schools in the Association of American Medical Colleges' (AAMC) Southern Group on Educational Affairs (SGEA) CQI Special Interest Group (SIG) are tackling practical issues of CQI development including establishing a CQI office, designating faculty and staff, charging a CQI committee, choosing software for data management, if schools are choosing formalized CQI models, and other considerations. The information presented is not meant to certify that any way is the correct way to manage CQI, but simply present some schools' models. Future research should include defining commonalities of CQI models as well as seeking differences. Furthermore, what are components of CQI models that may affect accreditation compliance negatively? Are there "worst practices" to avoid? What LCME elements are most commonly identified for CQI, and what are the successes and struggles for addressing those elements? What are identifiable challenges relating to use of standard spreadsheet software and engaging information technology for support? How can students be more engaged and involved in the CQI process? Finally, how do these major shifts to a formalized CQI process impact the educational experience?

Longitudinal Ultrasound Curriculum Incorporation at West Virginia University School of Medicine: A Description and Graduating Students' Perceptions.

OBJECTIVES: Sonography is a clinical tool being incorporated in multiple medical specialties with evidence of improved patient care and cost. Some schools have begun implementing ultrasound curricula. We hope to build upon that foundation and provide another potential framework of incorporation. There are several barriers, including curricular space, equipment and physical space, adequate faculty, and performing assessment. METHODS: At West Virginia University, we began a longitudinal ultrasound curriculum in 2012 with incorporation of didactic and practical sessions into gross anatomy, our systems-based second-year curriculum, physical diagnosis course, and clinical rotations. We included both written and practical assessment from the onset. After the initial 4 years, the first graduates were surveyed on their perceptions of the curriculum. Responses were correlated with specialty choice and clinical campus site. RESULTS: Based on our survey (90% response rate), students felt sonography was useful for anatomical understanding and patient care. Overall, 93% of our respondents reviewed the curriculum favorably. Qualitative feedback was very positive, with students desiring more ultrasound education and more required components, specifically in clinical rotations. CONCLUSIONS: Based on these results, some changes have already been implemented, including decreased student-to-instructor ratios, more open scan time, and more required components. The breadth of formal assessment has increased. Multiple pilot programs for clinical rotations are being developed. There is an ongoing need for faculty development and continued assessment of ultrasound competency.

Constructing tailored parental monitoring strategy profiles to predict adolescent disclosure and risk involvement.

•Many parents use multiple monitoring strategies in different combinations over time to monitor their adolescents.•Adolescents of parents who use multiple strategies reported greater risk involvement.•Parents who solicited information only from adolescents had greater knowledge and adolescent disclosure.

A Focused Observation Tool Using Dreyfus Stages of Skill Acquisition as an Evaluative Scale.

Focused Observartion (FO) is associated with assessing complex skills and differs from generalized observations and evaluations. We've developed a FO assessing clinical procedural skills using Hubert Dreyfus Stages of Skill Acquisition as descriptive anchors. This study sought to analyze the effectiveness of this measure of skill progression. During week 1 and week 4 of training, FO was performed repetitively on 6 residents during endotracheal intubation. Skill stage ratings were converted to numerical scores. A dependent, paired samples t-test was calculated using total mean score (dependent variable) and an effect size. (Cohen's d) was performed to ascertain the standardized mean difference between observations. A significant improvement in mean scores occurred between Week 1 (AVG 1.2, STDV ± 0.1) and Week 4 (AVG 2.0, STDV ± 0.1) (t= -3.9, p<.05) Calculated Chohen's d indicates that this difference was meaningful. This study demonstrates success in adapting a Focused Observation technique and an innovative evaluative scale based upon Dreyfus stages of skill acquisition.

Do Parents Meet Adolescents' Monitoring Standards? Examination of the Impact on Teen Risk Disclosure and Behaviors if They Don't.

In this study, we examined how adolescents compare monitoring efforts by their parents to those of a "good parent" standard and assessed the impact of these comparisons on adolescent self-disclosure and risk behavior and their perceptions of their parents' monitoring knowledge. Survey responses from 519 adolescents (12-17 years) at baseline of a larger, longitudinal study examining parental monitoring and adolescent risk were examined. Adolescents' "good parent comparisons" differed greatly by monitoring areas (e.g., telephone use, health, money); however, between 5.5% and 25.8% of adolescents believed their parents needed to monitor their activities more than they currently were monitoring. Alternatively, between 8.5% and 23.8% of adolescents believed their parents needed to monitor their activities less often. These perceptions significantly distinguished adolescents in terms of their level of disclosure, perceived monitoring knowledge, and risk involvement. Adolescents who viewed their parents as needing to monitor more were less likely to disclose information to their parents (p<.001), less likely to perceive their parents as having greater monitoring knowledge (p<.001), and more likely to be involved in a risk behaviors (p<.001) than adolescents who perceived their parents needed no change. Adolescent disclosure to a parent is a powerful predictor of adolescent risk and poor health outcomes. These findings demonstrate that adolescents' comparisons of their parents' monitoring efforts can predict differences in adolescent disclosure and future risk. Obtaining adolescent "good parent" comparisons may successfully identify intervention opportunities with the adolescent and parent by noting the areas of need and direction of monitoring improvement.

Investigating the Impact of Preparation Strategies on USMLE Step 1 Performance.

BACKGROUND: The USMLE Step 1 score helps differentiate applicants for competitive residency programs. Students frequently ask medical educators how to prepare for this high-stakes exam. Multiple resources exist such as books, training programs, and question banks. The purpose of this study is to provide medical educators with data on which resources correlate with higher exam scores. METHODS: 164 medical students at West Virginia University School of Medicine were given a survey following the completion of Step 1. The survey contained questions about resources used and exam date. De-identified data was paired with class quartile rankings and Step 1 scores. Average Step 1 scores were calculated for each resource and a student's t-test was used to compare between groups. Test dates were also broken into quintiles and average Step 1 scores were compared between groups. RESULTS: Students who used the USMLE World question bank had higher Step 1 scores (M=229, SE=1.4) compared to students who did not use this resource (M=215, SE=4.2). Commercial preparation courses were not associated with improved scores. The timing of when the exam was taken was also not associated with significant differences between scores. CONCLUSIONS: Interactive study options offer the best choice to improve USMLE Step 1 scores.

Medical education scholarship: an introductory guide: AMEE Guide No. 89.

Abstract This AMEE Guide provides an overview of medical education scholarship for early career scholars, based upon a summary of the existing literature and pragmatic advice derived from the experience of its authors. After providing an introduction to the principles of scholarship and describing questions that the Guide addresses, the authors offer a conceptual description of the complementary traditions of teaching and educational discovery, and advocate for the development of educational scholars with both traditions. They then describe the attributes of effective mentor-mentee relationships and how early career scholars can identify potential mentors who can fulfill this role. In the subsequent sections, they describe the appropriate development of scholarly questions and other components of a complete scholarly plan, including how to use conceptual frameworks in guiding such plans. From here, they describe methods that align with both the teaching and discovery traditions and provide concrete examples of each. They then provide guidelines for assessing the impact of scholarship, identify the various opportunities for sharing it, and how to effectively interpret and describe it. Additionally, they provide practical advice on how appropriately to demonstrate the scholarship in a promotional packet, including the principle of reflectivity in scholarship. Finally, they address the principles of applied research ethics for educational scholarship and when to consider soliciting approval for scholarly activities by a human research board.

Managing difficult encounters: understanding physician, patient, and situational factors.

Family physicians commonly find themselves in difficult clinical encounters. These encounters often leave the physician feeling frustrated. The patient may also be dissatisfied with these encounters because of unmet needs, unfulfilled expectations, and unresolved medical issues. Difficult encounters may be attributable to factors associated with the physician, patient, situation, or a combination. Common physician factors include negative bias toward specific health conditions, poor communication skills, and situational stressors. Patient factors may include personality disorders, multiple and poorly defined symptoms, nonadherence to medical advice, and self-destructive behaviors. Situational factors include time pressures during visits, patient and staff conflicts, or complex social issues. To better manage difficult clinical encounters, the physician needs to identify all contributing factors, starting with his or her personal frame of reference for the situation. During the encounter, the physician should use empathetic listening skills and a nonjudgmental, caring attitude; evaluate the challenging patient for underlying psychological and medical disorders and previous or current physical or mental abuse; set boundaries; and use patient-centered communication to reach a mutually agreed upon plan. The timing and duration of visits, as well as expected conduct, may need to be specifically negotiated. Understanding and managing the factors contributing to a difficult encounter will lead to a more effective and satisfactory experience for the physician and the patient.

Validating the nonparental adult inventory (NPAI) for mental health assessment and research.

Survey data collected from 518 parent-adolescent dyads were used to examine the psychometric properties of the NonParental Adult Inventory (NPAI). Test-retest reliability, internal reliability, and factor structure were examined. Reliability analyses indicate adequate to good test-retest reliability and internal consistency. Exploratory and confirmatory factor analyses support three-factor models that differ for parent and adolescent samples, both of which explain approximately 54 % of the variance. The NPAI reveals a three-factor structure that clearly differentiates between related and nonrelated adults in both adolescent and parent samples. This scale may be useful to both practitioners in assessment procedures and researchers for use in multivariate analyses.

A teaching oath: a commitment to medical students' learning and development.

BACKGROUND: There are several oaths and affirmations that are integrated into the academic customs of the health sciences, such as the Hippocratic Oath and the Ethical Affirmation for Scientists. What current oaths do not communicate is that teaching and learning are the foundation of the professions. SUMMARY: We articulated an oath to punctuate the important role of teaching and to emphasize that educating students is not a marginal responsibility but an important duty. The goal of this oath is to include all educators who contribute to teaching medical students, including basic science and clinical faculty, residents, nurses, and healthcare providers. This oath is also designed to be concise, allowing for a public declaration during ceremonies that call attention to teaching and learning. CONCLUSIONS: Publically declaring the Teaching Oath is an opportunity to clarify the highest standards of teaching and to energize educators to fulfill the promise of a dynamic learning community.

The integration of clerkships: WVU's innovative approach to curriculum delivery at a regional campus.

PURPOSE: The purpose of this descriptive paper is to examine the development of West Virginia University School of Medicine's integrated medical school curriculum on a regional campus. BACKGROUND: In 2003, the West Virginia University School of Medicine created a regional campus, the WVU Eastern Division, for third- and fourth-year medical students. The campus is located in a semi-rural area served by 3 small hospitals with lower numbers of physicians than average for West Virginia. Our campus was one of the first models in the United States using an integrated curricular design. CONCLUSIONS: Assessment data suggest that students do as well on high-stakes examinations and have acquired preferred residency placements as well as students who learn in more traditional curricular models. Graduates have also remained to practice in West Virginia's Eastern panhandle, helping to meet the patient care demands of an expanding population. Our experience may help inform future efforts to develop new curricular models for student education.

A generalizability study of student ratings in logbooks to assess the educational process of clinical learning.

PURPOSE: To investigate the number of student raters necessary for a reliable estimate of how educators approach the process of clinical learning (i.e., levels of student participation and educator feedback) in clinical settings. METHOD: Third-year medical students documented clinical experiences across seven core clerkships by using an online system. The authors asked students to identify their clinical encounters and to respond to questions about the educational process. The authors' hypothesis was that educators would have different preferences with regard to students' participation in the clinical experience, as well as different preferences with regard to offering their own feedback to students. The authors conducted a generalizability study to ascertain the variance components for the responses to the educator feedback and the student participation log questions. This generalizability study design was a rater-nested-with-person design, noted as r:p. The authors also conducted a decision study to calculate projected G (generalizability) coefficients across different numbers of raters. The results can help determine the minimum number of raters required to reach a reliable estimate of whether a faculty member offers feedback and invites students to participate in the clinical encounter. RESULTS: The generalizability study found that most of the variance components were attributed to educators. The decision study found that the G coefficients reached acceptable levels of reliability when at least five raters completed clinical encounters with an educator. CONCLUSIONS: The results suggest that students' responses reliably distinguished the levels of educator feedback and encouragement that were needed for student participation in clinical encounters.

An institutional approach to assist program directors and coordinators with meeting the challenges of graduate medical education.

OBJECTIVE: To investigate whether a multimethod approach, including a new position dedicated to graduate medical education (GME) educator, online education modules, and program file audits, was associated with quality improvement in our residency programs. METHOD: Data related to GME audits, residency review committee citations and cycle lengths were entered into a database. We conducted statistical analyses and calculated effect sizes to explore whether these resources were associated with program quality, as measured by maintaining necessary program policies and files, implementation of multiple assessments, increased residency review committee cycle lengths, and reductions in the number of citations. RESULTS: The statistical analyses support the implementation of the GME educator, file audits, and online courses designed to improve the quality of residency education. CONCLUSIONS: The GME office will continue to conduct audits, develop online learning resources, and provide one-on-one communication between the GME educator and program coordinators and directors. Our approach could serve as a model for other institutions interested in enhancing institutional oversight and the quality of their programs.