Evaluating Urology Program Directors' Perception on Resident Application Parameters Following the Transition of USMLE Step 1 to Pass/Fail.

OBJECTIVE: To investigate how the shift of the United States Medical Licensing Examination (USMLE) Step 1 to a Pass/Fail (P/F) scoring system impacts the perceptions of Urology Program Directors (PDs) on evaluating urology residency applicants. METHODS AND MATERIALS: A cross-sectional survey was sent to 117 PDs, including questions about program characteristics, perceptions of shelf scores and medical school rank post-transition, beliefs about the predictive value of Step 1 and Step 2 Clinical Knowledge (CK) scores for board success and residency performance, and changes in applicant parameter ranking. RESULTS: Forty-five PDs (38% response rate) participated. Notably, 49% favored releasing quantitative clerkship grades, and 71% valued medical school rank more. Opinions on Step 1 scores' correlation with board success were split (49% agreed), and 44% endorsed Step 2 CK scores' connection to board performance. As predictors of good residents, only 9% and 22% considered Step 1 and Step 2 CK scores, respectively, indicative. Clerkship grades and Urology rotation recommendation letters maintained significance, while research experience gained importance. Step 2 CK scores' importance rose but did not match Step 1 scores' previous significance. CONCLUSION: The transition to P/F for USMLE Step 1 adds intricacies to urology residency selection, exposing PDs' uncertainties regarding clerkship grades and the relevance of medical school rank. This research underscores the dynamic nature of urology residency admissions, emphasizing the increasing importance of research in evaluating applicants and a diminishing emphasis on volunteering and leadership.

Ophthalmology Residency Program Director Survey on Pass/Fail U.S. Medical Licensing Exam Step 1 Scoring.

Background Beginning January 26, 2022, the U.S. Medical Licensing Exam (USMLE) Step 1 changed from a numerical score to pass/fail (P/F). The purpose of this study was to determine the perspective of ophthalmology program directors regarding this change in evaluating applicants. Methods After institutional review board approval, a survey was sent out to program directors of all 125 ophthalmology programs accredited by the Accreditation Council for Graduate Medical Education. Survey questions asked for program demographics, the utility of USMLE Step 1 and 2 Clinical Knowledge scores in assessing applicants, and the importance of 16 different applicant metrics before and after Step 1 becomes P/F. The metrics examined were: letters of recommendation; clerkship grades; class ranking; Alpha Omega Alpha Membership; Gold Humanism Honor Society Membership; Dean's Letter; involvement and leadership; personal statement; number of abstracts, presentations, and publications; mean number of research experiences in the specialty; Step 2 Clinical Knowledge score; volunteering; preclinical grades; away rotation in the specialty; the applicant having another graduate degree; and graduation from a top 40 National Institutes of Health-funded program. Data were analyzed using nonoverlapping 95% confidence intervals. Results The survey was completed by 50 (40%) program directors. Sixty-eight percent of respondents stated a student's ranking would be considered more after USMLE Step 1 scores become P/F, and 60% stated medical schools should share clerkship shelf exam scores with residency programs. There were no significant differences in program directors' rankings of applicant metrics following the transition to P/F Step 1. Conclusion Based on our data, program directors will likely not place a greater emphasis on Step 2 scores, despite it being the only remaining objective measure for all applicants following the switch to a P/F Step 1. Nevertheless, program directors expressed an interest in receiving other objective measures, such as shelf exam scores and class ranking, as part of the application process. Notably, we found no significant changes in the rankings of various applicant metrics before and after the transition to P/F Step 1, indicating that the metrics that were important to program directors prior to the change remain just as critical in the new era of admissions.

A Survey of Otolaryngology Residency Programs on Adapting to the United States Medical Licensing Examination (USMLE) Step 1 Transitioning to Pass/Fail.

Objectives In February 2020, the National Board of Medical Examiners (NBME) announced that the United States Medical Licensing Examination (USMLE) Step 1 licensing examination would change from a numerical score to Pass/Fail (P/F). After implementation, many believe that USMLE-Step 2-Clinical Knowledge (CK) will become an important metric for students applying to otolaryngology (ENT). The purpose of this study is to determine factors important to resident selection after these changes. Methods A survey containing 15 questions related to resident selection practices and how changing USMLE Step 1 to P/F would impact future resident selection was designed. It was distributed to all ENT residency programs accredited by the Accreditation Council for Graduate Medical Education (ACGME). Results Forty percent of programs responded; 66% (95% confidence interval (CI): 51.1%-78.4%) felt that changing Step 1 scoring would not lead to students being more prepared for clinical rotations; 55% believe class rank will increase in significance (95% CI: 35.7%-64.3%). There was also an increase in the importance of Step 2 CK, which had a mean ranking of 10.67 prior to changes in Step 1 scoring and increased to 7.80 after P/F. Conclusions The changes in Step 1 scoring will likely lead to increasing importance of other objective measures like class rank or Step 2 CK. This may defeat the intended purpose put forth by the NBME. Therefore, further guidance on measures correlated with student performance as a resident will be integral to the selection process.

Evaluating the impact of pass/fail United States Medical Licensing Examination Step 1 scoring on pathology residency selection.

Beginning 26 January 2022, the United States Medical Licensing Examination Step 1 changed from a numerical score to Pass/Fail. Historically, residency programs have used Step 1 scores as a valuable metric in assessing the competitiveness of applicants. We assessed how residency program criteria will change when evaluating applicants after Step 1 becomes Pass/Fail. A survey was distributed to the program directors of all 144 pathology residency programs accredited by Accreditation Council for Graduate Medical Education. Survey questions evaluated the importance of using Step 1 and Step 2 Clinical Knowledge (CK) scores when assessing applicants. Participants were asked to rank a list of applicant criteria used before and after Step 1 becomes Pass/Fail. Data were analyzed using chi-squared and paired t-tests with significance at P < 0.05. A total of 34 residency program directors (23.6%) responded to the survey. 76.5% (P< 0.001) of responders believed Step 1 scores were able to predict a resident's ability to pass their board exams, while 41.2% believed Step 2 CK could predict a resident's ability to pass board exams and perform clinically in pathology (P = 0.282). 61.8% of responders agreed that an applicant's medical school ranking would become more important (P = 0.001). There were no significant differences in the relative importance of 16 selection criteria after the change of Step 1 to Pass/Fail. It does not appear that Step 2 CK will become more important. Although results are constrained by a 23.6% response rate, it can be a start to guiding future students through residency applications.

AHA Life's essential 8 and ideal cardiovascular health among young adults.

Objective: This study assessed cardiovascular health (CVH) in young adults using the 2022 AHA Life's Essential 8 (LE8) score and compared it with the Life's Simple 7 (LS7) score. Methods: Individuals aged 18 to 44 years without a history of cardiovascular disease in the National Health and Nutrition Examination Survey (NHANES) cycles were included. Data from 2007-2008 to 2017-2018 were combined to create 3 groups (2007-2010, 2011-2014, and 2015-2018) for analysis. The LE8 score and its components were computed in the overall population and stratified by sex and race/ethnicity. Trends for the LE8 score were analyzed using adjusted linear regression models. Results: Among 12,197 young adults, representing an estimated 89.4 million individuals, from the NHANES 2007-2018, the CVH in the overall population and across all subgroups was stable (Ptrend >0.05). The blood lipid score improved across all subgroups (Ptrend:<0.05). The mean LE8 score was 69.2±0.3. Females (71.4±0.4) had better CVH compared with males (67.2±0.4). Non-Hispanic Black individuals (65.1± 0.3) had the lowest CVH compared with Non-Hispanic White individuals (69.9±0.5), Mexican American individuals (67.3±0.3), and other race individuals (71.2±0.4). Of the 46.1 million individuals categorized as intermediate CVH by the LS7 score, 8.1 million (17.6%) and 2.3 million (5.0%) were reclassified to poor and ideal CVH by the LE8 score, respectively. Of the 40.1 million individuals categorized as ideal CVH by the LS7 score, 18.9 million (47.1%) and 0.1 million (0.2%) were reclassified to poor CVH and intermediate CVH by the LE8 score, respectively. Conclusion: Among US young adults, there has been no improvement in CVH over the last decade with notable sex and race/ethnicity-associated differences in the LE8 score. Nearly 1 in 4 young adults had ideal CVH using the LE8 score compared with 1 in 2 individuals using the LS7 score.

Perceptions of the Emergency Medicine Resident Selection Process by Program Directors Following the Transition to a Pass/Fail USMLE Step 1.

Background: Beginning January 26th, 2022, the National Board of Medical Examiners transitioned scoring of the United States Medical Licensing Examination (USMLE) Step 1 from a 3-digit score to pass/fail. In the past, the Step 1 score has been weighted heavily by program directors (PDs) as one of the most important metrics when assessing medical student's competitiveness. Objective: The objective of this study was to evaluate the perceptions of emergency medicine (EM) PDs on the transition to a pass/fail USMLE Step 1 exam, and to elicit the opinions of EM PDs on the USMLE examinations' ability to predict resident performance. Methods: A survey consisting of ranking and multiple-choice questions was sent to EM PDs. The multiple-choice questions were asked to determine EM PDs level of confidence in the ability of Step 1 and Step 2 Clinical Knowledge (CK) to predict a student's ability to succeed in residency. The ranking questions focused on assessing each program's current resident selection practices in comparison to expected selection criteria changes following a transition to pass/fail Step 1. R studio and MATLAB were used for statistical analysis, and a P value <0.05 was considered significant. Results: The survey was completed by 57 (20.21%) EM PDs. When asked if Step 1 and Step 2 CK are accurate predictors of a resident's ability to perform clinically within EM, only 10.5% of PDs answered 'yes' to Step 1 being predictive, compared to 31.6% for Step 2 CK. Regarding selection criteria, the top quartile of attributes (standardized letters of evaluation [1st], away rotations [2nd], clerkship grades [3rd] and Step 2 CK score [4th]) remained the same following the transition. Conclusion: Our results indicate that the top quartile of attributes might remain the same, despite most PDs agreeing that Step 2 CK is a better predictor of a resident's performance.

Training With Simulated Scotoma Leads to Behavioral Improvements Through at Least Two Distinct Mechanisms.

Purpose: Individuals with central vision loss due to macular degeneration (MD) often spontaneously develop a preferred retinal locus (PRL) outside the area of retinal damage, which they use instead of the fovea. Those who develop a stable PRL are more successful at coping with their vision loss. However, it is unclear whether improvements in visual performance at the PRL are specific to that retinal location or are also observed in other parts of the retina. Perceptual learning literature suggests that the retinal specificity of these effects provides insight about the mechanisms involved. Better understanding of these mechanisms is necessary for the next generation of interventions and improved patient outcomes. Methods: To address this, we trained participants with healthy vision to develop a trained retinal locus (TRL), analogous to the PRL in patients. We trained 24 participants on a visual search task using a gaze-contingent display to simulate a central scotoma. Results: Results showed retinotopically specific improvements in visual crowding only at the TRL; however, visual acuity improved in both the TRL and in an untrained retinal locus. Conclusions: These results suggest that training with an artificial scotoma involves multiple mechanistic levels, some location-specific and some not, and that simulated scotoma training paradigms likely influence multiple mechanisms simultaneously. Eye movement analysis suggests that the non-retinotopic learning effects may be related to improvements in the capability to maintain a stable gaze during stimulus presentation. This work suggests that effective interventions promoting peripheral viewing may influence multiple mechanisms simultaneously.

Diagnostic & interventional radiology residency program directors' perspectives on the USMLE step 1 exam shift to pass/fail scoring.

RATIONALE AND OBJECTIVES: As of January 2022, Step 1 of the United States Medical Licensing Examination (USMLE) has changed to pass/fail grading. The purpose of this study was to share survey results and communicate changes Diagnostic (DR) and integrated Interventional (IR) Radiology residency program directors (PDs) will make and aspire to make, given this change. MATERIALS AND METHODS: An online survey was sent to DR and IR PDs. Data was collected over four months. Custom R programming and MATLAB language scripts were used to evaluate the survey responses. Chi squared tests were used to determine statistical significance for multiple choice questions regarding PD views of Step 1 transitioning to pass-fail. Paired t-tests were used to differentiate pre- and post-values for questions in which PDs ranked criteria for resident selection. RESULTS: After USMLE Step 1 becomes pass/fail, most respondents will use Step 2 CK scores as a more important factor than previously, believe medical schools should share National Board of Medical Examiners (NBME) shelf exam scores, do not believe students will be better prepared clinically, and believe a student's medical school rank will be considered more. CONCLUSION: The added emphasis on Step 2 CK scores, NBME shelf exam scores, class rank, and a student's medical institution may negate the positive impacts of changing Step 1 to pass/fail. Alternatively, it may present an opportunity for programs to evaluate students more broadly.

Assessing the Impact of Changes to USMLE Step 1 Grading on Evaluation of Neurosurgery Residency Applicants in the United States: A Program Director Survey.

BACKGROUND: Neurosurgery (NS) is among the most selective specialties in the United States. As the United States Medical Licensing Examination (USMLE) Step 1 transitions to a binary pass/fail score, residency programs face unclear challenges in screening and evaluating applicants. The aim of this study is to provide insights into the perceived impact of changes to the USMLE Step 1 grading in the applicant selection process. METHODS: We created a survey using questions regarding NS program demographics, the perceived predictive abilities of Step 1 and Step 2 clinical knowledge (CK), and several factors that programs consider when assessing applicants. We queried program directors (PDs), program coordinators (PCs), and assistant PDs at 117 NS residency programs. Respondents were asked to rank these factors in order of importance for selection at their respective training program. We used descriptive statistics and a Wilcoxon matched-pairs signed-rank test to evaluate the effects of these changes using STATA 17. RESULTS: A total of 35 (30%) residency programs responded with 26 (74%) completing the factor ranking questions. 86% (95% confidence interval, 71.5%-94.3%) disagreed that the changes will better prepare students clinically. USMLE Step 2 CK scores, class rank, and away rotations saw significant increases in priority in the absence of a graded Step 1, whereas letters of recommendation and surrogates for research productivity saw notable, but not significant, changes after adjusting for multiple testing. CONCLUSIONS: Reporting binary Step 1 grades marks a significant shift in assessing applicants for NS residency by emphasizing Step 2 CK, class rank, and research productivity.