Perceptions of Justice in Clinical Learning Environments: Development and Validation of an Organizational Justice Measure for Medical Trainees.

PURPOSE: This study aimed to develop an instrument to measure medical trainees' perceptions of justice in clinical learning environments. METHOD: Between 2019 and 2023, the authors conducted a multiyear, multi-institutional, multiphase study to develop a 16-item justice measure with 4 dimensions: interpersonal, informational, procedural, and distributive. The authors gathered validity evidence based on test content, internal structure, and relationships with other variables across 3 phases. Phase 1 involved drafting items and gathering evidence that items measured intended dimensions. Phase 2 involved analyzing relevance of items for target groups, examining interitem correlations and factor loadings in a preliminary analysis, and obtaining reliability estimates. Phase 3 involved a confirmatory factor analysis and collecting convergent and discriminant validity evidence. RESULTS: In phase 1, 63 of 91 draft items were retained following a content validation exercise gauging how well items measured targeted dimensions (mean [SD] item ratings within dimensions, 4.16 [0.36] to 4.39 [0.34]) on a 5-point Likert scale (with 1 indicating not at all well and 5 indicating extremely well). In phase 2, 30 items were removed due to low factor loadings (i.e., < 0.40), and 4 items per dimension were selected (factor loadings, 0.42-0.89). In phase 3, a confirmatory factor analysis supported the 4-dimension model (χ2 = 610.14, P < .001; comparative fit index = 0.90, Tucker-Lewis Index = 0.87, root mean squared error of approximation = 0.11, standardized root mean squared residual = 0.06), with convergent and discriminant validity evidence showing hypothesized positive correlations with a justice measure (r = 0.93, P < .001), trait positive affect (r = 0.46, P < .001), and emotional stability (r = 0.33, P < .001) and negative correlations with trait negative affect (r = -0.39, P < .001). CONCLUSIONS: Results indicate the measure's potential utility in understanding justice perceptions and designing targeted interventions.

Can a Situational Judgment Test Identify Trainees at Risk of Professionalism Issues? A Multi-Institutional, Prospective Cohort Study.

PURPOSE: To determine whether overall situational judgment test (SJT) scores are associated with programs' clinical competency committee (CCC) ratings of trainee professionalism, any concerning behavior, and concerning behavior requiring active remediation at 2 time periods. METHOD: In fall 2019, trainees from 17 U.S. programs (16 residency, 1 fellowship) took an online 15-scenario SJT developed to measure 7 dimensions of professionalism. CCC midyear and year-end (6 months and 1 year following SJT completion, respectively) professionalism scores and concern ratings were gathered for academic year 2019-2020. Analyses were conducted to determine whether overall SJT scores related to overall professionalism ratings, trainees displaying any concerns, and trainees requiring active remediation at both time periods. RESULTS: Overall SJT scores correlated positively with midyear and year-end overall professionalism ratings ( r = .21 and .14, P < .001 and = .03, respectively). Holding gender and race/ethnicity constant, a 1 standard deviation (SD) increase in overall SJT score was associated with a .20 SD increase in overall professionalism ratings at midyear ( P = .005) and a .22 SD increase at year-end ( P = .001). Holding gender and race/ethnicity constant, a 1 SD increase in overall SJT score decreased the odds of a trainee displaying any concerns by 37% (odds ratio [OR] 95% confidence interval [CI]: [.44, .87], P = .006) at midyear and 34% (OR 95% CI: [.46, .95], P = .025) at year-end and decreased the odds of a trainee requiring active remediation by 51% (OR 95% CI: [.25, .90], P = .02) at midyear. CONCLUSIONS: Overall SJT scores correlated positively with midyear and year-end overall professionalism ratings and were associated with whether trainees exhibited any concerning behavior at midyear and year-end and whether trainees needed active remediation at midyear. Future research should investigate whether other potential professionalism measures are associated with concerning trainee behavior.

Community Needs Assessment of Low-Income Sections of 10 Rural Villages in Karnataka and Tamil Nadu, India.

Background India's health disparities are clearly visible in the southern state of Karnataka. A community needs assessment, one of the first done in this area in over a decade, was conducted to identify unsatisfied needs. The Northwell Center for Global Health worked alongside a local boarding school, Shanti Bhavan, to conduct a needs assessment using the Center for Disease Control and Prevention's Community Assessment for Public Health Emergency Response tool. Methods A community-based cross-sectional survey design was implemented in low-income sections of 10 rural villages in Karnataka throughout February 2019. The target population for this study included people who earned less than US$2 per day. The survey instrument consisted of a questionnaire and tracking form. Results One-hundred ninety-seven (197) of 359 households participated in the survey, which encompassed a total of 1,023 individuals. Proper housing structure was the most common need (27.7 %), followed by access to transportation (16.1 %) and access to healthcare (15.2 %). Agitated behavior, sad mood, and frequent worries were the most-experienced behavioral health concerns, with a 47.7%, 41.6%, and 41.1 % prevalence, respectively. Chronic diseases (eg, high blood pressure, diabetes, asthma) were prevalent in 35 of the households (9.7%). The major disease concern in relation to mosquito-borne illness was dengue (36.0 %). Access to healthcare was an issue in 44 of the 197 households (22.3%), with financial reasons being the most common barrier. Discussion Notably, there were no expressed needs for basic necessities such as food, water, and medication. This may be due to the help of state programs or a limitation of the survey format. Respondents were most concerned with dengue but are also at risk for other vector-borne diseases, such as malaria and chikungunya, highlighting the need to increase awareness and safety measures. Additionally, mental health problems represent a significant burden of disease.

Supervision and Care Quality as Perceived by Redeployed Attendings, Fellows, and Residents During a COVID-19 Surge: Lessons for the Future.

PURPOSE: To better prepare for potential future large-scale redeployments, this study examines quality of supervision and care as perceived by redeployed residents, fellows, and attendings during a COVID-19 surge. METHOD: During April and May 2020, attendings, fellows, and residents redeployed at 2 teaching hospitals were invited to participate in a survey, which included questions on respondents' prior experience; redeployed role; amount of supervision needed and received; and perceptions of quality of supervision, patient care, and interprofessional collaboration. Frequencies, means, and P values were calculated to compare perceptions by experience and trainee status. Narrative responses to 2 open-ended questions were independently coded; themes were constructed. RESULTS: Overall, 152 of 297 (51.2%) individuals responded, including 64 of 142 attendings (45.1%), 40 of 79 fellows (50.6%), and 48 of 76 residents (63.2%). Fellows and attendings, regardless of prior experience, perceived supervision as adequate. In contrast, experienced residents reported receiving more supervision than needed, while inexperienced residents reported receiving less supervision than needed and rated overall supervision as poor. Attendings, fellows, and experienced residents rated the overall quality of care as acceptable to good, whereas inexperienced residents perceived overall quality of care as worse to much worse, particularly when compared with baseline. CONCLUSIONS: Narrative themes indicated that the quality of supervision and care was buffered by strong camaraderie, a culture of informal consultation, team composition (mixing experienced with inexperienced), and clinical decision aids. The markedly negative view of inexperienced residents suggests a higher risk for disillusionment, perhaps even moral injury, during future redeployments. Implications for planning are explored.

Supervision, Interprofessional Collaboration, and Patient Safety in Intensive Care Units during the COVID-19 Pandemic.

Background: To meet coronavirus disease (COVID-19) demands in the spring of 2020, many intensive care (IC) units (ICUs) required help of redeployed personnel working outside their regular scope of practice, causing an expansion and change of staffing ratios. Objective: How did this composite alternative ICU workforce experience supervision, interprofessional collaboration, and quality and safety of care under the unprecedented clinical circumstances at the height of the first pandemic wave as lived experiences uniquely captured during the first peak of the pandemic? Methods: An international, cross-sectional survey was conducted among physicians, nurses, and allied personnel deployed or redeployed to ICUs in Utrecht, New York, and Dublin from April to May of 2020. Data were analyzed separately for the three sites. Quantitative data were treated for descriptive statistics; qualitative data were analyzed thematically and combined for general interpretations. Results: On the basis of 234, 83, and 34 responses (response rates of 68%, 48%, and 41% in Utrecht, New York, and Dublin, respectively), we found that the amount of supervision and the quality and safety of care were perceived as being lower than usual but still acceptable. The working atmosphere was overwhelmingly felt to be collaborative and supportive. Where IC-certified nurse-to-patient ratios had decreased most (Utrecht), nurses voiced criticism about supervision and quality of care. Continuity within the work environment, team composition, and informal ("curbside") consultations were critical mediators of success. Conclusion: In the exceptional circumstances encountered during the COVID-19 pandemic, many ICUs were managed by a composite workforce of IC-certified and redeployed personnel. Although supervision is critical for safe care, supervisory roles were not clearly related to the amount of prior ICU experience. Vital for satisfaction with the quality of care was the span of control for those who assumed supervisory roles (i.e., the ratio of certified to noncertified personnel). Stable teams that matched less experienced personnel with more experienced personnel; a strong, interprofessional, collaborative atmosphere; a robust culture of informal consultation; and judicious, more flexible use of rules and regulations proved to be essential.

Exploring the relationship between emotion and cognitive load types during patient handovers.

Cognitive Load Theory has emerged as an important approach to improving instruction in the health professions workplace, including patient handovers. At the same time, there is growing recognition that emotion influences learning through numerous cognitive processes including motivation, attention, working memory, and long-term memory. This study explores how emotion influences the cognitive load experienced by trainees performing patient handovers. From January to March 2019, 693 (38.7%) of 1807 residents and fellows from a 24-hospital health system in New York city completed a survey after performing a handover. Participants rated their emotional state and cognitive load. The survey included questions about features of the learner, task, and instructional environment. The authors used factor analysis to identify the core dimensions of emotion. Regression analyses explored the relationship between the emotion factors and cognitive load types. Two emotion dimensions were identified representing invigoration and tranquility. In regression analyses, higher levels of invigoration, tranquility, and their interaction were independently associated with lower intrinsic load and extraneous load. The interaction of invigoration and tranquility predicted lower germane load. The addition of the emotion variables to multivariate models including other predictors of cognitive load types significantly increased the amount of variance explained. The study provides a model for measuring emotions in workplace learning. Because emotion appears to have a significant influence on cognitive load types, instructional designers should consider strategies that help trainees regulate emotion in order to reduce cognitive load and improve learning and performance.

Evidence for validity for the Cognitive Load Inventory for Handoffs.

CONTEXT: Patient handovers remain a significant patient safety challenge. Cognitive load theory (CLT) can be used to identify the cognitive mechanisms for handover errors. The ability to measure cognitive load types during handovers could drive the development of more effective curricula and protocols. No such measure currently exists. METHODS: The authors developed the Cognitive Load Inventory for Handoffs (CLIH) using a multi-step process, including expert interviews to enhance content validity and talk-alouds to optimise response process validity. The final version contained 28 items. From January to March 2019, we administered a cross-sectional survey to 1807 residents and fellows from a large health care system in the USA. Participants completed the CLIH following a handover. Exploratory factor analysis of data from one-third of respondents identified high-performing items; confirmatory factor analysis of data from the remaining sample assessed model fit. Model fit was evaluated using the comparative fit index (CFI) (>0.90), Tucker-Lewis index (TFI) (>0.80), standardised root mean square residual (SRMR) (<0.08) and root mean square of error of approximation (RMSEA) (<0.08). RESULTS: Participants included 693 trainees (38.4%) (231 in the exploratory study and 462 in the confirmatory study). Eleven items were removed during exploratory factor analysis. Confirmatory factor analysis of the 16 remaining items (five for intrinsic load, seven for extraneous load and four for germane load) supported a three-factor model and met criteria for good model fit: the CFI was 0.95, TFI was 0.93, RMSEA was 0.074 and SRMR was 0.07. The factor structure was comparable for gender and role. Intrinsic, extraneous and germane load scales had high internal consistency. With one exception, scale scores were associated, as hypothesised, with postgraduate level and clinical setting. CONCLUSIONS: The CLIH measures three types of cognitive load during patient handovers. Evidencefor validity is provided for the CLIH's content, response process, internal structure and association with other variables. This instrument can be used to determine the relative drivers of cognitive load during handovers in order to optimize handover instruction and protocols.

Exploring Residents' Experience of Career Development Scholarship Tracks: A Qualitative Case Study Using Social Cognitive Career Theory.

Problem: Trainees enter graduate medical education with professional aspirations that often extend beyond the role of clinician to roles such as educator, innovator, leader, advocate, or researcher. Many residency programs have implemented academic tracks to support career development in these areas. With the exception of research tracks, these tracks generally do not include significant longitudinal protected time and often rely upon 'extra-curricular' effort and possess insufficient structure, mentorship, and accountability. Most prior studies of non-research scholarship tracks have not been theory driven and do not explore in depth the experience of residents who participate. Approach: To address this gap in the literature, we conducted a qualitative case study informed by Social Cognitive Career Theory to explore the professional identity development of residents who participated in a non-research scholarship track that incorporates recommended best practices. The track, Pathways to Expertise Program, incorporates features of successful research tracks: protected time, longitudinal experience, mentorship, platforms for recognition, and accountability. Participants from the first three cohorts were interviewed at the time of their graduation (2017-2019). Semi-structured interviews were conducted, transcribed, and independently coded. Social Cognitive Career Theory informed the organization of codes into themes. Context: The Pathways to Expertise Program was implemented in a psychiatry residency training program in a large urban academic teaching hospital. Impact: Fifteen residents entered Pathways to Expertise Program during the study period and all 15 participated in the study. Fourteen completed the program and presented their projects at the department grand rounds. For dissemination, 12 presented their project findings at one or more national meetings in the form of a poster (20 distributed across 11 residents), workshop (six distributed across four residents), or presentation (two across two residents). Six residents accounted for a total of seven first author publications in peer reviewed journals. All participants described how their self-efficacy increased as a result of new skills (e.g., content, methodology, and scientific communication), mentorship (e.g., content and process guidance), peer and broader support (e.g., small group supervision), persuasive communications (e.g., recognition both locally and nationally), and positive emotional reactions (e.g., triumph). The residents also described expecting compelling benefits (e.g., stronger application for fellowship and expanded career opportunities). Participants indicated that the experience influenced their career goals and how they perceived their professional identities. Lessons Learned: These findings suggest that a longitudinal academic track that incorporates features of successful research tracks (protected time, mentorship, peer support, and accountability for deliverables) can be instrumental in forming and maturing professional identities for non-clinical roles. These tracks can accomplish several important goals, including enhancing resilience via identity formation around passion and purpose and meeting society's need for physicians who are engaged in inquiry and innovation. Implications for the design of academic tracks in general are explored.