A randomized controlled trial of an intervention to increase cultural diversity awareness of research mentors of undergraduate students.

Cultural diversity variables like race and/or ethnicity influence research mentoring relationships, but mentors may not know how to address such variables with their mentees. Using a randomized controlled trial design, we tested a mentor training intervention to increase mentors' awareness and skill in addressing cultural diversity in research mentoring relationships, documenting its impact on mentors and their undergraduate mentees' ratings of mentor effectiveness. Participants were a national sample of 216 mentors and 117 mentees from 32 undergraduate research training programs in the United States. Mentors in the experimental condition reported greater gains than those in the comparison condition regarding the relevance of their racial/ethnic identity to mentoring and their confidence to mentor students across diverse cultural identities. Paired mentees of mentors in the experimental group rated their mentors higher at respectfully broaching and creating opportunities to address race/ethnicity matters than those with mentors in the comparison group. Our results support the efficacy of culturally focused mentorship education.

Virtually the Same? Evaluating the Effectiveness of Remote Undergraduate Research Experiences.

In-person undergraduate research experiences (UREs) promote students' integration into careers in life science research. In 2020, the COVID-19 pandemic prompted institutions hosting summer URE programs to offer them remotely, raising questions about whether undergraduates who participate in remote research can experience scientific integration and whether they might perceive doing research less favorably (i.e., not beneficial or too costly). To address these questions, we examined indicators of scientific integration and perceptions of the benefits and costs of doing research among students who participated in remote life science URE programs in Summer 2020. We found that students experienced gains in scientific self-efficacy pre- to post-URE, similar to results reported for in-person UREs. We also found that students experienced gains in scientific identity, graduate and career intentions, and perceptions of the benefits of doing research only if they started their remote UREs at lower levels on these variables. Collectively, students did not change in their perceptions of the costs of doing research despite the challenges of working remotely. Yet students who started with low cost perceptions increased in these perceptions. These findings indicate that remote UREs can support students' self-efficacy development, but may otherwise be limited in their potential to promote scientific integration.

"How Do We Do This at a Distance?!" A Descriptive Study of Remote Undergraduate Research Programs during COVID-19.

The COVID-19 pandemic shut down undergraduate research programs across the United States. A group of 23 colleges, universities, and research institutes hosted remote undergraduate research programs in the life sciences during Summer 2020. Given the unprecedented offering of remote programs, we carried out a study to describe and evaluate them. Using structured templates, we documented how programs were designed and implemented, including who participated. Through focus groups and surveys, we identified programmatic strengths and shortcomings as well as recommendations for improvements from students' perspectives. Strengths included the quality of mentorship, opportunities for learning and professional development, and a feeling of connection with a larger community. Weaknesses included limited cohort building, challenges with insufficient structure, and issues with technology. Although all programs had one or more activities related to diversity, equity, inclusion, and justice, these topics were largely absent from student reports even though programs coincided with a peak in national consciousness about racial inequities and structural racism. Our results provide evidence for designing remote Research Experiences for Undergraduates (REUs) that are experienced favorably by students. Our results also indicate that remote REUs are sufficiently positive to further investigate their affordances and constraints, including the potential to scale up offerings, with minimal concern about disenfranchising students.

The Influence of Messaging on Perceptions of Careers in Veterinary Medicine: Do Gender Stereotypes Matter?

The veterinary medical workforce is increasingly female; occupational feminization often transfers stereotypes associated with the predominant gender onto the profession. It is unknown whether within veterinary medicine a feminized public image is a possible contributor to the reduction in male applicants to training programs. The influence of stereotypically gendered messaging on how male and female undergraduate students perceive veterinary medicine was investigated in 482 undergraduate students enrolled in five introductory or second-level biology courses. Two short videos introducing the field of veterinary medicine were developed with imagery and language selected to emphasize either stereotypic feminine (communal) or masculine (agentic) aspects of the field. Participant groups were randomly assigned one of the two videos (feminine/communal or masculine/agentic) or no video (no exposure). An outcome survey elicited impressions of the field of veterinary medicine and gathered demographic data. There was a significant linear trend of condition on perception of the profession as feminine or masculine and on perception of the activities of a veterinarian as feminine/communal or masculine/agentic. Female participants were significantly more likely to agree that someone of their gender would be valued in the profession. Male participants reported significantly higher self-efficacy scores for performing the tasks of a veterinarian when they viewed the feminine stereotype video. These results demonstrate that gendered perceptions of the field can be manipulated. Intentional gendered messaging should be further explored as one strategy to broaden the talent pool in the workforce by attracting men back to the field.

Reassess-Realign-Reimagine: A Guide for Mentors Pivoting to Remote Research Mentoring.

Maintaining your research team's productivity during the COVID-19 era can be a challenge. Developing new strategies to mentor your research trainees in remote work environments will not only support research productivity and progress toward degree, but also help to keep your mentees' academic and research careers on track. We describe a three-step process grounded in reflective practice that research mentors and mentees can use together to reassess, realign, and reimagine their mentoring relationships to enhance their effectiveness, both in the current circumstances and for the future. Drawing on evidence-based approaches, a series of questions for mentees around documented mentoring competencies provide structure for remote mentoring plans. Special consideration is given to how these plans must address the psychosocial needs and diverse backgrounds of mentors and mentees in the unique conditions that require remote interactions.

Race and Ethnicity in Biology Research Mentoring Relationships.

This case study investigated how mentors and mentees in biology experience and understand race and ethnicity in their research mentoring relationships. Semi-structured interviews were conducted with mentors (n = 23) and mentees (n = 15) who had participated in an undergraduate biology summer research opportunity program at a large Midwestern research-intensive university. Interview transcripts were coded using an inductive, thematic analysis. Themes that emerged are presented, describing both participants' experiences with and beliefs about race and ethnicity in research training contexts (e.g., mentoring relationships, lab and field experiences). Although similarities were identified, the experiences and beliefs of mentors and mentees were not always aligned. Implications of the findings for training interventions and institutional partnerships to enhance the effectiveness of research mentoring relationships are discussed, with the goal of positively impacting the educational success of students from historically underrepresented racial/ethnic groups in science career pathways.

Entering Research Learning Assessment (ERLA): Validity Evidence for an Instrument to Measure Undergraduate and Graduate Research Trainee Development.

Expanding the scope of previous undergraduate research assessment tools, the Entering Research Learning Assessment (ERLA) measures undergraduate and graduate research trainee learning gains in the seven areas of trainee development in the evidence-based Entering Research conceptual framework: Research Comprehension and Communication Skills, Practical Research Skills, Research Ethics, Researcher Identity, Researcher Confidence and Independence, Equity and Inclusion Awareness and Skills, and Professional and Career Development Skills. In this paper, we present multiple sources of validity evidence for the ERLA trainee self-assessment and mentor assessment of trainee learning gains. Evidence of internal structure of the initial scales via exploratory factor analysis (Ntrainees = 193; Nmentors = 130) revealed seven factors that align with the Entering Research conceptual framework. Validity evidence for internal structure using confirmatory factor analysis, convergent validity, and evidence of internal consistency for the revised scale were examined with a larger sample (Ntrainees = 489; Nmentors = 256). Evidence of internal structure and alignment for a paired version of the ERLA was also examined with a subset of the original sample (N = 121 pairs). Each analysis revealed acceptable model-data fit. Guidance on using the ERLA instruments and interpreting their scores is presented.

Resources for Teaching and Assessing the Vision and Change Biology Core Concepts.

The Vision and Change report called for the biology community to mobilize around teaching the core concepts of biology. This essay describes a collection of resources developed by several different groups that can be used to respond to the report's call to transform undergraduate education at both the individual course and departmental levels. First, we present two frameworks that help articulate the Vision and Change core concepts, the BioCore Guide and the Conceptual Elements (CE) Framework, which can be used in mapping the core concepts onto existing curricula and designing new curricula that teach the biology core concepts. Second, we describe how the BioCore Guide and the CE Framework can be used alongside the Partnership for Undergraduate Life Sciences Education curricular rubric as a way for departments to self-assess their teaching of the core concepts. Finally, we highlight three sets of instruments that can be used to directly assess student learning of the core concepts: the Biology Card Sorting Task, the Biology Core Concept Instruments, and the Biology-Measuring Achievement and Progression in Science instruments. Approaches to using these resources independently and synergistically are discussed.

Framework for advancing rigorous research.

There is a pressing need to increase the rigor of research in the life and biomedical sciences. To address this issue, we propose that communities of 'rigor champions' be established to campaign for reforms of the research culture that has led to shortcomings in rigor. These communities of rigor champions would also assist in the development and adoption of a comprehensive educational platform that would teach the principles of rigorous science to researchers at all career stages.

Evaluation of the Second Edition of Entering Research: A Customizable Curriculum for Apprentice-Style Undergraduate and Graduate Research Training Programs and Courses.

The second edition of Entering Research (ER) is a collection of customizable active-learning activities, resources, and assessment and evaluation tools for use in undergraduate and graduate research training programs and courses. Results from two design and development research studies examining the effectiveness of the second edition of the ER curriculum and a 2-day ER facilitator training workshop are reported. Pilot testing of the second edition of the curriculum at 20 sites across the country (42 unique implementations) with 78 facilitators and 565 undergraduate and graduate research trainees provides evidence that the ER activities are clear and complete and that they were effective in helping trainees gain knowledge or improve their ability to do research. Overall, research training program directors and trainees were satisfied with courses and workshops that incorporated activities from ER. Likewise, evaluation data from four ER facilitator training workshops showed that participants valued the workshop and reported significant gains in confidence in their ability to successfully develop and implement a custom ER curriculum. Together, these results provide evidence that the ER curriculum and training workshop warrant further efficacy, effectiveness, and scale-up research.

Interventions to Optimize Mentoring Relationships for Diverse Biomedical Researchers.

The articles in this special issue provide insights from a variety of mentoring interventions that were implemented across the NIH Diversity Program Consortium (DPC). Many of the articles highlight examples of how the Entering Mentoring and Entering Research curricular materials, available through the National Research Mentoring Network (NRMN), were adapted and implemented for research mentors and research trainees at Building Infrastructure Leading to Diversity (BUILD) institutions. Other articles report the outcomes of programs developed and offered more broadly by the NRMN. This overview provides background information on NIH DPC-wide efforts and the Entering Mentoring and Entering Research curricula.

A Biology Core Concept Instrument (BCCI) to Teach and Assess Student Conceptual Understanding.

Instruments for teaching and assessing student understanding of the five core concepts in biology from Vision and Change are needed. We developed four Biology Core -Concept Instruments (BCCIs) that teach and assess students' ability to describe a concept in their own words, identify concepts represented in biological phenomena, and make connections between concepts. The BCCI includes a narrative, followed by a series of 10 true-false/identify (TF/I) and three open-ended questions. The TF/I questions are aligned with Cary and Branchaw's Conceptual Elements Framework and were iteratively developed with feedback from biology experts and student performance and feedback obtained during think-aloud interviews. A component scoring system was developed to discriminate between a student's ability to apply and identify each core concept from his or her ability to make connections between concepts. We field-tested the BCCIs (n = 152-191) with students in a first-year course focused on learning the five core concepts in biology and collected evidence of interrater reliability (α = 0.70) and item validity. With component scoring, we identified examples in which students were able to identify concepts singularly, but not make connections between concepts, or were better able to apply concepts to one biological phenomenon than another. Identifying these nuanced differences in learning can guide instruction to improve students' conceptual understanding.

Exploring Biology: A Vision and Change Disciplinary First-Year Seminar Improves Academic Performance in Introductory Biology.

The transition to college is challenging for most students, especially those who aspire to major in the science, technology, engineering, or mathematics disciplines, in which introductory courses can be large and instruction less than optimal. This paper describes a novel, disciplinary first-year seminar (FYS) course, Exploring Biology, designed to address many of the challenges facing aspiring biology students beginning their academic careers at a large public research university. The course addresses typical FYS goals, such as community building, introduction to resources, and academic skill development, and introduces students to the core concepts of biology defined in the 2011 Vision and Change report. Relative to a matched comparison group of students, Exploring Biology alumni were retained at higher rates and had higher levels of academic performance in a subsequent introductory biology course, suggesting Exploring Biology has a positive impact on future academic performance in the discipline. Results from course evaluations and an alumni survey show that, overall, students valued both the FYS components and biology components of the course. These results provide evidence that the Exploring Biology disciplinary FYS model is an intervention that may increase academic success and retention in biology.

Promoting STEM Trainee Research Self-Efficacy: A Mentor Training Intervention.

Self-efficacy, or an individual's belief in his or her ability to successfully complete a given task, is a significant predictor of outcome expectations, interests, career aspirations, and persistence among undergraduate students in STEM fields. Despite the central role that efficacy beliefs play in STEM career choice and persistence, few training opportunities have used theoretical models like social cognitive career theory (SCCT) to help mentors learn how to support trainee research self-efficacy. To address this gap, a mentor training intervention was developed to translate the research and theory behind self-efficacy and into the practice of mentoring in STEM. Evaluation data from mentors who participated in (N = 166) and facilitators who implemented (N = 7) a training based on SCCT were used to assess the effectiveness of such an intervention. Mentors reported high satisfaction and significant retrospective skill gains related to promoting trainee research self-efficacy. Mentors also reported changes that they intended to make in their mentoring. Facilitators with varying levels of familiarity with self-efficacy were able to implement the module effectively and provided additional suggestions for further improvement of the training.

Conceptual Elements: A Detailed Framework to Support and Assess Student Learning of Biology Core Concepts.

The Vision and Change in Undergraduate Biology Education: Call to Action report has inspired and supported a nationwide movement to restructure undergraduate biology curricula to address overarching disciplinary concepts and competencies. The report outlines the concepts and competencies generally but does not provide a detailed framework to guide the development of the learning outcomes, instructional materials, and assessment instruments needed to create a reformed biology curriculum. In this essay, we present a detailed Vision and Change core concept framework that articulates key components that transcend subdisciplines and scales for each overarching biological concept, the Conceptual Elements (CE) Framework. The CE Framework was developed using a grassroots approach of iterative revision and incorporates feedback from more than 60 biologists and undergraduate biology educators from across the United States. The final validation step resulted in strong national consensus, with greater than 92% of responders agreeing that each core concept list was ready for use by the biological sciences community, as determined by scientific accuracy and completeness. In addition, we describe in detail how educators and departments can use the CE Framework to guide and document reformation of individual courses as well as entire curricula.

A new approach to mentoring for research careers: the National Research Mentoring Network.

BACKGROUND AND PURPOSE: Effective mentorship is critical to the success of early stage investigators, and has been linked to enhanced mentee productivity, self-efficacy, and career satisfaction. The mission of the National Research Mentoring Network (NRMN) is to provide all trainees across the biomedical, behavioral, clinical, and social sciences with evidence-based mentorship and professional development programming that emphasizes the benefits and challenges of diversity, inclusivity, and culture within mentoring relationships, and more broadly the research workforce. The purpose of this paper is to describe the structure and activities of NRMN. KEY HIGHLIGHTS: NRMN serves as a national training hub for mentors and mentees striving to improve their relationships by better aligning expectations, promoting professional development, maintaining effective communication, addressing equity and inclusion, assessing understanding, fostering independence, and cultivating ethical behavior. Training is offered in-person at institutions, regional training, or national meetings, as well as via synchronous and asynchronous platforms; the growing training demand is being met by a cadre of NRMN Master Facilitators. NRMN offers career stage-focused coaching models for grant writing, and other professional development programs. NRMN partners with diverse stakeholders from the NIH-sponsored Diversity Program Consortium (DPC), as well as organizations outside the DPC to work synergistically towards common diversity goals. NRMN offers a virtual portal to the Network and all NRMN program offerings for mentees and mentors across career development stages. NRMNet provides access to a wide array of mentoring experiences and resources including MyNRMN, Guided Virtual Mentorship Program, news, training calendar, videos, and workshops. National scale and sustainability are being addressed by NRMN "Coaches-in-Training" offerings for more senior researchers to implement coaching models across the nation. "Shark Tanks" provide intensive review and coaching for early career health disparities investigators, focusing on grant writing for graduate students, postdoctoral trainees, and junior faculty. IMPLICATIONS: Partners from diverse perspectives are building the national capacity and sparking the institutional changes necessary to truly diversify and transform the biomedical research workforce. NRMN works to leverage resources towards the goals of sustainability, scalability, and expanded reach.

New Measures Assessing Predictors of Academic Persistence for Historically Underrepresented Racial/Ethnic Undergraduates in Science.

An important step in broadening participation of historically underrepresented (HU) racial/ethnic groups in the sciences is the creation of measures validated with these groups that will allow for greater confidence in the results of investigations into factors that predict their persistence. This study introduces new measures of theoretically derived factors emanating from social cognitive and social identity theories associated with persistence for HU racial/ethnic groups in science disciplines. The purpose of this study was to investigate: 1) the internal reliability and factor analyses for measures of research-related self-efficacy beliefs, sources of self-efficacy, outcome expectations, and science identity; and 2) potential group differences in responses to the measures, examining the main and interaction effects of gender and race/ethnicity. Survey data came from a national sample of 688 undergraduate students in science majors who were primarily black/African American and Hispanic/Latino/a with a 2:1 ratio of females to males. Analyses yielded acceptable validity statistics and race × gender group differences were observed in mean responses to several measures. Implications for broadening participation of HU groups in the sciences are discussed regarding future tests of predictive models of student persistence and training programs to consider cultural diversity factors in their design.

Defining Attributes and Metrics of Effective Research Mentoring Relationships.

Despite evidence of mentoring's importance in training researchers, studies to date have not yet determined which mentoring relationships have the most impact and what specific factors in those mentoring relationships contribute to key outcomes, such as the commitment to and persistence in research career paths for emerging researchers from diverse populations. Efforts to broaden participation and persistence in biomedical research careers require an understanding of why and how mentoring relationships work and their impact, not only to research training but also to promoting career advancement. This paper proposes core attributes of effective mentoring relationships, as supported by the literature and suggested by theoretical models of academic persistence. In addition, both existing and developing metrics for measuring the effectiveness of these attributes within mentoring relationships across diverse groups are presented, as well as preliminary data on these metrics from the authors' work.

Culturally Diverse Undergraduate Researchers' Academic Outcomes and Perceptions of Their Research Mentoring Relationships.

Few studies have empirically investigated the specific factors in mentoring relationships between undergraduate researchers (mentees) and their mentors in the biological and life sciences that account for mentees' positive academic and career outcomes. Using archival evaluation data from more than 400 mentees gathered over a multi-year period (2005-11) from several undergraduate biology research programs at a large, Midwestern research university, we validated existing evaluation measures of the mentored research experience and the mentor-mentee relationship. We used a subset of data from mentees (77% underrepresented racial/ethnic minorities) to test a hypothesized social cognitive career theory model of associations between mentees' academic outcomes and perceptions of their research mentoring relationships. Results from path analysis indicate that perceived mentor effectiveness indirectly predicted post-baccalaureate outcomes via research self-efficacy beliefs. Findings are discussed with implications for developing new and refining existing tools to measure this impact, programmatic interventions to increase the success of culturally diverse research mentees and future directions for research.

Assessment of course-based undergraduate research experiences: a meeting report.

The Course-Based Undergraduate Research Experiences Network (CUREnet) was initiated in 2012 with funding from the National Science Foundation program for Research Coordination Networks in Undergraduate Biology Education. CUREnet aims to address topics, problems, and opportunities inherent to integrating research experiences into undergraduate courses. During CUREnet meetings and discussions, it became apparent that there is need for a clear definition of what constitutes a CURE and systematic exploration of what makes CUREs meaningful in terms of student learning. Thus, we assembled a small working group of people with expertise in CURE instruction and assessment to: 1) draft an operational definition of a CURE, with the aim of defining what makes a laboratory course or project a "research experience"; 2) summarize research on CUREs, as well as findings from studies of undergraduate research internships that would be useful for thinking about how students are influenced by participating in CUREs; and 3) identify areas of greatest need with respect to CURE assessment, and directions for future research on and evaluation of CUREs. This report summarizes the outcomes and recommendations of this meeting.