Application of the Indigenous evaluation framework to a university certificate program for building cultural awareness in science, technology, engineering, and mathematics.

This paper presents a case example of the Indigenous Evaluation Framework as applied to a science, technology, engineering, and mathematics (STEM) education pilot program. Indigenous methodologies include knowledge and data that are inclusive of historically marginalized groups, are highly meaningful, valid, and useful for all. A paradigm shift from Western evaluation methodologies to Indigenous evaluation is necessary when evaluating STEM programs that are committed to increasing recruitment, retention, and graduation of students from historically marginalized groups. This paper describes the use of the Indigenous Evaluation Framework during the first two years of the newly created Environmental Stewardship of Indigenous Lands program at the University of Colorado Denver. We discuss the importance of the Indigenous Evaluation Framework and how it informs the development and continued improvements to the program that also provides agency to program leads and participants.

Training Mentor-Mentee Pairs to Build a Robust Culture for Mentorship and a Pipeline of Clinical and Translational Researchers: The Colorado Mentoring Training Program.

The Colorado Mentoring Training program (CO-Mentor) was developed at the University of Colorado Anschutz Medical Campus in 2010, supported by the Colorado Clinical and Translational Sciences Institute. CO-Mentor represents a different paradigm in mentorship training by focusing equally on the development of mentees, who are valued as essential to institutional capacity for effective mentorship. The training model is unique among Clinical and Translational Science Award sites in that it engages mentors and mentees in an established relationship. Dyads participate in 4 day-long sessions scheduled throughout the academic year. Each session features workshops that combine didactic and experiential components. The latter provide structured opportunities to develop mentorship-related skills, including self-knowledge and goal setting, communication skills (including negotiation), "managing up," and the purposeful development of a mentorship support network. Mentors and mentees in 3 recent cohorts reported significant growth in confidence with respect to all mentorship-related skills assessed using a pre-post evaluation survey (P = .001). Mentors reported the most growth in relation to networking to engage social and professional support to realize goals as well as sharing insights regarding paths to success. Mentees reported the most growth with respect to connecting with potential/future mentors, knowing characteristics to look for in current/future mentors, and managing the work environment (e.g., prioritizing work most fruitful to advancing research/career objectives). CO-Mentor represents a novel approach to enhancing mentorship capacity by investing equally in the development of salient skills among mentees and mentors and in the mentorship relationship as an essential resource for professional development, persistence, and scholarly achievement.

Bringing it home: expanding the local reach of dissemination and implementation training via a university-based workshop.

BACKGROUND: Currently, national training programs do not have the capacity to meet the growing demand for dissemination and implementation (D&I) workforce education and development. The Colorado Research in Implementation Science Program (CRISP) developed and delivered an introductory D&I workshop adapted from national programs to extend training reach and foster a local learning community for D&I. METHODS: To gauge interest and assess learning needs, a pre-registration survey was administered. Based on feedback, a 1.5-day workshop was designed. Day 1 introduced D&I frameworks, strategies, and evaluation principles. Local and national D&I experts provided ignite-style talks on key lessons followed by panel discussion. Breakout sessions discussed community engagement and applying for D&I grants. A workbook was developed to enhance the training and provided exercises for application to an individual's projects. Day 2 offered expert-led mentoring sessions with selected participants who desired advanced instruction. Two follow-up surveys (immediate post-workshop, 6 months) assessed knowledge gained from participation and utilization of workshop content. RESULTS: Ninety-three workshop registrants completed an assessment survey to inform workshop objectives and curriculum design; 43 % were new and 54 % reported a basic understanding of the D&I field. Pre-registrants intended to use the training to "apply for a D&I grant" (73 %); "incorporate D&I into existing projects" (76 %), and for quality improvement (51 %). Sixty-eight individuals attended Day 1; 11 also attended Day 2 mentoring sessions. In the 1-week post-workshop survey (n = 34), 100 % strongly agreed they were satisfied with the training; 97 % strongly agreed the workshop workbook was a valuable resource. All Day 2 participants strongly agreed that working closely with faculty and experts increased their overall confidence. In the 6-month follow-up evaluation (n = 23), evidence of new D&I-related manuscripts and grant proposals was found. Training materials were published online ( www.ucdenver.edu/implementation/workshops ) and disseminated via the National Institutes of Health (NIH) Clinical and Translational Science Awards Consortium. To sustain reach, CRISP adapted the materials into an interactive e-book ( www.CRISPebooks.org ) and launched a new graduate course. CONCLUSIONS: Local D&I training workshops can extend the reach of national training programs.

Solving the Puzzle of Recruitment and Retention-Strategies for Building a Robust Clinical and Translational Research Workforce.

This paper is the first in a five-part series on the clinical and translational science educational pipeline and presents strategies to support recruitment and retention to create diverse pathways into clinical and translational research (CTR). The strategies address multiple levels or contexts of persistence decisions and include: (1) creating a seamless pipeline by forming strategic partnerships to achieve continuity of support for scholars and collective impact; (2) providing meaningful research opportunities to support identity formation as a scientist and sustain motivation to pursue and persist in CTR careers; (3) fostering an environment for effective mentorship and peer support to promote academic and social integration; (4) advocating for institutional policies to alleviate environmental pull factors; and, (5) supporting program evaluation-particularly, the examination of longitudinal outcomes. By combining institutional policies that promote a culture and climate for diversity with quality, evidence-based programs and integrated networks of support, we can create the environment necessary for diverse scholars to progress successfully and efficiently through the pipeline to achieve National Institutes of Health's vision of a robust CTR workforce.