Improving management of vaccine supply chains: A multi-methods evaluation of vSTEP in Zambia.

BACKGROUND: Equipping supply chain professionals at all levels of the health care systems with essential leadership and management skills is essential to achieving global immunization targets. Numerous and diverse professional development initiatives have been established to support vaccine supply chain managers in Gavi-eligible countries. However, COVID-19 catalyzed rapid innovation in approaches to support leadership development in times of rapid change, and systematic evaluation of these approaches can inform future workforce development strategies to ensure resilient health systems. Therefore, we sought to evaluate outcomes and short-term impact of the fully virtual Strategic Training Executive Program 2.0 (vSTEP 2.0) program in Zambia on participant engagement, skill development, and application of new skills to improve supply chain performance. METHODS: We used a multi-method design to describe the outcomes and short-term impact of vSTEP 2.0 at three levels: (1) delegate response to the training experience (including participation, completion, and satisfaction); (2) delegate change in leadership skill (including achievement of learning objectives and change in competencies); and (3) application of new skills to impact supply chain performance. RESULTS: The program achieved high levels of engagement and an 83% graduation rate despite the length and rigor of the program. High satisfaction was evidenced by positive feedback from delegates on the quality and relevance of the program, especially in the context of COVID response (100% would "definitely" recommend). Delegates demonstrated significant growth in all domains of leadership competencies and applied their learnings to address a complex challenge in supply chain performance in their home organization. DISCUSSION: These findings demonstrate a strong appetite for leadership development support among vaccine supply chain professionals, especially in times of rapid change such as during the COVID response. These results also demonstrate the feasibility and impact of a fully virtual model for leadership development, with implications well beyond the COVID-19 pandemic.

Building leadership and management competencies of national immunization teams in 16 Gavi-eligible countries through the EPI leadership and management programme.

BACKGROUND: Strengthening leadership and management competencies among national Expanded Programme on Immunization (EPI) teams will be critical to achieving global immunization targets and other sustainable developmental goals. However, there is little empirical evidence of the effectiveness of investments in leadership and management capacity in the context of national EPI programs. Therefore, we sought to evaluate the EPI Leadership and Management Programme (EPI LAMP), a nine-month certificate program for EPI teams in national Ministries of Health from Gavi priority countries in Anglophone and Francophone Africa and Asia. METHODS: We used a mixed-methods longitudinal evaluation to describe EPI LAMP at four levels: (1) participant response to the training experience based on program administration records and satisfaction surveys; (2) change in management and leadership skill based on competency surveys and exit interviews; (3) change in behavior in the workplace based on exit interviews; and (4) impact of the training on EPI program performance based on the results of each delegate's leadership project. RESULTS: In the first three cohorts, the programme engaged 16 countries (63 participants) and achieved an 86% graduation rate (54 alumni). Participants demonstrated significant improvement in management and leadership competencies across eight domains with the largest improvement observed in the domain of governance and leadership. Women showed greater increases than men, especially in the domains of Operations Management and Political Advocacy and Dialogue. We observed no difference in the gains made by French-speaking delegates compared to English-speaking participants. Breakthrough projects developed by each team improved EPI program performance, as measured by metrics specific to each project. DISCUSSION: Our results show that team-based leadership programs can foster improvements in management practice, collaboration, and problem-solving, and that engagement the broader policy and organizational context is needed to foster the systems thinking capacity required to address complex challenges and improve system performance.