Data to Action: A Mixed-Methods Study of Data Use Teams, Improved Availability of Contraceptives in Guinea, Indonesia, Kenya, and Myanmar.

Information Mobilized for Performance Analysis and Continuous Transformation (IMPACT) Teams routinely bring together data, people, processes, and technology, under the leadership of governments, to institute a change in culture that leads to sustained improvements in supply chain processes and outcomes. This mixed methods study examined whether IMPACT Teams were effective in improving reproductive health supply chain outcomes in Guinea, Indonesia, Kenya, and Myanmar and identified enablers and barriers to IMPACT Team success and sustainability in Indonesia and Kenya.The study design employed a pre-post intervention comparison panel design with a nonrandomized matched comparison group to examine the IMPACT Teams' effect on 2 supply chain outcomes: stocked according to plan and stock-outs. Additional key informant interviews conducted in Kenya and Indonesia explored enablers and barriers to IMPACT Team success and sustainability.For nearly all products across the 4 countries, an increase in products being stocked according to plan and a reduction in stock-outs can be attributed to the IMPACT Team intervention, demonstrating that IMPACT teams are an effective approach for improving contraceptive supply chain inventory management and availability. However, our findings do not demonstrate a clear causal pathway as theorized in our theory of change, namely that government leadership leads to the installation of a data use culture, which in turn leads to improved product availability. In both Indonesia and Kenya, though product availability improved, there was a lack of leadership and culture change. This suggests that improved product availability does not depend on establishing a data use culture or government leadership, but rather, that a data use culture-rather than product availability-is the outcome of interest for sustained change, and that understanding motivations and incentives for leadership participation may be more important for scaling, institutionalizing, and sustaining gains in supply chain outcomes.

Using Human-Centered Design to Adapt Supply Chains and Digital Solutions for Community Health Volunteers in Nomadic Communities of Northern Kenya.

BACKGROUND: Unreliable and nonexistent supply chain procedures and processes are one of the primary barriers to achieving functional community health units in nomadic communities in the arid/semiarid counties of Kenya. METHODS: We used a human-centered design (HCD) approach to engage communities and community health volunteers (CHVs) in redesigning a proven data-centric supply chain approach that included a digital solution, called cStock, for this challenging context. We conducted the HCD process in 4 phases: (1) understanding intent, (2) research and insights, (3) ideation and prototyping, and (4) supply chain design and requirements building. Data collection used qualitative methods and involved a range of stakeholders including CHVs, supervisors, and local beneficiaries. CHVs and their supervisors also participated in cStock usability testing. Drawing on insights and personas generated from the research, stakeholders ideated and codesigned supply chain tools. RESULTS: The research identified critical insights for informing the redesign of cStock for nomadic communities. These insights were categorized into supply chain, information systems, human resources, behaviors, service delivery infrastructure, and connectivity. Four supply chain data solutions were designed, prototyped, tested, and iterated: a stock recording paper-based form, a user-friendly cStock application, a supervisor cStock application, and an unstructured supplementary service data reporting system using feature phones. CONCLUSIONS: Using the HCD process incorporated the perspective of CHVs and their communities and provided key insights to inform the design of the supply chain and adapt cStock. The process helped make cStock to be inclusive and have the potential to have a meaningful impact on strengthening the supply chain for seminomadic and nomadic communities in northern Kenya. A strong supply chain for these CHVs will increase access to essential and reproductive health commodities and contribute to improving the overall health and well-being of these communities, especially women and children.

Using Data to Keep Vaccines Cold in Kenya: Remote Temperature Monitoring with Data Review Teams for Vaccine Management.

BACKGROUND: Global vaccination coverage rates have remained around 85% for the past several years. Increasing immunization coverage rates requires an effective cold chain to maintain vaccine potency. Remote temperature monitoring (RTM) technology for vaccine refrigerators has shown promise for improving the ability of supply systems to maintain optimal temperature conditions to ensure potent vaccines reach the end users. METHODS: A pilot study of RTM technology and data use teams was implemented in 36 study sites in Kenya. Data were collected at baseline and endline points over a 3-month baseline and 7-month implementation period. Data included 44 qualitative interviews, process logs, meeting minutes from data use team meetings, and quantitative temperature and power data from the RTM devices. RESULTS: The ability of cold chain equipment to maintain World Health Organization-recommended temperatures in study sites improved markedly between the baseline and implementation periods, resulting in an improvement in total time spent in the correct range from 83.9% in the baseline period to 90.9% in the intervention period and an improvement in time spent in the too cold range from 6.5% to 1.5%. Friedman tests revealed that differences in time spent in the correct range and time spent in the too cold range during the course of the study were statistically significant (P<.001 and P=.04, respectively). Qualitative and quantitative data suggest that this improvement was due to a combination of improved responsiveness to temperature excursions at the facility level, resulting from SMS alarms for temperature excursion periods, and improved ability at the management level to recognize and address recurring problems. CONCLUSION: The combination of using RTM technology with a structured data review process by a management team is a promising approach for improving cold chain outcomes. Future research examining the added value of each of the technological and behavioral components separately is needed.

Are Procured Quantities of Implants Adequate and Appropriate? Modeling Procurement, Inventory, and Consumption of Contraceptive Implants During Rapid Uptake.

Donors and others are concerned that implants procured under the Family Planning 2020 Initiative exceed the number sought by clients, resulting in accumulating stocks. To explore this issue, we examined 3 questions across 9 countries: (1) How accurate were procurement quantities given requirements for filling supply chains for the rapidly growing implant programs? (2) Is there a standard factor that can be applied to consumption data to predict procurement volumes required? (3) How accurately do demographic estimates mirror dispensed-to-client data? We created a model incorporating public-sector supply chain system parameters to calculate system "imputed" inventory and the system "filled-to-max" inventory. Comparing results determined the adequacy of the procurement quantities. The proportion of consumption that the filled-to-max inventory represented through time suggests whether a standard factor can be applied to consumption to predict necessary procurement volumes. We compared demographic estimates to consumption data to determine the usability of the former in predicting demand. According to model results, 3 of the 9 countries came close to procuring accurate quantities over the study period between 2010 and 2017, 4 had procurement volumes lower than what was required to fill the supply chain to maximum inventory requirement levels, and 2 had volumes that exceeded the need. We found no standard factor for relating inventory quantities to consumption rates across countries, given that inventory needs can vary based on system design parameters and the rates of growth or decline in consumption. Finally, we observed that our demographic estimates were on average lower than the dispensed-to-client data in the 6 countries for which these data were available. Study results show that the significant investments in procurement quantities for the rapidly growing implant programs were justified based on consumption and system design. This research should assure observers that rapid increases in implant procurement quantities (where data are available) have generally not resulted in overstocks of the system to date. It suggests that the relationship between procurement quantities and consumption levels cannot be accurately assessed without understanding the country supply chain, inventory control parameters, and current and future demand.

Quality improvement practices to institutionalize supply chain best practices for iCCM: Evidence from Rwanda and Malawi.

BACKGROUND: Supply chain bottlenecks that prevent community health workers (CHWs) from accessing essential medicines significantly increase under-5 child mortality, particularly in poor and rural areas. OBJECTIVE: Using implementation research, interventions aimed at improving supply chain practices and access to medicines were tested in Malawi and Rwanda. These interventions included simple demand-based resupply procedures, using mobile technology and traditional methods for communication, and multilevel, performance-driven quality improvement (QI) teams. METHODS: Mixed-method evaluations were conducted at baseline (2010), midline (2013), and endline (2014). Baseline assessments identified common bottlenecks and established performance levels. Midline assessments identified which intervention package had the greatest impact. Endline surveys measured the progress of scale-up and institutionalization of each innovation. RESULTS: In both Rwanda and Malawi CHWs, health center staff, and district managers all cited many benefits of the establishment of resupply procedures and QI teams: such as providing structure and processes, a means to analyze and discuss problems and enhance collaboration between staff. CONCLUSIONS: Implementing simple, streamlined, demand-based resupply procedures formed the basis for informed and regular resupply, and increased the visibility of appropriate and timely community logistics data. QI teams played a critical role in reinforcing resupply procedures and routinely unlocking the bottlenecks that prevent the continuous flow of critical health products. While simple, streamlined, demand-based resupply procedures provide the basis for regular, functional, and efficient resupply of CHWs, the procedures alone are not sufficient to create consistent change in product availability. Supporting these procedures with multilevel QI teams reinforces the correct and consistent use of resupply procedures.

Making products available among community health workers: Evidence for improving community health supply chains from Ethiopia, Malawi, and Rwanda.

BACKGROUND: A UNICEF review of the challenges to scaling up integrated community case management (iCCM) found that drug shortages were a common bottleneck. In many settings, little thought has gone into the design of supply chains to the community level and limited evidence exists for how to address these unique challenges. SC4CCM's purpose was to conduct intervention research to identify proven, simple, affordable solutions that address the unique supply chain challenges faced by CHWs and to demonstrate that supply chain constraints at the community level can be overcome. METHODS: SC4CCM selected three countries to implement supply chain innovations and developed a theory of change (TOC) framework for the learning phase, which identified the main drivers of product availability and was used for baseline assessments, design, implementation and evaluation of interventions in Ethiopia, Malawi, and Rwanda. Interventions were developed in each country and tested over 12-24 months. Mixed-method follow up assessments were conducted in each country in 2012-2013. The Supply Chain for Community Case Management (SC4CCM) Project then simplified the TOC into a Community Health Supply Chain (CHSC) framework to enable cross country analysis. RESULTS: The findings from interventions in the three countries suggest that the greatest supply chain benefits are realized when all three CHSC framework elements (data flow, product flow, and effective people) are in place and working together. The synergistic effect of these three elements on supply chain performance was most effectively demonstrated by results from the Enhanced Management and Quality Collaborative interventions in Malawi and Rwanda, respectively, which were characterized by lower mean stockout rates and higher in stock rates on day of visit, when compared to other interventions. CONCLUSIONS: Many conditions are necessary to ensure continuous product availability at the community level, however a supply chain works best when three key elements (product flow, data flow, and effective people) are deliberately included as an integral part of the system design. Although these elements may be designed differently in different settings, streamlining and synchronizing them while ensuring inclusion of all components for each element improves supply chain performance and promotes product availability at the community level.

Strengthening community health supply chain performance through an integrated approach: Using mHealth technology and multilevel teams in Malawi.

BACKGROUND: In 2010, 7.6 million children under five died globally - largely due to preventable diseases. Majority of these deaths occurred in sub-Saharan Africa. As a strategy to reduce child mortality, the Government of Malawi, in 2008, initiated integrated community case management allowing health surveillance assistants (HSAs) to treat sick children in communities. Malawi however, faces health infrastructure challenges, including weak supply chain systems leading to low product availability. A baseline assessment conducted in 2010 identified data visibility, transport and motivation of HSAs as challenges to continuous product availability. The project designed a mHealth tool as part of two interventions to address these challenges. METHODS: A mobile health (mHealth) technology - cStock, for reporting on community stock data - was designed and implemented as an integral component of Enhanced Management (EM) and Efficient Product Transport (EPT) interventions. We developed a feasibility and acceptability framework to evaluate the effectiveness and predict the likelihood of scalability and ownership of the interventions. Mixed methods were used to conduct baseline and follow up assessments in May 2010 and February 2013, respectively. Routine monitoring data on community stock level reports, from cStock, were used to analyze supply chain performance over 18-month period in the intervention groups. RESULTS: Mean stock reporting rate by HSAs was 94% in EM group (n = 393) and 79% in EPT group (n = 253); mean reporting completeness was 85% and 65%, respectively. Lead time for HSA drug resupply over the 18-month period was, on average, 12.8 days in EM and 26.4 days in EPT, and mean stock out rate for 6 tracer products was significantly lower in EM compared to EPT group. CONCLUSIONS: Results demonstrate that cStock was feasible and acceptable to test users in Malawi, and that based on comparison with the EPT group, the team component of the EM group was an essential pairing with cStock to achieve the best possible supply chain performance and supply reliability. Establishing multi-level teams serves to connect HSAs with decision makers at higher levels of the health system, align objectives, clarify roles and promote trust and collaboration, thereby promoting country ownership and scalability of a cStock-like system.

Factors affecting availability of essential medicines among community health workers in Ethiopia, Malawi, and Rwanda: solving the last mile puzzle.

To understand how supply chain factors affect product availability at the community level, the Improving Supply Chains for Community Case Management of Pneumonia and Other Common Diseases of Childhood Project developed a theory of change (TOC) framework for gathering, organizing, and interpreting evidence about supply constraints to community case management (CCM). Baseline assessments in Ethiopia, Malawi, and Rwanda conducted in 2010 provided information on the strengths and weaknesses of existing CCM supply chains for five main products: antibiotics for pneumonia, oral rehydration solution, ready to use therapeutic food, zinc, and artemether/lumefantrine. The assessments tested the strength and validity of causal pathways identified in the TOC that were believed to influence availability of CCM products among community health workers (CHWs) for treating common childhood illnesses. Results of the assessments showed product availability to be weak in each country, with more than half of CHWs stocked out of at least one tracer product on the day of the assessment. This report will focus on the findings related to three key preconditions of the TOC and how these were used to inform the design of the CCM supply chain improvement strategy in each country. The three key preconditions include product availability at CHW resupply points, supply chain knowledge and capacity among CHWs and their supervisors, and availability of appropriate transportation.