Using Novel Multimethod Evaluation Approaches to Understand Complex Food System Interventions: Insights from a Supply Chain Intervention Intended to Improve Nutrition.

Background: A "food system" approach to improve diet quality by intervening within areas such as food supply chains is gaining prominence. However, evidence of such interventions' impact, and understanding of appropriate methods to evaluate them, is lacking. Objectives: We present an impact evaluation of an intervention that aimed to increase consumption of nutritious foods by supporting food-producing firms in Kenya. In doing so, we demonstrate how multiple methods, including those from other disciplines, can be used to evaluate a complex food systems intervention. Methods: Four methods focused on food-producing firms and their management, including a survey of intervention participants (n = 83 individuals), a "laboratory-in-the-field" experiment (n = 83 individuals), baseline/endline data on firm performance (n = 71 firms), and semistructured interviews (n = 19 firms). Three methods focused on consumers in neighborhoods targeted by a supported firm: a randomized field experiment tested effects of making a supported product exhaustively available on consumers' purchases and consumption (n = 1295 consumers); 3 discrete choice experiments (n = 1295 consumers) tested factors influencing consumers' willingness to pay for foods with relevant characteristics. Results: Among firms, we saw suggestive evidence of increased networking and business relationships, while laboratory-in-the-field experiments indicated the intervention might foster cooperation among participants. Qualitative interviews suggested that the intervention enabled firms to increase production, improve management, increase revenues, and lower costs. Baseline/endline data confirmed a positive effect only on the launch of new products and hiring workers. In the field experiment, consumption of the supported product increased in areas where it was made available relative to a control group, but this did not increase overall consumption of the food type or dietary diversity. Conclusions: Results showed positive signs of the intervention improving firm-level outcomes but limited impact on consumers' diet quality. The evaluation also demonstrates how diverse methods can be used to evaluate complex interventions.

Food Systems Interventions for Nutrition: Lessons from 6 Program Evaluations in Africa and South Asia.

Although there is growing global momentum behind food systems strategies to improve planetary and human health-including nutrition-there is limited evidence of what types of food systems interventions work. Evaluating these types of interventions is challenging due to their complex and dynamic nature and lack of fit with standard evaluation methods. In this article, we draw on a portfolio of 6 evaluations of food systems interventions in Africa and South Asia that were intended to improve nutrition. We identify key methodological challenges and formulate recommendations to improve the quality of such studies. We highlight 5 challenges: a lack of evidence base to justify the intervention, the dynamic and multifaceted nature of the interventions, addressing attribution, collecting or accessing accurate and timely data, and defining and measuring appropriate outcomes. In addition to more specific guidance, we identify 6 cross-cutting recommendations, including a need to use multiple and diverse methods and flexible designs. We also note that these evaluation challenges present opportunities to develop new methods and highlight several specific needs in this space.

Global Coverage of Mandatory Large-Scale Food Fortification Programs: A Systematic Review and Meta-Analysis.

Food fortification with micronutrients is widely implemented to reduce micronutrient deficiencies and related outcomes. Although many factors affect the success of fortification programs, high population coverage is needed to have a public health impact. We aimed to provide recent global coverage estimates of salt, wheat flour, vegetable oil, maize flour, rice, and sugar among countries with mandatory fortification legislation. The indicators were the proportion of households consuming the: food, fortifiable food (that is, industrially processed), fortified food (to any extent), and adequately fortified food (according to national or international standards). We estimated the number of individuals reached with fortified foods. We systematically retrieved and reviewed all applicable evidence from: published reports and articles from January 2010 to August 2021, survey lists/databases from key organizations, and reports/literature received from key informants. We analyzed data with R statistical package using random-effects meta-analysis models. An estimated 94.4% of households consumed salt, 78.4% consumed fortified salt (4.2 billion people), and 48.6% consumed adequately fortified salt in 64, 84, and 31 countries, respectively. Additionally, 77.4% of households consumed wheat flour, 61.6% consumed fortifiable wheat flour, and 47.1% consumed fortified wheat flour (66.2 million people) in 15, 8, and 10 countries, respectively, and 87.0% consumed vegetable oil, 86.7% consumed fortifiable oil, and 40.1% consumed fortified oil (123.9 million people) in 10, 7, and 5 countries, respectively. Data on adequately fortified wheat flour and vegetable oil and coverage indicators for maize flour, rice, and sugar were limited. There are major data gaps on fortification coverage for most foods except salt. All countries with mandatory fortification programs should generate and use more coverage data to assess program performance and adjust programs as needed to realize their potential to reduce micronutrient deficiencies (PROSPERO CRD42021269364).

Preventive small-quantity lipid-based nutrient supplements reduce severe wasting and severe stunting among young children: an individual participant data meta-analysis of randomized controlled trials.

BACKGROUND: Meta-analyses show that small-quantity lipid-based nutrient supplements (SQ-LNSs) reduce child wasting and stunting. There is little information regarding effects on severe wasting or stunting. OBJECTIVES: We aimed to identify the effect of SQ-LNSs on prevalence of severe wasting (weight-for-length z score < -3) and severe stunting (length-for-age z score < -3). METHODS: We conducted a 2-stage meta-analysis of individual participant data from 14 randomized controlled trials of SQ-LNSs provided to children 6-24 mo of age. We generated study-specific and subgroup estimates of SQ-LNS compared with control and pooled the estimates using fixed-effects models. We used random-effects meta-regression to examine study-level effect modifiers. In sensitivity analyses, we examined whether results differed depending on study arm inclusion criteria and types of comparisons. RESULTS: SQ-LNS provision led to a relative reduction of 31% in severe wasting [prevalence ratio (PR): 0.69; 95% CI: 0.55, 0.86; n = 34,373] and 17% in severe stunting (PR: 0.83; 95% CI: 0.78, 0.90; n = 36,795) at endline. Results were similar in most of the sensitivity analyses but somewhat attenuated when comparisons using passive control arms were excluded (PR: 0.74; 95% CI: 0.57, 0.96; n = 26,327 for severe wasting and PR: 0.88; 95% CI: 0.81, 0.95; n = 28,742 for severe stunting). Study-level characteristics generally did not significantly modify the effects of SQ-LNSs, but results suggested greater effects of SQ-LNSs in sites with greater burdens of wasting or stunting, or with poorer water quality or sanitation. CONCLUSIONS: Including SQ-LNSs in preventive interventions to promote healthy child growth and development is likely to reduce rates of severe wasting and stunting. This meta-analysis was registered at www.crd.york.ac.uk/PROSPERO as CRD42019146592.

Growth and growth trajectory among infants in early life: contributions of food insecurity and water insecurity in rural Zimbabwe.

Introduction: Stunting or linear growth faltering, measured by length-for-age Z-score (LAZ), remains a significant public health challenge, particularly in rural low-income and middle-income countries. It is a marker of inadequate environments in which infants are born and raised. However, the contributions of household resource insecurities, such as food and water, to growth and growth trajectory are understudied. Methods: We used the cluster-randomised Sanitation Hygiene and Infant Nutrition Efficacy trial to determine the association of household-level food insecurity (FI) and water insecurity (WI) on LAZ and LAZ trajectory among infants during early life. Dimensions of FI (poor access, household shocks, low availability and quality) and WI (poor access, poor quality, low reliability) were assessed with the multidimensional household food insecurity and the multidimensional household water insecurity measures. Infant length was converted to LAZ based on the 2006 WHO Child Growth Standards. We report the FI and WI fixed effects from multivariable growth curve models with repeated measures of LAZ at 1, 3, 6, 12 and 18 months (M1-M18). Results: A total of 714 and 710 infants were included in our analyses of LAZ from M1 to M18 and M6 to M18, respectively. Mean LAZ values at each time indicated worsening linear growth. From M1 to M18, low food availability and quality was associated with lower LAZ (ß=-0.09; 95% -0.19 to -0.13). From M6 to M18, poor food access was associated with lower LAZ (ß=-0.11; 95% -0.20 to -0.03). None of the WI dimensions were associated with LAZ, nor with LAZ trajectory over time. Conclusion: FI, but not WI, was associated with poor linear growth among rural Zimbabwean infants. Specifically, low food availability and quality and poor food access was associated with lower LAZ. There is no evidence of an effect of FI or WI on LAZ trajectory.

Cost-effectiveness of a market-based home fortification of food with micronutrient powder programme in Bangladesh.

OBJECTIVE: We estimated the cost-effectiveness of home fortification with micronutrient powder delivered in a sales-based programme in reducing the prevalence of Fe deficiency anaemia among children 6-59 months in Bangladesh. DESIGN: Cross-sectional interviews with local and central-level programme staff and document reviews were conducted. Using an activity-based costing approach, we estimated start-up and implementation costs of the programme. The incremental cost per anaemia case averted and disability-adjusted life years (DALY) averted were estimated by comparing the home fortification programme and no intervention scenarios. SETTING: The home fortification programme was implemented in 164 upazilas (sub-districts) in Bangladesh. PARTICIPANTS: Caregivers of child 6-59 months and BRAC staff members including community health workers were the participants for this study. RESULTS: The home fortification programme had an estimated total start-up cost of 35·46 million BDT (456 thousand USD) and implementation cost of 1111·63 million BDT (14·12 million USD). The incremental cost per Fe deficiency anaemia case averted and per DALY averted was estimated to be 1749 BDT (22·2 USD) and 12 558 BDT (159·3 USD), respectively. Considering per capita gross domestic product (1516·5 USD) as the cost-effectiveness threshold, the home fortification programme was highly cost-effective. The programme coverage and costs for nutritional counselling of the beneficiary were influential parameters for cost per DALY averted in the one-way sensitivity analysis. CONCLUSIONS: The market-based home fortification programme was a highly cost-effective mechanism for delivering micronutrients to a large number of children in Bangladesh. The policymakers should consider funding and sustaining large-scale sales-based micronutrient home fortification efforts assuming the clear population-level need and potential to benefit persists.

Factors associated with home visits by volunteer community health workers to implement a home-fortification intervention in Bangladesh: a multilevel analysis.

OBJECTIVE: BRAC, an international development organization based in Bangladesh, engages community health workers called Shasthya Shebikas (SS) to implement home fortification of foods with micronutrient powders (MNP). We identified factors associated with home visits by SS, at different levels of the BRAC programme-delivery hierarchy, to implement home-fortification interventions. DESIGN: We conducted a cross-sectional survey, semi-structured interviews, and collected programme-related data from sub-districts included in the caregiver survey of BRAC's home-fortification programme and performed multilevel logistic regression modelling to investigate factors associated with home visits by SS. SETTINGS: Sixty-eight sub-districts in Bangladesh. PARTICIPANTS: Caregivers of children aged 6-59 months (n 1408) and BRAC's SS (n 201). RESULTS: Households with older children (0·55; 0·42, 0·72; P < 0·001) and located >300 m from the SS's house (0·67; 0·50, 0·89; P = 0·006) were less likely to have been visited by the SS, whereas those with caregivers who had ≥5 years of schooling (1·53; 1·10, 2·12; P = 0·011) were more likely to have been visited by the SS (adjusted OR; 95 % CI). Households in the catchment area of older SS aged >50 years (0·44; 0·21, 0·90; P = 0·025) were less likely to have been visited by the SS, whereas those with SS who received incentives of >800 BDT (3·00; 1·58, 5·58; P = 0·001) were more likely to have been visited by the SS (adjusted OR; 95 % CI). CONCLUSIONS: The number of home visits is a function of the characteristics of SS, factors that characterize the households they serve and characteristics of their organizational context, particularly to implement home fortification of foods with MNP.

Role of home visits by volunteer community health workers: to improve the coverage of micronutrient powders in rural Bangladesh.

OBJECTIVE: We assessed the role of home visits by Shasthya Shebika (SS) - female volunteer community health workers (CHWs) - in improving the distribution of micronutrient powder (MNP), and explored the independent effects of caregiver-provider interaction on coverage variables. DESIGN: We used data from three cross-sectional surveys undertaken at baseline (n 1927), midline (n 1924) and endline (n 1540) as part of an evaluation of a home fortification programme. We defined an exposure group as one that had at least one SS visit to the caregiver's household in the 12 months preceding the survey considering three outcome variables - message (ever heard), contact (ever used) and effective coverage (regular used) of MNP. We performed multiple logistic regressions to explore the determinants of coverage, employed an 'interaction term' and calculated an odds ratio (OR) to assess the modifying effect of SS's home visits on coverage. SETTINGS: Sixty-eight sub-districts from ten districts of Bangladesh. PARTICIPANTS: Children aged 6-59 months and their caregivers. RESULTS: A home visit from an SS positively impacts message coverage at both midline (ratio of OR 1·70; 95 % CI 1·25, 2·32; P < 0·01) and endline (ratio of OR 3·58; 95 % CI 2·22, 5·78; P < 0·001), and contact coverage both at midline (ratio of OR 1·48; 95 % CI 1·06, 2·07; P = 0·021) and endline (ratio of OR 1·74; 95 % CI 1·23, 2·47; P = 0·002). There was no significant effect of a SS's home visit on effective coverage. CONCLUSIONS: The households visited by BRAC's volunteer CHWs have better message and contact coverage among the children aged 6-59 months.

Factors Associated With Community Health Worker Performance Differ by Task in a Multi-Tasked Setting in Rural Zimbabwe.

BACKGROUND: Zimbabwe, like most low-income countries, faces health worker shortages. Community health workers (CHWs) bridge this gap by delivering essential health services and nutrition interventions to communities. However, as workloads increase, CHWs' ability to provide quality services may be compromised. We studied influences upon CHWs' performance related to pregnancy surveillance and nutrition and hygiene education in rural Zimbabwe. METHODS: In the context of a cluster-randomized trial conducted in 2 rural districts between November 2012 and March 2015, 342 government-employed CHWs identified and referred pregnant women for early antenatal care and delivered household-level behavior change lessons about infant feeding and hygiene to more than 5,000 women. In 2013, we conducted a survey among 322 of the CHWs to assess the association between demographic and work characteristics and task performance. Exploratory factor analyses of the Likert-type survey questions produced 8 distinct and reliable constructs of job satisfaction and motivation, supervision, peer support, and feedback (Cronbach α range, 0.68 to 0.92). Pregnancy surveillance performance was assessed from pregnancy referrals, and nutrition and hygiene education performance was assessed by taking the average summative score (range, 5 to 30) of lesson delivery observations completed by a nurse supervisor using a 6-item Likert-type checklist. Poisson and multiple linear regressions were used to test associations between CHW demographic and work characteristics and performance. RESULTS: CHWs who referred more pregnant women were female, unmarried, under 40 years old, from larger households, and of longer tenure. They also perceived work resources to be adequate and received positive feedback from supervisors and the community, but they were less satisfied with remuneration. CHWs with high scores on behavior change lesson delivery were from smaller households, and they received more supportive supervision but less operational supervision. Measures of job satisfaction and motivation were not associated with either task. CONCLUSION: Among CHWs responsible for multiple tasks in rural Zimbabwe, factors associated with performance of one task were not the same as those associated with performance of another task. Our methods and findings illustrate ways to examine heterogeneity in CHW performance and to identify organizational factors associated with quality of program delivery.