Designing for Impact and Institutionalization: Applying Systems Thinking to Sustainable Postpartum Family Planning Approaches for First-Time Mothers in Bangladesh.

Integrated service delivery approaches have shown promise to increase use of services including postpartum family planning (PPFP) by young, first-time mothers (FTMs) but have proven challenging to scale and institutionalize. Integration adds complexity, requiring careful assessment of effects on a range of key system functions from demand creation and service delivery to oversight and governance. Through an innovative design process, we selected approaches to increase FTMs' PPFP use through existing health systems. We generated programmatic options and then sought to select approaches based on (1) potential impact on FTMs' PPFP uptake and (2) potential to institutionalize in the health system. The latter represented an innovation in addressing management systems' drivers of scalability and sustainability; to accomplish it, we developed a participatory design process to assess the potential of an approach to be institutionalized in a specific context.We adapted a management systems theory, the Viable System Model (VSM), which presents 5 essential organizational functions and the relations required between them to improve the viability (performance and institutionalization) of organizational systems. Drawing from the VSM, we developed a process for reviewing the effects of proposed approaches on provider workload, client flow, infrastructure, revisions to guidelines and job descriptions, coordination and management, and information systems. The VSM provided a structure to identify potential displacement of capacity in the health system and mitigate often neglected organizational challenges that compromise institutionalization. The process informed the elimination of approaches with potential for impact but that had deal-breakers to institutionalization, such as increased workload or shifted job descriptions, in the Bangladeshi context. For the selected approaches, consideration of systems elements fostered discussion of expected risks to institutionalization, highlighting needed mitigation efforts and monitoring during implementation.

Social accountability and health systems' change, beyond the shock of Covid-19: drawing on histories of technical and activist approaches to rethink a shared code of practice.

BACKGROUND: Recognition of the value of "social accountability" to improve health systems performance and to address health inequities, has increased over the last decades, with different schools of thought engaging in robust dialogue. This article explores the tensions between health policy and systems research and practice on the one hand, and health equity-focussed activism on the other, as distinct yet interacting processes that have both been impacted by the shock effects of the Covid-19 pandemic. This extended commentary brings multidisciplinary voices seeking to look back at health systems history and fundamental social-institutional systems' behaviors in order to contextualize these current debates over how best to push social accountability efforts forward. ANALYSIS: There is a documented history of tension between long and short processes of international health cooperation and intervention. Social accountability approaches, as a more recent strategy to improve health systems performance, intersect with this overarching history of negotiation between differently situated actors both global and local on whether to pursue sustained, slow, often community-driven change or to focus on rapid, measurable, often top-down interventions. Covid-19, as a global public health emergency, resulted in calls for urgent action which have unsurprisingly displaced some of the energy and aspiration for systemic transformation processes. A combination of accountability approaches and mechanisms have their own legitimacy in fostering health systems change, demanding collaboration between those that move both fast and slow, top-down and bottom-up. CONCLUSION: We argue that social accountability, much like all efforts to strengthen health systems, is "everybody's business" and that we must understand better the historical processes that have shaped the field of practice over time to move forward. These differences of perspective, knowledge-base and positioning vis-a-vis interventions or longer-term political commitment should not drive a conflict of legitimacy but instead be named, subsequently enabling the development of a shared code of conduct that applies to the breadth of actors involved in social accountability work. If we are concerned about the state of/status of social accountability within the context of "building back better" we must approach collaboration with a willingness to create dialogue across distinct disciplinary, technical and politically-informed ways of working.

The role of integrated community case management projects in strengthening health systems: case study analysis in Ethiopia, Malawi and Mozambique.

Integrated community case management (iCCM) has now been implemented at scale globally. Literature to-date has focused primarily on the effectiveness of iCCM and the systems conditions required to sustain iCCM. In this study, we sought to explore opportunities taken and lost for strengthening health systems through successive iCCM programmes. We employed a systematic, embedded, multiple case study design for three countries-Ethiopia, Malawi and Mozambique-where Save the Children implemented iCCM programmes between 2009 and 2017. We used textual analysis to code 62 project documents on nine categories of functions of health systems using NVivo 11.0. The document review was supplemented by four key informant interviews. This study makes important contributions to the theoretical understanding of the role of projects in health systems strengthening by not only documenting evidence of systems strengthening in multi-year iCCM projects, but also emphasizing important deficiencies in systems strengthening efforts. Projects operated on a spectrum, ranging from gap-filling interventions, to support, to actual strengthening. While there were natural limits to the influence of a project on the health system, all successive projects found constructive opportunities to try to strengthen systems. Alignment with the Ministry of Health was not always static and simple, and ministries themselves have shown pluralism in their perspectives and orientations. We conclude that systems strengthening remains 'everybody's business' and places demands for realism and transparency on government and the development architecture. While mid-size projects have limited decision space, there is value in better defining where systems strengthening contributions can actually be made. Furthermore, systems strengthening is not solely about macro-level changes, as operational and efficiency gains at meso and micro levels can have value to the system. Claims of 'systems strengthening' are, however, bounded within the quality of evaluation and learning investments.

Applying the Community Health Worker Coverage and Capacity Tool for Time-Use Modeling for Program Planning in Rwanda and Zanzibar.

Community health worker (CHW) programs are a critical component of health systems, notably in lower- and middle-income countries. However, when policy recommendations exceed what is feasible to implement, CHWs are overstretched by the volume of activities, implementation strength is diluted, and programs fail to produce promised outcomes. To counteract this, we developed a time-use modeling tool-the CHW Coverage and Capacity (C3) Tool-and used it with government partners in Rwanda and Zanzibar to address common policy questions related to CHW needs, coverage, and time optimization.In Rwanda, the C3 Tool was used to analyze 2 well-established cadres of CHWs and 1 new one. The well-established CHW cadres were within a "manageable" workload range whereas the new cadre was projected to achieve less than half of assigned activities. This is informing ongoing changes to the CHWs' scopes of work. In Zanzibar, the C3 Tool was used to update the national community health strategy to include community health volunteers (CHVs) for the first time and determine how many CHVs were needed. The tool projected that 2,200 CHVs could achieve approximately 90% coverage of all defined services. Based on these figures, Zanzibar updated its national community health strategy, which officially launched in February 2020.We discuss lessons from these 2 experiences. Translating analysis into decision making depends not only on the programmatic will and motivation of governments but also on finding opportune timing for when policy and program processes allow for optimization of CHW investments. Further research is needed but our experience supports the value of a modeling tool to ground program plans within estimated constraints on CHW time.

Health systems effects of successive emergency health and nutrition projects: an embedded retrospective case study analysis in Sudan and Pakistan.

Despite increasing attention to the concept of a humanitarian-development nexus in recent years, limited research is available to improve health systems strengthening practice within humanitarian programmes. We used an exploratory, systematic, embedded, multiple case study design to discern systems effects of successive Save the Children chronic emergency health and nutrition projects implemented in Sudan and Pakistan between 2011 and 2018. We used textual analysis to code 63 documents focused on eight themes using NVivo 11.0. This was supplemented by six key informant interviews. Findings offer a complex and mixed picture, with contributions to systems strengthening in community systems, their linkages to health management structures, and human resources for health. Projects with primary mandates for urgent service delivery progressively found systems strengthening opportunities, through a combination of tacit choices and explicit objectives. In both countries, some 'parallel systems' were set in place initially, with immediate gains (e.g. quality of services) only occasionally accompanied by enhanced systems capacity to sustain them. Cycles of implementation, however, achieved financial transition of 'macro-costs' to the government (e.g. facilities in Sudan, staff in Pakistan) through indirect pathways and the influence of pluralistic governmental structures themselves. Opportunities were taken, or missed, based on dynamic relationships within the government-development partners eco-system. Transition steps also came with unintended effects and drops in intensity. Both project contributions to systems strengthening and our own study were limited by substantial gaps in evaluation and documentation processes. We provide cautious recommendations based on the literature and our two case studies. Even mid-size chronic emergency projects can and should make meaningful and explicit contributions to systems strengthening. This contribution will, however, depend on the development eco-system context, and development of better collective intelligence (coordination, evaluation and learning, benchmarking, accountability) to improve individual projects' adaptive management efforts to improve fit with evolving national systems.

Piloting a participatory, community-based health information system for strengthening community-based health services: findings of a cluster-randomized controlled trial in the slums of Freetown, Sierra Leone.

BACKGROUND: Although community engagement has been promoted as a strategy for health systems strengthening, there is need for more evidence for effectiveness of this approach. We describe an operations research (OR) Study and assessment of one form of community engagement, the development and implementation of a participatory community-based health information system (PCBHIS), in slum communities in Freetown, Sierra Leone. METHODS: A child survival project was implemented in 10 slum communities, which were then randomly allocated to intervention (PCBHIS) and comparison areas. In the 5 PCBHIS communities, the findings from monthly reports submitted by community health workers (CHWs) and verbal autopsy findings for deaths of children who died before reaching 5 years of age, were processed and shared at bimonthly meetings in each community. These meetings, called Community Health Data Review (CHDR) meetings, were attended by community leaders, including members of the Ward Development Committee (WDC) and Health Management Committee (HMC), by the CHW Peer Supervisors, and by representatives of the Peripheral Health Unit. Following a review of the information, attendees proposed actions to strengthen community-based health services in their community. These meetings were held over a period of 20 months from July 2015 to March 2017. At baseline and endline, knowledge, practice and coverage (KPC) surveys measured household health-related behaviors and care-seeking behaviors. The capacity of HMCs and WDCs to engage with the local health system was also measured at baseline and endline. Reports of CHW household contact and assessments of CHW quality were obtained in the endline KPC household survey, and household contacts measured in monthly submitted reports were also tabulated. RESULTS: The self-assessment scores of WDCs' capacity to fulfil their roles improved more in the intervention than in the comparison area for all six components, but for only 1 of the 6 was the improvement statistically significant (monthly and quarterly meetings in which Peer Supervisor and/or CHW supervision was an agenda item). The scores for the HMCs improved less in the intervention area than in the comparison area for all six components, but none of these differences were statistically significant. Topics of discussion in CHDRs focused primarily on CHW functionality. All three indicators of CHW functioning (as measured by reports submitted from CHWs) improved more in the intervention area relative to the comparison area, with 2 out of 3 measures of improvement reaching statistical significance. Five of 7 household behaviors judged to be amenable to promotion by CHWs improved more in the intervention area than in the comparison area, and 2 out of the 5 were statistically significant (feeding colostrum and appropriate infant and young child feeding). Four of the 6 care-seeking behaviors judged to be amenable to promotion by CHWs improved more in the intervention area than in the comparison area, and 1 was statistically significant (treatment of diarrhea with ORS and zinc). None of the findings that favored the comparison area were statistically significant. CONCLUSIONS: This study was implemented in challenging circumstances. The OR Study intervention was delayed because of interruptions in finalizing the national CHW policy, two separate cholera epidemics, and the Ebola epidemic lasting more than 2 years. Weaknesses in the CHW intervention severely limited the extent to which the PCBHIS could be used to observe trends in mortality and morbidity. Nonetheless, the positive results achieved in the area of functionality of the CHW intervention and community structure capacity are encouraging. Results suggest there is value in further methodologically rigorous investigations into improving community-based health system functioning through a similar approach to community engagement.

A simple metric for a complex outcome: proposing a sustainment index for health indicators.

BACKGROUND: Sustainability is, at least in principle, an important criterion for evaluating global health and development programs. The absence of shared metrics for success or achievements in sustainability is however critically lacking. We propose a simple metric, free of causal inference, which can be used to test different empirical models for the sustainment of health outcomes. METHODS: We follow the suggestion of Chambers and use "sustainment" to refer to the verifiable and measured extent to which a health indicator has evolved over time. The sustainment index of a health indicator (Y) advanced by a program is based on a simple-to-calculate approximation of the derivative of Y over time (T0: baseline, T1: endline, and T2: post-project), based on the ratio of the slope of YT1-T2 over YT0-T1. SI(Y) = 1+ (YT1-T2 / YT0-T1). RESULTS: This construct provides three clear benchmarks: SI = 0, when the health indicator returns to baseline value post-project (YT2 = YT0); SI = 1, when the endline-post-project trend is a plateau; and SI = 2, when the progress slope during program is uninterrupted post-program. We find strong correlation (r2 = 0.922) between the SI and independent practitioners' rating of indicator trends. The SI shows different levels of achieved sustainment for a range of indicators in a published ex-post sustainability study. And we find that the SI can be computed for large national datasets for two types of indicators. CONCLUSIONS: The Sustainment Index has limitations and conditions of applicability, but it can be applied to different datasets and studies to provide a reliable dependent measure of the level of sustainment of health outcomes from one period of time to the next. The Index will need additional testing, and future evaluation-research work will need to consider index performance under different situations. The Sustainment Index has the potential to provide a standard metric to build evidence through more systematic research on sustainment and sustainability.

Hubris, humility and humanity: expanding evidence approaches for improving and sustaining community health programmes.

Community-based approaches are a critical foundation for many health outcomes, including reproductive, maternal, newborn and child health (RMNCH). Evidence is a vital part of strengthening that foundation, but largely focuses on the technical content of what must be done, rather than on how disparate community actors continuously interpret, implement and adapt interventions in dynamic and varied community health systems. We argue that efforts to strengthen evidence for community programmes must guard against the hubris of relying on a single approach or hierarchy of evidence for the range of research questions that arise when sustaining community programmes at scale. Moving forward we need a broader evidence agenda that better addresses the implementation realities influencing the scale and sustainability of community programmes and the partnerships underpinning them if future gains in community RMNCH are to be realised. This will require humility in understanding communities as social systems, the complexity of the interventions they engage with and the heterogeneity of evidence needs that address the implementation challenges faced. It also entails building common ground across epistemological word views to strengthen the robustness of implementation research by improving the use of conceptual frameworks, addressing uncertainty and fostering collaboration. Given the complexity of scaling up and sustaining community RMNCH, ensuring that evidence translates into action will require the ongoing brokering of relationships to support the human creativity, scepticism and scaffolding that together build layers of evidence, critical thinking and collaborative learning to effect change.

Thinking about complexity in health: A systematic review of the key systems thinking and complexity ideas in health.

RATIONALE, AIMS, AND OBJECTIVES: As the Sustainable Development Goals are rolled out worldwide, development leaders will be looking to the experiences of the past to improve implementation in the future. Systems thinking and complexity science (ST/CS) propose that health and the health system are composed of dynamic actors constantly evolving in response to each other and their context. While offering practical guidance for steering the next development agenda, there is no consensus as to how these important ideas are discussed in relation to health. This systematic review sought to identify and describe some of the key terms, concepts, and methods in recent ST/CS literature. METHOD: Using the search terms "systems thinkin * AND health OR complexity theor* AND health OR complex adaptive system* AND health," we identified 516 relevant full texts out of 3982 titles across the search period (2002-2015). RESULTS: The peak number of articles were published in 2014 (83) with journals specifically focused on medicine/healthcare (265) and particularly the Journal of Evaluation in Clinical Practice (37) representing the largest number by volume. Dynamic/dynamical systems (n = 332), emergence (n = 294), complex adaptive system(s) (n = 270), and interdependent/interconnected (n = 263) were the most common terms with systems dynamic modelling (58) and agent-based modelling (43) as the most common methods. CONCLUSIONS: The review offered several important conclusions. First, while there was no core ST/CS "canon," certain terms appeared frequently across the reviewed texts. Second, even as these ideas are gaining traction in academic and practitioner communities, most are concentrated in a few journals. Finally, articles on ST/CS remain largely theoretical illustrating the need for further study and practical application. Given the challenge posed by the next phase of development, gaining a better understanding of ST/CS ideas and their use may lead to improvements in the implementation and practice of the Sustainable Development Goals.

Navigating systems ideas for health practice: Towards a common learning device.

Systems thinking and reference to complexity science have gained currency in health sector practice and research. The extent to which such ideas might represent a mere passing fad or might more usefully be mobilized to tackle wicked problems in health systems is a concern underpinning this paper. Developing the usefulness of the systems idea requires appreciating how systems ideas are used essentially as constructs conceptually bounded by practitioners. Systems are used for purposes of understanding and engaging the reality of health issues, with the intent of transforming the reality into one that is more manageable, equitable, and sustainable. We examine some manifestations of the systems idea in health practice and the traditions of systems practice that variously make use of them. This provides a platform for proposing a systems thinking in (health) practice heuristic: a learning device supporting how different tools and methods can address "wicked problems" in health praxis. The device is built on the use of "conversation" as a metaphor to help practitioners use systems ideas in tandem with existing disciplinary and professional skills and methods. We consider how the application of the heuristic requires, and helps to develop, human characteristics of humility, empathy, and recognition of fallibility.

Beyond the building blocks: integrating community roles into health systems frameworks to achieve health for all.

Achieving ambitious health goals-from the Every Woman Every Child strategy to the health targets of the sustainable development goals to the renewed promise of Alma-Ata of 'health for all'-necessitates strong, functional and inclusive health systems. Improving and sustaining community health is integral to overall health systems strengthening efforts. However, while health systems and community health are conceptually and operationally related, the guidance informing health systems policymakers and financiers-particularly the well-known WHO 'building blocks' framework-only indirectly addresses the foundational elements necessary for effective community health. Although community-inclusive and community-led strategies may be more difficult, complex, and require more widespread resources than facility-based strategies, their exclusion from health systems frameworks leads to insufficient attention to elements that need ex-ante efforts and investments to set community health effectively within systems. This paper suggests an expansion of the WHO building blocks, starting with the recognition of the essential determinants of the production of health. It presents an expanded framework that articulates the need for dedicated human resources and quality services at the community level; it places strategies for organising and mobilising social resources in communities in the context of systems for health; it situates health information as one ingredient of a larger block dedicated to information, learning and accountability; and it recognises societal partnerships as critical links to the public health sector. This framework makes explicit the oft-neglected investment needs for community health and aims to inform efforts to situate community health within national health systems and global guidance to achieve health for all.

Neglected value of small population-based surveys: a comparison with demographic and health survey data.

We believe that global health practice and evaluation operate with misleading assumptions about lack of reliability of small population-based health surveys (district level and below), leading managers and decision-makers to under-use this valuable information and programmatic tool and to rely on health information from large national surveys when neither timing nor available data meet their needs. This paper uses a unique opportunity for comparison between a knowledge, practice, and coverage (KPC) household survey and Rwanda Demographic and Health Survey (RDHS) carried out in overlapping timeframes to disprove these enduring suspicions. Our analysis shows that the KPC provides coverage estimates consistent with the RDHS estimates for the same geographic areas. We discuss cases of divergence between estimates. Application of the Lives Saved Tool to the KPC results also yields child mortality estimates comparable with DHS-measured mortality. We draw three main lessons from the study and conclude with recommendations for challenging unfounded assumptions against the value of small household coverage surveys, which can be a key resource in the arsenal of local health programmers.

A causal loop analysis of the sustainability of integrated community case management in Rwanda.

Expansion of community health services in Rwanda has come with the national scale up of integrated Community Case Management (iCCM) of malaria, pneumonia and diarrhea. We used a sustainability assessment framework as part of a large-scale project evaluation to identify factors affecting iCCM sustainability (2011). We then (2012) used causal-loop analysis to identify systems determinants of iCCM sustainability from a national systems perspective. This allows us to develop three high-probability future scenarios putting the achievements of community health at risk, and to recommend mitigating strategies. Our causal loop diagram highlights both balancing and reinforcing loops of cause and effect in the national iCCM system. Financial, political and technical scenarios carry high probability for threatening the sustainability through: (1) reduction in performance-based financing resources, (2) political shocks and erosion of political commitment for community health, and (3) insufficient progress in resolving district health systems--"building blocks"--performance gaps. In a complex health system, the consequences of choices may be delayed and hard to predict precisely. Causal loop analysis and scenario mapping make explicit complex cause-and-effects relationships and high probability risks, which need to be anticipated and mitigated.

Plausible role for CHW peer support groups in increasing care-seeking in an integrated community case management project in Rwanda: a mixed methods evaluation.

BACKGROUND: The Kabeho Mwana project (2006-2011) supported the Rwanda Ministry of Health (MOH) in scaling up integrated community case management (iCCM) of childhood illness in 6 of Rwanda's 30 districts. The project trained and equipped community health workers (CHWs) according to national guidelines. In project districts, Kabeho Mwana staff also trained CHWs to conduct household-level health promotion and established supervision and reporting mechanisms through CHW peer support groups (PSGs) and quality improvement systems. METHODS: The 2005 and 2010 Demographic and Health Surveys were re-analyzed to evaluate how project and non-project districts differed in terms of care-seeking for fever, diarrhea, and acute respiratory infection symptoms and related indicators. We developed a logit regression model, controlling for the timing of the first CHW training, with the district included as a fixed categorical effect. We also analyzed qualitative data from the final evaluation to examine factors that may have contributed to improved outcomes. RESULTS: While there was notable improvement in care-seeking across all districts, care-seeking from any provider for each of the 3 conditions, and for all 3 combined, increased significantly more in the project districts. CHWs contributed a larger percentage of consultations in project districts (27%) than in non-project districts (12%). Qualitative data suggested that the PSG model was a valuable sub-level of CHW organization associated with improved CHW performance, supervision, and social capital. CONCLUSIONS: The iCCM model implemented by Kabeho Mwana resulted in greater improvements in care-seeking than those seen in the rest of the country. Intensive monitoring, collaborative supervision, community mobilization, and CHW PSGs contributed to this success. The PSGs were a unique contribution of the project, playing a critical role in improving care-seeking in project districts. Effective implementation of iCCM should therefore include CHW management and social support mechanisms. Finally, re-analysis of national survey data improved evaluation findings by providing impact estimates.