From effectiveness to sustainability: understanding the impact of CARE's Community Score Card© social accountability approach in Ntcheu, Malawi.

We evaluated the sustainability of CARE's Community Score Card© (CSC) social accountability approach in Ntcheu, Malawi, approximately 2.5 years after the end of formal intervention activities. Using a cross-sectional, exploratory design, we conducted 41 focus groups with members of Community Health Advisory Groups (CHAGs) and youth groups and 19 semi-structured interviews with local and district government officials, project staff, and national stakeholders to understand how and in what form CSC activities are continuing. Focus groups and interviews were audio-recorded, transcribed and translated into English. Thematic coding was done using Dedoose software. Most groups were continuing to meet and implement the CSC, although some made modifications. CHAGs, youth and local government officials all attributed their continued implementation to the value that they saw in the process that allows marginalized groups within the community, including women and youth, a safe space for sharing their ideas and issues and the initial results this generated. However, lack of access to resources for implementation and challenges in convening and facilitating the interface meeting phase created barriers to continued sustainability. The CSC is sustainable by communities 2.5 years after the end of formal intervention activities. For future interventions, health systems and non-governmental organizations should plan for a transition phase with periodic refresher trainings and a small fund to support implementation, such as refreshments and transportation, to increase the likelihood of community-driven sustainability.

Evaluating Young People's Ability to Sustain an Evidence-Based Social Accountability Approach to Improve Adolescent Sexual and Reproductive Health in Ntcheu, Malawi.

The Community Score Card© (CSC), a social accountability approach, brings together community members, service providers, and local government officials to identify issues, prioritize, and plan actions to improve local health services. In addition, young people in Ntcheu, Malawi have been using the CSC approach to mobilize their communities to bring change across varying issues of importance to them. An earlier cluster randomized trial in Ntcheu showed the CSC effectively increased reproductive health behaviors, improved satisfaction with services, and enhanced the coverage and quality of services. Building upon this evidence of effectiveness, this study aims to evaluate if and how young people were able to sustain implementation of the CSC, and the improvements it brings, approximately 2.5 years after the randomized trial ended. As part of a larger evaluation of CSC sustainability in Ntcheu, we conducted 8 focus groups across 5 health catchment areas with 109 members of mixed-gender youth groups (58 females and 51 males, ages 14-29 years) who continued to engage with the CSC. Audio recordings were transcribed, translated into English, and coded in Dedoose using an a priori codebook augmented with emergent codes and a constant comparative approach. Although the 8 youth groups were still actively using the CSC, they had made some adaptations. While the CSC in Ntcheu initially focused on maternal health, young people adopted the approach for broader sexual and reproductive topics important to them such as child marriages and girls' education. To enable sustainability, young people trained each other in the CSC process; they also requested more formal facilitation training. Young people from Ntcheu recommended nationwide scale-up of the CSC. Young people organically adopted the CSC, which enabled them to highlight issues within their communities that were a priority to them. This diffusion among young people enabled them to elevate their voice and facilitate a process where they hold local government officials, village leaders, and services providers accountable for actions and the quality of healthcare services. Young people organized and sustained the CSC as a social accountability approach to improve adolescent sexual and reproductive health in their communities more than 2.5 years after the initial effectiveness trial ended.

Bringing women's voices to PMTCT CARE: adapting CARE's Community Score Card© to engage women living with HIV to build quality health systems in Malawi.

BACKGROUND: Coverage of prevention of mother-to-child transmission of HIV (PMTCT) services has expanded rapidly but approaches to ensure service delivery is patient-centered have not always kept pace. To better understand how the inclusion of women living with HIV in a collective, quality improvement process could address persistent gaps, we adapted a social accountability approach, CARE's Community Score Card© (CSC), to the PMTCT context. The CSC process generates perception-based score cards and facilitates regular quality improvement dialogues between service users and service providers. METHODS: Fifteen indicators were generated by PMTCT service users and providers as part of the CSC process. These indicators were scored by each population during three sequential cycles of the CSC process which culminates in a sharing of scores in a collective meeting followed by action planning. We aggregated these scores across facilities and analyzed the differences in first and last scorings to understand perceived improvements over the course of the project (z-test comparing the significance of two proportions; one-tailed p-value ≤ .05). Data were collected over 12 months from September 2017 to August 2018. RESULTS: Fourteen of the fifteen indicators improved over the course of this project, with eight showing statistically significant improvement. Out of the indicators that showed statistically significant improvement, the majority fell within the control of local communities, local health facilities, or service providers (7 out of 8) and were related to patient or user experience and support from families and community members (6 out of 8). From first to last cycle, scores from service users' and service providers' perspectives converged. At the first scoring cycle, four indicators exhibited statistically significant differences (p-value ≤ .05) between service users and service providers. At the final cycle there were no statistically significant differences between the scores of these two groups. CONCLUSIONS: By creating an opportunity for mothers living with HIV, health service providers, communities, and local government officials to jointly identify issues and implement solutions, the CSC contributed to improvements in the perceived quality of PMTCT services. The success of this model highlights the feasibility and importance of involving people living with HIV in quality improvement and assurance efforts. TRIAL REGISTRATION: Trial registration: ClincalTrials.gov NCT04372667 retrospectively registered on May 1st 2020.

Effects of the Community Score Card approach on reproductive health service-related outcomes in Malawi.

BACKGROUND: Social accountability approaches are increasingly being employed in low-resource settings to improve government services. In line with the continuous quality improvement (CQI) philosophy that quality is the product of a linked chain, collaborative social accountability approaches like the Community Score Card (CSC) aim to empower clients and frontline service providers to transform their own lives and hold public officials to account for state obligations. Despite being a critical focus of collaborative social accountability approaches, to our knowledge, a quantitative survey of health workers to understand the impact of these approaches on their self-reported responsibilities and service provision has not been conducted. To fill this gap, we carried out a quantitative survey with health workers to assess the CSC's impact on health worker-reported service responsibilities and provision and complement women's self-reports. METHODS: We evaluated the effect of the CSC on reproductive health-related outcomes using a cluster-randomized design in Ntcheu district, Malawi. We matched 10 pairs of health facilities and surrounding catchment communities; one from each pair was randomly assigned to the intervention and control arms. The intervention communities and health workers each completed 3-4 cycles of the CSC process by endline. We then surveyed all health workers in the 20 intervention and comparison sites at endline (n = 412) to estimate the intervention's impact. RESULTS: Significantly (p < .05) more health workers in the CSC intervention areas compared to control areas reported responsibility for antenatal care, comprehensive antenatal care counseling, recording of the number of pregnant and postpartum women seen each month, and the average age of their last family planning client was younger. In addition, marginally significantly (p < .10) more health workers in treatment versus control areas report visiting women at their home at least once during their pregnancy. However, health worker-reported responsibility for HIV testing was significantly lower in intervention areas than in control. CONCLUSIONS: The CSC aims to empower health workers to collaborate with the community and rest of the health system to identify and overcome the diverse and context-specific range of performance barriers they face. In doing so, it aims to support them to demand and ensure quality care for themselves from the health system so they can, in turn, deliver quality services to clients. Our results contribute to the evidence that the CSC may hold promise at improving service provision. While there is increasing evidence that collaborative social accountability approaches like the CSC are effective means to improving reproductive health-related service provision and outcomes in low-resource settings, additional research is needed.

Creating spaces for dialogue: a cluster-randomized evaluation of CARE's Community Score Card on health governance outcomes.

BACKGROUND: Social accountability interventions such as CARE's Community Score Card© show promise for improving sexual, reproductive, and maternal health outcomes. A key component of the intervention is creation of spaces where community members, healthcare workers, and district officials can safely interact and collaborate to improve health-related outcomes. Here, we evaluate the intervention's effect on governance constructs such as power sharing and equity that are central to our theory of change. METHODS: We randomly assigned ten matched pairs of communities to intervention and control arms, administering endline surveys to women in each arm who had given birth in the last 12 months. Forty-six governance items were reduced by factor analysis into eight underlying scales. We evaluated the intervention's impact on these constructs using local average treatment effect estimates. RESULTS: Among intervention-area women who reported a community meeting, we further evaluated the influence of the governance constructs on health-related outcomes: home visit from a community health worker, modern family planning, and satisfaction with health services. A significantly greater proportion of intervention-area women compared to control reported the existence of community groups that provide and facilitate negotiated space between community members and healthcare workers (p = .003). Several governance constructs were positively associated with the health-related outcomes. Further, active participation in the intervention was also positively associated with several governance constructs. CONCLUSIONS: CARE's Community Score Card© facilitated the creation and claiming of effective and inclusive negotiated spaces in which community members and healthcare workers could vocalize service delivery issues and prioritize actions for improvement. We argue that reliable measurement of governance concepts such as power sharing, equity and quality of negotiated space, collective efficacy, and mutual responsibility will enhance our ability to evaluate social accountability interventions and understand the processes by which they affect change.

Is quality of care a key predictor of perinatal health care utilization and patient satisfaction in Malawi?

BACKGROUND: The Malawi government encourages early antenatal care, delivery in health facilities, and timely postnatal care. Efforts to sustain or increase current levels of perinatal service utilization may not achieve desired gains if the quality of care provided is neglected. This study examined predictors of perinatal service utilization and patients' satisfaction with these services with a focus on quality of care. METHODS: We used baseline, two-stage cluster sampling household survey data collected between November and December, 2012 before implementation of CARE's Community Score Card© intervention in Ntcheu district, Malawi. Women with a birth during the last year (N = 1301) were asked about seeking: 1) family planning, 2) antenatal, 3) delivery, and 4) postnatal care; the quality of care received; and their overall satisfaction with the care received. Specific quality of care items were assessed for each type of service, and up to five such items per type of service were used in analyses. Separate logistic regression models were fitted to examine predictors of family planning, antenatal, delivery, and postnatal service utilization and of complete satisfaction with each of these services; all models were adjusted for women's socio-demographic characteristics, perceptions of the closest facility to their homes, service use indicators, and quality of care items. RESULTS: We found higher levels of perinatal service use than previously documented in Malawi (baseline antenatal care 99.4%; skilled birth attendance 97.3%; postnatal care 77.5%; current family planning use 52.8%). Almost 73% of quality of perinatal care items assessed were favorably reported by > 90% of women. Women reported high overall satisfaction (≥85%) with all types of services examined, higher for antenatal and postnatal care than for family planning and delivery care. We found significant associations between perceived and actual quality of care and both women's use and satisfaction with the perinatal health services received. CONCLUSIONS: Quality of care is a key predictor of perinatal health service utilization and complete patient satisfaction with such services in Malawi. The current heightened attention toward perinatal health services and outcomes should be coupled with efforts to improve the actual quality of care offered to women in this country.

Effects of a social accountability approach, CARE's Community Score Card, on reproductive health-related outcomes in Malawi: A cluster-randomized controlled evaluation.

BACKGROUND: Social accountability approaches, which emphasize mutual responsibility and accountability by community members, health care workers, and local health officials for improving health outcomes in the community, are increasingly being employed in low-resource settings. We evaluated the effects of a social accountability approach, CARE's Community Score Card (CSC), on reproductive health outcomes in Ntcheu district, Malawi using a cluster-randomized control design. METHODS: We matched 10 pairs of communities, randomly assigning one from each pair to intervention and control arms. We conducted two independent cross-sectional surveys of women who had given birth in the last 12 months, at baseline and at two years post-baseline. Using difference-in-difference (DiD) and local average treatment effect (LATE) estimates, we evaluated the effects on outcomes including modern contraceptive use, antenatal and postnatal care service utilization, and service satisfaction. We also evaluated changes in indicators developed by community members and service providers in the intervention areas. RESULTS: DiD analyses showed significantly greater improvements in the proportion of women receiving a home visit during pregnancy (B = 0.20, P < .01), receiving a postnatal visit (B = 0.06, P = .01), and overall service satisfaction (B = 0.16, P < .001) in intervention compared to control areas. LATE analyses estimated significant effects of the CSC intervention on home visits by health workers (114% higher in intervention compared to control) (B = 1.14, P < .001) and current use of modern contraceptives (57% higher) (B = 0.57, P < .01). All 13 community- and provider-developed indicators improved, with 6 of them showing significant improvements. CONCLUSIONS: By facilitating the relationship between community members, health service providers, and local government officials, the CSC contributed to important improvements in reproductive health-related outcomes. Further, the CSC builds mutual accountability, and ensures that solutions to problems are locally-relevant, locally-supported and feasible to implement.