Impacts of performance-based financing on health system performance: evidence from the Democratic Republic of Congo.

BACKGROUND: Health systems' weakness remains one of the primary obstacles towards achieving universal access to quality healthcare in low-income settings. Performance-based financing (PBF) programs have been increasingly used to increase access to quality care in LMICs. However, evidence on the impacts of these programs remains fragmented and inconclusive. We analyze the health system impacts of the PBF program in the Democratic Republic of the Congo (DRC), one of the largest such programs introduced in LMICs to date. METHODS: We used a health systems perspective to analyze the benefits of PBF relative to unconditional financing of health facilities. Fifty-eight health zones in six provinces were randomly assigned to either a control group (28 zones) in which facilities received unconditional transfers or to a PBF program (30 zones) that started at the end of 2016. Follow-up data collection took place in 2021-2022 and included health facility assessments, health worker interviews, direct observations of consultations and deliveries, patient exit interviews, and household surveys. Using multivariate regression models, we estimated the impact of the program on 55 outcomes in seven health system domains: structural quality, technical process quality, non-technical process quality, service fees, facility management, providers' satisfaction, and service coverage. We used random-effects meta-analysis to generate pooled average estimates within each domain. RESULTS: The PBF program improved the structural quality of health facilities by 4 percentage points (ppts) (95% CI 0.01-0.08), technical process quality by 5 ppts (0.03-0.07), and non-technical process by 2 ppts (0-0.04). PBF also increased coverage of priority health services by 3 ppts (0.02-0.04). Improvements were also observed for facility management (9 ppts, 0.04-0.15), service fee policies, and users' satisfaction with service affordability (14 ppts, 0.07-0.20). Service fees and health workers' satisfaction were not affected by the program. CONCLUSIONS: The results suggest that well-designed PBF programs can lead to improvements in most health systems domains relative to comparable unconditional financing. However, the large persisting gaps suggest that additional changes, such as allocating more resources to the health system and reforming the human resources for health management, will be necessary in DRC to achieve the ambitious global universal health coverage and mortality goals. TRIAL REGISTRATION: American Economics Association Trial registry AEARCTR-0002880.

Financially incentivized knowledge assessments to improve provider compliance with treatment guidelines: a cluster-randomized controlled trial.

BACKGROUND: Despite increasing access to health care, under-5 mortality remains high in many parts of Sub-Saharan Africa. Interventions to improve quality of care have mostly focused on additional training for medical staff, but generally shown little impact. We will assess the impact of financially incentivized quarterly provider knowledge assessment on compliance with Integrated Management of Childhood Illness (IMCI) protocols in Congo, DRC. METHODS: Out of a total of 1738 facilities currently receiving results-based financing under an ongoing health financing program, 110 facilities were chosen for this study. All health care workers providing outpatient services to children under age 5 in these facilities will be included in the study. Facilities were randomized with equal probability to control and treatment. Treatment facilities will receive quarterly medical staff knowledge assessments using interactive vignettes. Performance on these vignettes will be rewarded through financial bonus payments to facilities. A baseline survey of health worker knowledge was conducted in 2018. An endline assessment is scheduled to start in the second half of 2021. The primary outcome of interest is health worker compliance with Integrated Management of Childhood Illness (IMCI) guidelines. Compliance will be verified through direct observation of medical staff-patient interactions. DISCUSSION: This is to our knowledge the first trial assessing whether linking health financing to health care worker performance on knowledge assessments can increase compliance with under-5 case management protocols. TRIAL REGISTRATION: ClinicalTrials.gov NCT04634019 . Registered on November 18, 2020.

Decentralized facility financing versus performance-based payments in primary health care: a large-scale randomized controlled trial in Nigeria.

BACKGROUND: Health system financing presents a challenge in many developing countries. We assessed two reform packages, performance-based financing (PBF) and direct facility financing (DFF), against each other and business-as-usual for maternal and child healthcare (MCH) provision in Nigeria. METHODS: We sampled 571 facilities (269 in PBF; 302 in DFF) in 52 districts randomly assigned to PBF or DFF, and 215 facilities in 25 observable-matched control districts. PBF facilities received $2 ($1 for operating grants plus $1 for bonuses) for every $1 received by DFF facilities (operating grants alone). Both received autonomy, supervision, and enhanced community engagement, isolating the impact of additional performance-linked facility and health worker payments. Facilities and households with recent pregnancies in facility catchments were surveyed at baseline (2014) and endline (2017). Outcomes were Penta3 immunization, institutional deliveries, modern contraceptive prevalence rate (mCPR), four-plus antenatal care (ANC) visits, insecticide-treated mosquito net (ITN) use by under-fives, and directly observed quality of care (QOC). We estimated difference-in-differences with state fixed effects and clustered standard errors. RESULTS: PBF increased institutional deliveries by 10% points over DFF and 7% over business-as-usual (p<0.01). PBF and DFF were more effective than business-as-usual for Penta3 (p<0.05 and p<0.01, respectively); PBF also for mCPR (p<0.05). Twenty-one of 26 QOC indicators improved in both PBF and DFF relative to business-as-usual (p<0.05). However, except for deliveries, PBF was as or less effective than DFF: Penta3 immunization and ITN use were each 6% less than DFF (p<0.1 for both) and QOC gains were also comparable. Utilization gains come from the middle of the rural wealth distribution (p<0.05). CONCLUSIONS: Our findings show that both PBF and DFF represent significant improvements over business-as-usual for service provision and quality of care. However, except for institutional delivery, PBF and DFF do not differ from each other despite PBF disbursing $2 for every dollar disbursed by DFF. These findings highlight the importance of direct facility financing and decentralization in improving PHC and suggest potential complementarities between the two approaches in strengthening MCH service delivery. TRIAL REGISTRATION: ClinicalTrials.gov NCT03890653 ; May 8, 2017. Retrospectively registered.

A nationwide program to improve clinical care quality in the Kyrgyz Republic.

BACKGROUND: To assess baseline quality of care in the Kyrgyz Republic in 2019 and determine the effect of online simulated patients in changing doctors' practice in three specific disease areas: non-communicable disease, neonatal/child health, and maternal health. METHODS: Over 2000 family health, pediatric, neonatology, therapy, and obstetric-gynecologic doctors from every rayon (district) hospital and at least one associated family health (Primary) care clinic participated. To adequately scale the project, the Ministry of Health used online simulated Clinical Performance and Value (CPV) vignettes. All doctors cared for the same set of patients in their clinical area. Over eight months in 2019, we gathered three rounds of CPV data in seven oblasts. RESULTS: Overall quality scores were highly variable at baseline (59.2% + 13.5%). After three rounds the average score increased 6.5% (P < 0.001). By the end of round three, the lowest scoring oblast was providing higher quality care compared to the highest scoring oblast in the initial round (64.2% in round 3 vs 62.4% in round 1), indicating greater adherence to the evidence base. Additionally, family health doctors ordered 26% fewer unnecessary tests (P < 0.05), while specialists ordered 39% fewer unnecessary tests (P < 0.05). If trends continue, this translates into a net annual savings of 63 million Kyrgyz som. CONCLUSIONS: This study demonstrates serial measurement of care provided by over 2000 physicians in the Kyrgyz Republic can be improved as measured by CPVs. This project may be a useful template to improve health care quality at a national level in other low- and middle-income country settings.

Quality of care for children with severe disease in the Democratic Republic of the Congo.

BACKGROUND: Despite the almost universal adoption of Integrated Management of Childhood Illness (IMCI) guidelines for the diagnosis and treatment of sick children under the age of five in low- and middle-income countries, child mortality remains high in many settings. One possible explanation of the continued high mortality burden is lack of compliance with diagnostic and treatment protocols. We test this hypothesis in a sample of children with severe illness in the Democratic Republic of the Congo (DRC). METHODS: One thousand one hundred eighty under-five clinical visits were observed across a regionally representative sample of 321 facilities in the DRC. Based on a detailed list of disease symptoms observed, patients with severe febrile disease (including malaria), severe pneumonia, and severe dehydration were identified. For all three disease categories, treatments were then compared to recommended case management following IMCI guidelines. RESULTS: Out of 1180 under-five consultations observed, 332 patients (28%) had signs of severe febrile disease, 189 patients (16%) had signs of severe pneumonia, and 19 patients (2%) had signs of severe dehydration. Overall, providers gave the IMCI-recommended treatment in 42% of cases of these three severe diseases. Less than 15% of children with severe disease were recommended to receive in-patient care either in the facility they visited or in a higher-level facility. CONCLUSIONS: These results suggest that adherence to IMCI protocols for severe disease remains remarkably low in the DRC. There is a critical need to identify and implement effective approaches for improving the quality of care for severely ill children in settings with high child mortality.

Methods to improve quality performance at scale in lower- and middle-income countries.

Universal Health Coverage is one of the Sustainable Development Goal targets. But coverage without quality health services limits benefits to populations. Performance-based financing programs (PBF) use strategic purchasing of services to expand coverage and promote quality by measuring quality and rewarding good performance. The widespread presence of PBF programs in lower and middle-income countries provide an opportunity to introduce and test new approaches for measuring and improving quality at scale. This article describes four approaches to improve quality of health services at scale in PBF programs. These approaches looked at structural and process measures of quality as well as outcome measures like patient satisfaction. Three types of tools were used in these approaches: clinical vignettes, competency tests and patient satisfaction surveys. Specific tools within each of the approaches are used in Kyrgyzstan, Cambodia, Democratic Republic of Congo and the Republic of Congo.

Performance-based financing as a health system reform: mapping the key dimensions for monitoring and evaluation.

BACKGROUND: Performance-based financing is increasingly being applied in a variety of contexts, with the expectation that it can improve the performance of health systems. However, while there is a growing literature on implementation issues and effects on outputs, there has been relatively little focus on interactions between PBF and health systems and how these should be studied. This paper aims to contribute to filling that gap by developing a framework for assessing the interactions between PBF and health systems, focusing on low and middle income countries. In doing so, it elaborates a general framework for monitoring and evaluating health system reforms in general. METHODS: This paper is based on an exploratory literature review and on the work of a group of academics and PBF practitioners. The group developed ideas for the monitoring and evaluation framework through exchange of emails and working documents. Ideas were further refined through discussion at the Health Systems Research symposium in Beijing in October 2012, through comments from members of the online PBF Community of Practice and Beijing participants, and through discussion with PBF experts in Bergen in June 2013. RESULTS: The paper starts with a discussion of definitions, to clarify the core concept of PBF and how the different terms are used. It then develops a framework for monitoring its interactions with the health system, structured around five domains of context, the development process, design, implementation and effects. Some of the key questions for monitoring and evaluation are highlighted, and a systematic approach to monitoring effects proposed, structured according to the health system pillars, but also according to inputs, processes and outputs. CONCLUSIONS: The paper lays out a broad framework within which indicators can be prioritised for monitoring and evaluation of PBF or other health system reforms. It highlights the dynamic linkages between the domains and the different pillars. All of these are also framed within inter-sectoral and wider societal contexts. It highlights the importance of differentiating short term and long term effects, and also effects (intended and unintended) at different levels of the health system, and for different sectors and areas of the country. Outstanding work will include using and refining the framework and agreeing on the most important hypotheses to test using it, in relation to PBF but also other purchasing and provider payment reforms, as well as appropriate research methods to use for this task.