To call or not to call: exploring the validity of telephone interviews to derive maternal self-reports of experiences with facility childbirth care in northern Nigeria.

BACKGROUND: To institutionalise respectful maternity care, frequent data on the experience of childbirth care is needed by health facility staff and managers. Telephone interviews have been proposed as a low-cost alternative to derive timely and actionable maternal self-reports of experience of care. However, evidence on the validity of telephone interviews for this purpose is limited. METHODS: Eight indicators of positive maternity care experience and 18 indicators of negative maternity care experience were investigated. We compared the responses from exit interviews with women about their childbirth care experience (reference standard) to follow-up telephone interviews with the same women 14 months after childbirth. We calculated individual-level validity metrics including, agreement, sensitivity, specificity, area under the receiver operating characteristic curve (AUC). We compared the characteristics of women included in the telephone follow-up interviews to those from the exit interviews. RESULTS: Demographic characteristics were similar between the original exit interview group (n=388) and those subsequently reached for telephone interview (n=294). Seven of the eight positive maternity care experience indicators had reported prevalence higher than 50% at both exit and telephone interviews. For these indicators, agreement between the exit and the telephone interviews ranged between 50% and 92%; seven positive indicators met the criteria for validation analysis, but all had an AUC below 0.6. Reported prevalence for 15 of the 18 negative maternity care experience indicators was lower than 5% at exit and telephone interviews. For these 15 indicators, agreement between exit and telephone interview was high at over 80%. Just three negative indicators met the criteria for validation analysis, and all had an AUC below 0.6. CONCLUSIONS: The telephone interviews conducted 14 months after childbirth did not yield results that were consistent with exit interviews conducted at the time of facility discharge. Women's reports of experience of childbirth care may be influenced by the location of reporting or changes in the recall of experiences of care over time.

Improving maternal and newborn health services in Northeast Nigeria through a government-led partnership of stakeholders: a quasi-experimental study.

OBJECTIVES: This study aimed to quantify change in the coverage, quality and equity of essential maternal and newborn healthcare interventions in Gombe state, Northeast Nigeria, following a four year, government-led, maternal and newborn health intervention. DESIGN: Quasi-experimental plausibility study. Repeat cross-sectional household and linked health facility surveys were implemented in intervention and comparison areas. SETTING: Gombe state, Northeast Nigeria. PARTICIPANTS: Each household survey included a sample of 1000 women aged 13-49 years with a live birth in the previous 12 months. Health facility surveys comprised a readiness assessment and birth attendant interview. INTERVENTIONS: Between 2016-2019 a complex package of evidence-based interventions was implemented to increase access, use and quality of maternal and newborn healthcare, spanning the six WHO health system building blocks. OUTCOME MEASURES: Eighteen indicators of maternal and newborn healthcare. RESULTS: Between 2016 and 2019, the coverage of all indicators improved in intervention areas, with the exception of postnatal and postpartum contacts, which remained below 15%. Greater improvements were observed in intervention than comparison areas for eight indicators, including coverage of at least one antenatal visit (71% (95% CI 62 to 68) to 88% (95% CI 82 to 93)), at least four antenatal visits (46% (95% CI 39 to 53) to 69% (95% CI 60 to 75)), facility birth (48% (95% CI 37 to 59) to 64% (95% CI 54 to 73)), administration of uterotonics (44% (95% CI 34 to 54) to 59% (95% CI 50 to 67)), delayed newborn bathing (44% (95% CI 36 to 52) to 62% (95% CI 52 to 71)) and clean cord care (42% (95% CI 34 to 49) to 73% (95% CI 66 to 79)). Wide-spread inequities persisted however; only at least one antenatal visit saw pro-poor improvement. CONCLUSIONS: This intervention achieved improvements in life-saving behaviours for mothers and newborns, demonstrating that multipartner action, coordinated through government leadership, can shift the needle in the right direction, even in resource-constrained settings.

Operationalising effective coverage measurement of facility based childbirth in Gombe State; a comparison of data sources.

Estimating effective coverage of childbirth care requires linking population based data sources to health facility data. For effective coverage to gain widespread adoption there is a need to focus on the feasibility of constructing these measures using data typically available to decision makers in low resource settings. We estimated effective coverage of childbirth care in Gombe State, northeast Nigeria, using two different combinations of facility data sources and examined their strengths and limitations for decision makers. Effective coverage captures information on four steps: access, facility inputs, receipt of interventions and process quality. We linked data from the 2018 Nigerian Demographic and Health Survey (NDHS) to two sources of health facility data: (1) comprehensive health facility survey data generated by a research project; and (2) District Health Information Software 2 (DHIS2). For each combination of data sources, we examined which steps were feasible to calculate, the size of the drop in coverage between steps and the resulting estimate of effective coverage. Analysis included 822 women with a recent live birth, 30% of whom attended a facility for childbirth. Effective coverage was low: 2% based on the project data and less than 1% using the DHIS2. Linking project data with NDHS, it was feasible to measure all four steps; using DHIS2 it was possible to estimate three steps: no data was available to measure process quality. The provision of high quality care is suboptimal in this high mortality setting where access and facility readiness to provide care, crucial foundations to the provision of high quality of care, have not yet been met. This study demonstrates that partial effective coverage measures can be constructed from routine data combined with nationally representative surveys. Advocacy to include process of care indicators in facility summary reports could optimise this data source for decision making.

Routine health management information system data in Ethiopia: consistency, trends, and challenges.

Background: Ethiopia is investing in the routine Health Management Information System. Improved routine data are needed for decision-making in the health sector. Objective: To analyse the quality of the routine Health Management Information System data and triangulate with other sources, such as the Demographic and Health Surveys. Methods: We analysed national Health Management Information System data on 19 indicators of maternal health, neonatal survival, immunization, child nutrition, malaria, and tuberculosis over the 2012-2018 time period. The analyses were conducted by 38 analysts from the Ministry of Health, Ethiopia, and two government agencies who participated in the Operational Research and Coaching for Analysts (ORCA) project between June 2018 and June 2020. Using a World Health Organization Data Quality Review toolkit, we assessed indicator definitions, completeness, internal consistency over time and between related indicators, and external consistency compared with other data sources. Results: Several services reported coverage of above 100%. For many indicators, denominators were based on poor-quality population data estimates. Data on individual vaccinations had relatively good internal consistency. In contrast, there was low external consistency for data on fully vaccinated children, with the routine Health Management Information System showing 89% coverage but the Demographic and Health Survey estimate at 39%. Maternal health indicators displayed increasing coverage over time. Indicators on child nutrition, malaria, and tuberculosis were less consistent. Data on neonatal mortality were incomplete and operationalised as mortality on day 0-6. Our comparisons with survey and population projections indicated that one in eight early neonatal deaths were reported in the routine Health Management Information System. Data quality varied between regions. Conclusions: The quality of routine data gathered in the health system needs further attention. We suggest regular triangulation with data from other sources. We recommend addressing the denominator issues, reducing the complexity of indicators, and aligning indicators to international definitions.

Improving the quality of routine maternal and newborn data captured in primary health facilities in Gombe State, Northeastern Nigeria: a before-and-after study.

OBJECTIVES: Primary objective: to assess nine data quality metrics for 14 maternal and newborn health data elements, following implementation of an integrated, district-focused data quality intervention. SECONDARY OBJECTIVE: to consider whether assessing the data quality metrics beyond completeness and accuracy of facility reporting offered new insight into reviewing routine data quality. DESIGN: Before-and-after study design. SETTING: Primary health facilities in Gombe State, Northeastern Nigeria. PARTICIPANTS: Monitoring and evaluation officers and maternal, newborn and child health coordinators for state-level and all 11 local government areas (district-equivalent) overseeing 492 primary care facilities offering maternal and newborn care services. INTERVENTION: Between April 2017 and December 2018, we implemented an integrated data quality intervention which included: introduction of job aids and regular self-assessment of data quality, peer-review and feedback, learning workshops, work planning for improvement, and ongoing support through social media. OUTCOME MEASURES: 9 metrics for the data quality dimensions of completeness and timeliness, internal consistency of reported data, and external consistency. RESULTS: The data quality intervention was associated with improvements in seven of nine data quality metrics assessed including availability and timeliness of reporting, completeness of data elements, accuracy of facility reporting, consistency between related data elements, and frequency of outliers reported. Improvement differed by data element type, with content of care and commodity-related data improving more than contact-related data. Increases in the consistency between related data elements demonstrated improved internal consistency within and across facility documentation. CONCLUSIONS: An integrated district-focused data quality intervention-including regular self-assessment of data quality, peer-review and feedback, learning workshops, work planning for improvement, and ongoing support through social media-can increase the completeness, accuracy and internal consistency of facility-based routine data.

Monitoring childbirth care in primary health facilities: a validity study in Gombe State, northeastern Nigeria.

BACKGROUND: Improving the quality of facility-based births is a critical strategy for reducing the high burden of maternal and neonatal mortality and morbidity across all settings. Accurate data on childbirth care is essential for monitoring progress. In northeastern Nigeria, we assessed the validity of childbirth care indicators in a rural primary health care context, as documented by health workers and reported by women at different recall periods. METHODS: We compared birth observations (gold standard) to: (i) facility exit interviews with observed women; (ii) household follow-up interviews 9-22 months after childbirth; and (iii) health worker documentation in the maternity register. We calculated sensitivity, specificity, and area under the receiver operating curve (AUC) to determine individual-level reporting accuracy. We calculated the inflation factor (IF) to determine population-level validity. RESULTS: Twenty-five childbirth care indicators were assessed to validate health worker documentation and women's self-reports. During exit interviews, women's recall had high validity (AUC≥0.70 and 0.75

Quality of routine facility data for monitoring priority maternal and newborn indicators in DHIS2: A case study from Gombe State, Nigeria.

INTRODUCTION: Routine health information systems are critical for monitoring service delivery. District Heath Information System, version 2 (DHIS2) is an open source software platform used in more than 60 countries, on which global initiatives increasingly rely for such monitoring. We used facility-reported data in DHIS2 for Gombe State, north-eastern Nigeria, to present a case study of data quality to monitor priority maternal and neonatal health indicators. METHODS: For all health facilities in DHIS2 offering antenatal and postnatal care services (n = 497) and labor and delivery services (n = 486), we assessed the quality of data for July 2016-June 2017 according to the World Health Organization data quality review guidance. Using data from DHIS2 as well as external facility-level and population-level household surveys, we reviewed three data quality dimensions-completeness and timeliness, internal consistency, and external consistency-and considered the opportunities for improvement. RESULTS: Of 14 priority maternal and neonatal health indicators that could be tracked through facility-based data, 12 were included in Gombe's DHIS2. During July 2016-June 2017, facility-reported data in DHIS2 were incomplete at least 40% of the time, under-reported 10%-60% of the events documented in facility registers, and showed inconsistencies over time, between related indicators, and with an external data source. The best quality data elements were those that aligned with Gombe's health program priorities, particularly older health programs, and those that reflected contact indicators rather than indicators related to the provision of commodities or content of care. CONCLUSION: This case study from Gombe State, Nigeria, demonstrates the high potential for effective monitoring of maternal and neonatal health using DHIS2. However, coordinated action at multiple levels of the health system is needed to maximize reporting of existing data; rationalize data flow; routinize data quality review, feedback, and supervision; and ensure ongoing maintenance of DHIS2.

Seasonal malaria chemoprevention packaged with malnutrition prevention in northern Nigeria: A pragmatic trial (SMAMP study) with nested case-control.

Integrating seasonal malaria chemoprevention (SMC), recommended by the WHO since 2012 to prevent malaria infection, with nutrition interventions may improve health outcomes and operational efficiencies. This study assessed the effects of co-packaging interventions on distribution coverage, nutrition, and clinical malaria outcomes in northern Nigeria. From August to November 2014, community volunteers delivered sulfadoxine-pyrimethamine and amodiaquine (SP-AQ) door-to-door each month to approximately 7,000 children aged 6-24 months in seven wards of Madobi, Kano State, Nigeria. In three of the wards children additionally received a lipid-based nutrient supplement (LNS-medium quantity), Plumpy Doz. Coverage, adherence, and anthropometric outcomes were assessed through baseline, midline, and endline household surveys. A facility-based case-control study was also conducted to estimate impact on clinical malaria outcomes. Coverage of SP-AQ was similar between arms at 89% (n = 2,409 child-months [88-90%]) in the SP-AQ only arm and 90% (n = 1,947 child-months [88-92%]) in the SP-AQ plus LNS arm (p = 0.52). Coverage of LNS was 83% (n = 2,409 child-months [81-84%]). Whilst there were marked changes in anthropometric status between baseline, midline and endline, these were largely accounted for by socioeconomic status and must be interpreted with care due to possible measurement issues, especially length-based indices. Overall nutritional status of our most robust measure, weight-for-age, does appear to have improved by endline, but was similar in the two study arms, suggesting no additional benefit of the LNS. While the odds of clinical malaria among those who received the intended intervention were lower in each study arm compared to children who did not receive interventions (SP-AQ only OR = 0.23 [0.09-0.6]; SP-AQ plus LNS OR = 0.22 [0.09-0.55]), LNS was not shown to have an additional impact. Coverage of SMC was high regardless of integrating LNS delivery into the SMC campaign. Supplementation with LNS did not appear to impact nutritional outcomes, but appeared to enhance the impact of SP-AQ on clinical odds of malaria. These results indicate that combining nutritional interventions with seasonal malaria chemoprevention in high-risk areas can be done successfully, warranting further exploration with other products or dosing. Trial Registration: ISRCTN 11413895.

Effects of a participatory community quality improvement strategy on improving household and provider health care behaviors and practices: a propensity score analysis.

BACKGROUND: Maternal and newborn health care intervention coverage has increased in many low-income countries over the last decade, yet poor quality of care remains a challenge, limiting health gains. The World Health Organization envisions community engagement as a critical component of health care delivery systems to ensure quality services, responsive to community needs. Aligned with this, a Participatory Community Quality Improvement (PCQI) strategy was introduced in Ethiopia, in 14 of 91 rural woredas (districts) where the Last Ten Kilometers Project (L10 K) Platform activities were supporting national Basic Emergency Obstetric and Newborn Care (BEmONC) strengthening strategies. This paper examines the effects of the PCQI strategy in improving maternal and newborn care behaviors, and providers' and households' practices. METHODS: PCQI engages communities in identifying barriers to access and quality of services, and developing, implementing and monitoring solutions. Thirty-four intervention kebeles (communities), which included the L10 K Platform, BEmONC, and PCQI, and 82 comparison kebeles, which included the L10 K Platform and BEmONC, were visited in December 2010-January 2011 and again 48 months later. Twelve women with children aged 0 to 11 months were interviewed in each kebele. Propensity score matching was used to estimate the program's average treatment effects (ATEs) on women's care seeking behavior, providers' service provision behavior and households' newborn care practices. RESULTS: The ATEs of PCQI were statistically significant (p < 0.05) for two care seeking behaviors - four or more antenatal care (ANC) visits and institutional deliveries at 14% (95% CI: 6, 21) and 11% (95% CI: 4, 17), respectively - and one service provision behavior - complete ANC at 17% (95% CI: 11, 24). We found no evidence of an effect on remaining outcomes relating to household newborn care practices, and postnatal care performed by the provider. CONCLUSIONS: National BEmONC strengthening and government initiatives to improve access and quality of maternal and newborn health services, together with L10 K Platform activities, appeared to work better for some care practices where communities were engaged in the PCQI strategy. Additional research with more robust measure of impact and cost-effectiveness analysis would be useful to establish effectiveness for a wider set of outcomes.

Does provision of point-of-care CD4 technology and early knowledge of CD4 levels affect early initiation and retention on antiretroviral treatment in HIV-positive pregnant women in the context of Option B+ for PMTCT?

Evidence for Elimination (E4E) is a collaborative project established in 2012 as part of the INSPIRE (INtegrating and Scaling up PMTCT through Implementation REsearch) initiative. E4E is a cluster-randomized trial with 2 arms; Standard of care and "POC Plus" [in which point-of-care (POC) CD4 devices and related counseling support are provided]; aimed at improving retention-in-care of HIV-infected pregnant women and mothers. In November 2013, Zimbabwe adopted Option B+ for HIV-positive pregnant women under which antiretroviral treatment eligibility is no longer based on CD4 count. However, Ministry of Health and Child Care guidelines still require baseline and 6-monthly CD4 testing for treatment monitoring, until viral load testing becomes widely available. Considering the current limited capacity for viral-load testing, the significant investments in CD4 testing already made and the historical reliance on CD4 by health care workers for determining eligibility for antiretroviral treatment, E4E seeks to compare the impact of the provision of POC CD4 technology and early knowledge of CD4 levels on retention-in-care at 12 months, with the current standard of routine, laboratory-based CD4 testing. The study also compares rates of initiation and time-to-initiation between the 2 arms and according to level of maternal CD4 count, the cost of retaining HIV-positive pregnant women in care and the acceptability and feasibility of POC CD4 in the context of Option B+. Outcome measures are derived from routine health systems data. E4E will provide data on POC CD4 testing and retention-in-care associated with Option B+ and serve as an early learning platform to inform implementation of Option B+ in Zimbabwe.