Exploring data quality and use of the routine health information system in Ethiopia: a mixed-methods study.

OBJECTIVE: A routine health information system (RHIS) enables decision making in the healthcare system. We aimed to analyse data quality at the district and regional level and explore factors and perceptions affecting the quality and use of routine data. DESIGN: This was a mixed-methods study. We used the WHO toolkit for analysing data quality and interviewed staff at the point of data generation and along with the flow of data. Data were analysed using the Performance of Routine Information System Management framework. SETTING: This study was performed in eight districts in four regions of Ethiopia. The study was nested within a 2-year programme of the Operational Research and Coaching for government Analysts. PARTICIPANTS: We visited 45 health posts, 1 district hospital, 16 health centres and 8 district offices for analysis of routine RHIS data and interviewed 117 staff members for the qualitative assessment. OUTCOME MEASURES: We assessed availability of source documents, completeness, timeliness and accuracy of reporting of routine data, and explored data quality and use perceptions. RESULTS: There was variable quality of both indicator and data element. Data on maternal health and immunisation were of higher quality than data on child nutrition. Issues ranged from simple organisational factors, such as availability of register books, to intricate technical issues, like complexity of indicators and choice of denominators based on population estimates. Respondents showed knowledge of the reporting procedures, but also demonstrated limited skills, lack of supportive supervision and reporting to please the next level. We saw limited examples of the use of data by the staff who were responsible for data reporting. CONCLUSION: We identified important organisational, technical, behavioural and process factors that need further attention to improve the quality and use of RHIS data in Ethiopia.

Routine health management information system data in Ethiopia: consistency, trends, and challenges.

Background: Ethiopia is investing in the routine Health Management Information System. Improved routine data are needed for decision-making in the health sector. Objective: To analyse the quality of the routine Health Management Information System data and triangulate with other sources, such as the Demographic and Health Surveys. Methods: We analysed national Health Management Information System data on 19 indicators of maternal health, neonatal survival, immunization, child nutrition, malaria, and tuberculosis over the 2012-2018 time period. The analyses were conducted by 38 analysts from the Ministry of Health, Ethiopia, and two government agencies who participated in the Operational Research and Coaching for Analysts (ORCA) project between June 2018 and June 2020. Using a World Health Organization Data Quality Review toolkit, we assessed indicator definitions, completeness, internal consistency over time and between related indicators, and external consistency compared with other data sources. Results: Several services reported coverage of above 100%. For many indicators, denominators were based on poor-quality population data estimates. Data on individual vaccinations had relatively good internal consistency. In contrast, there was low external consistency for data on fully vaccinated children, with the routine Health Management Information System showing 89% coverage but the Demographic and Health Survey estimate at 39%. Maternal health indicators displayed increasing coverage over time. Indicators on child nutrition, malaria, and tuberculosis were less consistent. Data on neonatal mortality were incomplete and operationalised as mortality on day 0-6. Our comparisons with survey and population projections indicated that one in eight early neonatal deaths were reported in the routine Health Management Information System. Data quality varied between regions. Conclusions: The quality of routine data gathered in the health system needs further attention. We suggest regular triangulation with data from other sources. We recommend addressing the denominator issues, reducing the complexity of indicators, and aligning indicators to international definitions.

The State of Health Technology Assessment in the Ethiopian Health Sector: Learning from Recent Policy Initiatives.

Health technology assessment (HTA) has previously been implemented only in a fragmented manner in the Ethiopian health sector decision-making cycle, and the sector has been hampered by limited institutional capacity and skilled human resources to inform evidence-based decision making. The country is in the midst of widescale implementation of a community-based health insurance scheme and is preparing for the launch of a social health insurance scheme. The country continues to face a limited financial resource envelope, undergoing an epidemiological transition, and is facing a much greater burden of noncommunicable diseases, for which the essential health benefit package, defined 12 years ago, may no longer be suitable. This has called for an in-depth review of the application of HTA in the context of the current health needs and institutional settings. To meet the increasing need for HTA, the Health Economics and Financing Analysis (HEFA) team was established within the Finance Resource Mobilization Department under the Ministry of Health. The HEFA team is tasked with spearheading the application of evidence-based health care decision making in Ethiopia by organizing available evidence, costing interventions, and defining effectiveness measures of the different health programs and then supporting policymakers at the national and regional levels. Improving and harmonizing the institutional approach to HTA, including staffing the HEFA team with the appropriate mix of expertise, and networking with relevant sector organizations will improve Ethiopia's ability to tackle the current health sector challenges as well as protect fledgling insurance schemes' progress toward universal health coverage.