Assessment of facility-based tuberculosis data quality in an integrated HIV/TB database in three South African districts.

BACKGROUND: Assessment of data quality is essential to successful monitoring & evaluation of tuberculosis (TB) services. South Africa uses the Three Interlinked Electronic Register (TIER.Net) to monitor TB diagnoses and treatment outcomes. We assessed the quality of routine programmatic data as captured in TIER.Net. METHODS: We reviewed 277 records from routine data collected for adults who had started TB treatment for drug-sensitive (DS-) TB between 10/2018-12/2019 from 15 facilities across three South African districts using three sources and three approaches to link these (i.e., two approaches compared TIER.NET with the TB Treatment Record while the third approach compared all three sources of TB data: the TB treatment record or patient medical file; the TB Identification Register; and the TB module in TIER.Net). We report agreement and completeness of demographic information and key TB-related variables across all three data sources. RESULTS: In our first approach we selected 150 patient records from TIER.Net and found all but one corresponding TB Treatment Record (99%). In our second approach we were also able to find a corresponding TIER.Net record from a starting point of the paper-based, TB Treatment Record for 73/75 (97%) records. We found fewer records 55/75 (73%) in TIER.Net when we used as a starting point records from the TB Identification Register. Demographic information (name, surname, date of birth, and gender) was accurately reported across all three data sources (matching 90% or more). The reporting of key TB-related variables was similar across both the TB Treatment Record and the TB module in TIER.Net (p>0.05). We observed differences in completeness and moderate agreement (Kappa 0.41-0.60) for site of disease, TB treatment outcome and smear microscopy or X-ray as a diagnostic test (p<0.05). We observed more missing items for the TB Treatment record compared to TIER.Net; TB treatment outcome date and site of disease specifically. In comparison, TB treatment start dates as well as HIV-status recording had higher concordance. HIV status and lab results appeared to be more complete in the TB module in TIER.Net than in the TB Treatment Records, and there was "good/substantial" agreement (Kappa 0.61-0.80) for HIV status. DISCUSSION AND CONCLUSION: Our key finding was that the TB Module in TIER.Net was more complete in some key variables including TB treatment outcome. Most TB patient records we reviewed were found on TIER.Net but there was a noticeable gap of TB Identification patient records from the paper register as compared to TIER.Net, including those who tested TB-negative or HIV-negative. There is evidence of complete and "good/substantial" data quality for key TB-related variables, such as "First GeneXpert test result" and "HIV status." Improvements in data completeness of TIER.Net compared to the TB Treatment Record are the most urgent area for improvement, especially recording of TB treatment outcomes.

Assessment of facility-level antiretroviral treatment patient status utilizing a national-level laboratory cohort: Toward an understanding of system-level tracking and clinic switching in South Africa.

Background: Most estimates of HIV retention are derived at the clinic level through antiretroviral (ART) patient management systems, which capture ART clinic visit data, yet these cannot account for silent transfers across HIV treatment sites. Patient laboratory monitoring visits may also be observed in routinely collected laboratory data, which include ART monitoring tests such as CD4 count and HIV viral load, key to our work here. Methods: In this analysis, we utilized the NHLS National HIV Cohort (a system-wide viewpoint) to investigate the accuracy of facility-level estimates of retention in care for adult patients accessing care (defined using clinic visit data on patients under ART recorded in an electronic patient management system) at Themba Lethu Clinic (TLC). Furthermore, we describe patterns of facility switching among all patients and those patients classified as lost to follow-up (LTFU) at the facility level. Results: Of the 43,538 unique patients in the TLC dataset, we included 20,093 of 25,514 possible patient records (78.8%) in our analysis that were linked with the NHLS National Cohort, and we restricted the analytic sample to patients initiating ART between 1 January 2007 and 31 December 2017. Most (60%) patients were female, and the median age (IQR) at ART initiation was 37 (31-45) years. We found the laboratory records augmented retention estimates by a median of 860 additional active records (about 8% of all median active records across all years) from the facility viewpoint; this augmentation was more noticeable from the system-wide viewpoint, which added evidence of activity of about one-third of total active records in 2017. In 2017, we found 7.0% misclassification at the facility-level viewpoint, a gap which is potentially solvable through data integration/triangulation. We observed 1,134/20,093 (5.6%) silent transfers; these were noticeably more female and younger than the entire dataset. We also report the most common locations for clinic switching at a provincial level. Discussion: Integration of multiple data sources has the potential to reduce the misclassification of patients as being lost to care and help understand situations where clinic switching is common. This may help in prioritizing interventions that would assist patients moving between clinics and hopefully contribute to services that normalize formal transfers and fewer silent transfers.

Role of data from cost and other economic analyses in healthcare decision-making for HIV, TB and sexual/reproductive health programmes in South Africa.

An increasing focus on the use of the results of cost analyses and other economic evaluations in health programme decision-making by governments, donors and technical support partners working in low- and middle-income countries is accompanied by recognition that this use is impeded by several factors, including the lack of skills, data and coordination between spheres of the government. We describe our experience generating economic evaluation data for human immunodeficiency virus, tuberculosis and sexual/reproductive health programmes in South Africa alongside the results of a series of in-depth interviews (IDIs) among decision-makers within the South African government and implementing organizations (data users) and producers of economic evaluations (data producers). We summarize results across (1) the process of implementing a new intervention; (2) barriers to the use of cost data and suggested solutions and (3) the transferability of experiences to the planned South African implementation of universal health coverage (UHC). Based on our experience and the IDIs, we suggest concrete steps towards the improvement of economic data use in the planning and the establishment of structures mandated under the transition to UHC. Our key recommendations include the following: (1) compile a publicly available and regularly updated in-country cost repository; (2) increase the availability of programmatic outcomes data at the aggregate level; (3) agree upon and implement a set of primary decision criteria for the adoption and funding of interventions; (4) combine the efforts of health economics institutions into a stringent system for health technology assessments and (5) improve the link between national and provincial planning and budgeting.

Community health worker models in South Africa: a qualitative study on policy implementation of the 2018/19 revised framework.

South Africa has a long history of community health workers (CHWs). It has been a journey that has required balancing constrained resources and competing priorities. CHWs form a bridge between communities and healthcare service provision within health facilities and act as the cornerstone of South Africa's Ward-Based Primary Healthcare Outreach Teams. This study aimed to document the CHW policy implementation landscape across six provinces in South Africa and explore the reasons for local adaptation of CHW models and to identify potential barriers and facilitators to implementation of the revised framework to help guide and inform future planning. We conducted a qualitative study among a sample of Department of Health Managers at the National, Provincial and District level, healthcare providers, implementing partners [including non-governmental organizations (NGOs) who worked with CHWs] and CHWs themselves. Data were collected between April 2018 and December 2018. We conducted 65 in-depth interviews (IDIs) with healthcare providers, managers and experts familiar with CHW work and nine focus group discussions (FGDs) with 101 CHWs. We present (i) current models of CHW policy implementation across South Africa, (ii) facilitators, (iii) barriers to CHW programme implementation and (iv) respondents' recommendations on how the CHW programme can be improved. We chronicled the differences in NGO involvement, the common facilitators of purpose and passion in the CHWs' work and the multitude of barriers and resource limitations CHWs must work under. We found that models of implementation vary greatly and that adaptability is an important aspect of successful implementation under resource constraints. Our findings largely aligned to existing research but included an evaluation of districts/provinces that had not previously been explored together. CHWs continue to promote health and link their communities to healthcare facilities, in spite of lack of permanent employment, limited resources, such as uniforms, and low wages.

Implementation of an electronic monitoring and evaluation system for the antiretroviral treatment programme in the Cape Winelands district, South Africa: a qualitative evaluation.

BACKGROUND: A pragmatic three-tiered approach to monitor the world's largest antiretroviral treatment (ART) programme was adopted by the South African National Department of Health in 2010. With the rapid expansion of the programme, the limitations of the paper-based register (tier 1) were the catalyst for implementation of the stand-alone electronic register (tier 2), which offers simple digitisation of the paper-based register. This article engages with theory on implementation to identify and contextualise enabling and constraining factors for implementation of the electronic register, to describe experiences and use of the register, and to make recommendations for implementation in similar settings where standardisation of ART monitoring and evaluation has not been achieved. METHODS: We conducted a qualitative evaluation of the roll-out of the register. This comprised twenty in-depth interviews with a diverse sample of stakeholders at facility, sub-district, and district levels of the health system. Facility-level participants were selected across five sub-districts, including one facility per sub-district. Responses were coded and analysed using a thematic approach. An implementation science framework guided interpretation of the data. RESULTS & DISCUSSION: We identified the following seven themes: 1) ease of implementation, 2) perceived value of an electronic M&E system, 3) importance of stakeholder engagement, 4) influence of a data champion, 5) operational and logistical factors, 6) workload and role clarity, and 7) importance of integrating the electronic register with routine facility monitoring and evaluation. Interpreting our findings through an implementation theory enabled us to construct the scaffolding for implementation across the five facility-settings. This approach illustrated that implementation was not a linear process but occurred at two nodes: at the adoption of the register for roll-out, and at implementation at facility-level. CONCLUSION: In this study we found that relative advantage of an intervention and stakeholder engagement are critical to implementation. We suggest that without these aspects of implementation, formative and summative outcomes of implementation at both the adoption and coalface stages of implementation would be negatively affected.