Assessing attitudes towards violence against women and girls, their determinants and health-seeking behaviour among women and men in South Sudan: a cross-sectional national survey.

OBJECTIVE: Investigating attitudes accepting two categories of violence against women and girls (VAWG) (intimate partner violence-IPV-and other expressions of VAWG) and their association with seven demographic/social determinants and health-seeking behaviours in South Sudan. DESIGN: Cross-sectional study using data from the South Sudan National Household Survey 2020. SETTING: South Sudan. PARTICIPANTS AND METHODS: 1741 South Sudanese women and 1739 men aged 15-49 years; data captured between November 2020 and February 2021 and analysed using binary logistic regression. RESULTS: People with secondary or higher education displayed attitudes rejecting acceptance of IPV (OR 0.631, 95% CI 0.508 to 0.783). Women and men living in states with more numerous internally displaced people (IDP) or political/military violence had attitudes accepting IPV more than residents of less violence-affected regions (OR 1.853, 95% CI 1.587 to 2.164). Women had a higher odd of having attitudes accepting IPV than men (OR 1.195, 95% CI 1.014 to 1.409). People knowing where to receive gender-based violence healthcare and psychological support (OR 0.703, 95% CI 0.596 to 0.830) and with primary (OR 0.613, 95% CI 0.515 to 0.729), secondary or higher education (OR 0.596, 95% CI 0.481 to 0.740) displayed attitudes rejecting acceptance of other expressions of VAWG. People residing in states with proportionately more IDP and who accepted IPV were more likely to have attitudes accepting other expressions of VAWG (OR 1.699, 95% CI 1.459 to 1.978; OR 3.195, 95% CI 2.703 to 3.775, respectively). CONCLUSION: Attitudes towards accepting VAWG in South Sudan are associated with women's and men's education, gender, residence and knowledge about health-seeking behaviour. Prioritising women's empowerment and gender transformative programming in the most conflict-affected areas where rates of VAWG are higher should be prioritised along with increasing girls' access to education. A less feasible strategy to decrease gender inequalities is reducing insecurity, military conflict, and displacement, and increasing economic stability.

Innovative approach to improve information accuracy in a two-district cross-sectional study in Bihar, India.

OBJECTIVE: Combine Health Management Information Systems (HMIS) and probability survey data using the statistical annealing technique (AT) to produce more accurate health coverage estimates than either source of data and a measure of HMIS data error. SETTING: This study is set in Bihar, the fifth poorest state in India, where half the population lives below the poverty line. An important source of data, used by health professionals for programme decision making, is routine health facility or HMIS data. Its quality is sometimes poor or unknown, and has no measure of its uncertainty. Using AT, we combine district-level HMIS and probability survey data (n=475) for the first time for 10 indicators assessing antenatal care, institutional delivery and neonatal care from 11 blocks of Aurangabad and 14 blocks of Gopalganj districts (N=6 253 965) in Bihar state, India. PARTICIPANTS: Both districts are rural. Bihar is 82.7% Hindu and 16.9% Islamic. PRIMARY OUTCOME MEASURES: Survey prevalence measures for 10 indicators, corresponding prevalences using HMIS data, combined prevalences calculated with AT and SEs for each type of data. RESULTS: The combined and survey estimates differ by <0.10. The combined and HMIS estimates differ by up to 84.2%, with the HMIS having 1.4-32.3 times larger error. Of 20 HMIS versus survey coverage estimate comparisons across the two districts only five differed by <0.10. Of 250 subdistrict-level comparisons of HMIS versus combined estimates, only 36.4% of the HMIS estimates are within the 95% CI of the combined estimate. CONCLUSIONS: Our statistical innovation increases the accuracy of information available for local health system decision making, allows evaluation of indicator accuracy and increases the accuracy of HMIS estimates. The combined estimates with a measure of error better informs health system professionals about their risks when using HMIS estimates, so they can reduce waste by making better decisions. Our results show that AT is an effective method ready for additional international assessment while also being used to provide affordable information to improve health services.

How to estimate health service coverage in 58 districts of Benin with no survey data: Using hybrid estimation to fill the gaps.

The global movement to use routine information for managing health systems to achieve the Sustainable Development Goals, relies on administrative data which have inherent biases when used to estimate coverage with health services. Health policies and interventions planned with incorrect information can have detrimental impacts on communities. Statistical inferences using administrative data can be improved when they are combined with random probability survey data. Sometimes, survey data are only available for some districts. We present new methods for extending combined estimation techniques to all districts by combining additional data sources. Our study uses data from a probability survey (n = 1786) conducted during 2015 in 19 of Benin's 77 communes and administrative count data from all of them for a national immunization day (n = 2,792,803). Communes are equivalent to districts. We extend combined-data estimation from 19 to 77 communes by estimating denominators using the survey data and then building a statistical model using population estimates from different sources to estimate denominators in adjacent districts. By dividing administrative numerators by the model-estimated denominators we obtain extrapolated hybrid prevalence estimates. Framing the problem in the Bayesian paradigm guarantees estimated prevalence rates fall within the appropriate ranges and conveniently incorporates a sensitivity analysis. Our new methodology, estimated Benin's polio vaccination rates for 77 communes. We leveraged probability survey data from 19 communes to formulate estimates for the 58 communes with administrative data alone; polio vaccination coverage estimates in the 58 communes decreased to ranges consistent with those from the probability surveys (87%, standard deviation = 0.09) and more credible than the administrative estimates. Combining probability survey and administrative data can be extended beyond the districts in which both are collected to estimate coverage in an entire catchment area. These more accurate results will better inform health policy-making and intervention planning to reduce waste and improve health in communities.

Model-based small area estimation methods and precise district-level HIV prevalence estimates in Uganda.

BACKGROUND: Model-based small area estimation methods can help generate parameter estimates at the district level, where planned population survey sample sizes are not large enough to support direct estimates of HIV prevalence with adequate precision. We computed district-level HIV prevalence estimates and their 95% confidence intervals for districts in Uganda. METHODS: Our analysis used direct survey and model-based estimation methods, including Fay-Herriot (area-level) and Battese-Harter-Fuller (unit-level) small area models. We used regression analysis to assess for consistency in estimating HIV prevalence. We use a ratio analysis of the mean square error and the coefficient of variation of the estimates to evaluate precision. The models were applied to Uganda Population-Based HIV Impact Assessment 2016/2017 data with auxiliary information from the 2016 Lot Quality Assurance Sampling survey and antenatal care data from district health information system datasets for unit-level and area-level models, respectively. RESULTS: Estimates from the model-based and the direct survey methods were similar. However, direct survey estimates were unstable compared with the model-based estimates. Area-level model estimates were more stable than unit-level model estimates. The correlation between unit-level and direct survey estimates was (ß1 = 0.66, r2 = 0.862), and correlation between area-level model and direct survey estimates was (ß1 = 0.44, r2 = 0.698). The error associated with the estimates decreased by 37.5% and 33.1% for the unit-level and area-level models, respectively, compared to the direct survey estimates. CONCLUSIONS: Although the unit-level model estimates were less precise than the area-level model estimates, they were highly correlated with the direct survey estimates and had less standard error associated with estimates than the area-level model. Unit-level models provide more accurate and reliable data to support local decision-making when unit-level auxiliary information is available.

Does interviewer gender influence a mother's response to household surveys about maternal and child health in traditional settings? A qualitative study in Bihar, India.

BACKGROUND: Two probability surveys, conducted in the same districts of Bihar, India (Aurangabad and Gopalganj) at approximately the same time in 2016 using identical questionnaires and similar survey methods, produced significantly different responses for 37.2% (58/156) of the indicator comparisons. Interviewers for one survey were men while for the other they were women. Respondents were mothers of children aged 0-59 months living in a traditional rural setting. We examined the influence of interviewer gender on mothers' survey responses and their implications for interpreting survey results. METHODS: We used qualitative methods including 10 focus group discussions (FGDs) and 33 in-depth interviews (IDIs) in the same locations as the 2016 surveys. FGD participants were purposefully selected mothers with children 0-59 months, husbands and other in-law family members. IDIs were carried out with frontline health-workers, enumerators and supervisors from the two previous household surveys. RESULTS: Findings revealed a preference for female interviewers for household surveys in study districts as they facilitated access to mothers and reduced their discomfort as survey participants. However, this gender preference was related to the survey question. Regardless of age, caste and educational level, most mothers were not permitted to communicate with men (aside from husbands) about female-specific health topics, including birth preparedness, delivery, menstrual cycles, contraception, breastfeeding, sexual behaviour, sexually transmitted disease, and domestic violence. Mothers in higher castes perceived these social restrictions more acutely than mothers in lower castes. There was no systematic direction of the resulting error. Mothers were willing to discuss child health issues with interviewers of either gender. CONCLUSIONS: Interviewer gender is an important consideration when designing survey protocols for maternal and reproductive health studies and when selecting and training enumerators. Female interviewers are optimal for traditional settings in Bihar as they are more likely to obtain accurate data on sensitive topics and reduce the potential for non-sampling error due to their reduced social distance with maternal respondents.

Difference in HIV prevalence by testing venue: results from population level survey in Uganda.

Growing demand for use of Health Facility (HF) HIV testing data, in addition to other testing data to obtain district level HIV prevalence requires understanding the comparability of these various sources. We analysed the 2011 Uganda AIDS indicator survey data to assess: the proportion of people tested for HIV across Uganda by venue of testing; HIV prevalence ratio for those tested in a HF compared to those tested in community setting; [Katz, D., Baptista, J., Azen, S. P., & Pike, M. C. (1978). Obtaining confidence intervals for the risk ratio in cohort studies. International Biometric Society, 34(3), 469-474. https://doi.org/10.2307/2530610] and factors associated with HIV positivity in each subgroup. Of the 11,685 individuals, 8978 (77.1%) had ever tested for HIV in a HF. Fifty nine per cent tested in a HF in the 12 months preceding the survey (female: 5507, 72.7% versus male: 1413, 34.9%). HIV prevalence ratio was 1.8 times among those tested in a HF compared to those tested at community setting (10.9% [95% CI: 10.0-11.7] versus 6.2% [95% CI: 5.4-7.0]). Among HF testers, older age group, previously married and having no sexual partner was associated with significantly higher HIV prevalence. Using facility testing data for planning and decisions should take into consideration the elevated and varying HIV prevalence among individuals accessing HIV testing services at HFs as well as differences in their social-demographic characteristics.

Population-level effective coverage of adolescent weekly iron and folic acid supplementation is low in rural West Bengal, India.

OBJECTIVE: To assess the coverage of the adolescent weekly iron and folic acid supplementation (WIFS) programme in rural West Bengal, India. DESIGN: We conducted a population-based cross-sectional survey of intended WIFS programme beneficiaries (in-school adolescent girls and boys and out-of-school adolescent girls). SETTING: Birbhum Health and Demographic Surveillance System. PARTICIPANTS: A total of 4448 adolescents 10-19 years of age participated in the study. RESULTS: The percentage of adolescents who reported taking four WIFS tablets during the last month as intended by the national programme was 9·4 % among in-school girls, 7·1 % for in-school boys and 2·3 % for out-of-school girls. The low effective coverage was due to the combination of large deficits in WIFS provision and poor adherence. A large proportion of adolescents reported they were not provided any WIFS tablets in the last month: 61·7 % of in-school girls, 73·3 % of in-school boys and 97·1 % of out-of-school girls. In terms of adherence, only 41·6 % of in-school girls, 38·1 % of in-school boys and 47·4 % of out-of-school girls reported that they consumed all WIFS tablets they received. Counselling from teachers, administrators and school staff was the primary reason adolescents reported taking WIFS tablets, whereas the major reasons for non-adherence were lack of perceived benefit, peer suggestion not to take WIFS and a reported history of side effects. CONCLUSIONS: The effective coverage of the WIFS programme for in-school adolescents and out-of-school adolescent girls is low in rural Birbhum. Integrated supply- and demand-side strategies appear to be necessary to increase the effective coverage and potential benefits of the WIFS programme.

Is development aid to strengthen health systems during protracted conflict a useful investment? The case of South Sudan, 2011-2015.

Introduction: Is achievement of Sustainable Development Goal (SDG) 16 (building peaceful societies) a precondition for achieving SDG 3 (health and well-being in all societies, including conflict-affected countries)? Do health system investments in conflict-affected countries waste resources or benefit the public's health? To answer these questions, we examine the maternal, newborn, child and reproductive health (MNCRH) service provision during protracted conflicts and economic shocks in the Republic of South Sudan between 2011 (at independence) and 2015. Methods: We conducted two national cross-sectional probability surveys in 10 states (2011) and nine states (2015). Trained state-level health workers collected data from households randomly selected using probability proportional to size sampling of villages in each county. County data were weighted by their population sizes to measure state and national MNCRH services coverage. A two-sample, two-sided Z-test of proportions tested for changes in national health service coverage between 2011 (n=11 800) and 2015 (n=10 792). Results: Twenty-two of 27 national indicator estimates (81.5%) of MNCRH service coverage improved significantly. Examples: malaria prophylaxis in pregnancy increased by 8.6% (p<0.001) to 33.1% (397/1199 mothers, 95% CI ±2.9%), institutional deliveries by 10.5% (p<0.001) to 20% (230/1199 mothers, ±2.6%) and measles vaccination coverage in children aged 12-23 months by 11.2% (p<0.001) to 49.7% (529/1064 children, ±2.3%). The largest increase (17.7%, p<0.001) occurred for mothers treating diarrhoea in children aged 0-59 months with oral rehydration salts to 51.4% (635/1235 children, ±2.9%). Antenatal and postnatal care, and contraceptive prevalence did not change significantly. Child vitamin A supplementation decreased. Despite significant increases, coverage remained low (median of all indicators = 31.3%, SD = 19.7). Coverage varied considerably by state (mean SD for all indicators and states=11.1%). Conclusion: Health system strengthening is not a uniform process and not necessarily deterred by conflict. Despite the conflict, health system investments were not wasted; health service coverage increased.

Combining national survey with facility-based HIV testing data to obtain more accurate estimate of HIV prevalence in districts in Uganda.

BACKGROUND: National or regional population-based HIV prevalence surveys have small sample sizes at district or sub-district levels; this leads to wide confidence intervals when estimating HIV prevalence at district level for programme monitoring and decision making. Health facility programme data, collected during service delivery is widely available, but since people self-select for HIV testing, HIV prevalence estimates based on it, is subject to selection bias. We present a statistical annealing technique, Hybrid Prevalence Estimation (HPE), that combines a small population-based survey sample with a facility-based sample to generate district level HIV prevalence estimates with associated confidence intervals. METHODS: We apply the HPE methodology to combine the 2011 Uganda AIDS indicator survey with the 2011 health facility HIV testing data to obtain HIV prevalence estimates for districts in Uganda. Multilevel logistic regression was used to obtain the propensity of testing for HIV in a health facility, and the propensity to test was used to combine the population survey and health facility HIV testing data to obtain the HPEs. We assessed comparability of the HPEs and survey-based estimates using Bland Altman analysis. RESULTS: The estimates ranged from 0.012 to 0.178 and had narrower confidence intervals compared to survey-based estimates. The average difference between HPEs and population survey estimates was 0.00 (95% CI: - 0.04, 0.04). The HPE standard errors were 28.9% (95% CI: 23.4-34.4) reduced, compared to survey-based standard errors. Overall reduction in HPE standard errors compared survey-based standard errors ranged from 5.4 to 95%. CONCLUSIONS: Facility data can be combined with population survey data to obtain more accurate HIV prevalence estimates for geographical areas with small population survey sample sizes. We recommend use of the methodology by district level managers to obtain more accurate HIV prevalence estimates to guide decision making without incurring additional data collection costs.

Measuring health system resilience in a highly fragile nation during protracted conflict: South Sudan 2011-15.

Health systems resilience (HSR) is defined as the ability of a health system to continue providing normal services in response to a crisis, making it a critical concept for analysis of health systems in fragile and conflict-affected settings (FCAS). However, no consensus for this definition exists and even less about how to measure HSR. We examine three current HSR definitions (maintaining function, improving function and achieving health system targets) using real-time data from South Sudan to develop a data-driven understanding of resilience. We used 14 maternal, newborn and child health (MNCH) coverage indicators from household surveys in South Sudan collected at independence (2011) and following 2 years of protracted conflict (2015), to construct a resilience index (RI) for 9 of the former 10 states and nationally. We also assessed health system stress using conflict-related indicators and developed a stress index. We cross tabulated the two indices to assess the relationship of resilience and stress. For maintaining function for 80% of MNCH indicators, seven state health systems were resilient, compared with improving function for 50% of the indicators (two states were resilient). Achieving the health system national target of 50% coverage in half of the MNCH indicators displayed no resilience. MNCH coverage levels were low, with state averages ranging between 15% and 44%. Central Equatoria State displayed high resilience and high system stress. Lakes and Northern Bahr el Ghazal displayed high resilience and low stress. Jonglei and Upper Nile States had low resilience and high stress. This study is the first to investigate HSR definitions using a resilience metric and to simultaneously measure health system stress in FCAS. Improving function is the HSR definition detecting the greatest variation in the RI. HSR and health system stress are not consistently negatively associated. HSR is highly complex warranting more in-depth analyses in FCAS.

How well do mothers recall their own and their infants' perinatal events? A two-district study using cross-sectional stratified random sampling in Bihar, India.

OBJECTIVE: Global monitoring of maternal, newborn and child health (MNCH) programmes use self-reported data subject to recall error which may lead to incorrect decisions for improving health services and wasted resources. To minimise this risk, samples of mothers of infants aged 0-2 and 3-5 months are sometimes used. We test whether a single sample of mothers of infants aged 0-5 months provides the same information. DESIGN: An annual MNCH household survey in two districts of Bihar, India (n=6 million). PARTICIPANTS: Independent samples (n=475 each) of mothers of infants aged 0-5, 0-2 and 3-5 months. OUTCOME MEASURES: Main analyses compare responses from the samples of infants aged 0-5 and 0-2 months with Mantel-Haenszel-Cochran statistics using 51 indicators in two districts. RESULTS: No measurable differences are detected in 79.4% (81/102) comparisons; 20.6% (21/102) display differences for the main comparison. Subanalyses produce similar results. A difference detected for exclusive breast feeding is due to premature complementary feeding by older infants. Measurable differences are detected in 33% (8/24) of the indicators on Front Line Worker (FLW) support, 26.9% (7/26) of indicators of birth preparedness and place of birth and attendant, and 9.5% (4/42) of the indicators on neonatal and antenatal care. CONCLUSIONS: Differences in FLW visits and compliance with their advice may be due to seasonal effects: mothers of older infants aged 3-5 months were pregnant during the dry season; mothers of infants aged 0-2 months were pregnant during the monsoons, making transportation difficult. Useful coverage estimates can be obtained by sampling mothers with infants aged 0-5 months as with two samples suggesting that mothers of young infants recall their own perinatal events and those of their children. For some indicators (eg, exclusive breast feeding), it may be necessary to adjust targets. Excessive stratification wastes resources, does not improve the quality of information and increases the burden placed on data collectors and communities which can increase non-sampling error.

Are health workers reduced to being drug dispensers of antiretroviral treatment? A randomized cross-sectional assessment of the quality of health care for HIV patients in northern Uganda.

High quality of care (QoC) for antiretroviral treatment (ART) is essential to prevent treatment failure. Uganda, as many sub-Saharan African countries, increased access to ART by decentralizing provision to districts. However, little is known whether this rapid scale-up maintained high-quality clinical services. We assess the quality of ART in the Acholi and Lango sub-regions of northern Uganda to identify whether the technical quality of critical ART sub-system needs improvement. We conducted a randomized cross-sectional survey among health facilities (HF) in Acholi (n = 11) and Lango (n = 10). Applying lot quality assurance sampling principles with a rapid health facility assessment tool, we assessed ART services vis-à-vis national treatment guidelines using 37 indicators. We interviewed health workers (n = 21) using structured questionnaires, directly observed clinical consultations (n = 126) and assessed HF infrastructure, human resources, medical supplies and patient records in each health facility (n = 21). The district QoC performance standard was 80% of HF had to comply with each guideline. Neither sub-region complied with treatment guidelines. No HF displayed adequate: patient monitoring, physical examination, training, supervision and regular monitoring of patients' immunology. The full range of first and second line antiretroviral (ARV) medication was not available in Acholi while Lango had sufficient stocks. Clinicians dispensed available ARVs without benefit of physical examination or immunological monitoring. Patients reported compliance with drug use (>80%). Patients' knowledge of preventing HIV/AIDS transmission concentrated on condom use; otherwise it was poor. The poor ART QoC in northern Uganda raises major questions about ART quality although ARVs were dispensed. Poor clinical care renders patients' reports of treatment compliance as insufficient evidence that it takes place. Further studies need to test patients' immunological status and QoC in more regions of Uganda and elsewhere in sub-Saharan Africa to identify topical and geographical areas which are priorities for improving HIV care.

Improved assessment of mass drug administration and health district management performance to eliminate lymphatic filariasis.

Lymphatic filariasis (LF) elimination as a public health problem requires the interruption of transmission by administration of preventive mass drug administration (MDA) to the eligible population living in endemic districts. Suboptimal MDA coverage leads to persistent parasite transmission with consequential infection, disease and disability, and the need for continuing MDA rounds, requiring considerable investment. Routine coverage reports must be verified in each MDA implementation unit (IU) due to incorrect denominators and numerators used to calculate coverage estimates with administrative data. IU are usually the health districts. Coverage is verified so IU teams can evaluate their outreach and take appropriate action to improve performance. Mozambique and the Democratic Republic of Congo (DRC) have conducted MDA campaigns for LF since 2009 and 2014, respectively. To verify district reports and assess the declared achievement using administrative data of the minimum 80% coverage of eligible people (or 65% of the total population), both countries conducted rapid probability surveys using Lot Quality Assurance Sampling (LQAS)(n = 1102) in 2015 and 2016 in 58 IU in 49 districts. The surveys identified IU with suboptimal coverage, reasons residents did not take the medication, place where the medication was received, information sources, and knowledge about diseases prevented by the MDA. LQAS identified four inadequately covered IU triggering district team performance reviews with provincial and national teams and district retreatment. Provincial estimates using probability samples (weighted by populations sizes) were 10 and 17 percentage points lower than reported coverage in DRC and Mozambique. The surveys identified: absence from home during annual MDA rounds as the main reason for low performance and provided valuable information about pre-campaign and campaign activities resulting in improved strategies and continued progress towards elimination of LF and co-endemic Neglected Tropical Diseases.

Hybrid prevalence estimation: Method to improve intervention coverage estimations.

Delivering excellent health services requires accurate health information systems (HIS) data. Poor-quality data can lead to poor judgments and outcomes. Unlike probability surveys, which are representative of the population and carry accuracy estimates, HIS do not, but in many countries the HIS is the primary source of data used for administrative estimates. However, HIS are not structured to detect gaps in service coverage and leave communities exposed to unnecessary health risks. Here we propose a method to improve informatics by combining HIS and probability survey data to construct a hybrid estimator. This technique provides a more accurate estimator than either data source alone and facilitates informed decision-making. We use data from vitamin A and polio vaccination campaigns in children from Madagascar and Benin to demonstrate the effect. The hybrid estimator is a weighted average of two measurements and produces SEs and 95% confidence intervals (CIs) for the hybrid and HIS estimators. The estimates of coverage proportions using the combined data and the survey estimates differ by no more than 3%, while decreasing the SE by 1-6%; the administrative estimates from the HIS and combined data estimates are very different, with 3-25 times larger CI, questioning the value of administrative estimates. Estimators of unknown accuracy may lead to poorly formulated policies and wasted resources. The hybrid estimator technique can be applied to disease prevention services for which population coverages are measured. This methodology creates more accurate estimators, alongside measured HIS errors, to improve tracking the public's health.

Institutionalizing and sustaining social change in health systems: the case of Uganda.

The key to high impact health services is institutionalizing and sustaining programme evaluation. Uganda represents a success story in the use of a specific programme evaluation method: Lot Quality Assurance Sampling (LQAS). Institutionalization is defined by two C's: competent programme evaluators and control mechanisms that effectively use evaluation data to improve health services. Sustainability means continued training and funding for the evaluation approach. Social science literature that researches institutionalization has emphasized 'stability', whereas in global health, the issue is determining how to improve the impact of services by 'changing' programmes. In Uganda, we measured the extent of the institutionalization and sustainability of evaluating programmes that produce change in nine districts sampled to represent three largely rural regions and varying levels of effective health programmes. We used the proportion of mothers with children aged 0-11 months who delivered in a health facility as the principal indicator to measure programme effectiveness. Interviews and focus groups were conducted among directors, evaluation supervisors, data collectors in the district health offices, and informant interviews conducted individually at the central government level. Seven of the nine districts demonstrated a high level of institutionalization of evaluation. The two others had only conducted one round of programme evaluation. When we control for the availability of health facilities, we find that the degree of institutionalization is moderately related to the prevalence of the delivery of a baby in a health facility. Evaluation was institutionalized at the central government level. Sustainability existed at both levels. Several measures indicate that lessons from the nine district case studies may be relevant to the 74 districts that had at least two rounds of programme evaluation. We note that there is an association between the evaluation data being used to change health services, and the four separate indicators being used to measure women's health and child survival services. We conclude that the two C's (competent evaluators and control mechanisms) have been critical for sustaining programme evaluation in Uganda.

Using lot quality assurance sampling to assess access to water, sanitation and hygiene services in a refugee camp setting in South Sudan: a feasibility study.

BACKGROUND: Humanitarian agencies working in refugee camp settings require rapid assessment methods to measure the needs of the populations they serve. Due to the high level of dependency of refugees, agencies need to carry out these assessments. Lot Quality Assurance Sampling (LQAS) is a method commonly used in development settings to assess populations living in a project catchment area to identify their greatest needs. LQAS could be well suited to serve the needs of refugee populations, but it has rarely been used in humanitarian settings. We adapted and implemented an LQAS survey design in Batil refugee camp, South Sudan in May 2013 to measure the added value of using it for sub-camp level assessment. METHODS: Using pre-existing divisions within the camp, we divided the Batil catchment area into six contiguous segments, called 'supervision areas' (SA). Six teams of two data collectors randomly selected 19 respondents in each SA, who they interviewed to collect information on water, sanitation, hygiene, and diarrhoea prevalence. These findings were aggregated into a stratified random sample of 114 respondents, and the results were analysed to produce a coverage estimate with 95% confidence interval for the camp and to prioritize SAs within the camp. RESULTS: The survey provided coverage estimates on WASH indicators as well as evidence that areas of the camp closer to the main road, to clinics and to the market were better served than areas at the periphery of the camp. This assumption did not hold for all services, however, as sanitation services were uniformly high regardless of location. While it was necessary to adapt the standard LQAS protocol used in low-resource communities, the LQAS model proved to be feasible in a refugee camp setting, and program managers found the results useful at both the catchment area and SA level. CONCLUSIONS: This study, one of the few adaptations of LQAS for a camp setting, shows that it is a feasible method for regular monitoring, with the added value of enabling camp managers to identify and advocate for the least served areas within the camp. Feedback on the results from stakeholders was overwhelmingly positive.

Can local staff reliably assess their own programs? A confirmatory test-retest study of Lot Quality Assurance Sampling data collectors in Uganda.

BACKGROUND: Data collection techniques that routinely provide health system information at the local level are in demand and needed. LQAS is intended for use by local health teams to collect data at the district and sub-district levels. Our question is whether local health staff produce biased results as they are responsible for implementing the programs they also assess. METHODS: This test-retest study replicates on a larger scale an earlier LQAS reliability assessment in Uganda. We conducted in two districts an LQAS survey using 15 local health staff as data collectors. A week later, the data collectors swapped districts, where they acted as disinterested non-local data collectors, repeating the LQAS survey with the same respondents. We analysed the resulting two data sets for agreement using Cohens' Kappa. RESULTS: The average Kappa score for the knowledge indicators was k = 0.43 (SD = 0.16) and for practice indicators k = 0.63 (SD = 0.17). These scores show moderate agreement for knowledge indicators and substantial agreement for practice indicators. Analyses confirm that respondents were more knowledgeable on retest; no evidence of bias was found for practice indicators. CONCLUSION: The findings of this study are remarkably similar to those produced in the first reliability study. There is no evidence that using local healthcare staff to collect LQAS data biases data collection in an LQAS study. The bias observed in the knowledge indicators was most likely due to a 'practice effect', whereby respondents increased their knowledge as a result of completing the first survey; no corresponding effect was seen in the practice indicators.

Assessing delivery practices of mothers over time and over space in Uganda, 2003-2012.

BACKGROUND: It is well known that safe delivery in a health facility reduces the risks of maternal and infant mortality resulting from perinatal complications. What is less understood are the factors associated with safe delivery practices. We investigate factors influencing health facility delivery practices while adjusting for multiple other factors simultaneously, spatial heterogeneity, and trends over time. METHODS: We fitted a logistic regression model to Lot Quality Assurance Sampling (LQAS) data from Uganda in a framework that considered individual-level covariates, geographical features, and variations over five time points. We accounted for all two-covariate interactions and all three-covariate interactions for which two of the covariates already had a significant interaction, were able to quantify uncertainty in outputs using computationally intensive cluster bootstrap methods, and displayed outputs using a geographical information system. Finally, we investigated what information could be predicted about districts at future time-points, before the next LQAS survey is carried out. To do this, we applied the model to project a confidence interval for the district level coverage of health facility delivery at future time points, by using the lower and upper end values of known demographics to construct a confidence range for the prediction and define priority groups. RESULTS: We show that ease of access, maternal age and education are strongly associated with delivery in a health facility; after accounting for this, there remains a significant trend towards greater uptake over time. We use this model together with known demographics to formulate a nascent early warning system that identifies candidate districts expected to have low prevalence of facility-based delivery in the immediate future. CONCLUSIONS: Our results support the hypothesis that increased development, particularly related to education and access to health facilities, will act to increase facility-based deliveries, a factor associated with reducing perinatal associated mortality. We provide a statistical method for using inexpensive and routinely collected monitoring and evaluation data to answer complex epidemiology and public health questions in a resource-poor setting. We produced a model based on this data that explained the spatial distribution of facility-based delivery in Uganda. Finally, we used this model to make a prediction about the future priority of districts that was validated by monitoring and evaluation data collected in the next year.

Empowering districts to target priorities for improving child health service in Uganda using change management and rapid assessment methods.

BACKGROUND: Local health system managers in low- and middle-income countries have the responsibility to set health priorities and allocate resources accordingly. Although tools exist to aid this process, they are not widely applied for various reasons including non-availability, poor knowledge of the tools, and poor adaptability into the local context. In Uganda, delivery of basic services is devolved to the District Local Governments through the District Health Teams (DHTs). The Community and District Empowerment for Scale-up (CODES) project aims to provide a set of management tools that aid contextualised priority setting, fund allocation, and problem-solving in a systematic way to improve effective coverage and quality of child survival interventions. DESIGN: Although the various tools have previously been used at the national level, the project aims to combine them in an integral way for implementation at the district level. These tools include Lot Quality Assurance Sampling (LQAS) surveys to generate local evidence, Bottleneck analysis and Causal analysis as analytical tools, Continuous Quality Improvement, and Community Dialogues based on Citizen Report Cards and U reports. The tools enable identification of gaps, prioritisation of possible solutions, and allocation of resources accordingly. This paper presents some of the tools used by the project in five districts in Uganda during the proof-of-concept phase of the project. RESULTS: All five districts were trained and participated in LQAS surveys and readily adopted the tools for priority setting and resource allocation. All districts developed health operational work plans, which were based on the evidence and each of the districts implemented more than three of the priority activities which were included in their work plans. CONCLUSIONS: In the five districts, the CODES project demonstrated that DHTs can adopt and integrate these tools in the planning process by systematically identifying gaps and setting priority interventions for child survival.

Associations with HIV testing in Uganda: an analysis of the Lot Quality Assurance Sampling database 2003-2012.

Beginning in 2003, Uganda used Lot Quality Assurance Sampling (LQAS) to assist district managers collect and use data to improve their human immunodeficiency virus (HIV)/AIDS program. Uganda's LQAS-database (2003-2012) covers up to 73 of 112 districts. Our multidistrict analysis of the LQAS data-set at 2003-2004 and 2012 examined gender variation among adults who ever tested for HIV over time, and attributes associated with testing. Conditional logistic regression matched men and women by community with seven model effect variables. HIV testing prevalence rose from 14% (men) and 12% (women) in 2003-2004 to 62% (men) and 80% (women) in 2012. In 2003-2004, knowing the benefits of testing (Odds Ratio [OR] = 6.09, 95% CI = 3.01-12.35), knowing where to get tested (OR = 2.83, 95% CI = 1.44-5.56), and secondary education (OR = 3.04, 95% CI = 1.19-7.77) were significantly associated with HIV testing. By 2012, knowing the benefits of testing (OR = 3.63, 95% CI = 2.25-5.83), where to get tested (OR = 5.15, 95% CI = 3.26-8.14), primary education (OR = 2.01, 95% CI = 1.39-2.91), being female (OR = 3.03, 95% CI = 2.53-3.62), and being married (OR = 1.81, 95% CI = 1.17-2.8) were significantly associated with HIV testing. HIV testing prevalence in Uganda has increased dramatically, more for women than men. Our results concurred with other authors that education, knowledge of HIV, and marriage (women only) are associated with testing for HIV and suggest that couples testing is more prevalent than other authors.