Data triangulation to estimate age-specific coverage of voluntary medical male circumcision for HIV prevention in four Kenyan counties.

BACKGROUND: Kenya is 1 of 14 priority countries in Africa scaling up voluntary medical male circumcision (VMMC) for HIV prevention following the recommendations of the World Health Organization and the Joint United Nations Programme on HIV/AIDS. To inform VMMC target setting, we modeled the impact of circumcising specific client age groups across several Kenyan geographic areas. METHODS: The Decision Makers' Program Planning Tool, Version 2 (DMPPT 2) was applied in Kisumu, Siaya, Homa Bay, and Migori counties. Initial modeling done in mid-2016 showed coverage estimates above 100% in age groups and geographic areas where demand for VMMC continued to be high. On the basis of information obtained from country policy makers and VMMC program implementers, we adjusted circumcision coverage for duplicate reporting, county-level population estimates, migration across county boundaries for VMMC services, and replacement of traditional circumcision with circumcisions in the VMMC program. To address residual inflated coverage following these adjustments we applied county-specific correction factors computed by triangulating model results with coverage estimates from population surveys. RESULTS: A program record review identified duplicate reporting in Homa Bay, Kisumu, and Siaya. Using county population estimates from the Kenya National Bureau of Statistics, we found that adjusting for migration and correcting for replacement of traditional circumcision with VMMC led to lower estimates of 2016 male circumcision coverage especially for Kisumu, Migori, and Siaya. Even after addressing these issues, overestimation of 2016 male circumcision coverage persisted, especially in Homa Bay. We estimated male circumcision coverage in 2016 by applying correction factors. Modeled estimates for 2016 circumcision coverage for the 10- to 14-year age group ranged from 50% in Homa Bay to approximately 90% in Kisumu. Results for the 15- to 19-year age group suggest almost complete coverage in Kisumu, Migori, and Siaya. Coverage for the 20- to 24-year age group ranged from about 80% in Siaya to about 90% in Homa Bay, coverage for those aged 25-29 years ranged from about 60% in Siaya to 80% in Migori, and coverage in those aged 30-34 years ranged from about 50% in Siaya to about 70% in Migori. CONCLUSIONS: Our analysis points to solutions for some of the data issues encountered in Kenya. Kenya is the first country in which these data issues have been encountered because baseline circumcision rates were high. We anticipate that some of the modeling methods we developed for Kenya will be applicable in other countries.

Geographic coverage of male circumcision in western Kenya.

Voluntary Medical Male Circumcision (VMMC) for human immunodeficiency virus (HIV) prevention has scaled up rapidly among young men in western Kenya since 2008. Whether the program has successfully reached uncircumcised men evenly across the region is largely unknown. Using data from two cluster randomized surveys from the 2008 and 2014 Kenyan Demographic Health Survey (KDHS), we mapped the continuous spatial distribution of circumcised men by age group across former Nyanza Province to identify geographic areas where local circumcision prevalence is lower than the overall, regional prevalence. The prevalence of self-reported circumcision among men 15 to 49 across six counties in former Nyanza Province increased from 45.6% (95% CI = 33.2-58.0%) in 2008 to 71.4% (95% CI = 67.4-75.0%) in 2014, with the greatest increase in men 15 to 24 years of age, from 40.4% (95% CI = 27.7-55.0%) in 2008 to 81.6% (95% CI = 77.2-85.0%) in 2014. Despite the dramatic scale-up of VMMC in western Kenya, circumcision coverage in parts of Kisumu, Siaya, and Homa Bay counties was lower than expected (P < 0.05), with up to 50% of men aged 15 to 24 still uncircumcised by 2014 in some areas. The VMMC program has proven successful in reaching a large population of uncircumcised men in western Kenya, but as of 2014, pockets of low circumcision coverage still existed. Closing regional gaps in VMMC prevalence to reach 80% coverage may require targeting specific areas where VMMC prevalence is lower than expected.

Voluntary medical male circumcision scale-up in Nyanza, Kenya: evaluating technical efficiency and productivity of service delivery.

BACKGROUND: Voluntary medical male circumcision (VMMC) service delivery is complex and resource-intensive. In Kenya's context there is still paucity of information on resource use vis-à-vis outputs as programs scale up. Knowledge of technical efficiency, productivity and potential sources of constraints is desirable to improve decision-making. OBJECTIVE: To evaluate technical efficiency and productivity of VMMC service delivery in Nyanza in 2011/2012 using data envelopment analysis. DESIGN: Comparative process evaluation of facilities providing VMMC in Nyanza in 2011/2012 using output orientated data envelopment analysis. RESULTS: Twenty one facilities were evaluated. Only 1 of 7 variables considered (total elapsed operation time) significantly improved from 32.8 minutes (SD 8.8) in 2011 to 30 minutes (SD 6.6) in 2012 (95%CI = 0.0350-5.2488; p = 0.047). Mean scale technical efficiency significantly improved from 91% (SD 19.8) in 2011 to 99% (SD 4.0) in 2012 particularly among outreach compared to fixed service delivery facilities (CI -31.47959-4.698508; p = 0.005). Increase in mean VRS technical efficiency from 84% (SD 25.3) in 2011 and 89% (SD 25.1) in 2012 was not statistically significant. Benchmark facilities were #119 and #125 in 2011 and #103 in 2012. Malmquist Productivity Index (MPI) at fixed facilities declined by 2.5% but gained by 4.9% at outreach ones by 2012. Total factor productivity improved by 83% (p = 0.032) in 2012, largely due to progress in technological efficiency by 79% (p = 0.008). CONCLUSIONS: Significant improvement in scale technical efficiency among outreach facilities in 2012 was attributable to accelerated activities. However, ongoing pure technical inefficiency requires concerted attention. Technological progress was the key driver of service productivity growth in Nyanza. Incorporating service-quality dimensions and using stepwise-multiple criteria in performance evaluation enhances comprehensiveness and validity. These findings highlight site-level resource use and sources of variations in VMMC service productivity, which are important for program planning.

Systematic monitoring of male circumcision scale-up in Nyanza, Kenya: exploratory factor analysis of service quality instrument and performance ranking.

BACKGROUND: Considerable conceptual and operational complexities related to service quality measurements and variability in delivery contexts of scaled-up medical male circumcision, pose real challenges to monitoring implementation of quality and safety. Clarifying latent factors of the quality instruments can enhance contextual applicability and the likelihood that observed service outcomes are appropriately assessed. OBJECTIVE: To explore factors underlying SYMMACS service quality assessment tool (adopted from the WHO VMMC quality toolkit) and; determine service quality performance using composite quality index derived from the latent factors. STUDY DESIGN: Using a comparative process evaluation of Voluntary Medical Male Circumcision Scale-Up in Kenya site level data was collected among health facilities providing VMMC over two years. Systematic Monitoring of the Medical Male Circumcision Scale-Up quality instrument was used to assess availability of guidelines, supplies and equipment, infection control, and continuity of care services. Exploratory factor analysis was performed to clarify quality structure. RESULTS: Fifty four items and 246 responses were analyzed. Based on Eigenvalue >1.00 cut-off, factors 1, 2 & 3 were retained each respectively having eigenvalues of 5.78; 4.29; 2.99. These cumulatively accounted for 29.1% of the total variance (12.9%; 9.5%; 6.7%) with final communality estimates being 13.06. Using a cut-off factor loading value of ≥0.4, fifteen items loading on factor 1, five on factor 2 and one on factor 3 were retained. Factor 1 closely relates to preparedness to deliver safe male circumcisions while factor two depicts skilled task performance and compliance with protocols. Of the 28 facilities, 32% attained between 90th and 95th percentile (excellent); 45% between 50th and 75th percentiles (average) and 14.3% below 25th percentile (poor). CONCLUSION: the service quality assessment instrument may be simplified to have nearly 20 items that relate more closely to service outcomes. Ranking of facilities and circumcision procedure using a composite index based on these items indicates that majority performed above average.

Provider attitudes toward the voluntary medical male circumcision scale-up in Kenya, South Africa, Tanzania and Zimbabwe.

BACKGROUND: Countries participating in voluntary medical male circumcision (VMMC) scale-up have adopted most of six elements of surgical efficiency, depending on national policy. However, effective implementation of these elements largely depends on providers' attitudes and subsequent compliance. We explored the concordance between recommended practices and providers' perceptions toward the VMMC efficiency elements, in part to inform review of national policies. METHODS AND FINDINGS: As part of Systematic Monitoring of the VMMC Scale-up (SYMMACS), we conducted a survey of VMMC providers in Kenya, South Africa, Tanzania, and Zimbabwe. SYMMACS assessed providers' attitudes and perceptions toward these elements in 2011 and 2012. A restricted analysis using 2012 data to calculate unadjusted odds ratios and 95% confidence intervals for the country effect on each attitudinal outcome was done using logistic regression. As only two countries allow more than one cadre to perform the surgical procedure, odds ratios looking at country effect were adjusted for cadre effect for these two countries. Qualitative data from open-ended responses were used to triangulate with quantitative analyses. This analysis showed concordance between each country's policies and provider attitudes toward the efficiency elements. One exception was task-shifting, which is not authorized in South Africa or Zimbabwe; providers across all countries approved this practice. CONCLUSIONS: The decision to adopt efficiency elements is often based on national policies. The concordance between the policies of each country and provider attitudes bodes well for compliance and effective implementation. However, study findings suggest that there may be need to consult providers when developing national policies.

Work experience, job-fulfillment and burnout among VMMC providers in Kenya, South Africa, Tanzania and Zimbabwe.

BACKGROUND: Human resource capacity is vital to the scale-up of voluntary medical male circumcision (VMMC) services. VMMC providers are at risk of "burnout" from performing a single task repeatedly in a high volume work environment that produces long work hours and intense work effort. METHODS AND FINDINGS: The Systematic Monitoring of the Voluntary Medical Male Circumcision Scale-up (SYMMACS) surveyed VMMC providers in Kenya, South Africa, Tanzania, and Zimbabwe in 2011 (n = 357) and 2012 (n = 591). Providers self-reported on their training, work experience, levels of job-fulfillment and work fatigue/burnout. Data analysis included a descriptive analysis of VMMC provider characteristics, and both bivariate and multivariate analyses of factors associated with provider work fatigue/burnout. In 2012, Kenyan providers had worked in VMMC for a median of 31 months compared to South Africa (10 months), Tanzania (15 months), and Zimbabwe (11 months). More than three-quarters (78 - 99%) of providers in all countries in 2012 reported that VMMC is a personally fulfilling job. However, 67% of Kenyan providers reported starting to experience work fatigue/burnout compared to South Africa (33%), Zimbabwe (17%), and Tanzania (15%). Despite the high level of work fatigue/burnout in Kenya, none of the measured factors (i.e., gender, age, full-time versus part-time status, length of service, number of operations performed, or cadre) were significantly associated with work fatigue/burnout in 2011. In 2012, logistic regression found increases in age (p<.05) and number of months working in VMMC (p<.01) were associated with an increased likelihood of experiencing work fatigue/burnout, while higher career total VMMCs decreased the likelihood of experiencing burnout. CONCLUSION: Given cross-country differences, further elucidation of cultural and other contextual factors that may influence provider burnout is required. Continuing to emphasize the contribution that providers make in the fight against HIV/AIDS is important.