A cross-sectional study comparing case scenarios and record review to measure quality of Integrated Community Case Management care in western Uganda.

BACKGROUND: In Integrated Community Case Management (iCCM), village health workers (VHW) assess and treat malaria, pneumonia and diarrhea using a clinical algorithm. Study objectives included: 1) Compare VHWs' performance on case scenario exercises to record review data; 2) assess impact of formal education on performance in the case scenario exercises. METHODS: 36 VHWs in Bugoye Subcounty, Uganda completed the case scenarios exercise, which included video case scenarios and brief oral case vignettes, between July 2017 and February 2018. We obtained clinical records for all iCCM encounters in the same time period. RESULTS: In the video case scenarios, 45% of mock patients received all correct management steps (including all recommended education), while 94% received all critical management steps. Based on the level of data available from record review, 74% of patients in the record review dataset received overall correct management compared to 94% in the video case scenarios. In the case scenarios, VHWs with primary school education performed similarly to those with some or all secondary school education. CONCLUSIONS: The case scenarios produced higher estimates of quality of care than record review. VHWs often omitted recommended health education topics in the case scenarios. Level of formal education did not appear to influence performance in the case scenarios.

Assessing Village Health Workers' Ability to Perform and Interpret Rapid Diagnostic Tests for Malaria 4 Years after Initial Training: A Cross-Sectional Study.

Village health workers (VHWs) in Bugoye subcounty, Uganda, provide integrated community case management (iCCM) care to children younger than 5 years for malaria, pneumonia, and diarrhea. We assessed the longevity of VHWs' skills in performing and reading malaria rapid diagnostic tests (RDTs) 4 years after initial training, comparing VHWs who had completed initial iCCM training 1 year before the study with VHWs who had completed training 4 years before the study. Both groups received quarterly refresher trainings. Trained interviewers observed 36 VHWs reading six mock RDTs each and performing an RDT as part of a larger skills assessment exercise. VHWs read 97% of mock RDTs correctly; of the 36 VHWs, 86% read all six mock RDTs correctly. Most VHWs scored either 12/13 or 13/13 on the RDT checklist (39% and 36%, respectively), with 25% scoring 11/13 or lower. For reading mock RDTs, VHWs in the first group (initial training 4 years before study) read 97% of mock RDTs correctly, whereas those in the second group (initial training 1 year before study) read 96% of mock RDTs correctly; the first group had a mean of 5.83 RDTs read correctly, compared with 5.77 RDTs read correctly in the second group (P = 0.83). For performing an RDT, the first group completed a mean of 12.0 steps correctly, compared with a mean of 12.2 correct steps in the second group (P = 0.60). Overall, VHWs demonstrated proficiency in reading RDTs accurately and performing RDTs according to protocol at least 4 years after initial iCCM training.

Quality of care in integrated community case management services in Bugoye, Uganda: a retrospective observational study.

BACKGROUND: Village health workers (VHWs) in five villages in Bugoye subcounty (Kasese District, Uganda) provide integrated community case management (iCCM) services, in which VHWs evaluate and treat malaria, pneumonia, and diarrhoea in children under 5 years of age. VHWs use a "Sick Child Job Aid" that guides them through the evaluation and treatment of these illnesses. A retrospective observational study was conducted to measure the quality of iCCM care provided by 23 VHWs in 5 villages in Bugoye subcounty over a 2-year period. METHODS: Patient characteristics and clinical services were summarized using existing aggregate programme data. Lot quality assurance sampling of individual patient records was used to estimate adherence to the iCCM algorithm, VHW-level quality (based on adherence to the iCCM protocol), and change over time in quality of care (using generalized estimating equations regression modelling). RESULTS: For each of 23 VHWs, 25 patient visits were randomly selected from a 2-year period after iCCM care initiation. In these visits, 97% (150) of patients with diarrhoea were treated with oral rehydration and zinc, 95% (216) of patients with pneumonia were treated with amoxicillin, and 94% (240) of patients with malaria were treated with artemisinin-based combination therapy or rectal artesunate. However, only 44% (44) of patients with a negative rapid test for malaria were appropriately referred to a health facility. Overall, 75% (434) of patients received all the correct evaluation and management steps. Only 9 (39%) of the 23 VHWs met the pre-determined LQAS threshold for high-quality care over the 2-year observation period. Quality of care increased significantly in the first 6 months after initiation of iCCM services (p = 0.003), and then plateaued during months 7-24. CONCLUSIONS: Quality of care was high for uncomplicated malaria, pneumonia and diarrhoea. Overall quality of care was lower, in part because VHWs often did not follow the guidelines to refer patients with fever who tested negative for malaria. Quality of care appears to improve in the initial months after iCCM implementation, as VHWs gain initial experience in iCCM care.

Monitoring iCCM referral systems: Bugoye Integrated Community Case Management Initiative (BIMI) in Uganda.

BACKGROUND: In Uganda, over half of under-five child mortality is attributed to three infectious diseases: malaria, pneumonia and diarrhoea. Integrated community case management (iCCM) trains village health workers (VHWs) to provide in-home diagnosis and treatment of these common childhood illnesses. For severely ill children, iCCM relies on a functioning referral system to ensure timely treatment at a health facility. However, referral completion rates vary widely among iCCM programmes and are difficult to monitor. The Bugoye Integrated Community Case Management Initiative (BIMI) is an iCCM programme operating in Bugoye sub-county, Uganda. This case study describes BIMI's experience with monitoring referral completion at Bugoye Health Centre III (BHC), and outlines improvements to be made within iCCM referral systems. METHODS: This study triangulated multiple data sources to evaluate the strengths and gaps in the BIMI referral system. Three quantitative data sources were reviewed: (1) VHW report of referred patients, (2) referral forms found at BHC, and (3) BHC patient records. These data sources were collated and triangulated from January-December 2014. The goal was to determine if patients were completing their referrals and if referrals were adequately documented using routine data sources. RESULTS: From January-December 2014, there were 268 patients referred to BHC, as documented by VHWs. However, only 52 of these patients had referral forms stored at BHC. Of the 52 referral forms found, 22 of these patients were also found in BHC register books recorded by clinic staff. Thus, the study found a mismatch between VHW reports of patient referrals and the referral visits documented at BHC. This discrepancy may indicate several gaps: (1) referred patients may not be completing their referral, (2) referral forms may be getting lost at BHC, and, (3) referred patients may be going to other health facilities or drug shops, rather than BHC, for their referral. CONCLUSIONS: This study demonstrates the challenges of effectively monitoring iCCM referral completion, given identified limitations such as discordant data sources, incomplete record keeping and lack of unique identifiers. There is a need to innovate and improve the ways by which referral compliance is monitored using routine data, in order to improve the percentage of referrals completed. Through research and field experience, this study proposes programmatic and technological solutions to rectify these gaps within iCCM programmes facing similar challenges. With improved monitoring, VHWs will be empowered to increase referral completion, allowing critically ill children to access needed health services.