Effectiveness of Smartphone-Based Community Case Management on the Urgent Referral, Reconsultation, and Hospitalization of Children Aged Under 5 Years in Malawi: Cluster-Randomized, Stepped-Wedge Trial.

BACKGROUND: Integrated community case management (CCM) has led to reductions in child mortality in Malawi resulting from illnesses such as malaria, pneumonia, and diarrhea. However, adherence to CCM guidelines is often poor, potentially leading to inappropriate clinical decisions and poor outcomes. We determined the impact of an e-CCM app on the referral, reconsultation, and hospitalization rates of children presenting to village clinics in Malawi. OBJECTIVE: We determined the impact of an electronic version of a smartphone-based CCM (e-CCM) app on the referral, reconsultation, and hospitalization rates of children presenting to village clinics in Malawi. METHODS: We used a stepped-wedge, cluster-randomized trial to compare paper-based CCM (control) with and without the use of an e-CCM app on smartphones from November 2016 to February 2017. A total of 102 village clinics from 2 districts in northern Malawi were assigned to 1 of 6 clusters, which were randomized on the sequencing of the crossover from the control phase to the intervention phase as well as the duration of exposure in each phase. Children aged ≥2 months to <5 years who presented with acute illness were enrolled consecutively by health surveillance assistants. The primary outcome of urgent referrals to higher-level facilities was evaluated by using multilevel mixed effects models. A logistic regression model with the random effects of the cluster and the fixed effects for each step was fitted. The adjustment for potential confounders included baseline factors, such as patient age, sex, and the geographical location of the village clinics. Calendar time was adjusted for in the analysis. RESULTS: A total of 6965 children were recruited-49.11% (3421/6965) in the control phase and 50.88% (3544/6965) in the intervention phase. After adjusting for calendar time, children in the intervention phase were more likely to be urgently referred to a higher-level health facility than children in the control phase (odds ratio [OR] 2.02, 95% CI 1.27-3.23; P=.003). Overall, children in the intervention arm had lower odds of attending a repeat health surveillance assistant consultation (OR 0.45, 95% CI 0.34-0.59; P<.001) or being admitted to a hospital (OR 0.75, 95% CI 0.62-0.90; P=.002), but after adjusting for time, these differences were not significant (P=.07 for consultation; P=.30 for hospital admission). CONCLUSIONS: The addition of e-CCM decision support by using smartphones led to a greater proportion of children being referred to higher-level facilities, with no apparent increase in hospital admissions or repeat consultations in village clinics. Our findings provide support for the implementation of e-CCM tools in Malawi and other low- and middle-income countries with a need for ongoing assessments of effectiveness and integration with national digital health strategies. TRIAL REGISTRATION: ClinicalTrials.gov NCT02763345; https://clinicaltrials.gov/ct2/show/NCT02763345.

Are we on the same page? Exploring stakeholders' shared mental models of mobile health in rural Nigeria.

Despite the benefits promised by mobile health, the introduction of these solutions is often met with resistance from various stakeholders. This article adopts a shared mental model approach to unearth the current perceptions, concerns, and mentalities of key stakeholders engaged in the provision of healthcare in Nigeria. These include policy makers, academics, healthcare professionals, and health information systems developers. Interviews and focus groups were used to examine stakeholders' views across three mental models: (1) the technology, (2) processes, and (3) the team. Our investigations reveal disparities in stakeholders' existing mental models and their perceptions of the proposed mobile health solution. We argue that fostering a common understanding of mobile health, as well as elucidating an improved understanding of processes and team behaviours, will mitigate the risk of resistance among stakeholders involved in the design and delivery of community healthcare services and culminate in a positive attitude towards new mobile health solutions among these stakeholders. We highlight the need to enhance communication and training from national to rural levels to promote complementary mental models and positively influence team performance.

MHealth and perceived quality of care delivery: a conceptual model and validation.

BACKGROUND: The objective of this research is to examine, conceptualize, and empirically validate a model of mobile health (mHealth) impacts on physicians' perceived quality of care delivery (PQoC). METHODS: Observational quasi-experimental one group posttest-only design was implemented through the empirical testing of the conceptual model with nine hypotheses related to the association of task and technology characteristics, self-efficacy, m-health utilization, task-technology fit (TTF), and their relationships with PQoC. Primary data was collected over a four-month period from acute care physicians in The Ottawa Hospital, Ontario, Canada. The self-reported data was collected by employing a survey and distributed through the internal hospital channels to physicians who adopted iPads for their daily activities. RESULTS: Physicians' PQoC was found to be positively affected by the level of mHealth utilization and TTF, while the magnitude of the TTF direct effect was two times stronger than utilization. Additionally, self-efficacy has the highest direct and total effect on mHealth utilization; in the formation of TTF, technological characteristics dominate followed by task characteristics. CONCLUSION: To date, the impact of utilized mHealth on PQoC has neither been richly theorized nor explored in depth. We address this gap in existing literature. Realizing how an organization can improve TTF will lead to better PQoC.

Considerations for Improved Mobile Health Evaluation: Retrospective Qualitative Investigation.

BACKGROUND: Mobile phone use and, consequently, mobile health (mHealth) interventions have seen an exponential increase in the last decade. There is an excess of 318,000 health-related apps available free of cost for consumers to download. However, many of these interventions are not evaluated and are lacking appropriate regulations. Randomized controlled trials are often considered the gold standard study design in determining the effectiveness of interventions, but recent literature has identified limitations in the methodology when used to evaluate mHealth. OBJECTIVE: The objective of this study was to investigate the system developers' experiences of evaluating mHealth interventions in the context of a developing country. METHODS: We employed a qualitative exploratory approach, conducting semistructured interviews with multidisciplinary members of an mHealth project consortium. A conventional content analysis approach was used to allow codes and themes to be identified directly from the data. RESULTS: The findings from this study identified the system developers' perceptions of mHealth evaluation, providing an insight into the requirements of an effective mHealth evaluation. This study identified social and technical factors which should be taken into account when evaluating an mHealth intervention. CONCLUSIONS: Contextual issues represented one of the most recurrent challenges of mHealth evaluation in the context of a developing country, highlighting the importance of a mixed method evaluation. There is a myriad of social, technical, and regulatory variables, which may impact the effectiveness of an mHealth intervention. Failure to account for these variables in an evaluation may limit the ability of the intervention to achieve long-term implementation and scale.

People Welcomed This Innovation with Two Hands: A Qualitative Report of an mHealth Intervention for Community Case Management in Malawi.

INTRODUCTION: Community Case Management (CCM) aims to improve health outcomes among children under five with malaria, diarrhea, and pneumonia, but its effectiveness in Malawi is limited by inconsistent standards of delivery characteristic of paper-based interventions. This may lead to negative impacts on child health outcomes and inefficient use of health system resources. This study evaluated the acceptability and impact of the Supporting LIFE Community Case Management App (SL eCCM App) by Health Surveillance Assistants (HSAs) and caregivers in two districts of Northern Malawi. METHODS: Data were collected through semi-structured interviews with HSAs and caregivers as part of a nested study within a larger trial. We used deductive and inductive approaches during data analysis. Relevant constructs were identified from the Consolidated Framework for Implementation Research and combined with emerging concepts from the data. The Framework Method was used to chart and explore data, leading to the development of themes. RESULTS: Seventeen HSAs and 28 caregivers were interviewed. Participants were generally enthusiastic about the SL eCCM App. Nearly all HSAs expressed a preference for the App over routine paper-based CCM. Most HSAs claimed the App was more reliable and less error prone, facilitated more accurate diagnoses and treatment recommendations, and enhanced professional confidence and respect in the community. Some HSAs believed additional features would improve usability of the App, others identified mobile network or electricity shortages as barriers. Not all caregivers understood the purpose of the App, but most welcomed it as a health and technological advancement. CONCLUSION: The SL eCCM App is acceptable to both HSAs and caregivers, and in most cases, preferred, as it was believed to foster improvements in CCM delivery. Our findings suggest that mobile health interventions for CCM, such as the SL eCCM App, may have potential to improve the effectiveness and efficiency of care to children under five.

Perceptions of a mobile health intervention for Community Case Management in Malawi: Opportunities and challenges for Health Surveillance Assistants in a community setting.

Background: Improved availability of mobile phones in low- and middle-income countries (LMICs) offer an opportunity to improve delivery of Community Case Management (CCM). Despite enthusiasm for introducing mHealth into healthcare across LMICs, end-user attitudes towards mHealth solutions for CCM are limited. We aimed to explore Health Surveillance Assistants' (HSAs) perceptions of the Supporting LIFE electronic CCM Application (SL eCCM App) and their experiences incorporating it as part of their clinical practice. Methods: This exploratory qualitative study was part of a mixed methods feasibility study investigating whether children under-5 presenting to village clinics could be followed-up to collect patient outcome data. The convenience sample of 12 HSAs enrolled into the feasibility study participated in semi-structured interviews, which were conducted at village clinics after HSAs had field-tested the SL eCCM App over a 10-day period. Interviews explored HSAs perceptions of the SL eCCM App and their experiences in using the App in addition to paper CCM to assess and treat acutely unwell children. Open coding was used to label emerging concepts, which were iteratively defined and developed into six key themes. Results: HSAs' perceived enhanced clinical decision-making, quality of CCM delivery, and work efficiency as opportunities associated with using the SL eCCM App. HSAs believed the inability to retrieve patient records,, cumbersome duplicate assessments/data entry study procedures, and inconsistencies between the SL eCCM App and paper-based CCM guidelines as challenges to implementation. Adding features to the App, such as, permitting communication between colleagues/supervisors, drug stock-out reporting, and community assessments, were identified as potentially supporting HSAs' many roles in the community. Conclusion: This study identified opportunities and challenges associated with using the SL eCCM App in Malawi. This information can be used to inform future development and evaluation of the SL eCCM App, and similar mHealth solutions for CCM in Malawi and other developing countries.

The added value of a mobile application of Community Case Management on referral, re-consultation and hospitalization rates of children aged under 5 years in two districts in Northern Malawi: study protocol for a pragmatic, stepped-wedge cluster-randomized controlled trial.

BACKGROUND: There is evidence to suggest that frontline community health workers in Malawi are under-referring children to higher-level facilities. Integrating a digitized version of paper-based methods of Community Case Management (CCM) could strengthen delivery, increasing urgent referral rates and preventing unnecessary re-consultations and hospital admissions. This trial aims to evaluate the added value of the Supporting LIFE electronic Community Case Management Application (SL eCCM App) compared to paper-based CCM on urgent referral, re-consultation and hospitalization rates, in two districts in Northern Malawi. METHODS/DESIGN: This is a pragmatic, stepped-wedge cluster-randomized trial assessing the added value of the SL eCCM App on urgent referral, re-consultation and hospitalization rates of children aged 2 months and older to up to 5 years, within 7 days of the index visit. One hundred and two health surveillance assistants (HSAs) were stratified into six clusters based on geographical location, and clusters randomized to the timing of crossover to the intervention using simple, computer-generated randomization. Training workshops were conducted prior to the control (paper-CCM) and intervention (paper-CCM + SL eCCM App) in assigned clusters. Neither participants nor study personnel were blinded to allocation. Outcome measures were determined by abstraction of clinical data from patient records 2 weeks after recruitment. A nested qualitative study explored perceptions of adherence to urgent referral recommendations and a cost evaluation determined the financial and time-related costs to caregivers of subsequent health care utilization. The trial was conducted between July 2016 and February 2017. DISCUSSION: This is the first large-scale trial evaluating the value of adding a mobile application of CCM to the assessment of children aged under 5 years. The trial will generate evidence on the potential use of mobile health for CCM in Malawi, and more widely in other low- and middle-income countries. TRIAL REGISTRATION: ClinicalTrials.gov, ID: NCT02763345 . Registered on 3 May 2016.