The development of the concept of return-on-investment from large-scale quality improvement programmes in healthcare: an integrative systematic literature review.

BACKGROUND: Return on Investment (ROI) is increasingly being used to evaluate financial benefits from healthcare Quality Improvement (QI). ROI is traditionally used to evaluate investment performance in the commercial field. Little is known about ROI in healthcare. The aim of this systematic review was to analyse and develop ROI as a concept and develop a ROI conceptual framework for large-scale healthcare QI programmes. METHODS: We searched Medline, Embase, Global health, PsycInfo, EconLit, NHS EED, Web of Science, Google Scholar using ROI or returns-on-investment concepts (e.g., cost-benefit, cost-effectiveness, value). We combined this terms with healthcare and QI. Included articles discussed at least three organisational QI benefits, including financial or patient benefits. We synthesised the different ways in which ROI or return-on-investment concepts were used and discussed by the QI literature; first the economically focused, then the non-economically focused QI literature. We then integrated these literatures to summarise their combined views. RESULTS: We retrieved 10 428 articles. One hundred and two (102) articles were selected for full text screening. Of these 34 were excluded and 68 included. The included articles were QI economic, effectiveness, process, and impact evaluations as well as reports and conceptual literature. Fifteen of 68 articles were directly focused on QI programme economic outcomes. Of these, only four focused on ROI. ROI related concepts in this group included cost-effectiveness, cost-benefit, ROI, cost-saving, cost-reduction, and cost-avoidance. The remaining articles mainly mentioned efficiency, productivity, value, or benefits. Financial outcomes were not the main goal of QI programmes. We found that the ROI concept in healthcare QI aligned with the concepts of value and benefit, both monetary and non-monetary. CONCLUSION: Our analysis of the reviewed literature indicates that ROI in QI is conceptualised as value or benefit as demonstrated through a combination of significant outcomes for one or more stakeholders in healthcare organisations. As such, organisations at different developmental stages can deduce benefits that are relevant and legitimate as per their contextual needs. TRIAL REGISTRATION: Review registration: PROSPERO; CRD42021236948.

Identifying and understanding benefits associated with return-on-investment from large-scale healthcare Quality Improvement programmes: an integrative systematic literature review.

BACKGROUND: We previously developed a Quality Improvement (QI) Return-on-Investment (ROI) conceptual framework for large-scale healthcare QI programmes. We defined ROI as any monetary or non-monetary value or benefit derived from QI. We called the framework the QI-ROI conceptual framework. The current study describes the different categories of benefits covered by this framework and explores the relationships between these benefits. METHODS: We searched Medline, Embase, Global health, PsycInfo, EconLit, NHS EED, Web of Science, Google Scholar, organisational journals, and citations, using ROI or returns-on-investment concepts (e.g., cost-benefit, cost-effectiveness, value) combined with healthcare and QI. Our analysis was informed by Complexity Theory in view of the complexity of large QI programmes. We used Framework analysis to analyse the data using a preliminary ROI conceptual framework that was based on organisational obligations towards its stakeholders. Included articles discussed at least three organisational benefits towards these obligations, with at least one financial or patient benefit. We synthesized the different QI benefits discussed. RESULTS: We retrieved 10 428 articles. One hundred and two (102) articles were selected for full text screening. Of these 34 were excluded and 68 included. Included articles were QI economic, effectiveness, process, and impact evaluations as well as conceptual literature. Based on these literatures, we reviewed and updated our QI-ROI conceptual framework from our first study. Our QI-ROI conceptual framework consists of four categories: 1) organisational performance, 2) organisational development, 3) external outcomes, and 4) unintended outcomes (positive and negative). We found that QI benefits are interlinked, and that ROI in large-scale QI is not merely an end-outcome; there are earlier benefits that matter to organisations that contribute to overall ROI. Organisations also found positive aspects of negative unintended consequences, such as learning from failed QI. DISCUSSION AND CONCLUSION: Our analysis indicated that the QI-ROI conceptual framework is made-up of multi-faceted and interconnected benefits from large-scale QI programmes. One or more of these may be desirable depending on each organisation's goals and objectives, as well as stage of development. As such, it is possible for organisations to deduce incremental benefits or returns-on-investments throughout a programme lifecycle that are relevant and legitimate.

Perspectives of healthcare providers, service users, and family members about mental illness stigma in primary care settings: A multi-site qualitative study of seven countries in Africa, Asia, and Europe.

BACKGROUND: Stigma among healthcare providers is a barrier to the effective delivery of mental health services in primary care. Few studies have been conducted in primary care settings comparing the attitudes of healthcare providers and experiences of people with mental illness who are service users in those facilities. Such research is necessary across diverse global settings to characterize stigma and inform effective stigma reduction. METHODS: Qualitative research was conducted on mental illness stigma in primary care settings in one low-income country (Nepal), two lower-middle income countries (India, Tunisia), one upper-middle-income country (Lebanon), and three high-income countries (Czech Republic, Hungary, Italy). Qualitative interviews were conducted with 248 participants: 64 primary care providers, 11 primary care facility managers, 111 people with mental illness, and 60 family members of people with mental illness. Data were analyzed using framework analysis. RESULTS: Primary care providers endorsed some willingness to help persons with mental illness but reported not having appropriate training and supervision to deliver mental healthcare. They expressed that people with mental illness are aggressive and unpredictable. Some reported that mental illness is incurable, and mental healthcare is burdensome and leads to burnout. They preferred mental healthcare to be delivered by specialists. Service users did not report high levels of discrimination from primary care providers; however, they had limited expectations of support from primary care providers. Service users reported internalized stigma and discrimination from family and community members. Providers and service users reported unreliable psychiatric medication supply and lack of facilities for confidential consultations. Limitations of the study include conducting qualitative interviews in clinical settings and reliance on clinician-researchers in some sites to conduct interviews, which potentially biases respondents to present attitudes and experiences about primary care services in a positive manner. CONCLUSIONS: Primary care providers' willingness to interact with people with mental illness and receive more training presents an opportunity to address stigmatizing beliefs and stereotypes. This study also raises important methodological questions about the most appropriate strategies to accurately understand attitudes and experiences of people with mental illness. Recommendations are provided for future qualitative research about stigma, such as qualitative interviewing by non-clinical personnel, involving non-clinical staff for recruitment of participants, conducting interviews in non-clinical settings, and partnering with people with mental illness to facilitate qualitative data collection and analysis.

Adaptation of the World Health Organization Electronic Mental Health Gap Action Programme Intervention Guide App for Mobile Devices in Nepal and Nigeria: Protocol for a Feasibility Cluster Randomized Controlled Trial.

BACKGROUND: There is a growing global need for scalable approaches to training and supervising primary care workers (PCWs) to deliver mental health services. Over the past decade, the World Health Organization Mental Health Gap Action Programme Intervention Guide (mhGAP-IG) and associated training and implementation guidance have been disseminated to more than 100 countries. On the basis of the opportunities provided by mobile technology, an updated electronic Mental Health Gap Action Programme Intervention Guide (e-mhGAP-IG) is now being developed along with a clinical dashboard and guidance for the use of mobile technology in supervision. OBJECTIVE: This study aims to assess the feasibility, acceptability, adoption, and other implementation parameters of the e-mhGAP-IG for diagnosis and management of depression in 2 lower-middle-income countries (Nepal and Nigeria) and to conduct a feasibility cluster randomized controlled trial (cRCT) to evaluate trial procedures for a subsequent fully powered trial comparing the clinical effectiveness and cost-effectiveness of the e-mhGAP-IG and remote supervision with standard mhGAP-IG implementation. METHODS: A feasibility cRCT will be conducted in Nepal and Nigeria to evaluate the feasibility of the e-mhGAP-IG for use in depression diagnosis and treatment. In each country, an estimated 20 primary health clinics (PHCs) in Nepal and 6 PHCs in Nigeria will be randomized to have their staff trained in e-mhGAP-IG or the paper version of mhGAP-IG v2.0. The PHC will be the unit of clustering. All PCWs within a facility will receive the same training (e-mhGAP-IG vs paper mhGAP-IG). Approximately 2-5 PCWs, depending on staffing, will be recruited per clinic (estimated 20 health workers per arm in Nepal and 15 per arm in Nigeria). The primary outcomes of interest will be the feasibility and acceptability of training, supervision, and care delivery using the e-mhGAP-IG. Secondary implementation outcomes include the adoption of the e-mhGAP-IG and feasibility of trial procedures. The secondary intervention outcome-and the primary outcome for a subsequent fully powered trial-will be the accurate identification of depression by PCWs. Detection rates before and after training will be compared in each arm. RESULTS: To date, qualitative formative work has been conducted at both sites to prepare for the pilot feasibility cRCT, and the e-mhGAP-IG and remote supervision guidelines have been developed. CONCLUSIONS: The incorporation of mobile digital technology has the potential to improve the scalability of mental health services in primary care and enhance the quality and accuracy of care. TRIAL REGISTRATION: ClinicalTrials.gov NCT04522453; https://clinicaltrials.gov/ct2/show/NCT04522453. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/24115.

Time to Change's social marketing campaign for a new target population: results from 2017 to 2019.

BACKGROUND: Since 2009 Time to Change has included among its strategies a social marketing campaign to tackle the stigma surrounding mental health problems. At the start of its third phase (2016-2021) the target group of the campaign was kept as people aged between mid-twenties and mid-forties but changed to middle-low income groups and the content was focused on men. METHODS: Participants (n = 3700) were recruited through an online market research panel, before and after each burst of the campaign. They completed an online questionnaire evaluating knowledge (Mental Health Knowledge Schedule, MAKS); attitudes (Community Attitudes toward Mental Illness, CAMI); and desire for social distance (Intended Behaviour subscale of the Reported and Intended Behaviour Scale, RIBS). Socio-demographic data and awareness of the campaign were also collected. RESULTS: For each of the 3 bursts, significant pre-post awareness differences were found (OR = 2.83, CI = 1.90-4.20, p < 0.001; OR = 1.72, CI = 1.22-2.42, p = 0.002; OR = 1.41, CI = 1.01-1.97, p = 0.043), and awareness at the end of the third burst was 33%. Demographic factors associated with awareness for one or more bursts included having children, familiarity with mental illness, male sex, being Black, Asian or other ethnic minorities and living in London or the East Midlands regions. An improvement across bursts in the "living with" subscale item of the RIBS, and in the "recover" and "advice to a friend" MAKS items were found. Familiarity with mental illness had the strongest association with all outcome measures, while the awareness of the campaign was also related with higher scores in MAKS and RIBS. CONCLUSIONS: These interim results suggest that the campaign is reaching and having an impact on its new target audience to a similar extent as did the TTC phase 1 campaign. While over the course of TTC we have found no evidence that demographic differences in stigma have widened, and indeed those by age group and region of England have narrowed, those for socioeconomic status, ethnicity and sex have so far remained unchanged. By targeting a lower socioeconomic group and creating relatively greater awareness among men and in Black and ethnic minority groups, the campaign is showing the potential to address these persistent differences in stigma.