Tools for assessing health research partnership outcomes and impacts: a systematic review.

OBJECTIVE: To identify and assess the globally available valid, reliable and acceptable tools for assessing health research partnership outcomes and impacts. METHODS: We searched Ovid MEDLINE, Embase, CINAHL Plus and PsycINFO from origin to 2 June 2021, without limits, using an a priori strategy and registered protocol. We screened citations independently and in duplicate, resolving discrepancies by consensus and retaining studies involving health research partnerships, the development, use and/or assessment of tools to evaluate partnership outcomes and impacts, and reporting empirical psychometric evidence. Study, tool, psychometric and pragmatic characteristics were abstracted using a hybrid approach, then synthesized using descriptive statistics and thematic analysis. Study quality was assessed using the quality of survey studies in psychology (Q-SSP) checklist. RESULTS: From 56 123 total citations, we screened 36 027 citations, assessed 2784 full-text papers, abstracted data from 48 studies and one companion report, and identified 58 tools. Most tools comprised surveys, questionnaires and scales. Studies used cross-sectional or mixed-method/embedded survey designs and employed quantitative and mixed methods. Both studies and tools were conceptually well grounded, focusing mainly on outcomes, then process, and less frequently on impact measurement. Multiple forms of empirical validity and reliability evidence was present for most tools; however, psychometric characteristics were inconsistently assessed and reported. We identified a subset of studies (22) and accompanying tools distinguished by their empirical psychometric, pragmatic and study quality characteristics. While our review demonstrated psychometric and pragmatic improvements over previous reviews, challenges related to health research partnership assessment and the nascency of partnership science persist. CONCLUSION: This systematic review identified multiple tools demonstrating empirical psychometric evidence, pragmatic strength and moderate study quality. Increased attention to psychometric and pragmatic requirements in tool development, testing and reporting is key to advancing health research partnership assessment and partnership science. PROSPERO CRD42021137932.

Adapting evidence-informed population health interventions for new contexts: a scoping review of current practice.

BACKGROUND: Implementing evidence-informed population health interventions in new contexts often requires adaptations. While the need to adapt interventions to better fit new contexts is recognised, uncertainties remain regarding why and when to adapt (or not), and how to assess the benefits (or not) of adaptation. The ADAPT Study aims to develop comprehensive guidance on adaptation. This scoping review informs guidance development by mapping and exploring how adaptation has been undertaken in practice, in public health and health services research. METHODS: We searched seven databases from January 2000 and October 2018 to identify eligible studies for this scoping review and a related systematic review of adaptation guidance. We mapped the studies of adaptation by coding data from all eligible studies describing the methods, contexts, and interventions considered for adaptation. From this map, we selected a sample of studies for in-depth examination. Two reviewers extracted data independently into seven categories: description, key concepts, types, rationale, processes, evaluation methods, evaluation justification, and accounts of failures and successes. RESULTS: We retrieved 6694 unique records. From 429 records screened at full text, we identified 298 eligible studies for mapping and selected 28 studies for in-depth examination. The majority of studies in our map focused on micro- (i.e., individual-) level interventions (84%), related to transferring an intervention to a new population group within the same country (62%) and did not report using guidance (73%). Studies covered a range of topic areas, including health behaviour (24%), mental health (19%), sexual health (16%), and parenting and family-centred interventions (15%). Our in-depth analysis showed that adaptation is seen to save costs and time relative to developing a new intervention, and to enhance contextual relevance and cultural compatibility. It commonly follows a structured process and involves stakeholders to help with decisions on what to adapt, when, and how. CONCLUSIONS: Adaptation has been undertaken on a range of health topics and largely in line with existing guidance. Significant gaps relate to adaptation of macro- (e.g., national-) level interventions, consideration of programme theories, mechanisms and contexts (i.e., a functional view of interventions), nuances around stakeholder involvement, and evaluation of the adapted interventions. Registration Open Science Framework, 2019, osf.io/udzma.

Interventions to reduce ambient air pollution and their effects on health: An abridged Cochrane systematic review.

BACKGROUND: A broad range of interventions have been implemented to improve ambient air quality, and many of these have been evaluated. Yet to date no systematic review has been conducted to identify and synthesize these studies. In this systematic review, we assess the effectiveness of interventions in reducing ambient particulate matter air pollution and improving adverse health outcomes. METHODS: We searched a range of electronic databases across multiple disciplines, as well as grey literature databases, trial registries, reference lists of included studies and the contents of relevant journals, through August 2016. Eligible for inclusion were randomized and cluster randomized controlled trials, as well as several non-randomized study designs often used for evaluating air quality interventions. We included studies that evaluated interventions targeting industrial, residential, vehicular and multiple sources, with respect to their effect on mortality, morbidity and the concentrations of particulate matter (PM - including PM10, PM2.5, coarse particulate matter and combustion-related PM), as well as several criteria pollutants, including ozone, carbon monoxide, nitrogen oxides, nitrogen dioxide, nitric oxide and sulphur dioxide. We did not restrict studies based on the population, setting or comparison. Two authors independently assessed studies for inclusion, extracted data and assessed risk of bias. We assessed risk of bias using the Graphic Appraisal Tool for Epidemiological studies (GATE) for correlation studies, as modified and employed by the UK National Institute for Health and Care Excellence. We synthesized evidence narratively, as well as graphically using harvest plots. We assessed the certainty of evidence using the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) system. RESULTS: We included 42 studies assessing 38 unique interventions. These comprised a heterogeneous mix of interventions, including those aiming to address industrial sources (n = 5; e.g. the closure of a factory), residential sources (n = 7; e.g. coal ban), vehicular sources (n = 22; e.g. low emission zones), and multiple sources (n = 4; e.g. tailored measures that target both local traffic and industrial polluters). Evidence for effectiveness was mixed. Most included studies observed either no significant association or an association favoring the intervention, with little evidence that the assessed interventions might be harmful. CONCLUSIONS: Given the heterogeneity across interventions, outcomes, and methods, it was difficult to derive overall conclusions regarding the effectiveness of interventions in terms of improved air quality or health. Some evidence suggests that interventions are associated with improvements in air quality and human health, with very little evidence suggesting interventions were harmful. The evidence base highlights the challenges related to establishing the effectiveness of specific air pollution interventions on outcomes. It also points to the need for improved study design and analysis methods, as well as more uniform evaluations. The prospective planning of evaluations and an evaluation component built into the design and implementation of interventions may also be particularly beneficial.

Adapting evidence-informed complex population health interventions for new contexts: a systematic review of guidance.

BACKGROUND: Adapting interventions that have worked elsewhere can save resources associated with developing new interventions for each specific context. While a developing body of evidence shows benefits of adapted interventions compared with interventions transported without adaptation, there are also examples of interventions which have been extensively adapted, yet have not worked in the new context. Decisions on when, to what extent, and how to adapt interventions therefore are not straightforward, particularly when conceptualising intervention effects as contingent upon contextual interactions in complex systems. No guidance currently addresses these questions comprehensively. To inform development of an overarching guidance on adaptation of complex population health interventions, this systematic review synthesises the content of the existing guidance papers. METHODS: We searched for papers published between January 2000 and October 2018 in 7 bibliographic databases. We used citation tracking and contacted authors and experts to locate further papers. We double screened all the identified records. We extracted data into the following categories: descriptive information, key concepts and definitions, rationale for adaptation, aspects of adaptation, process of adaptation, evaluating and reporting adapted interventions. Data extraction was conducted independently by two reviewers, and retrieved data were synthesised thematically within pre-specified and emergent categories. RESULTS: We retrieved 6694 unique records. Thirty-eight papers were included in the review representing 35 sources of guidance. Most papers were developed in the USA in the context of implementing evidence-informed interventions among different population groups within the country, such as minority populations. We found much agreement on how the papers defined key concepts, aims, and procedures of adaptation, including involvement of key stakeholders, but also identified gaps in scope, conceptualisation, and operationalisation in several categories. CONCLUSIONS: Our review found limitations that should be addressed in future guidance on adaptation. Specifically, future guidance needs to be reflective of adaptations in the context of transferring interventions across countries, including macro- (e.g. national-) level interventions, better theorise the role of intervention mechanisms and contextual interactions in the replicability of effects and accordingly conceptualise key concepts, such as fidelity to intervention functions, and finally, suggest evidence-informed strategies for adaptation re-evaluation and reporting. TRIAL REGISTRATION: PROSPERO 2018, CRD42018112714.

Looking beyond the forest: Using harvest plots, gap analysis, and expert consultations to assess effectiveness, engage stakeholders, and inform policy.

We describe a combination of methods for assessing the effectiveness of complex interventions, especially where substantial heterogeneity with regard to the population, intervention, comparison, outcomes, and study design of interest is expected. We applied these methods in a recent systematic review of the effectiveness of reinforced home-based palliative care (rHBPC) interventions, which included home-based care with an additional and explicit component of lay caregiver support. We first summarized the identified evidence, deemed inappropriate for statistical pooling, graphically by creating harvest plots. Although very useful as a tool for summary and presentation of overall effectiveness, such graphical summary approaches may obscure relevant differences between studies. Thus, we then used a gap analysis and conducted expert consultations to look beyond the aggregate level at how the identified evidence of effectiveness may be explained. The goal of these supplemental methods was to step outside of the conventional systematic review and explore this heterogeneity from a broader perspective, based on the experience of palliative care researchers and practitioners. The gap analysis and expert consultations provided valuable input into possible underlying explanations in the evidence, which could be helpful in the further adaptation and testing of existing rHBPC interventions or the development and evaluation of new ones. We feel that such a combination of methods could prove accessible, understandable, and useful in informing decisions and could thus help increase the relevance of systematic reviews to the decision-making process.

Teachers' competence, school policy and social context-HIV prevention needs of primary schools in Kagera, Tanzania.

Sub-Saharan Africa carries a high burden of the HIV epidemic, with young adults being particularly affected. Well-designed school-based HIV prevention interventions can contribute to establishing protective behaviour. The aim of this study was to explore the needs of primary school students and teachers in the region of Kagera, Tanzania, regarding an HIV prevention intervention in the primary school setting. The needs assessment was structured according to the PRECEDE component of the PRECEDE-PROCEED model. Qualitative data was collected in six focus group discussions with primary school students and teachers. Key informant interviews with seven experts were conducted. We employed qualitative content analysis to analyse data in MAXQDA. The findings suggest that teachers need to be adequately trained to provide HIV and sex education and to support HIV-positive students. Enabling structural factors, such as an appropriate syllabus, are required. Stigmatization has been reported a major barrier to HIV prevention in schools. Teachers and students identified a more trustful relationship between each other as well as to legal guardians of children as a basis for HIV prevention. These findings will inform the development of a tailored HIV prevention intervention.