The Use of Contribution Analysis in Evaluating Health Interventions: A Scoping Review.

Contribution Analysis (CA) is a promising theory-based evaluation approach for complex interventions, yet its application in health interventions remains largely unexplored. To bridge this gap, we conducted a scoping review to examine the extent of such applications and the methodologies, strengths, and limitations of this approach in health programming. Our comprehensive search strategy was developed and used in 15 databases to identify peer-reviewed articles from 1999 to 2023 that focused on using CA to evaluate health interventions. We then implemented rigorous double- and triple-screening processes for abstracts and full-text papers, respectively. Data were extracted and narratively summarized. Our review found seven relevant studies, which showed that CA has been employed in health promotion programs, health policies, and targeted health issues such as nutrition, cardiovascular disease, substance misuse, and suicide prevention. The studies identified strengths of using CA, including its flexible impact evaluation approach, capacity to inform decision-making, and potential to enhance understanding of health programs and policies. However, challenges such as how to determine suitable evidence levels and how to best manage resource intensity were also identified. The limited number of studies indicates that CA is still a novel approach, whereas the variation in the reporting of the studies suggests that this approach could benefit from more standardized methods and detailed stakeholder engagement strategies.

Examining the competencies required by evaluation capacity builders in community-based organizations.

Increasing demand for evidence generated through program evaluation has led many community-based organizations (CBOs) to seek external support for evaluation capacity building (ECB). However, studies have yet to explore the essential competencies required by evaluation capacity builders working in the community sector. Our qualitative study aimed to examine the perceptions of ECB practitioners (n = 12) regarding essential competencies for building evaluation capacity in this sector. Our findings reveal that ECB practice requires competencies not found in known evaluation competency frameworks, such as instructional design, knowledge of organizational change models, motivating stakeholders, and understanding of the community sector. Our findings provide valuable information to help guide future education and training related to building the evaluation capacity of community organizations.

Chronic disease prevention evaluation in Ontario's public health system: a qualitative needs assessment.

OBJECTIVES: Building evaluation capacity for chronic disease prevention (CDP) is a critical step in ensuring the effectiveness of CDP programming over time. In this article, we highlight the findings of the qualitative arm of a mixed-methods needs assessment designed to assess the gaps and areas of strength within Ontario's public health system with respect to CDP evaluation. METHODS: We conducted 29 interviews and focus groups with representatives from 25 public health units (PHUs) and analyzed the data using thematic analysis. We sought to understand what gaps and challenges exist in the Ontario public health system around CDP evaluation. RESULTS: Challenges facing Ontario's PHUs in CDP evaluation include variation and centralization of capacity to evaluate, as well as competing priorities limiting the development of evaluative thinking. Participating PHUs identified the need for evaluation capacity building (ECB) strategies grounded in an understanding of the unique contexts in which they work and a desire for guidance in conducting a complex and thoughtful evaluation. Moving forward, PHUs noted a desire for a strong system of knowledge sharing and consultation across the public health system, including through strengthening existing partnerships with community collaborators. CONCLUSION: These results support the case for ECB strategies that are adaptive and context-sensitive and equip PHUs with the skills required to evaluate complex CDP programming.

RéSUMé: OBJECTIFS: Le renforcement des capacités en évaluation dans le domaine de la prévention des maladies chroniques (PMC) est crucial pour assurer l'efficacité des programmes visant à prévenir les maladies chroniques au fil du temps. Dans cet article, nous rapportons les résultats du volet qualitatif d'une analyse des besoins utilisant les méthodes mixtes conçues pour rendre compte des lacunes et des forces du système de santé publique de l'Ontario en matière d'évaluation de programmes de PMC. MéTHODES: Nous avons d'abord mené 29 entretiens et groupes de discussion auprès de 25 unités de santé publique (USP) pour ensuite analyser les données recueillies par une analyse thématique de contenu. Nous avons cherché à identifier les lacunes, les forces et les défis qui existent dans le système de santé publique de l'Ontario en matière d'évaluation de programmes de PMC. RéSULTATS: Les défis auxquels sont confrontées les USP de l'Ontario en matière d'évaluation de programmes de PMC comprennent la centralisation et les variations dans les capacités à réaliser l'évaluation ainsi que les priorités concurrentes qui limitent le développement de la pensée évaluative. Les organisations participantes souhaitent des stratégies de renforcement des capacités en évaluation qui tiennent compte des différents contextes dans lesquelles elles travaillent ainsi qu'un soutien dans la réalisation d'évaluations complexes. Pour aller de l'avant, les USP souhaitent également mettre en place un système efficace d'échanges d'informations et de consultations à travers le système de santé publique, notamment en renforçant les partenariats existants dans le milieu communautaire. CONCLUSION: Ces résultats appellent l'élaboration de stratégies de renforcement des capacités en évaluation qui sont flexibles, sensibles au contexte et qui dotent les USP des compétences requises en matière d'évaluation de programmes de PMC.

Difficult but Close Relationships: Children's Perspectives on Relationships With Their Mothers in the Context of Domestic Violence.

This article reports findings from a participative and qualitative study conducted with children who had experienced domestic violence, focusing on their perspectives on their relationships with their mothers. Three focus groups and 46 individual interviews were conducted with children to gather their experiences. The research findings demonstrate that women's and children's victimizations are inextricably linked, and that domestic violence affects mother-child relationships. They also show that, despite the challenges and difficulties, children generally consider their mothers as very significant individuals in their lives, and have close relationships with them. The findings also reveal a dynamic of mutual protectiveness.