Pause, re-think, go virtual pandemic adaptations from 20 diverse mental health promotion intervention projects across Canada.

The Government of Canada's Mental Health Promotion Innovation Fund (MHP-IF) is a platform for learning across diverse projects, facilitated by a Knowledge Development and Exchange Hub. MHP-IF projects were getting underway before the COVID-19 pandemic escalated in 2020 and dramatically shifted their circumstances and activities. Using storytelling methods, this study explored 20 project experiences during the first year of the pandemic, including how and why assumptions, plans, and activities were adapted; early signals about what was working well or not; and how adaptations influenced equity, access, and cultural safety. Project teams generally navigated through four stages: pausing, re-thinking, adapting, and settling into adjustments. Within and across these stages, projects addressed similar processes, including meeting fundamental needs of participants and project teams, managing unanticipated benefits, and engaging with online formats. All projects experienced the pandemic's influence of amplifying both inequities and public and political attention on mental health. This study provides experiential evidence from diverse settings and populations in Canada about pandemic adaptations. The multi-project model and storytelling methods can usefully contribute to additional research, including ways to address inequities and promote cultural safety.

Engaged scholarship and public policy decision-making: a scoping review.

BACKGROUND: Engaged scholarship includes the coproduction and use of research by partnerships that blend research, policy and/or practice perspectives. This way of doing research attempts to bridge-the-gap between knowledge and its application. Recent reviews have described practices that support engagement and involve the community in research and patients in healthcare but there is less known about how to engage individuals working to inform public policy. AIMS AND OBJECTIVES: The purpose of this research was to articulate the actions and context that support the coproduction and use of research to inform public policy decisions. The study focuses on partnerships between researchers and stakeholders working in public policy across different levels and sectors of government. METHODS: A scoping review methodology was used. Relevant articles were identified from six electronic bibliographic databases of peer-reviewed literature. FINDINGS: A total of 9904 articles were screened and 375 full-text articles were assessed for eligibility. The included 11 studies were from research partnerships internationally and described actions and contextual factors contributing to the coproduction and use of research to inform public policy. Key actions included facilitating frequent interactions with public policy stakeholders, joint planning for research, and collaboration to execute data collection and analysis. Contextual factors included clarity in responsibilities, prior relationships, and mutual respect for partner priorities and perspectives. CONCLUSIONS: Key actions and contextual factors were identified in this review and warrant further study to strengthen research-policy partnerships and their outcomes.

Chronic disease prevention evaluation in Ontario's public health system: a qualitative needs assessment.

OBJECTIVES: Building evaluation capacity for chronic disease prevention (CDP) is a critical step in ensuring the effectiveness of CDP programming over time. In this article, we highlight the findings of the qualitative arm of a mixed-methods needs assessment designed to assess the gaps and areas of strength within Ontario's public health system with respect to CDP evaluation. METHODS: We conducted 29 interviews and focus groups with representatives from 25 public health units (PHUs) and analyzed the data using thematic analysis. We sought to understand what gaps and challenges exist in the Ontario public health system around CDP evaluation. RESULTS: Challenges facing Ontario's PHUs in CDP evaluation include variation and centralization of capacity to evaluate, as well as competing priorities limiting the development of evaluative thinking. Participating PHUs identified the need for evaluation capacity building (ECB) strategies grounded in an understanding of the unique contexts in which they work and a desire for guidance in conducting a complex and thoughtful evaluation. Moving forward, PHUs noted a desire for a strong system of knowledge sharing and consultation across the public health system, including through strengthening existing partnerships with community collaborators. CONCLUSION: These results support the case for ECB strategies that are adaptive and context-sensitive and equip PHUs with the skills required to evaluate complex CDP programming.

RéSUMé: OBJECTIFS: Le renforcement des capacités en évaluation dans le domaine de la prévention des maladies chroniques (PMC) est crucial pour assurer l'efficacité des programmes visant à prévenir les maladies chroniques au fil du temps. Dans cet article, nous rapportons les résultats du volet qualitatif d'une analyse des besoins utilisant les méthodes mixtes conçues pour rendre compte des lacunes et des forces du système de santé publique de l'Ontario en matière d'évaluation de programmes de PMC. MéTHODES: Nous avons d'abord mené 29 entretiens et groupes de discussion auprès de 25 unités de santé publique (USP) pour ensuite analyser les données recueillies par une analyse thématique de contenu. Nous avons cherché à identifier les lacunes, les forces et les défis qui existent dans le système de santé publique de l'Ontario en matière d'évaluation de programmes de PMC. RéSULTATS: Les défis auxquels sont confrontées les USP de l'Ontario en matière d'évaluation de programmes de PMC comprennent la centralisation et les variations dans les capacités à réaliser l'évaluation ainsi que les priorités concurrentes qui limitent le développement de la pensée évaluative. Les organisations participantes souhaitent des stratégies de renforcement des capacités en évaluation qui tiennent compte des différents contextes dans lesquelles elles travaillent ainsi qu'un soutien dans la réalisation d'évaluations complexes. Pour aller de l'avant, les USP souhaitent également mettre en place un système efficace d'échanges d'informations et de consultations à travers le système de santé publique, notamment en renforçant les partenariats existants dans le milieu communautaire. CONCLUSION: Ces résultats appellent l'élaboration de stratégies de renforcement des capacités en évaluation qui sont flexibles, sensibles au contexte et qui dotent les USP des compétences requises en matière d'évaluation de programmes de PMC.

Evaluating a Tool to Support the Integration of Gender in Programs to Promote Men's Health.

Men's disproportionate rate of suicide and substance use has been linked to problematic conformity to traditional masculine ideals. Mental health promotion interventions directed toward men should address the gender-specific needs of men; yet, no tools exist to provide such guidance. To address this need, the Check-Mate tool was developed as part of a global evaluation of the Movember Foundation's Social Innovators Challenge (SIC). The tool provides an initial set of evidence-based guidelines for incorporating gender-related influences in men's mental health promotion programs. This article describes the development of Check-Mate and an evaluation of its usability and usefulness. Using a qualitative descriptive approach, semistructured interviews were conducted with the leads for eight of the SIC projects; they used the tool for these. Data were analyzed using conventional content analysis. Overall, project leads found the tool user-friendly. Identified strengths of Check-Mate included its practicality, adaptability, usefulness for priming thinking on gender sensitization, and value in guiding program planning and implementation. With respect to limitations, project leads explained that the complexity of men's mental health promotion programming may limit applicability of some or all approaches included in Check-Mate. They also expressed concern about how using Check-Mate might reinforce hegemonic masculine ideals. It was suggested that examples illustrating the use of Check-Mate would be a helpful accompaniment to the tool. Findings indicate that Check-Mate is a useful guide in men's mental health promotion programming. In addition to future testing of the tool in different settings, links between the tool's approaches and program outcomes should be explored.

A mixed methods evaluation of capturing and sharing practitioner experience for improving local tobacco control strategies.

OBJECTIVE: Practitioner experience is one type of evidence that is used in public health planning and action. Yet, methods for capturing and sharing experience are under-developed. We evaluated the reach, uptake and use of an example of capturing and sharing practitioner experience from tobacco control known as documentation of practice (DoP) reports. METHODS: The participatory, mixed methods approach included the following: a document review to capture data related to the extent and how DoP reports reached the target population; an online survey to assess awareness, use and perceptions about DoP reports; and semi-structured interviews to identify and explore examples of instrumental, conceptual and symbolic use of DoP reports. The samples for the survey and interviews included tobacco control practitioners from public health units in Ontario, Canada. RESULTS: Seventy-three individuals participated in the survey and 10 were interviewed. Awareness of at least one DoP report was high. The most common way of learning about DoP reports was email. DoP reports focused on policy issues had highest use; these reports were used in conceptual (helped raise awareness), instrumental (directly informed local policy development) and symbolic (confirmed a choice already made) ways. DoP reports may be improved with key messages, shorter development timelines, more relevant topic selection and dissemination to audiences beyond public health. CONCLUSION: DoP reports are useful to public health practitioners working in tobacco control within Ontario; refinements to development and dissemination processes will enhance use. Future studies and adaptations of DoP reports could help improve use of practitioner experience as one source of evidence informing public health practice.

Knowledge translation for realist reviews: a participatory approach for a review on scaling up complex interventions.

BACKGROUND: Knowledge syntheses that use a realist methodology are gaining popularity. Yet, there are few reports in the literature that describe how results are summarised, shared and used. This paper aims to inform knowledge translation (KT) for realist reviews by describing the process of developing a KT strategy for a review on pathways for scaling up complex public health interventions. METHODS: The participatory approach used for the realist review was also used to develop the KT strategy. The approach included three main steps, namely (1) an international meeting focused on interpreting preliminary findings from the realist review and seeking input on KT activities; (2) a targeted literature review on KT for realist reviews; and (3) consultations with primary knowledge users of the review. RESULTS: The international meeting identified a general preference among knowledge users for findings from the review that are action oriented. A need was also identified for understanding how to tailor findings for specific knowledge user groups in relation to their needs. The literature review identified four papers that included brief descriptions of planned or actual KT activities for specific research studies; however, information was minimal on what KT activities or products work for whom, under what conditions and why. The consultations revealed that KT for realist reviews should consider the following: (1) activities closely aligned with the preferences of specific knowledge user groups; (2) key findings that are sensitive to factors within the knowledge user's context; and (3) actionable statements that can advance KT goals, activities or products. The KT strategy derived from the three activities includes a planning framework and tailored KT activities that address preferences of knowledge users for findings that are action oriented and context relevant. CONCLUSIONS: This paper provides an example of a KT strategy for realist reviews that blends theoretical and practical insights. Evaluation of the strategy's implementation will provide useful insights on its effectiveness and potential for broader application.

Financial Impact of Incentive Spirometry.

Despite largely unproven clinical effectiveness, incentive spirometry (IS) is widely used in an effort to reduce postoperative pulmonary complications. The objective of the study is to evaluate the financial impact of implementing IS. The amount of time nurses and RTs spend each day doing IS-related activities was assessed utilizing an online survey distributed to the relevant national nursing and respiratory therapists (RT) societies along with questionnaire that was prospectively collected every day for 4 weeks at a single 10-bed cardiothoracic surgery step-down unit. Cost of RT time to teach IS use to patients and cost of nurse time spent reeducating and reminding patients to use IS were used to calculate IS implementation cost estimates per patient. Per-patient cost of IS implementation ranged from $65.30 to $240.96 for a mean 9-day step-down stay. For the 566 patients who stayed in the 10-bed step-down in 2016, the total estimated cost of implementing IS ranged from $36 959.80 to $136 383.36. Using national survey workload data, per-patient cost of IS implementation costed $107.36 (95% confidence interval [CI], $97.88-$116.98) for a hospital stay of 4.5 days. For the 9.7 million inpatient surgeries performed annually in the United States, the total annual cost of implementing postoperative IS is estimated to be $1.04 billion (95% CI, $949.4 million-$1.13 billion). The cost of implementing IS is substantial. Further efficacy studies are necessary to determine whether the cost is justifiable.

Alliance members' roles in collective field-building: an assessment of leadership and championship within the Population Health Intervention Research Initiative for Canada.

BACKGROUND: The Population Health Intervention Research Initiative for Canada (PHIRIC) is a multi-stakeholder alliance founded in 2006 to advance population health intervention research (PHIR). PHIRIC aimed to strengthen Canada's capacity to conduct and use such research to inform policy and practice to improve the public's health by building PHIR as a field of research. In 2014, an evaluative study of PHIRIC at organisational and system levels was conducted, guided by a field-building and collaborative action perspective. METHODS: The study involved 17 qualitative key informant interviews with 21 current and former PHIRIC Planning Committee and Working Group members. The interviews examined how individuals and organisations were acting as champions and exerting leadership in building the field of PHIR. RESULTS: Founding PHIRIC organisational members have been championing PHIR at organisational and system levels. While the PHIR field has progressed in terms of enhanced funding, legitimacy, profile and capacity, some members and organisations faced constraints and challenges acting as leaders and champions in their respective environments. Expectations about the future of PHIRIC and field-building of PHIR were mixed, where longer-term and founding members of PHIRIC expressed more optimism than recent members. All agreed on the need for incorporating perspectives of decision-makers into PHIR directions and initiatives. CONCLUSIONS: The findings contribute to understanding alliance members' roles in leadership and championship for field-building more generally, and for population health and PHIR specifically. Building this field requires multi-level efforts, collaborative action and distributed leadership to create the necessary conditions for PHIRIC members to both benefit from and contribute to advancing PHIR as a field. Lessons from this 'made in Canada' model may be of interest to other countries regarding the structures needed for PHIR field-building.

Exploring the unanticipated effects of multi-sectoral partnerships in chronic disease prevention.

Multi-sectoral partnerships are important parts of many public health efforts to address chronic diseases, such as cancer, diabetes, and cardiovascular disease. Despite the potential value of multi-sectoral approaches, uncertainty exists regarding their effects on individuals, organizations, communities and populations. This article reports on a study that examined the unanticipated effects (both positive and negative) of the Public Health Agency of Canada's (the Agency) Multi-sectoral Partnerships initiative, which supports more than 30 multi-sectoral partnership projects across Canada. Thirteen semi-structured interviews were conducted with staff from organizations participating in 3 diverse partnership projects as part of the Agency's multi-sectoral partnerships initiative. Multiple unanticipated effects were identified and organized into 4 themes: (1) insights about the flexibility and responsiveness of government; (2) access to new and valuable resources (people, skills, expertise); (3) opportunity to build new capacities; and (4) understanding realistic timelines for partnership activities and outcomes. While these effects were unanticipated for study participants, they resonate with insights from the literature on multi-sectoral partnerships. These results raise a number of questions for consideration as partnership initiatives continue to evolve, including the types of training that partners might need; the individual and organizational capacities required for partnership approaches; and the evaluation techniques that might be most useful to capture the non-linear effects of partnership approaches.

Scaling up complex interventions: insights from a realist synthesis.

Preventing chronic diseases, such as cancer, cardiovascular disease and diabetes, requires complex interventions, involving multi-component and multi-level efforts that are tailored to the contexts in which they are delivered. Despite an increasing number of complex interventions in public health, many fail to be 'scaled up'. This study aimed to increase understanding of how and under what conditions complex public health interventions may be scaled up to benefit more people and populations.A realist synthesis was conducted and discussed at an in-person workshop involving practitioners responsible for scaling up activities. Realist approaches view causality through the linkages between changes in contexts (C) that activate mechanisms (M), leading to specific outcomes (O) (CMO configurations). To focus this review, three cases of complex interventions that had been successfully scaled up were included: Vibrant Communities, Youth Build USA and Pathways to Education. A search strategy of published and grey literature related to each case was developed, involving searches of relevant databases and nominations from experts. Data extracted from included documents were classified according to CMO configurations within strategic themes. Findings were compared and contrasted with guidance from diffusion theory, and interpreted with knowledge users to identify practical implications and potential directions for future research.Four core mechanisms were identified, namely awareness, commitment, confidence and trust. These mechanisms were activated within two broad scaling up strategies, those of renewing and regenerating, and documenting success. Within each strategy, specific actions to change contexts included building partnerships, conducting evaluations, engaging political support and adapting funding models. These modified contexts triggered the identified mechanisms, leading to a range of scaling up outcomes, such as commitment of new communities, changes in relevant legislation, or agreements with new funding partners.This synthesis applies and advances theory, realist methods and the practice of scaling up complex interventions. Practitioners may benefit from a number of coordinated efforts, including conducting or commissioning evaluations at strategic moments, mobilising local and political support through relevant partnerships, and promoting ongoing knowledge exchange in peer learning networks. Action research studies guided by these findings, and studies on knowledge translation for realist syntheses are promising future directions.

Outcomes of Interorganizational Networks in Canada for Chronic Disease Prevention: Insights From a Concept Mapping Study, 2015.

INTRODUCTION: We conducted a mixed methods study from June 2014 to March 2015 to assess the perspectives of stakeholders in networks that adopt a population approach for chronic disease prevention (CDP). The purpose of the study was to identify important and feasible outcome measures for monitoring network performance. METHODS: Participants from CDP networks in Canada completed an online concept mapping exercise, which was followed by interviews with network stakeholders to further understand the findings. RESULTS: Nine concepts were considered important outcomes of CDP networks: enhanced learning, improved use of resources, enhanced or increased relationships, improved collaborative action, network cohesion, improved system outcomes, improved population health outcomes, improved practice and policy planning, and improved intersectoral engagement. Three themes emerged from participant interviews related to measurement of the identified concepts: the methodological difficulties in measuring network outcomes, the dynamic nature of network evolution and function and implications for outcome assessment, and the challenge of measuring multisectoral engagement in CDP networks. CONCLUSION: Results from this study provide initial insights into concepts that can be used to describe the outcomes of networks for CDP and may offer foundations for strengthening network outcome-monitoring strategies and methodologies.

Building the field of population health intervention research: The development and use of an initial set of competencies.

Population health intervention research (PHIR) is a relatively new research field that studies interventions that can improve health and health equity at a population level. Competencies are one way to give legitimacy and definition to a field. An initial set of PHIR competencies was developed with leadership from a multi-sector group in Canada. This paper describes the development process for these competencies and their possible uses. Methods to develop the competencies included key informant interviews; a targeted review of scientific and gray literature; a 2-round, online adapted Delphi study with a 24-member panel; and a focus group with 9 international PHIR experts. The resulting competencies consist of 25 items grouped into 6 categories. They include principles of good science applicable though not exclusive to PHIR, and more suitable for PHIR teams rather than individuals. This initial set of competencies, released in 2013, may be used to develop graduate student curriculum, recruit trainees and faculty to academic institutions, plan non-degree professional development, and develop job descriptions for PHIR-related research and professional positions. The competencies provide some initial guideposts for the field and will need to be adapted as the PHIR field matures and to meet unique needs of different jurisdictions.

Improving the performance of interorganizational networks for preventing chronic disease: identifying and acting on research needs.

This article describes the role of interorganizational networks in chronic disease prevention and an action research agenda for promoting understanding and improvement. Through a model of engaged scholarship, leaders with expertise and experience in chronic disease prevention networks helped shape research directions focused on network value, governance, and evolution. The guiding principles for facilitating this research include applying existing knowledge, developing network-appropriate methods and measures, creating structural change, promoting an impact orientation, and fostering cultural change.

Interorganizational relationships in the Heart and Stroke Foundation's Spark Together for Healthy Kids™: insights from using network analysis.

The Heart and Stroke Foundation's Spark Together for Healthy Kids™ (Spark) is a multiyear initiative in Ontario, Canada, that takes a population approach to obesity prevention. It focuses on creating healthy environments by improving access to healthy foods and physical activity, with an emphasis on strengthening the advocacy capacity of organizations and citizens. Consistent with the complexity of the intervention, the evaluation of Spark applied systems concepts and methods to test the utility of network analysis as a method for evaluation, and to inform collaborations of organizations involved in programs and advocacy. Relationships among organizations from different sectors and jurisdictional levels with a focus on school community environments were of particular interest. Interorganizational network analysis was used to understand these relationships, including the role of the Heart and Stroke Foundation. Findings revealed a niche brokering role for the Heart and Stroke Foundation and other provincial and national organizations, and the importance of these brokers for engaging local and regional organizations. Findings also reinforced the importance of a mixed methods approach to network analysis, and the potential value of the analysis for scientific and practical purposes.

Networks to strengthen health systems for chronic disease prevention.

Interorganizational networks that harness the priorities, capacities, and skills of various agencies and individuals have emerged as useful approaches for strengthening preventive services in public health systems. We use examples from the Canadian Heart Health Initiative and Alberta's Primary Care Networks to illustrate characteristics of networks, describe the limitations of existing frameworks for assessing the performance of prevention-oriented networks, and propose a research agenda for guiding future efforts to improve the performance of these initiatives. Prevention-specific assessment strategies that capture relevant aspects of network performance need to be identified, and feedback mechanisms are needed that make better use of these data to drive change in network activities.

Strengthening chronic disease prevention programming: the Toward Evidence-Informed Practice (TEIP) Program Evidence Tool.

In public health and chronic disease prevention there is increasing priority for effective use of evidence in practice. In Ontario, Canada, despite various models being advanced, public health practitioners are seeking ways to identify and apply evidence in their work in practical and meaningful ways. In a companion article, "Strengthening Chronic Disease Prevention Programming: The Toward Evidence-Informed Practice (TEIP) Program Assessment Tool," we describe use of a tool to assess and strengthen program planning and implementation processes using 19 criteria derived from best and promising practices literature. In this article, we describe use of a complementary Program Evidence Tool to identify, synthesize, and apply a range of evidence sources to strengthen the content of chronic disease prevention programming.The Program Evidence Tool adapts tools of evidence-based medicine to the unique contexts of community-based health promotion and chronic disease prevention. Knowledge management tools and a guided dialogue process known as an Evidence Forum enable community stakeholders to make appropriate use of evidence in diverse social, political, and structural contexts. Practical guidelines and worksheets direct users through 5 steps: 1) define an evidence question, 2) develop a search strategy, 3) collect and synthesize evidence, 4) interpret and adapt evidence, and 5) implement and evaluate. We describe the Program Evidence Tool's benefits, strengths, challenges, and what was learned from its application in 4 Ontario public health departments. The Program Evidence Tool contributes to the development and understanding of the complex use of evidence in community-based chronic disease prevention.

Strengthening chronic disease prevention programming: the Toward Evidence-Informed Practice (TEIP) Program Assessment Tool.

Best practices identified solely on the strength of research evidence may not be entirely relevant or practical for use in community-based public health and the practice of chronic disease prevention. Aiming to bridge the gap between best practices literature and local knowledge and expertise, the Ontario Public Health Association, through the Toward Evidence-Informed Practice initiative, developed a set of resources to strengthen evidence-informed decision making in chronic disease prevention programs. A Program Assessment Tool, described in this article, emphasizes better processes by incorporating review criteria into the program planning and implementation process. In a companion paper, "Strengthening Chronic Disease Prevention Programming: The Toward Evidence-Informed Practice (TEIP) Program Evidence Tool," we describe another tool, which emphasizes better evidence by providing guidelines and worksheets to identify, synthesize, and incorporate evidence from a range of sources (eg, peer-reviewed literature, gray literature, local expertise) to strengthen local programs.The Program Assessment Tool uses 19 criteria derived from literature on best and promising practices to assess and strengthen program planning and implementation. We describe the benefits, strengths, and challenges in implementing the tool in 22 community-based chronic disease prevention projects in Ontario, Canada. The Program Assessment Tool helps put best processes into operation to complement adoption and adaptation of evidence-informed practices for chronic disease prevention.

"The magic is in the mix": lessons from research capacity building in the Canadian tobacco control community, 2000-2010.

Global public health issues, including tobacco use, will be addressed most effectively if informed by relevant evidence. Additional capacity is needed to undertake and sustain relevant and rigorous research that will inform and enable learning from interventions. Despite the undisputed importance of research capacity building (RCB), there is little evidence about how to create relevant capacities. RCB for tobacco control in Canada from 2000-2010 offers a rich experience from which to learn. Lessons were derived using structured data collection from seven capacity-building initiatives and an invitational workshop, at which reflections on major contributions and lessons learned were discussed by initiative leads. Ten years of RCB for tobacco control in Canada revealed the importance of a) taking an organic approach to RCB, b) targeting and sustaining investments in a mix of RCB activities, c) vision and collaborative leadership at organizational and initiative levels, d) a focus on building community, and e) studying capacity building. The experience also provided tangible examples of RCB initiatives and how independent investments can be linked to create a coherent approach. Looking ahead, promising directions may include positioning RCB within a broader context of "field building", focusing on practical approaches to sustainability, and enhancing research on RCB.