Lessons Learned from the Implementation of Youth Wellness Hubs Ontario, an Integrated Youth Services Network: Perspectives from Network Leads.

Introduction: Mental health and substance use services for youth in Canada continue to be fragmented. In response, Integrated Youth Services (IYS) has been proposed to address gaps in youth mental health services that can lead to improved youth outcomes. Youth Wellness Hubs Ontario (YWHO) was launched in 2017 as Ontario's IYS Network for youth ages 12-25, prioritizing continuous improvement through evaluation. Description: At the end of the first three years of the YWHO initiative, an evaluation was carried out to identify the barriers and facilitators to the initial implementation of YWHO and service delivery modifications resulting from the COVID-19 pandemic across ten sites. Reporting on these is the focus of this article. Key informant interviews were conducted in early 2021 with Network Leads from all ten initial YWHO sites. Reflexive thematic analysis was used to analyze all interview data. Discussion: Facilitators to the implementation of the YWHO model included diversified funding models, YWHO Provincial Office implementation supports, clear hub processes, robust community partnerships, organizational support and dedicated staff. Common barriers included certain challenges related to staffing and finances, implementation of the shared data collection platform, implementation of measurement-based care, partnerships, integrated service delivery, and branding and communications. Conclusion: Implementation of IYS is highly collaborative and quite complex. As interest in such models increase, so does the need for knowledge related to optimal implementation. Learnings have informed developments and improvements made to the YWHO model. Insights will also inform how stakeholders support youth in their communities in designing and implementing services that improve youth mental health and overall well-being.

Surgical treatment of interhemispheric arachnoid cysts.

OBJECTIVE: In children, interhemispheric arachnoid cysts (IHACs) are rare lesions often associated with corpus callosum dysgenesis. It is still controversial about surgical treatments for IHACs. We aim to report our experience with pediatric IHAC patients and evaluate surgical courses and neurological developments. METHODS: Pediatric IHACs treated between 2001 and 2021 were reviewed retrospectively. IHAC was observed until they represented rapid cyst enlargement or neurological symptoms. Cyst fenestration was done by microscope or endoscope, depending on the IHAC's location. Cyst size and corpus callosum dysgenesis were evaluated with neuroimaging. Neurological development was assessed from medical records at the last follow-up. RESULTS: Fifteen children received cyst fenestration surgery (mean age 11.4 months). Eleven patients (73.3%) under observation showed rapid cyst enlargement in a short period (median 5 months). Cysto-ventriculostomy (CVS) and cysto-cisternostomy (CCS) regressed the cyst size significantly (p = 0.003). The median follow-up duration was 51 months (range 14-178 months). Corpus callosum dysgenesis was observed in eleven patients (73.3%, complete = 5, partial = 6). Among eight patients (53.3%) having developmental delay, five patients (33.3%) showed speech delay, including one patient with intractable seizures. CONCLUSION: Pediatric IHACs frequently present within 1 year after birth, with rapid cyst enlargement. CVS and CCS were effective in regressing the cyst size. Corpus callosum dysgenesis accompanied by IHAC might have a risk of language achievement; however, development delay could rely on multifactorial features, such as epilepsy or other brain anomalies.

Creating a developmental framework for evaluating RRI implementation in research organisations.

The evaluation of Responsible Research and Innovation (RRI) actions presents important challenges for the key stakeholders engaged in the process of RRI implementation, such as policy makers, programme managers, and researchers. While there is a considerable body of literature on the conceptualization of responsibility in research and a plethora of attempts to practice RRI, there is a need for increased attention to the monitoring and evaluation of case studies of RRI implementations in research organisations, in particular regarding their structural change effects. This paper aims to discuss a contextualised developmental framework for evaluating RRI implementation in research organisations, with a specific focus on achieving structural change through tailor-made action plans. The framework, developed through RRI evaluation work in the field of biosciences, adopts a systemic and process-oriented perspective, encompassing participatory, anticipatory, reflexive, and responsive dimensions. Concrete empirical examples from bioscience organizations are provided to illustrate how the framework relates to specific conditions, experiences, and solutions, demonstrating how conceptual insights have emerged from real-life practices and data analysis. While the framework was initially customized for the specific contexts of six bioscience research organizations, it holds potential for broader relevance and applicability in addressing challenges related to RRI design, implementation, and evaluation.

An evaluation of the Compassion, Inclusion, and Engagement initiative: learning from PWLE and communities across British Columbia.

BACKGROUND: The Compassion, Inclusion and Engagement initiative (CIE) was a social contact intervention that operated in British Columbia between 2015 and 2021. The primary objective of CIE was to increase the participation of people with lived experience of substance use (PWLE) in the planning, design, implementation, and evaluation of harm reduction supports and services. CASE PRESENTATION: CIE used the developmental evaluation methodology outcome mapping to define and measure progress towards its goals. Developmental evaluation emphasizes learning in contrast to other forms of evaluation which are often more focused on determining the value or success of a project or programme based on predetermined criteria. Outcome mapping is a relational practice which acknowledges that change is achieved by an initiative's partners and the role of the initiative is to provide access to resources, ideas and opportunities that can facilitate and support change. CONCLUSIONS: Through the implementation and evaluation of CIE, it became clear that directly supporting PWLE facilitated more meaningful and lasting change than solely working to improve the health and social services that supported them. The impacts of the CIE initiative extend far beyond the outcomes of any of the dialogues it facilitated and are largely the result of an increase in social capital. CIE engagements created the opportunity for change by inviting people most affected by the toxic drug supply together with those committed to supporting them, but their ability to bring about systemic change was limited. Both PWLE and service providers noted the lack of support to attend CIE engagements, lack of support for actions that came from those engagements, and lack of PWLE inclusion in decision-making by health authorities as limiting factors for systemic change. The lack of response at a systemic level often resulted in PWLE carrying the burden of responding to toxic drug poisonings, often without resources, support, or compensation.

Developmental evaluation during the COVID-19 pandemic: Practice-based learnings from projects in British Columbia, Canada.

In this article, we explore experiences and learnings from adapting to challenges encountered in implementing three Developmental Evaluations (DE) in British Columbia, Canada within the evolving context of the COVID-19 pandemic. We situate our DE projects within our approach to the DE life cycle and describe challenges encountered and required adaptations in each phase of the life cycle. Regarding foundational aspects of DEs, we experienced challenges with relationship building, assessing and responding to the context, and ensuring continuous learning. These challenges were related to suboptimal embeddedness of the evaluators within the evaluated projects. We adapted by leveraging online channels to maintain communications and securing stakeholder engagement by assuming non-traditional DE roles based on our knowledge of the context to support project goals. Additional challenges experienced with mapping the rationale and goals of the projects, identifying domains for assessment, collecting data, making sense of the data and intervening were adapted to by facilitating online workshops, collecting data online and through proxy evaluators, while sharing methodological insights within the evaluation team. During evolving crises, like the COVID-19 pandemic, evaluators must embrace flexibility, leverage, and apply their knowledge of the evaluation context, lean on their strengths, purposefully reflect and share knowledge to optimise their DEs.

Barriers and Facilitators to the Implementation of an Integrated Youth Services Network in Ontario.

Introduction: In response to the challenges of the traditional mental health system for youth both in Canada and abroad, models of integrated youth services (IYS) that span the integration of mental health, health, substance use, eucation, employment, peer support, and navigation into 'one-stop shops' are being established nationally and internationally. IYS models, however, need to be better described and evaluated to inform the replicability of this approach in other jurisdictions. Description: This paper describes the implementation of an IYS in a small urban city and rural county in Ontario, Canada, including insights from key informants into barriers, facilitators, and lessons learned. Discussion: This evaluation identified a number of barriers and facilitators to the implementation of the IYS model in this specific context. Implementation facilitators included youth and family engagement, network partner collaboration, leadership, governance structure, community enthusiasm and support, and collaborative funding models. Barriers to implementation included the COVID-19 pandemic and related public health restrictions, the diverse needs of youth, change management, sustainable funding, and transportation. Lessons learned: By establishing a shared vision of delivering youth services across the integrated network, and engaging youth early in the process of model development, IYS have the potential to transform the service system for youth and their families. Meeting the diverse needs and challenges of youth who live in rural or small urban communities will enhance service delivery and experience for young people.

Differences in Home-Care Services in Finland for Older Adults between 2012 and 2019 - A Developmental Evaluation Study.

This study aimed to evaluate differences in client-centered approaches to home-care services for older adults from the perspectives of nurses and service managers in Finland. The research method used developmental evaluation. Developmental activities for client-centered services were implemented in three home-care organizations between 2012 and 2019. Home care nurses and service managers were interviewed individually and in groups at the beginning and end of the development process. Then, four categories of differences enabling operating models in client-centered care were identified: modernized client-centered service patterns, comprehensive service coordination, digital service environments technology utilization, and changing human resources. This study found a positive trend in adopting a client-centered approach and technology in home care services. In the implementation of home care practices, innovations for client-centered implementation of homecare should consider the renewal of service models, development of case management, and development and utilization of technology in homecare operating environments.

Formative evaluation of Zero Suicide in the emergency department: Identifying strategies to overcome implementation barriers.

BACKGROUND: Zero Suicide has been widely promoted as a comprehensive suicide prevention approach in healthcare systems, yet less is known about the barriers to implementing this approach in the emergency department. OBJECTIVES: This developmental evaluation aimed to assess emergency department providers' perceived knowledge and self-efficacy regarding suicide prevention practices, as well as apply the Consolidated Framework for Implementation Research to explore potential facilitators and barriers to implementing Zero Suicide and identify strategies to overcome barriers. METHODS: A sequential mixed methods approach was used, including a survey assessing emergency department providers' perceived knowledge and attitudes and semi-structured interviews exploring potential determinants of implementation. RESULTS: Survey respondents (n = 43) perceived that they have the knowledge and self-efficacy to implement clinical elements of Zero Suicide; however, interview participants (n = 18) revealed that some clinical elements are not implemented consistently and perceive implementation barriers across multiple levels, including limited training on suicide risk assessment and limited resources needed to engage and re-engage at-risk patients in their suicide care management plan and provide follow-up supportive contacts during patients' transitions in care. CONCLUSION: To overcome identified barriers in this setting, targeted implementation strategies are needed, including integration in electronic health record systems, leadership advocacy, and ongoing staff training.

Operationalizing Implementation Science in Nutrition: The Implementation Science Initiative in Kenya and Uganda.

BACKGROUND: Implementation science (IS) has the potential to improve the implementation and impact of policies, programs, and interventions. Most of the training, guidance, and experience has focused on implementation research, which is only 1 part of the broader field of IS. In 2018, the Society for Implementation Science in Nutrition borrowed concepts from IS in health to develop a broader and more integrated conceptual framework, adapted to the particular case of nutrition and with language and concepts more familiar to the nutrition community: it is called the IS in Nutrition (ISN) framework. OBJECTIVE: The purpose of this research was to generate knowledge concerning challenges and strategies in operationalizing the ISN framework in low- and middle-income country (LMIC) settings. METHODS: The ISN framework was operationalized in partnership with country teams in Kenya and Uganda over a 3-y period as part of the Implementation Science Initiative. An action research methodology (developmental evaluation) was used to provide timely feedback to the country teams, facilitate adaptations and adjustments, and generate the data presented in this article concerning challenges and strategies. RESULTS: Operationalization of the ISN framework proceeded by first articulating a set of guiding principles as touchstones for the country teams and further articulating 6 components of an IS system to facilitate development of work streams. Challenges and strategies in implementing these 6 components were then documented. The knowledge gained through this experience led to the development of an IS system operational model to assist the application of IS in other LMIC settings. CONCLUSIONS: Future investments in IS should prioritize a system- and capacity-building approach in order to realize its full potential and become institutionalized at country level. The operational model can guide others to improve the implementation of IS within a broad range of programs.

Methodological pluralism for better evaluations of complex interventions: lessons from evaluating an innovation platform in Australia.

Complex interventions, such as innovation platforms, pose challenges for evaluators. A variety of methodological approaches are often required to build a more complete and comprehensive understanding of how complex interventions work. In this paper, we outline and critically appraise a methodologically pluralist evaluation of an innovation platform to strengthen primary care for Aboriginal and Torres Strait Islander Australians. In doing so, we aim to identify lessons learned from the approach taken and add to existing literature on implementing evaluations in complex settings, such as innovation platforms. The pluralist design used four evaluation approaches-developmental evaluation, principles-focused evaluation, network analysis, and framework analysis-with differing strengths and challenges. Taken together, the multiple evaluation approaches yielded a detailed description and nuanced understanding of the formation, functioning and outcomes of the innovation platform that would be difficult to achieve with any single evaluation method. While a methodologically pluralist design may place additional pressure on logistical and analytic resources available, it enables a deeper understanding of the mechanisms that underlie complex interventions.

A Protocol for a Comprehensive Monitoring and Evaluation Framework With a Compendium of Tools to Assess Quality of Project ECHO (Extension for Community Healthcare Outcomes) Implementation Using Mixed Methods, Developmental Evaluation Design.

Introduction: The United States Centers for Disease Control and Prevention (CDC), through U.S. President's Emergency Plan for AIDS Relief (PEPFAR), supports a third of all people receiving HIV care globally. CDC works with local partners to improve methods to find, treat, and prevent HIV and tuberculosis. However, a shortage of trained medical professionals has impeded efforts to control the HIV epidemic in Sub-Saharan Africa and Asia. The Project Extension for Community Healthcare Outcomes (ECHOTM) model expands capacity to manage complex diseases, share knowledge, disseminate best practices, and build communities of practice. This manuscript describes a practical protocol for an evaluation framework and toolkit to assess ECHO implementation. Methods and Analysis: This mixed methods, developmental evaluation design uses an appreciative inquiry approach, and includes a survey, focus group discussion, semi-structured key informant interviews, and readiness assessments. In addition, ECHO session content will be objectively reviewed for accuracy, content validity, delivery, appropriateness, and consistency with current guidelines. Finally, we offer a mechanism to triangulate data sources to assess acceptability and feasibility of the evaluation framework and compendium of monitoring and evaluation tools. Expected impact of the study on public health: This protocol offers a unique approach to engage diverse group of stakeholders using an appreciative inquiry process to co-create a comprehensive evaluation framework and a compendium of assessment tools. This evaluation framework utilizes mixed methods (quantitative and qualitative data collection tools), was pilot tested in Tanzania, and has the potential for contextualized use in other countries who plan to evaluate their Project ECHO implementation.

Partnership evaluation: An application of a developmental framework to the Governance and Local Development project in Senegal.

This study explores the valued-added of USAID/Senegal's Governance for Local Development (GOLD) project's integrated approach to working with four sector projects: two in health, one in water and sanitation, and one in nutrition. The study builds on a partnership evaluation framework that identifies practices related to preconditions, factors linked with success, implementation structures and processes, contribution of collaboration to performance, and collaboration outcomes. A survey instrument developed statements of positive practices and asked respondents to agree or disagree with each one. The analysis includes exploration of differences in perception. Respondents generally expressed agreement with the statements in the survey instrument associated with the various dimensions of effective partnerships. All projects mentioned the presence of partnership champions. Problems with joint action (e.g., planning, budgeting, managing) were the most frequently cited constraints. The study confirms most of the hypotheses embedded in the evaluation framework regarding partnership's potential for creating synergies and improved outcomes and affirms the framework's usefulness as a developmental evaluation tool. Positive outcomes result from intentional efforts to build relationships, cultivate champions, and design systems and processes that support a partnership culture and contribute to each partners' success as well as the success of the partnership itself.

Using community-led development to build health communication about rheumatic heart disease in Aboriginal children: a developmental evaluation.

OBJECTIVE: A high prevalence of acute rheumatic fever (ARF) and rheumatic heart disease (RHD) among Aboriginal children in northern Australia is coupled with low understanding among families. This has negative impacts on children's health, limits opportunities for prevention and suggests that better health communication is needed. METHODS: During an RHD echocardiography screening project, Aboriginal teachers in a remote community school created lessons to teach children about RHD in their home languages, drawing on principles of community-led development. Access to community-level RHD data, previously unknown to teachers and families, was a catalyst for this innovative work. Careful, iterative discussions among speakers of four Aboriginal languages ensured a culturally coherent narrative and accompanying teaching resources. RESULTS: The evaluation demonstrated the importance of collective work, local Indigenous Knowledge and metaphors. As a result of the lessons, some children showed new responses and attitudes to skin infections and their RHD treatment. Language teachers used natural social networks to disseminate new information. A community interagency collaboration working to prevent RHD commenced. Conclusions and implications for public health: Action to address high rates of RHD must include effective health communication strategies that value Indigenous Knowledge, language and culture, collaborative leadership and respect for Indigenous data sovereignty.

[Application of dementia care mapping (DCM) for one year in a geriatric health services facility: Effects of developmental evaluation based on collaboration by medical and welfare staff aimed at person-centred care].

PURPOSE: This study aimed to clarify the effects of dementia care mapping (DCM) for one year in a healthcare center for older adults. DCM was conducted between September 2016 and August 2017. The care staff include nurses and caregivers in a narrow sense, medical staff, such as a physician, physical therapists, and occupational therapists worked on DCM as care staff in this study. RESULTS: There were 24 participants, with an average work experience of 7.21 (±4.74) years. In comparison to the baseline evaluation, the final assessment of self-efficacy through person-centred care showed significant improvement in 'Forecasting and Problem Solving on the Job' within 'Perceived Job Competence of Care Workers'. Six main categories of content were extracted from focus group interviews: 'Awareness,' 'Change of Elderly People under the Care of Staff throughout the Development of Mapping', 'Affirmative Feelings of Care Staff for Mapping', 'Negative Feelings for Mapping', 'Need for the Efficacy and Efficiency of the Mapping', and 'Mapping Based on the Age of the Participant and Future Prospects for Mapping'. The results of person-centred care showed that both the older patients and the staff noticed changes through the development of mapping. CONCLUSION: The developmental evaluation, based on collaboration by medical and welfare staff can improve self-efficacy through the practice of person-centred care and improves the ability to solve problems during the provision of care.

An Intervention to Enhance Social, Emotional, and Identity Learning for Very Young Adolescents and Support Gender Equity: Protocol for a Pragmatic Randomized Controlled Trial.

BACKGROUND: The onset of puberty is a pivotal period of human development that is associated with significant changes in cognitive, social, emotional, psychological, and behavioral processes that shape identity formation. Very early adolescence provides a critical opportunity to shape identity formation around gender norms, attitudes, and beliefs before inequitable gender norms are amplified during and after puberty. OBJECTIVE: The aim of the Discover Learning Project is to integrate strategic insights from developmental science to promote positive transformation in social, emotional, and gender identity learning among 10- to 11-year-olds in Tanzania. Through a pragmatic randomized controlled trial, the intervention scaffolds the development of critical social and emotional mindsets and skills (curiosity, generosity, persistence, purpose, growth mindset, and teamwork) delivered by conducting 18 after-school, technology-driven, experiential learning sessions in small, mixed-gender groups. METHODS: The Discover Learning Intervention is a 3-arm randomized controlled trial that will be delivered to 579 participants selected from four public primary schools in Temeke District, Dar es Salaam, Tanzania. Randomization will be done at the individual level into 3 treatment groups receiving incremental intervention components. The treatment components include Discover Learning content curated into child-friendly videos, facilitated discussions, and a parent-child workbook, to be implemented over two phases, each 6 weeks long. A baseline survey will be administered to participants and their parents prior to the intervention. The process will be observed systematically, and data will be collected using surveys, in-depth interviews, observations, and focus group discussions with adolescents, parents, teachers, and facilitators conducted prior, during, and after each implementation phase. RESULTS: This study builds on formative and pilot studies conducted with the target population to inform the design of the intervention. The results will generate new evidence that will inform strategies for achieving scale in Tanzania and provide insights for replication of similar programs that are invested in gender-transformative interventions in peri-urban, low-resource settings. CONCLUSIONS: The Discover Learning Intervention makes an important contribution to the field of adolescent developmental science as an intervention designed for very young adolescents in a low-resource setting. TRIAL REGISTRATION: ClinicalTrials.gov NCT04458077; https://clinicaltrials.gov/ct2/show/NCT04458077. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/23071.

Inclusion and equity in education: Current policy reform in Nova Scotia, Canada.

This article aims to explore the context of inclusive education policy in Canada, and to highlight the particular case of inclusive education policy reform in the province of Nova Scotia. As with most other provinces and territories, inclusive education policy in Nova Scotia has broadened to include a lens of equity, with a focus on not only students with special education needs, but all students - particularly those most often marginalized by and within Canadian school systems. The article reflects on the first phase of the developmental evaluation process which took place prior to full implementation of the policy. Four interconnected key themes emerge: 1) the shifting roles and identities for educators and specialized staff; 2) the changing roles of classroom teachers; 3) the importance of support to ensure effective universal and differentiated classroom practices; and 4) the professional learning of school staff. Although situated within the Nova Scotian and the national Canadian context, the discussion and implications can readily be applied to international systems engaged in developing and implementing broad inclusive education policy.

Using developmental evaluation and community-based participatory research to develop a model of supportive housing.

Community-based participatory research (CBPR) and developmental evaluation (DE) have emerged over recent decades as separate approaches for addressing complex social issues. Current literature offers little with respect to the use of CBPR and DE in combination, although the two approaches are complementary. Through the current paper, we outline how CBPR and DE were used to develop a model of supportive housing for teen families. More specifically, we describe the structures and processes that contributed to this development, including (1) our partnership approach, (2) pooled resources, (3) regular opportunities for collaboration and reflection, (4) integration of multiple data sources, (5) ongoing feedback and knowledge dissemination, and (6) adjustments to program practices. We end by providing insights into the lessons that we learned through this project. Through this paper, we describe how researchers and community partners can collaboratively use CBPR and DE to develop a program model in complex community settings. Insights are offered that will be important for researchers, evaluators, and practitioners seeking to develop programming in response to complex community issues.

Using developmental evaluation to enhance continuous reflection, learning and adaptation of an innovation platform in Australian Indigenous primary healthcare.

Effective efforts to strengthen health systems need diverse, multi-stakeholder networks working together on complex or 'wicked' problems such as prevention and control of chronic diseases, solutions to which go beyond the role and capability of one organisation. The contextual complexities inherent in 'wicked' problems mean that solutions warrant a systems approach that encompasses innovation and new ways of thinking about, facilitating and implementing collective decision-making processes and change practices.Innovation platforms are a mechanism for facilitating communication and collaboration among diverse stakeholders, promoting joint action and stimulating innovation. Developmental evaluation is an approach that is increasingly being used to evaluate innovative and emergent programmes and projects, as it enables evaluators to provide real-time feedback so that evaluation findings can be used to guide development and adaptations. Developmental evaluation emphasises learning and adaptation, and aligns well with the implementation of innovation platforms that have continuous reflection, learning and adaptation as a specific design principle.Here, we outline our rationale for applying a developmental evaluation to enhance the formation, functioning and outcomes of an innovation platform aimed at accelerating and strengthening large-scale quality improvement efforts in Australian Aboriginal and Torres Strait Islander primary healthcare. We provide examples to explain how the developmental evaluation findings were used for adaptation of the innovation platform and assess to what extent our application of developmental evaluation was consistent with, and reflective of, its essential principles.Our evaluation aligned strongly with the principles of developmental evaluation, and the approach we took was well suited to situations with a developmental purpose, innovation niche and complexity such as innovation platforms. As a result, along with the increasing interest in multi-stakeholder platforms (e.g. innovation platforms) and the inherent challenges with evaluating these complex networks, we anticipate our use of this approach being of interest globally.

Impact of a digital Modified Checklist for Autism in Toddlers-Revised on likelihood and age of autism diagnosis and referral for developmental evaluation.

LAY ABSTRACT: This was a project in primary care for young children (1-2 years old). We tested a parent questionnaire on a tablet. This tablet questionnaire asked questions to see whether the child may have autism. We compared the paper and pencil version of the questionnaire to the tablet questionnaire. We read the medical charts for the children until they were 4 years old to see whether they ended up having autism. We found that doctors were more likely to recommend an autism evaluation when a parent used the tablet questionnaire. We think that the tablet's automatic scoring feature helped the doctors. We also think that the doctors benefited from the advice the tablet gave them.

Building a framework for the evaluation of knowledge translation for the Canadian Network for Observational Drug Effect Studies.

PURPOSE: The Canadian Network for Observational Drug Effect Studies (CNODES), a network of pharmacoepidemiologists and other researchers from seven provincial sites, provides evidence on the benefits and risks of drugs used by Canadians. The Knowledge Translation Team, one of CNODES' four main teams, evaluates the impact of its efforts using an iterative and emergent approach. This article shares key lessons from early evaluation phases, including identifying stakeholders and their evaluation needs, choosing evaluation theories and approaches, and developing evaluation questions, designs, and methods appropriate for the CNODES context. METHODS: Stakeholder analysis was conducted using documentary analysis to determine key contextual factors and research evidence needs of decision maker partners and other stakeholders. Selected theories and frameworks from the evaluation and knowledge translation literature informed decisions about evaluation design and implementation. A developmental approach to evaluation was deemed appropriate due to the innovative, complex, and ever-changing context. RESULTS: A theory of change, logic model, and potential evaluation questions were developed, informed by the stakeholder analysis. Early indicators of program impact (citation metrics, alternative metrics) have been documented; efforts to collect data on additional indicators are ongoing. CONCLUSION: A flexible, iterative, and emergent evaluation approach allows the Knowledge Translation Team to apply lessons learned from completed projects to ongoing research projects, adapt its approaches based on stakeholder needs, document successes, and be accountable to funders/stakeholders. This evaluation approach may be useful for other international pharmacoepidemiology research networks planning and implementing evaluations of similarly complex, multistakeholder initiatives that are subject to constant change.