A mixed-methods analysis to understand the implementation of a multistakeholder research consortium: Environmental influences on child health outcomes (ECHO).

Introduction: Large, transdisciplinary research consortia have increasingly been called upon to address complex and challenging health problems. The National Institutes of Health's (NIH) Environmental influences on Child Health Outcomes (ECHO) Program developed multisite collaboration strategies to promote impactful collaborative observational research on child health. Team science and implementation science offer theoretical and methodological structure to answer questions about the strategies that facilitate successful consortia. We sought to characterize the elements and conditions that influence the implementation of a complex, interdisciplinary longitudinal research program, ECHO. Methods: Informed by the Practical, Robust, Implementation and Sustainability Model, our ethnographic research included semi-structured interviews with internal stakeholders and program evaluation metrics. We conducted template and matrix analysis and triangulated the qualitative and quantitative data to understand the implementation of ECHO. Results: Between February and May 2022, we conducted 24 virtual interviews with representatives from ECHO components. The main cross-cutting topics that emerged from thematic analysis were collaboration and team science; communication and decision-making; data processes and harmonization; and diversity, equity, and inclusion. Both the qualitative and secondary quantitative evaluation data provided insights into the reach, adoption, implementation, and effectiveness of the program. Conclusion: A large, multidisciplinary research consortium such as ECHO has produced conceptual, instrumental, capacity building, and connectivity impact for internal and external stakeholders. Facilitators included infrastructure that supported collaboration and learning, alignment of data processes, and harmonization. Opportunities for enhanced impact include multidisciplinary, multimethod communication strategies, and alignment of research priorities.

Evaluation of the First Year of the Cross-Sector Innovation Initiative: Lessons Learned in Advancing Cross-Sector Alignment.

The Cross-sector Innovation Initiative (CSII) funded 10 communities for 2 years to support public health, health care, and social services sector alignment and community engagement to improve health equity and population health. The CSII is founded on the idea that working in alignment across sectors, in partnership with the community, better positions agencies and the communities they serve to address health inequities in meaningful and innovative ways. This evaluation identified the activities that sites undertook during the first year of the program to align sectors and engage the community, and factors that facilitated and hindered those efforts. The evaluation utilized secondary data from project reports and primary data from observations of peer-to-peer learning events. This evaluation found that cross-sector alignment benefits from a sustained focus on longer-term goals and the ability to build, strengthen, and maintain trust and commitment among cross-sector partners and community stakeholders and to explicitly include community voice and participation.

Technical assistance for the evaluation of community-based HIV prevention programs.

Funding agencies are using technical assistance (TA) to strengthen the evaluation capacity of community-based organizations (CBOs) engaged in HIV prevention efforts. The authors used qualitative methods to identify the types of evaluation TA needed by CBOs, to understand CBOs' past experiences with evaluation TA, and to elicit ideas for optimal delivery of evaluation TA. Assistance in developing evaluation tools and data analysis were the most commonly cited needs. Preferred TA providers were characterized as having practical expertise, accessibility, cultural competence, communication skills, and collaboration skills. Critical elements of an ideal TA system were adequate funding, program-specific TA, and extensive interaction between TA providers and CBO staff. Study data were used to generate a set of recommendations for health educators and others who may provide CBOs with TA for evaluating prevention programs.

Evaluation barriers and facilitators among community-based HIV prevention programs.

Funding agencies are using technical assistance to promote evaluation of their community-based HIV prevention programs. Using qualitative methods, we identified 11 factors that hinder and facilitate evaluation within community-based organizations (CBOs): staff perceptions, availability of funding, data collection, data validity, data utility, technical assistance, effects on services, effects on funding, staff skills, tools and technology, and expectations of the funding agency. Using these factors, we developed eight strategies to promote CBO evaluation. These strategies go beyond the traditional role of technical assistance and address the broader context within which CBOs evaluate their programs. Funding agencies and technical assistance providers can use these strategies to enhance CBO evaluation, which may result in more and better quality evaluations and, ultimately, improvements in the effectiveness of HIV prevention services.