Engaging partners to initiate evaluation efforts: tactics used and lessons learned from the prevention research centers program.

BACKGROUND: The Centers for Disease Control and Prevention's (CDC's) Prevention Research Centers (PRC) Program underwent a 2-year evaluation planning project using a participatory process that allowed perspectives from the national community of PRC partners to be expressed and reflected in a national logic model. CONTEXT: The PRC Program recognized the challenge in developing a feasible, useable, and relevant evaluation process for a large, diverse program. To address the challenge, participatory and utilization-focused evaluation models were used. METHODS: Four tactics guided the evaluation planning process: 1) assessing stakeholders' communication needs and existing communication mechanisms and infrastructure; 2) using existing mechanisms and establishing others as needed to inform, educate, and request feedback; 3) listening to and using feedback received; and 4) obtaining adequate resources and building flexibility into the project plan to support multifaceted mechanisms for data collection. CONSEQUENCES: Participatory methods resulted in buy-in from stakeholders and the development of a national logic model. Benefits included CDC's use of the logic model for program planning and development of a national evaluation protocol and increased expectations among PRC partners for involvement. Challenges included the time, effort, and investment of program resources required for the participatory approach and the identification of whom to engage and when to engage them for feedback on project decisions. INTERPRETATION: By using a participatory and utilization-focused model, program partners positively influenced how CDC developed an evaluation plan. The tactics we used can guide the involvement of program stakeholders and help with decisions on appropriate methods and approaches for engaging partners.

Coordinated school health programs and academic achievement: a systematic review of the literature.

BACKGROUND: Few evaluations of school health programs measure academic outcomes. K-12 education needs evidence for academic achievement to implement school programs. This article presents a systematic review of the literature to examine evidence that school health programs aligned with the Coordinated School Health Program (CSHP) model improve academic success. METHODS: A multidisciplinary panel of health researchers searched the literature related to academic achievement and elements of the CSHP model (health services, counseling/social services, nutrition services, health promotion for staff, parent/family/community involvement, healthy school environment, physical education, and health education) to identify scientifically rigorous studies of interventions. Study designs were classified according to the analytic framework provided in the Guide developed by the Community Preventive Services Task Force. RESULTS: The strongest evidence from scientifically rigorous evaluations exists for a positive effect on some academic outcomes from school health programs for asthmatic children that incorporate health education and parental involvement. Strong evidence also exists for a lack of negative effects of physical education programs on academic outcomes. Limited evidence from scientifically rigorous evaluations support the effect of nutrition services, health services, and mental health programs, but no such evidence is found in the literature to support the effect of staff health promotion programs or school environment interventions on academic outcomes. CONCLUSIONS: Scientifically rigorous evaluation of school health programs is challenging to conduct due to issues related to sample size, recruitment, random assignment to condition, implementation fidelity, costs, and adequate follow-up time. However, school health programs hold promise for improving academic outcomes for children.

Using concept mapping to develop a logic model for the Prevention Research Centers Program.

INTRODUCTION: Concept mapping is a structured conceptualization process that provides a visual representation of relationships among ideas. Concept mapping was used to develop a logic model for the Centers for Disease Control and Prevention's Prevention Research Centers Program, which has a large and diverse group of stakeholders throughout the United States. No published studies have used concept mapping to develop a logic model for a national program. METHODS: Two logic models were constructed using the data from the concept mapping process and program documents: one for the national level and one for the local level. Concept mapping involved three phases: 1) developing questions to generate ideas about the program's purpose and function, 2) gathering input from 145 national stakeholders and 135 local stakeholders and sorting ideas into themes, and 3) using multivariate statistical analyses to generate concept maps. Logic models were refined using feedback received from stakeholders at regional meetings and conferences and from a structured feedback tool. RESULTS: The national concept map consisted of 9 clusters with 88 statements; the local concept map consisted of 11 clusters with 75 statements. Clusters were categorized into three logic model components: inputs, activities, and outcomes. Based on feedback, two draft logic models were combined and finalized into one for the Prevention Research Centers Program. CONCLUSION: Concept mapping provides a valuable data source, establishes a common view of a program, and identifies inputs, activities, and outcomes in a logic model. Our concept mapping process resulted in a logic model that is meaningful for stakeholders, incorporates input from the program's partners, and establishes important program expectations. Our methods may be beneficial for other programs that are developing logic models for evaluation planning.