The Kaiser Permanente Community Health Initiative: overview and evaluation design.

We provide an overview of the Kaiser Permanente Community Health Initiative--created in 2003 to promote obesity-prevention policy and environmental change in communities served by Kaiser Permanente-and describe the design for evaluating the initiative. The Initiative focuses on 3 ethnically diverse northern California communities that range in size from 37,000 to 52,000 residents. The evaluation assesses impact by measuring intermediate outcomes and conducting pre- and posttracking of population-level measures of physical activity, nutrition, and overweight.

Approaches to measuring the extent and impact of environmental change in three California community-level obesity prevention initiatives.

Despite growing support among public health researchers and practitioners for environmental approaches to obesity prevention, there is a lack of empirical evidence from intervention studies showing a favorable impact of either increased healthy food availability on healthy eating or changes in the built environment on physical activity. It is therefore critical that we carefully evaluate initiatives targeting the community environment to expand the evidence base for environmental interventions. We describe the approaches used to measure the extent and impact of environmental change in 3 community-level obesity-prevention initiatives in California. We focus on measuring changes in the community environment and assessing the impact of those changes on residents most directly exposed to the interventions.

Policy-contribution assessment and field-building analysis of the Robert Wood Johnson Foundation's Active Living Research Program.

BACKGROUND: The Robert Wood Johnson Foundation requested this utilization-focused evaluation of its Active Living Research (ALR) program. This evaluation reports on the trajectory of influence of past and future ALR outcomes on field-building and policy contributions as well as on possible users of completed and disseminated ALR products. METHODS: In 2006 and 2007, key-informant interviews were conducted with 136 representatives of first-line potential users of ALR research products, including state physical activity and nutrition program coordinators, policymakers, scientists, and funders. Literature reviews, bibliometric analyses, and document reviews served to describe the context for ALR's work and the ways it could enhance its utility for field building and policymaking. RESULTS: The contributions of ALR to the emerging transdisciplinary field included leadership in the development of measurement tools, epidemiologic studies, implementation research, the translation of research to practice, and the communication of learned lessons to diverse audiences. ALR's contributions to policy discussions were found across a spectrum of policy-development phases that included describing the problem, raising awareness of alternative strategies for increasing physical activity, convening nontraditional partners, and evaluating policy implementation. CONCLUSIONS: Policy-relevant research can make contributions to policymakers' thinking but almost never causes a change by itself. Five years after the original authorization of ALR, there is ample evidence of its recognition as a resource by key players, its field-building influence, and its contributions to policy discussions. All these bear promise for a broader contribution to obesity prevention. Recommendations for increasing ALR's impact on policy and practice are offered.

Involving local health departments in community health partnerships: evaluation results from the partnership for the public's health initiative.

Improving community health "from the ground up" entails a comprehensive ecological approach, deep involvement of community-based entities, and addressing social determinants of population health status. Although the Centers for Disease Control and Prevention, the Office of the Surgeon General, and other authorities have called for public health to be an "inter-sector" enterprise, few models have surfaced that feature local health departments as a key part of the collaborative model for effecting community-level change. This paper presents evaluation findings and lessons learned from the Partnership for the Public's Health (PPH), a comprehensive community initiative that featured a central role for local health departments with their community partners. Funded by The California Endowment, PPH provided technical and financial resources to 39 community partnerships in 14 local health department jurisdictions in California to promote community and health department capacity building and community-level policy and systems change designed to produce long-term improvements in population health. The evaluation used multiple data sources to create progress ratings for each partnership in five goal areas related to capacity building, community health improvement programs, and policy and systems change. Overall results were generally positive; in particular, of the 37 partnerships funded continuously throughout the 5 years of the initiative, between 25% and 40% were able to make a high level of progress in each of the Initiative's five goal areas. Factors associated with partnership success were also identified by local evaluators. These results showed that health departments able to work effectively with community groups had strong, committed leaders who used creative financing mechanisms, inclusive planning processes, organizational changes, and open communication to promote collaboration with the communities they served.

Youth development, community engagement, and reducing risk behavior.

This article examines behaviors and attitudes associated with the "Youth Development Model," widely cited as a means of promoting resistance among young people to adverse environmental influences. Focusing on tobacco use as an example of high-risk behavior, the research reported here (1) tests the statistical independence of individual Youth Development Model dimensions, and (2) assesses their relationships to tobacco-related attitudes and behavior. The "engagement" dimension, reflecting strong ties of youths with the broader community, most clearly distinguishes risk reduction interventions based on the Youth Development Model. Two exploratory studies indicate that, among dimensions associated with this model, engagement is the least readily measurable and the least consistent and robust as a predictor of tobacco-related attitudes and behavior. Editors' Strategic Implications: The authors present an important challenge to the increasingly prevalent Youth Development Model. The results of the two studies call for a better conceptual and operational understanding of engagement, which must precede its successful application in reducing risky behavior among young people.

A qualitative exploration of alternative strategies for building community health partnerships: collaboration- versus issue-oriented approaches.

Broad-based community partnerships are seen as an effective way of addressing many community health issues, but the partnership approach has had relatively limited success in producing measurable improvements in long-term health outcomes. One potential reason, among many, for this lack of success is a mismatch between the goals of the partnership and its structure/membership. This article reports on an exploratory empirical analysis relating the structure of partnerships to the types of issues they address. A qualitative analysis of 34 "successful" community health partnerships, produced two relatively clear patterns relating partnership goals to structure/membership: (1) "collaboration-oriented" partnerships that included substantial resident involvement and focused on broader determinants of health with interventions aimed at producing immediate, concrete community improvements; and (2) "issue-oriented" partnerships that focused on a single, typically health-related issue with multilevel interventions that included a focus on higher-level systems and policy change. Issue-oriented partnerships tended to have larger organizations governing the partnership with resident input obtained in other ways. The implication of these results, if confirmed by further research, is that funders and organizers of community health partnerships may need to pay closer attention to the alignment between the membership/structure of a community partnership and its goals, particularly with respect to the involvement of community residents.

The California wellness foundation's Health Improvement Initiative: evaluation findings and lessons learned.

PURPOSE: To evaluate the effect of the Health Improvement Initiative (HII), a 5-year grantmaking initiative funded by The California Wellness Foundation designed to identify the critical factors needed to bring about population health improvements through community-level systems change. DESIGN: The evaluation of the HII used a case-study, logic-model approach to make inferences about the effect of each community coalition (Health Partnership) on its target community. The primary outcome measure was the creation of significant and sustainable community-level systems change. SETTING: The HII included nine communities in California that received funding to create broad-based Health Partnerships. SUBJECTS: Primary data were collected from a variety of Initiative stakeholders by key informant interviews, closed-ended surveys, and participant observation. INTERVENTION: The HII provided funding over 5 years to nine Health Partnerships that were intended to be a driving force in implementing community-level systems change. The ultimate objective of the systems change process was to improve "population health, " broadly defined to include social economic, and cultural determinants of health, in addition to traditional health status indicators. MEASURES: Both qualitative and quantitative techniques were used to assess the effect of the HII on key community systems. The primary outcomes were qualitative descriptions of community-level changes. RESULTS: At the end of the 5 years of HII funding, six of the nine Partnerships had played a critical role in implementing sustainable systems changes that would likely have a significant effect in their target communities. CONCLUSION: The HII was successful in promoting community-level systems change in the majority of funded communities, although the evidence was mixed regarding the role of the Partnerships in bringing about these changes.

Evaluating the California Wellness Foundation's Health Improvement Initiative: a logic model approach.

The difficulties of conducting randomized trials to evaluate community-based initiatives have led some researchers to argue in favor of a case study "logic model" approach to evaluation. This article describes a case study logic approach adopted for the evaluation of one community initiative, the Health Improvement Initiative (HII) funded by the California Wellness Foundation (TCWF). The HII is a comprehensive, community-based initiative designed to improve population health by implementing and sustaining community-level systems changes. Nine communities received funding to create broad-based community coalitions (Health Partnerships) that were charged with developing and implementing action plans around systems change. The HII is being evaluated using a case-study logic-model approach that uses quantitative and qualitative data to construct indicators of coalition functioning, systems changes, and population health. By examining the relationship between these indicators over time, it should be possible to determine if any changes in intermediate or long-term outcomes are associated with Health Partnership activities.