Innovative Methods for Designing Actionable Program Evaluation.

CONTEXT: For most programs, whether funded through governmental agencies or nongovernmental organizations, demonstrating the impact of implemented activities is vital to ensuring continued funding and support. OBJECTIVE: Program evaluation is a critical tool that serves the dual purpose of describing impact and identifying areas for program improvement. From a funder's perspective, describing the individual and collective impact of state-based programs can be challenging due to variations in strategies being implemented and types of data being collected. DESIGN: A case study was used to describe the actionable, mixed-methods evaluation of the Core Violence and Injury Prevention Program (Core VIPP), including how the evaluation design and approach shifted to address evolving challenges faced by award recipients over time. Particular emphasis is given to innovative methods for collecting, analyzing, and disseminating data for key state and federal stakeholders. RESULTS: The results of the Core VIPP evaluation showed how this funding played a vital role in building injury and violence prevention capacity in state health departments, leading to a decrease in both intermediate and long-term outcomes. CONCLUSIONS: The lessons learned through the mixed-method evaluation of the Core VIPP informed the structure of the subsequent funding cycle (Core SVIPP) to include more prescriptive requirements for evidence-based implementation and a state support team structure for delivery of training and technical assistance.

Developing a Motion Comic for HIV/STD Prevention for Young People Ages 15-24, Part 1: Listening to Your Target Audience.

Young people (15-24 years) in the United States are disproportionately affected by infection with human immunodeficiency virus (HIV) and sexually transmitted diseases (STD). Shortfalls in HIV/STD-related knowledge, attitudes, beliefs, and behavioral intentions (KABI) likely contribute to this discrepancy. In this report we describe our experience developing a novel means of health communication combining entertainment-education theory and recent technological advances to create a HIV/STD-focused "motion comic." We also report the audience satisfaction and acceptance of the intervention. We used the Health Belief Model (HBM), entertainment-education (EE) principles, and the Sabido Method (SM) and conducted three rounds of focus groups to develop a 38-minute HIV/STD focused motion comic for young people between the ages 15 and 24 years. Participants indicated that motion comics were an acceptable method of delivering HIV/STD prevention messages. They also expressed satisfaction with motion comics plot, story settings, the tone of humor, and drama. Our results suggest that motion comics are a viable new method of delivering health communication messages about HIV/STD and other public health issues, and warrant further development and broader evaluation.

Developing a Motion Comic for HIV/STD Prevention for Young People Ages 15-24, Part 2: Evaluation of a Pilot Intervention.

In the United States, young people (ages 15-24 years) are disproportionately affected by human immunodeficiency virus (HIV) and other sexually transmitted diseases (STDs), due at least in part to inadequate or incorrect HIV/STD-related knowledge, attitudes, beliefs, and behavioral intentions (KABI). Comic book narratives are a proven method of HIV/STD prevention communication to strengthen KABI for HIV/STD prevention. Motion comics, a new type of comic media, are an engaging and low-cost means of narrative storytelling. The objective of this study was to quantitatively evaluate the effectiveness of a pilot six-episode HIV/STD-focused motion comic series to improve HIV/STD-related KABI among young people. We assessed change in HIV/STD knowledge, HIV stigma, condom attitudes, HIV/STD testing attitudes, and behavioral intentions among 138 participants in 15 focus groups immediately before and after viewing the motion comic series. We used paired t-tests and indicators of overall improvement to assess differences between surveys. We found a significant decrease in HIV stigma (p < .001) and increases in both HIV knowledge (p = .002) and behavioral intentions to engage in safe sex (p < .001). In summary, this motion comic intervention improved HIV/STD-related KABI of young adult viewers by reducing HIV stigma and increasing behavioral intentions to engage in safer sex. Our results demonstrate the promise of this novel intervention and support its use to deliver health messages to young people.

Vital signs: leading causes of death, prevalence of diseases and risk factors, and use of health services among Hispanics in the United States - 2009-2013.

BACKGROUND: Hispanics and Latinos (Hispanics) are estimated to represent 17.7% of the U.S. population. Published national health estimates stratified by Hispanic origin and nativity are lacking. METHODS: Four national data sets were analyzed to compare Hispanics overall, non-Hispanic whites (whites), and Hispanic country/region of origin subgroups (Hispanic origin subgroups) for leading causes of death, prevalence of diseases and associated risk factors, and use of health services. Analyses were generally restricted to ages 18-64 years and were further stratified when possible by sex and nativity. RESULTS: Hispanics were on average nearly 15 years younger than whites; they were more likely to live below the poverty line and not to have completed high school. Hispanics showed a 24% lower all-cause death rate and lower death rates for nine of the 15 leading causes of death, but higher death rates from diabetes (51% higher), chronic liver disease and cirrhosis (48%), essential hypertension and hypertensive renal disease (8%), and homicide (96%) and higher prevalence of diabetes (133%) and obesity (23%) compared with whites. In all, 41.5% of Hispanics lacked health insurance (15.1% of whites), and 15.5% of Hispanics reported delay or nonreceipt of needed medical care because of cost concerns (13.6% of whites). Among Hispanics, self-reported smoking prevalences varied by Hispanic origin and by sex. U.S.-born Hispanics had higher prevalences of obesity, hypertension, smoking, heart disease, and cancer than foreign-born Hispanics: 30% higher, 40%, 72%, 89%, and 93%, respectively. CONCLUSION: Hispanics had better health outcomes than whites for most analyzed health factors, despite facing worse socioeconomic barriers, but they had much higher death rates from diabetes, chronic liver disease/cirrhosis, and homicide, and a higher prevalence of obesity. There were substantial differences among Hispanics by origin, nativity, and sex. IMPLICATIONS FOR PUBLIC HEALTH: Differences by origin, nativity, and sex are important considerations when targeting health programs to specific audiences. Increasing the proportions of Hispanics with health insurance and a medical home (patientcentered, team-based, comprehensive, coordinated health care with enhanced access) is critical. A feasible and systematic data collection strategy is needed to reflect health diversity among Hispanic origin subgroups, including by nativity.

Brief sexual histories and routine HIV/STD testing by medical providers.

Clinicians who routinely take patient sexual histories have the opportunity to assess patient risk for sexually transmitted diseases (STDs), including human immunodeficiency virus (HIV), and make appropriate recommendations for routine HIV/STD screenings. However, less than 40% of providers conduct sexual histories with patients, and many do not receive formal sexual history training in school. After partnering with a national professional organization of physicians, we trained 26 (US and US territory-based) practicing physicians (58% female; median age=48 years) regarding sexual history taking using both in-person and webinar methods. Trainings occurred during either a 6-h onsite or 2-h webinar session. We evaluated their post-training experiences integrating sexual histories during routine medical visits. We assessed use of sexual histories and routine HIV/STD screenings. All participating physicians reported improved sexual history taking and increases in documented sexual histories and routine HIV/STD screenings. Four themes emerged from the qualitative evaluations: (1) the need for more sexual history training; (2) the importance of providing a gender-neutral sexual history tool; (3) the existence of barriers to routine sexual histories/testing; and (4) unintended benefits for providers who were conducting routine sexual histories. These findings were used to develop a brief, gender-neutral sexual history tool for clinical use. This pilot evaluation demonstrates that providers were willing to utilize a sexual history tool in clinical practice in support of HIV/STD prevention efforts.

Strengthening the network of mentored, underrepresented minority scientists and leaders to reduce HIV-related health disparities.

OBJECTIVES: We reviewed data for the Minority HIV/AIDS Research Initiative (MARI), which was established in 2003 to support underrepresented minority scientists performing HIV prevention research in highly affected communities. METHODS: MARI was established at the Centers for Disease Prevention and Control as a program of competitively awarded, mentored grants for early career researchers conducting HIV prevention research in highly affected racial/ethnic and sexual minority communities. We have described progress from 2003 to 2013. RESULTS: To date, MARI has mentored 27 scientist leaders using low-cost strategies to enhance the development of effective HIV prevention interventions. These scientists have (1) developed research programs in disproportionately affected communities of color, (2) produced first-authored peer-reviewed scientific and programmatic products (including articles and community-level interventions), and (3) obtained larger, subsequent funding awards for research and programmatic work related to HIV prevention and health disparities work. CONCLUSIONS: The MARI program demonstrates how to effectively engage minority scientists to conduct HIV prevention research and reduce racial/ethnic investigator disparities and serves as a model for programs to reduce disparities in other public health areas in which communities of color are disproportionately affected.