Analysis of a database of materials for HIV prevention program evaluation.

Program evaluation technology transfer is the transfer of information on program evaluation from research to practitioners. There have been anecdotal reports of a lack of technology transfer materials related to HIV prevention program evaluation, especially materials usable by persons without extensive training in evaluation. The Centers for Disease Control and Prevention reviewed available program evaluation materials relevant to HIV prevention and developed a database of those materials. Materials were classified according to appropriate audience, level of evaluation expertise required, steps in the evaluation process addressed, and other criteria. The database was queried to determine the number of materials available for various combinations of search criteria. These queries revealed that for certain audiences and steps in the evaluation process there are few materials, especially usable by individuals without evaluation experience. The conclusion is that for certain areas of program evaluation, and for certain audiences, more evaluation technology transfer materials are needed.

Building evaluation capacity for HIV prevention programs.

HIV prevention programs, even those using science-based interventions, need to conduct evaluation to support the implementation and transfer of effective interventions, account for services, demonstrate effectiveness, and improve programs. The Program Evaluation Research Branch of the Division of HIV/AIDS Prevention, National Center for HIV, STD, and TB Prevention, Centers for Disease Control and Prevention, assists health department grantees and other CDC grantees by providing evaluation guidance, technical assistance (TA), and training in order to build their HIV prevention program evaluation capacity. Together, these evaluation resources assist grantees with overall implementation of evaluation and identify specific types of evaluation appropriate to each stage of intervention development. This paper describes the evaluation developmental process for different types of evaluation activities, provides a framework for building evaluation capacity, discusses the evaluation resources provided by CDC and gives examples of how evaluation TA and training support the overall technology transfer goals.

The value of engaging stakeholders in planning and implementing evaluations.

Stakeholder participation in evaluation has surfaced as a major factor contributing to the effectiveness of HIV prevention programs. In recognition of the multiple benefits, the Centers for Disease Control and Prevention (CDC), has used a framework to involve stakeholders in the evaluation of its programs. This article describes the framework used by the CDC and provides examples of four studies that involved various stakeholders from health departments, community-based organizations, and community planning groups to national and regional organizations in designing and implementing evaluations that yielded results useful for program improvement. The participatory process involved stakeholders in each of the four phases of the framework: evaluation planning, implementation, development of action plans, and dissemination. Lessons learned include the importance of having a facilitator to coordinate activities and ongoing communication with those involved in the evaluation. Stakeholders shared that using the evaluation results for action planning was beneficial for improving their programs. Despite many challenges faced in the stakeholder evaluation process, most stakeholders agreed that many benefits grew out of the multiple perspectives presented and understanding of the service agencies.