Case-control vaccine effectiveness studies: Data collection, analysis and reporting results.

The case-control methodology is frequently used to evaluate vaccine effectiveness post-licensure. The results of such studies provide important insight into the level of protection afforded by vaccines in a 'real world' context, and are commonly used to guide vaccine policy decisions. However, the potential for bias and confounding are important limitations to this method, and the results of a poorly conducted or incorrectly interpreted case-control study can mislead policies. In 2012, a group of experts met to review recent experience with case-control studies evaluating vaccine effectiveness; we summarize the recommendations of that group regarding best practices for data collection, analysis, and presentation of the results of case-control vaccine effectiveness studies. Vaccination status is the primary exposure of interest, but can be challenging to assess accurately and with minimal bias. Investigators should understand factors associated with vaccination as well as the availability of documented vaccination status in the study context; case-control studies may not be a valid method for evaluating vaccine effectiveness in settings where many children lack a documented immunization history. To avoid bias, it is essential to use the same methods and effort gathering vaccination data from cases and controls. Variables that may confound the association between illness and vaccination are also important to capture as completely as possible, and where relevant, adjust for in the analysis according to the analytic plan. In presenting results from case-control vaccine effectiveness studies, investigators should describe enrollment among eligible cases and controls as well as the proportion with no documented vaccine history. Emphasis should be placed on confidence intervals, rather than point estimates, of vaccine effectiveness. Case-control studies are a useful approach for evaluating vaccine effectiveness; however careful attention must be paid to the collection, analysis and presentation of the data in order to best inform evidence-based vaccine policies.

Case-control vaccine effectiveness studies: Preparation, design, and enrollment of cases and controls.

Case-control studies are commonly used to evaluate effectiveness of licensed vaccines after deployment in public health programs. Such studies can provide policy-relevant data on vaccine performance under 'real world' conditions, contributing to the evidence base to support and sustain introduction of new vaccines. However, case-control studies do not measure the impact of vaccine introduction on disease at a population level, and are subject to bias and confounding, which may lead to inaccurate results that can misinform policy decisions. In 2012, a group of experts met to review recent experience with case-control studies evaluating the effectiveness of several vaccines; here we summarize the recommendations of that group regarding best practices for planning, design and enrollment of cases and controls. Rigorous planning and preparation should focus on understanding the study context including healthcare-seeking and vaccination practices. Case-control vaccine effectiveness studies are best carried out soon after vaccine introduction because high coverage creates strong potential for confounding. Endpoints specific to the vaccine target are preferable to non-specific clinical syndromes since the proportion of non-specific outcomes preventable through vaccination may vary over time and place, leading to potentially confusing results. Controls should be representative of the source population from which cases arise, and are generally recruited from the community or health facilities where cases are enrolled. Matching of controls to cases for potential confounding factors is commonly used, although should be reserved for a limited number of key variables believed to be linked to both vaccination and disease. Case-control vaccine effectiveness studies can provide information useful to guide policy decisions and vaccine development, however rigorous preparation and design is essential.