Pushing the boundaries of evaluation, diffusion, and use of medical devices in Europe: Insights from the COMED project.

The field of medical devices has attracted considerable interest from scholarly research in health economics in recent years. Medical devices are indispensable tools for quality health care delivery, but their assessment and appropriate use pose significant challenges to healthcare systems. More research is needed to overcome existing gaps associated with evaluation of digital technologies, address challenges in the use of real-world data in generating evidence for decision-making and to uncover drivers of variation in access to medical devices across countries. Furthermore, the translation of the results and recommendations stemming from research projects into health technology assessment practices needs to be strengthened. The European Union (EU) project COMED aimed to address these gaps by improving existing research and developing new research streams on the methods for evaluation and diffusion of medical devices. The project also intended to provide directly applicable policy advice and tools to inform decision-making, with the aim of impacting public health in the EU. This Health Economics Supplement, together with references of other published outputs of the project, is intended to be the main source for researchers and policy makers seeking information on the COMED project.

Implementation of coverage with evidence development schemes for medical devices: A decision tool for late technology adopter countries.

Experiences with coverage with evidence development (CED) schemes are fairly limited in Central and Eastern European (CEE) countries, which are usually late adopters of new health technologies. Our aim was to put forward recommendations on how CEE health technology assessment bodies and payer organizations can apply CED to reduce decision uncertainty on reimbursement of medical devices, with a particular focus on transferring the structure and data from CED schemes in early technology adopter countries in Western Europe. Structured interviews on the practices and feasibility of transferring CED schemes were conducted and subsequently, a draft tool for the systematic classification of decision alternatives and recommendations was developed. The decision tool was reviewed in a focus group discussion and validated within a wider group of CEE experts in a virtual workshop. Transferability assessment is needed in case of (1) joint implementation of a CED scheme; (2) transferring the structure of an existing CED scheme to a CEE country; (3) reimbursement decisions that are linked to outcomes of an ongoing CED scheme in another country and (4) real-world evidence transferred from completed CED schemes. Efficient use of available resources may be improved by adequately transferring evidence and policy tools from early technology adopter countries.

Program Evaluation of Population- and System-Level Policies: Evidence for Decision Making.

BACKGROUND: Policy evaluations often focus on ex post estimation of causal effects on short-term surrogate outcomes. The value of such information is limited for decision making, as the failure to reflect policy-relevant outcomes and disregard for opportunity costs prohibits the assessment of value for money. Further, these evaluations do not always consider all relevant evidence, other courses of action, or decision uncertainty. METHODS: In this article, we explore how policy evaluation could better meet the needs of decision making. We begin by defining the evidence required to inform decision making. We then conduct a literature review of challenges in evaluating policies. Finally, we highlight potential methods available to help address these challenges. RESULTS: The evidence required to inform decision making includes the impacts on the policy-relevant outcomes, the costs and associated opportunity costs, and the consequences of uncertainty. Challenges in evaluating health policies are described using 8 categories: 1) valuation space; 2) comparators; 3) time of evaluation; 4) mechanisms of action; 5) effects; 6) resources, constraints, and opportunity costs; 7) fidelity, adaptation, and level of implementation; and 8) generalizability and external validity. Methods from a broad set of disciplines are available to improve policy evaluation, relating to causal inference, decision-analytic modeling, theory of change, realist evaluation, and structured expert elicitation. LIMITATIONS: The targeted review may not identify all possible challenges, and the methods covered are not exhaustive. CONCLUSIONS: Evaluations should provide appropriate evidence to inform decision making. There are challenges in evaluating policies, but methods from multiple disciplines are available to address these challenges. IMPLICATIONS: Evaluators need to carefully consider the decision being informed, the necessary evidence to inform it, and the appropriate methods.[Box: see text].

Examining the impact of different country processes for appraising rare disease treatments: a case study analysis.

BACKGROUND: Conventional appraisal and reimbursement processes are being challenged by the increasing number of rare disease treatments (RDTs) with a small evidence base and often a high price. Processes to appraise RDTs vary across countries; some use standard processes, others have separate processes or adapted processes that explicitly deal with rare disease specificities. The objective of this study was to examine the impacts of different appraisal processes for two RDTs. METHODS: A case study analysis was conducted using countries with different forms of appraisal processes for RDTs for which public health technology assessment (HTA) reports were available. Two contrasting RDTs were chosen according to the criteria: rare versus ultra-rare treatment, affecting child versus adult, life-threatening versus disabling. Information from public HTA reports for each country's RDT appraisal was extracted into templates, allowing a systematic comparison of the appraisals across countries and identification of the impact of the different processes in practice. RESULTS: Reports from Belgium, England, France, Germany, Italy, Netherlands, Norway, Scotland, Sweden, and the USA were selected for nusinersen (for spinal muscular atrophy) and voretigene neparvovec (for inherited retinal disorders). Countries with separate or adapted processes had more consistent approaches for managing RDT-related issues during appraisal, such as stakeholder involvement and criteria to address the specificities of RDTs, creating more transparency in decision-making. CONCLUSIONS: Findings suggest that separate or adapted approaches for RDT appraisal may facilitate more structured, consistent decision-making and better management of RDT specificities.

Do existing real-world data sources generate suitable evidence for the HTA of medical devices in Europe? Mapping and critical appraisal.

AIM: Technological and computational advancements offer new tools for the collection and analysis of real-world data (RWD). Considering the substantial effort and resources devoted to collecting RWD, a greater return would be achieved if real-world evidence (RWE) was effectively used to support Health Technology Assessment (HTA) and decision making on medical technologies. A useful question is: To what extent are RWD suitable for generating RWE? METHODS: We mapped existing RWD sources in Europe for three case studies: hip and knee arthroplasty, transcatheter aortic valve implantation (TAVI) and mitral valve repair (TMVR), and robotic surgery procedures. We provided a comprehensive assessment of their content and appropriateness for conducting the HTA of medical devices. The identification of RWD sources was performed combining a systematic search on PubMed with gray literature scoping, covering fifteen European countries. RESULTS: We identified seventy-one RWD sources on arthroplasties; ninety-five on TAVI and TMVR; and seventy-seven on robotic procedures. The number, content, and integrity of the sources varied dramatically across countries. Most sources included at least one health outcome (97.5%), with mortality and rehospitalization/reoperation the most common; 80% of sources included resource outcomes, with length of stay the most common, and comparators were available in almost 70% of sources. CONCLUSIONS: RWD sources bear the potential for the HTA of medical devices. The main challenges are data accessibility, a lack of standardization of health and economic outcomes, and inadequate comparators. These findings are crucial to enabling the incorporation of RWD into decision making and represent a readily available tool for getting acquainted with existing information sources.

HTA'd in the USA: A Comparison of ICER in the United States with NICE in England and Wales.

BACKGROUND: The Institute for Clinical and Economic Review (ICER) has gained recognition for performing independent health technology assessments (HTAs) that include the cost-effectiveness of selected new technologies in the United States. ICER has similarities with the National Institute for Health and Care Excellence (NICE) in England and Wales, but the amount of overlap and new methods adopted to meet stakeholder needs in the complex U.S. health care system have not been fully analyzed. OBJECTIVE: To perform a comprehensive comparison of ICER and NICE. METHODS: We compared ICER and NICE using the same framework as Drummond et al. (2008), which suggests 4 dimensions for comparison of HTA organizations: structure of HTA programs, methods of HTA, processes for conduct of HTA, and use of HTAs in decision making. RESULTS: We found differences between ICER and NICE in the structure of HTA programs (setup of the organizations, governance issues, and funding); methods (perspective, costs, utilities, discounting, and thresholds); process (relationship with relevant stakeholders, deliberative decision-making processes, and timelines); and the use of HTA in decision making (the format and type of evidence generated, how the evidence is considered, and the format of the recommendations). CONCLUSIONS: ICER uses a different approach for clinical review but performs cost-effectiveness analysis using methods similar to NICE. The key differences between NICE and ICER arise because of important differences between the United Kingdom's "single payer" health care system and the United States's pluralistic system. ICER's lack of mandatory power translates to substantial differences in terms of its processes and type of recommendations. DISCLOSURES: No outside funding supported this study. Thokala has received grants from the Institute for Clinical and Economic Review (ICER) for modeling projects. Carlson has received grants from ICER, unrelated to this study. Drummond has nothing to disclose.

Childhood and adolescent influenza vaccination in Europe: A review of current policies and recommendations for the future.

Children and adolescents experience some of the highest rates of influenza infection and the subsequent burden on both infected children and their parents/carers is substantial. Vaccinating children and adolescents against seasonal influenza has the potential to reduce the burden of disease in both vaccinated and unvaccinated individuals due to the pivotal role that younger age groups play in the transmission of infection. While countries such as the USA, Canada and the UK have consequently recommended the universal vaccination of children, the vast majority of European countries have not yet extended their vaccination policies to this age group. This review examines the rationale for childhood and adolescent vaccination against seasonal influenza and reviews current vaccination policies in Europe. We discuss key policy considerations for European countries that must be considered when extending vaccination programmes to younger age groups alongside recommendations for European policy makers based on our findings.

Generating appropriate clinical data for value assessment of medical devices: what role does regulation play?

Assessing the value of health technologies, through health technology assessment is critically dependent on the existence of relevant and robust clinical data on the efficacy, safety and ideally, effectiveness of the technologies concerned. However, in the case of medical devices, such clinical data may not always be available, because of the different nature of the regulatory requirements in different jurisdictions. Therefore, we conducted a systematic review of the regulatory requirements in seven major jurisdictions in order to identify current challenges and to suggest possible improvements. There are differences in the requirements across jurisdictions and in the balance between pre-market and post-market controls. Several improvements are required in order to generate adequate clinical data for health technology assessment.

Issues in the incorporation of economic perspectives and evidence into Cochrane reviews.

BACKGROUND: Methods for systematic reviews of the effects of health interventions have focused mainly on addressing the question of 'What works?' or 'Is this intervention effective in achieving one or more specific outcomes?' Addressing the question 'Is it worth it given the resources available?' has received less attention. This latter question can be addressed by applying an economic lens to the systematic review process.This paper reflects on the value and desire for the consideration by end users for coverage of an economic perspective in a Cochrane review and outlines two potential approaches and future directions. METHODS: Two frameworks to guide review authors who are seeking to include an economic perspective are outlined. The first involves conducting a full systematic review of economic evaluations that is integrated into a review of intervention effects. The second involves developing a brief economic commentary. The two approaches share a set of common stages but allow the tailoring of the economic component of the Cochrane review to the skills and resources available to the review team. RESULTS: The number of studies using the methods outlined in the paper is limited, and further examples are needed both to explore the value of these approaches and to further develop them. The rate of progress will hinge on the organisational leadership, capacity and resources available to the CCEMG, author teams and other Cochrane entities. Particular methodological challenges to overcome relate to understanding the key economic trade-offs and casual relationships for a given decision problem and informing the development of evaluations designed to support local decision-makers. CONCLUSIONS: Methods for incorporating economic perspectives and evidence into Cochrane intervention reviews are established. Their role is not to provide a precise estimate of 'cost-effectiveness' but rather to help end-users of Cochrane reviews to determine the implications of the economic components of reviews for their own specific decisions.

Novel health economic evaluation of a vaccination strategy to prevent HPV-related diseases: the BEST study.

BACKGROUND: The development of human papillomavirus (HPV)-related diseases is not understood perfectly and uncertainties associated with commonly utilized probabilistic models must be considered. The study assessed the cost-effectiveness of a quadrivalent-based multicohort HPV vaccination strategy within a Bayesian framework. METHODS: A full Bayesian multicohort Markov model was used, in which all unknown quantities were associated with suitable probability distributions reflecting the state of currently available knowledge. These distributions were informed by observed data or expert opinion. The model cycle lasted 1 year, whereas the follow-up time horizon was 90 years. Precancerous cervical lesions, cervical cancers, and anogenital warts were considered as outcomes. RESULTS: The base case scenario (2 cohorts of girls aged 12 and 15 y) and other multicohort vaccination strategies (additional cohorts aged 18 and 25 y) were cost-effective, with a discounted cost per quality-adjusted life-year gained that corresponded to €12,013, €13,232, and €15,890 for vaccination programs based on 2, 3, and 4 cohorts, respectively. With multicohort vaccination strategies, the reduction in the number of HPV-related events occurred earlier (range, 3.8-6.4 y) when compared with a single cohort. The analysis of the expected value of information showed that the results of the model were subject to limited uncertainty (cost per patient = €12.6). CONCLUSIONS: This methodological approach is designed to incorporate the uncertainty associated with HPV vaccination. Modeling the cost-effectiveness of a multicohort vaccination program with Bayesian statistics confirmed the value for money of quadrivalent-based HPV vaccination. The expected value of information gave the most appropriate and feasible representation of the true value of this program.

Determinants of demand for total hip and knee arthroplasty: a systematic literature review.

BACKGROUND: Documented age, gender, race and socio-economic disparities in total joint arthroplasty (TJA), suggest that those who need the surgery may not receive it, and present a challenge to explain the causes of unmet need. It is not clear whether doctors limit treatment opportunities to patients, nor is it known the effect that patient beliefs and expectations about the operation, including their paid work status and retirement plans, have on the decision to undergo TJA. Identifying socio-economic and other determinants of demand would inform the design of effective and efficient health policy. This review was conducted to identify the factors that lead patients in need to undergo TJA. METHODS: An electronic search of the Embase and Medline (Ovid) bibliographic databases conducted in September 2011 identified studies in the English language that reported on factors driving patients in need of hip or knee replacement to undergo surgery. The review included reports of elective surgery rates in eligible patients or, controlling for disease severity, in general subjects, and stated clinical experts' and patients' opinions on suitability for or willingness to undergo TJA. Quantitative and qualitative studies were reviewed, but quantitative studies involving fewer than 20 subjects were excluded. The quality of individual studies was assessed on the basis of study design (i.e., prospective versus retrospective), reporting of attrition, adjustment for and report of confounding effects, and reported measures of need (self-reported versus doctor-assessed). Reported estimates of effect on the probability of surgery from analyses adjusting for confounders were summarised in narrative form and synthesised in odds ratio (OR) forest plots for individual determinants. RESULTS: The review included 26 quantitative studies-23 on individuals' decisions or views on having the operation and three about health professionals' opinions-and 10 qualitative studies. Ethnic and racial disparities in TJA use are associated with socio-economic access factors and expectations about the process and outcomes of surgery. In the United States, health insurance coverage affects demand, including that from the Medicare population, for whom having supplemental Medicaid coverage increases the likelihood of undergoing TJA. Patients with post-secondary education are more likely to demand hip or knee surgery than those without it (range of OR 0.87-2.38). Women are as willing to undergo surgery as men, but they are less likely to be offered surgery by specialists than men with the same need. There is considerable variation in patient demand with age, with distinct patterns for hip and knee. Paid employment appears to increase the chances of undergoing surgery, but no study was found that investigated the relationship between retirement plans and demand for TJA. There is evidence of substantial geographical variation in access to joint replacement within the territory covered by a public national health system, which is unlikely to be explained by differences in preference or unmeasured need alone. The literature tends to focus on associations, rather than testing of causal relationships, and is insufficient to assess the relative importance of determinants. CONCLUSIONS: Patients' use of hip and knee replacement is a function of their socio-economic circumstances, which reinforce disparities by gender and race originating in the doctor-patient interaction. Willingness to undergo surgery declines steeply after the age of retirement, at the time some eligible patients may lower their expectations of health status achievement. There is some evidence that paid employment independently increases the likelihood of operation. The relative contribution of variations in surgical decision making to differential access across regions within countries deserves further research that controls for clinical need and patient lifestyle preferences, including retirement decisions. Evidence on this question will become increasingly relevant for service planning and policy design in societies with ageing populations.

Explicit incorporation of equity considerations into economic evaluation of public health interventions.

Health equity is one of the main avowed objectives of public health policy across the world. Yet economic evaluations in public health (like those in health care more generally) continue to focus on maximizing health gain. Health equity considerations are rarely mentioned. Health economists rely on the quasi-egalitarian value judgment that 'a QALY is a QALY'--that is QALYs are equally weighted and the same health outcome is worth the same no matter how it is achieved or to whom it accrues. This value judgment is questionable in many important circumstances in public health. For example, policy-makers may place rather little value on health outcomes achieved by infringing individual liberties or by discriminating on the basis of age, sex, or race. Furthermore, there is evidence that a majority of the general public wish to give greater weight to health gains accruing to children, the severely ill, and, to a lesser extent, the socio-economically disadvantaged. This paper outlines four approaches to explicit incorporation of equity considerations into economic evaluation in public health: (i) review of background information on equity, (ii) health inequality impact assessment, (iii) analysis of the opportunity cost of equity, and (iv) equity weighting of health outcomes. The first three approaches can readily be applied using standard methods of health technology assessment, where suitable data are available; whereas approaches for generating equity weights remain experimental. The potential benefits of considering equity are likely to be largest in cases involving: (a) interventions that target disadvantaged individuals or communities and are also relatively cost-ineffective and (b) interventions to encourage lifestyle change, which may be relatively ineffective among 'hard-to-reach' disadvantaged groups and hence may require re-design to avoid increasing health inequalities.

Methodological issues in undertaking independent cost-effectiveness analysis for NICE: the case of therapies for ADHD.

This paper outlines methodological challenges encountered in producing an independent economic evaluation for the National Institute for Health and Clinical Excellence (NICE) to inform its technology appraisal process. The analysis used to highlight these challenges is a recent evaluation of pharmacological treatments for attention deficit hyperactivity disorder (ADHD). The NICE reference case for economic evaluation is compared with the methods necessary to complete an evaluation given the evidence base for ADHD. The primary analysis deviated from NICE methods guidelines most noticeably in the time horizon. Identifying appropriate utility data was challenging, and the results were sensitive to the values used. Issues found in this evaluation are common to many technology appraisals. Although challenging to undertake, economic evaluation in disease areas such as ADHD has great potential to add value, making the limitations of the data explicit, combining available evidence in a systematic and transparent framework and identifying future research needs.

Considerations and preliminary proposals for defining a reference case for economic evaluations in ankylosing spondylitis.

Since healthcare resources are scarce, choices have to be made on how they will be allocated. The use of economic evaluations using cost-effectiveness analyses has increased rapidly as policymakers have realized their value in maximizing the population's benefits (in terms of length of life and health status) within a given budget. Following efforts by OMERACT to create reference case definitions for the conduct of economic evaluation in rheumatoid arthritis, osteoporosis, and osteoarthritis, we review various methodological areas and research decisions that could benefit from a consensus between researchers, clinicians, and drug developers in terms of an ankylosing spondylitis (AS) reference case. Ten methodological issues are presented that will be important for future development of evaluations. Tentative proposals to define the issues in a reference case for AS are made, along with recommendations for further research.

Whither trial-based economic evaluation for health care decision making?

The randomised controlled trial (RCT) has developed a central role in applied cost-effectiveness studies in health care as the vehicle for analysis. This paper considers the role of trial-based economic evaluation in this era of explicit decision making. It is argued that any framework for economic analysis can only be judged insofar as it can inform two key decisions and be consistent with the objectives of a health care system subject to its resource constraints. The two decisions are, firstly, whether to adopt a health technology given existing evidence and, secondly, an assessment of whether more evidence is required to support this decision in the future. It is argued that a framework of economic analysis is needed which can estimate costs and effects, based on all the available evidence, relating to the full range of possible alternative interventions and clinical strategies, over an appropriate time horizon and for specific patient groups. It must also enable the accumulated evidence to be synthesised in an explicit and transparent way in order to fully represent the decision uncertainty. These requirements suggest that, in most circumstances, the use of a single RCT as a vehicle for economic analysis will be an inadequate and partial basis for decision making. It is argued that RCT evidence, with or without economic content, should be viewed as simply one of the sources of evidence, which must be placed in a broader framework of evidence synthesis and decision analysis.

Unfinished symphony: a tribute to the life and career of Bernie O'Brien (1959-2004).

The death of Bernie O'Brien in February 2004 brought a premature end to one of the most productive and influential careers in the area of health technology assessment and economic evaluation. A long-term member of the Society for Medical Decision Making, Bernie will be remembered for his research contributions in areas including outcome valuation, decision modeling, statistical methods in economic evaluation, and applied cost-effectiveness studies. He was also an excellent communicator and teacher and, above all, a fun guy to work with. In this article, the authors provide a review of Bernie's academic contributions.