Experiences of Using Cochrane Systematic Reviews by Local HTA Units.

This study evaluated the use of Cochrane systematic reviews (CSRs) by Quebec's local health technology assessment (HTA) units to promote efficiency in hospital decision-making. An online survey was conducted to examine: Characteristics of the HTA units; Knowledge about works and services from the Cochrane Collaboration; Level of satisfaction about the use of CSRs; Facilitating factors and barriers to the implementation of CSRs evidence in a local context; Suggestions to improve the use of CSRs. Data accuracy was checked by 2 independent evaluators. Ten HTA units participated. From their implementation a total of 321 HTA reports were published (49.8% included a SR). Works and services provided by the Cochrane collaboration were very well-known and HTA units were highly satisfied with CSRs (80%-100%). As regards to applicability in HTA and use of CSRs, major strengths were as follow: Useful as resource for search terms and background material; May reduce the workload (eg, brief review instead of full SR); Use to update a current review. Major weaknesses were: Limited use since no CSRs were available for many HTA projects; Difficulty to apply findings to local context; Focused only on efficacy and innocuity; Cannot be used as a substitute to a full HTA report. This study provided a unique context of assessment with a familiar group of producers, users and disseminators of CSRs in hospital setting. Since they generally used other articles from the literature or produce an original SR in complement with CSRs, this led to suggestions to improve their use of CSRs. However, the main limit for the use of CRS in local HTA will remain its lack of contextualisation. As such, this study reinforces the need to consider the notion of complementarity of experimental data informing us about causality and contextual data, allowing decision-making adapted to local issues.

Integration of ethical considerations into HTA reports: an analysis of integration levels using a systematic review.

OBJECTIVE: To describe the type and level of ethical integration in published health technology assessment (HTA) reports and systematically identify the ethical approaches utilized. METHODS: A literature search was conducted with the Google™ search engine using the keyword "ethic" between 1 January 2015 and 20 August 2019. Only HTA assessment reports with a section on ethics were retained and classified according to their level of ethical integration: no ethical analysis, ethical issues highlighted, assessments according to legal or social norms, and assessments from a moral or axiological perspective-using a qualitative methodology to distinguish such integration. RESULTS: This review yielded 188 reports with a section identified as being on ethics, produced by seventeen HTA agencies in eleven countries. One hundred and thirty-six reports did not develop an ethical analysis, thirty-one highlighted ethical issues, seventeen conducted a norm-based ethical assessment using a descriptive approach grounded in social norms, and four developed an assessment grounded in a moral or axiological perspective. The bioethical "four-principles" framework was used, but mainly for presenting ethical issues and not as a moral framework. CONCLUSIONS: The majority of reports featuring a section on ethics mention ethical considerations without ethical analysis. Ethical issues are grouped with legal, social, and organizational issues and treated as contextual considerations that decision makers should be aware of. When reports present systematic norm-based ethical assessments from a descriptive perspective or ethical assessment based on a moral or axiological perspective, there is a tendency to ground these analyses in frameworks created for the purpose and reliant on a concept of ethics supporting them.

How does HTA addresses current social expectations? An international survey.

OBJECTIVES: Integration of ethics into technology assessment in healthcare (HTA) reports is directly linked to the need of decision makers to provide rational grounds justifying their social choices. In a decision-making paradigm, facts and values are intertwined and the social role of HTA reports is to provide relevant information to decision makers. Since 2003, numerous surveys and discussions have addressed different aspects of the integration of ethics into HTA. This study aims to clarify how HTA professionals consider the integration of ethics into HTA, so an international survey was conducted in 2018 and the results are reported here. METHODS: A survey comprising twenty-two questions was designed and carried out from April 2018 to July 2018. Three hundred and twenty-eight HTA agencies from seventy-five countries were invited to participate in this survey. RESULTS: Eighty-nine participants completed the survey, representing a participation rate of twenty-seven percent. As to how HTA reports should fulfill their social role, over 84 percent of respondents agreed upon the necessity to address this role for decision makers, patients, and citizens. At a lower level, the same was found regarding the necessity to make value-judgments explicit in different report sections, including ethical analysis. This contrasts with the response-variability obtained on the status of ethical analysis with the exception of the expertise required. Variability in stakeholder-participation usefulness was also observed. CONCLUSIONS: This study reveals the importance of a three-phase approach, including assessment, contextual data, and recommendations, and highlights the necessity to make explicit value-judgments and have a systematic ethical analysis in order to fulfill HTA's social role in guiding decision makers.

ETHICS IN HEALTH TECHNOLOGY ASSESSMENT: A SYSTEMATIC REVIEW.

OBJECTIVES: Integration of ethics into health technology assessment (HTA) remains challenging for HTA practitioners. We conducted a systematic review on social and methodological issues related to ethical analysis in HTA. We examined: (1) reasons for integrating ethics (social needs); (2) obstacles to ethical integration; (3) concepts and processes deployed in ethical evaluation (more specifically value judgments) and critical analyses of formal experimentations of ethical evaluation in HTA. METHODS: Search criteria included "ethic," "technology assessment," and "HTA". The literature search was done in Medline/Ovid, SCOPUS, CINAHL, PsycINFO, and the international HTA Database. Screening of citations, full-text screening, and data extraction were performed by two subgroups of two independent reviewers. Data extracted from articles were grouped into categories using a general inductive method. RESULTS: A list of 1,646 citations remained after the removal of duplicates. Of these, 132 were fully reviewed, yielding 67 eligible articles for analysis. The social need most often reported was to inform policy decision making. The absence of shared standard models for ethical analysis was the obstacle to integration most often mentioned. Fairness and Equity and values embedded in Principlism were the values most often mentioned in relation to ethical evaluation. CONCLUSIONS: Compared with the scientific experimental paradigm, there are no settled proceedings for ethics in HTA nor consensus on the role of ethical theory and ethical expertise hindering its integration. Our findings enable us to hypothesize that there exists interdependence between the three issues studied in this work and that value judgments could be their linking concept.

IMPACT OF HEALTH TECHNOLOGY ASSESSMENT REPORTS ON HOSPITAL DECISION MAKERS - 10-YEAR INSIGHT FROM A HOSPITAL UNIT IN SHERBROOKE, CANADA: IMPACT OF HEALTH TECHNOLOGY ASSESSMENT ON HOSPITAL DECISIONS.

OBJECTIVES: The overarching goal of this research was to (i) evaluate the impact of reports with recommendations provided by a hospital-based health technology assessment (HB-HTA) unit on the local hospital decision-making processes and implementation activities and (ii) identify the underlying factors of the nonimplementation of recommendations. METHODS: All reports produced by the HB-HTA unit between December 2003 and March 2013 were retrieved, and hospital decision makers who requested these reports were solicited for enrolment. Participants were interviewed using a mixed design survey. RESULTS: Twenty reports, associated with fifteen decision makers, fulfilled the study criteria. Nine decision makers accepted to participate, corresponding to thirteen reports and twenty-three recommendations. Of the twenty-three recommendations issued, 65 percent were implemented, 9 percent were accepted for implementation but not implemented, and 26 percent were declined. In terms of the utility of each report to guide decision makers, 92 percent of the reports were considered in the decision-making process; 85 percent had one or more recommendations adopted; and 77 percent had recommendations implemented. The most frequently mentioned reasons for nonimplementation were related to contextual factors (64 percent), production/diffusion process factors (14 percent), content/format factors (14 percent), or other factors (9 percent). Among the contextual factors, the complexity of the changes (i.e., administrative reasons), budget and resources constraints, failure to identify administrative responsibility to carry out the recommendation, and nonpriority status of the HTA recommendation, were provided. CONCLUSIONS: This study highlights that although HB-HTA reports are useful to hospital managers in their decision-making processes, certain barriers such as contextual factors need to be better addressed to improve HB-HTA efficiency and usefulness.

IMPORTANCE OF CONTEXTUAL DATA IN PRODUCING HEALTH TECHNOLOGY ASSESSMENT RECOMMENDATIONS: A CASE STUDY.

OBJECTIVES: Contextual data and local expertise are important sources of data that cannot be ignored in hospital-based health technology assessment (HTA) processes. Despite a lack of or unconvincing evidence in the scientific literature, technology can be recommended in a given context. We illustrate this using a case study regarding biplane angiography for vascular neurointervention. METHODS: A systematic literature review was conducted, along with an analysis of the context in our setting. The outcomes of interest were radiation doses, clinical complications, procedure times, purchase cost, impact on teaching program, the confidence of clinicians in the technology, quality of care, accessibility, and the volume of activity. A committee comprising managers, clinical experts, physicians, physicists and HTA experts was created to produce a recommendation regarding biplane technology acquisition to replace a monoplane device. RESULTS: The systematic literature review yielded nine eligible articles for analysis. Despite a very low level of evidence in the literature, the biplane system appears to reduce ionizing radiation and medical complications, as well as shorten procedure time. Contextual data indicated that the biplane system could improve operator confidence, which could translate into reduced risk, particularly for complex procedures. In addition, the biplane system can support our institution in its advanced procedures teaching program. CONCLUSIONS: Given the advantages provided by the biplane technology in our setting, the committee has recommended its acquisition. Contextual data were of utmost importance in this recommendation. Moreover, this technology should be implemented alongside a responsibility to collect outcome data to optimize clinical protocol in the doses of ionizing delivered.

Social acceptance and population confidence in telehealth in Quebec.

BACKGROUND: Access to healthcare in remote areas is difficult and telehealth could be a promising avenue if accepted by the population. The aim of this study is to assess social acceptance and population confidence in telehealth in the Province of Quebec. METHODS: We conducted a survey using a questionnaire assessing the social acceptance of and confidence level in telehealth. Two strategies were used: 1) paper questionnaires were sent to two hospitals in Quebec; and 2) online questionnaires were randomly sent by a firm specialized in online survey to a representative sample of the population of the Province of Quebec. Respondents were all residents of the Province of Quebec and 18 years and older. Questions were scored with a four-level Likert scale. RESULTS: A total of 1816 questionnaires were analyzed (229 written and 1,587 online questionnaires). The socio-demographic variables in our samples, especially the online questionnaires, were fairly representative of Quebec's population. Overall, social acceptance scored at 77.71% and confidence level at 65.76%. Both scores were higher in the case of treatment (3 scenarios were proposed) vs. diagnosis (p < 0.05). No difference was found when respondents were asked to respond for themselves and for a member of their family, which demonstrates a true interest in telehealth in Quebec. In addition, we found a significant difference (p < 0.05) between written and online questionnaires regarding social acceptance (80.75% vs. 77.33%) and confidence level (74.84% vs. 64.55%). These differences may be due to social desirability or avidity bias in the written questionnaires. CONCLUSIONS: Our results suggest that the population in Quebec encourages the development of telehealth for real time diagnosis and long distance treatment for regions deprived of healthcare professionals.