Achieving research impact in medical research through collaboration across organizational boundaries: Insights from a mixed methods study in the Netherlands.

BACKGROUND: In the Netherlands, university medical centres (UMCs) bear primary responsibility for conducting medical research and delivering highly specialized care. The TopCare program was a policy experiment lasting 4 years in which three non-academic hospitals received funding from the Dutch Ministry of Health to also conduct medical research and deliver highly specialized care in specific domains. This study investigates research collaboration outcomes for all Dutch UMCs and non-academic hospitals in general and, more specifically, for the domains in the non-academic hospitals participating in the TopCare program. Additionally, it explores the organizational boundary work employed by these hospitals to foster productive research collaborations. METHODS: A mixed method research design was employed combining quantitative bibliometric analysis of publications and citations across all Dutch UMCs and non-academic hospitals and the TopCare domains with geographical distances, document analysis and ethnographic interviews with actors in the TopCare program. RESULTS: Quantitative analysis shows that, over the period of study, international collaboration increased among all hospitals while national collaboration and single institution research declined slightly. Collaborative efforts correlated with higher impact scores, and international collaboration scored higher than national collaboration. A total of 60% of all non-academic hospitals' publications were produced in collaboration with UMCs, whereas almost 30% of the UMCs' publications were the result of such collaboration. Non-academic hospitals showed a higher rate of collaboration with the UMC that was nearest geographically, whereas TopCare hospitals prioritized expertise over geographical proximity within their specialized domains. Boundary work mechanisms adopted by TopCare hospitals included aligning research activities with organizational mindset (identity), bolstering research infrastructure (competence) and finding and mobilizing strategic partnerships with academic partners (power). These efforts aimed to establish credibility and attractiveness as collaboration partners. CONCLUSIONS: Research collaboration between non-academic hospitals and UMCs, particularly where this also involves international collaboration, pays off in terms of publications and impact. The TopCare hospitals used the program's resources to perform boundary work aimed at becoming an attractive and credible collaboration partner for academia. Local factors such as research history, strategic domain focus, in-house expertise, patient flows, infrastructure and network relationships influenced collaboration dynamics within TopCare hospitals and between them and UMCs.

Health-related quality of life in patients with steroid-refractory acute graft-versus-host disease.

BACKGROUND: Evidence regarding health-related quality of life (HRQoL) in patients with steroid-refractory acute graft-versus-host disease (SR-aGvHD) is lacking. Evaluating HRQoL was a secondary objective of the HOVON 113 MSC trial. Here we describe the outcomes of the EQ-5D-5L, EORTC QLQ-C30, and FACT-BMT for all adult patients who completed these questionnaires at baseline (i.e., before the start of treatment; n = 26). METHODS: Descriptive statistics were used to describe baseline patient and disease characteristics, EQ-5D dimension scores and values, EQ VAS scores, EORTC QLQ-C30 scale/item and summary scores, and FACT-BMT subscale and total scores. RESULTS: The mean EQ-5D value was 0.36. In total, 96% of the patients reported problems with usual activities, 92% with pain/discomfort, 84% with mobility, 80% with self-care, and 72% with anxiety/depression. The mean EORTC QLQ-C30 summary score was 43.50. Mean scale/item scores ranged from 21.79 to 60.00 for functioning scales, from 39.74 to 75.21 for symptom scales, and from 5.33 to 91.67 for single items. The mean FACT-BMT total score was 75.31. Mean subscale scores ranged from 10.09 for physical well-being to 23.94 for social/family well-being. CONCLUSION: Our study showed that HRQoL in patients with SR-aGvHD is poor. Improving HRQoL and symptom management in these patients should be a top priority.

Cost-effectiveness of Anti-CD19 chimeric antigen receptor T-Cell therapy in pediatric relapsed/refractory B-cell acute lymphoblastic leukemia. A societal view.

INTRODUCTION: In several studies, the chimeric antigen receptor T-cell therapy tisagenlecleucel demonstrated encouraging rates of remission and lasting survival benefits in pediatric patients with relapsed/refractory (r/r) acute lymphoblastic leukemia (ALL). We assessed the cost-effectiveness of tisagenlecleucel (list price: 320 000 EUR) among these patients when compared to clofarabine monotherapy (Clo-M), clofarabine combination therapy (Clo-C), and blinatumomab (Blina) from both a healthcare and a societal perspective. We also assessed future medical and future non-medical consumption costs. METHODS: A three-state partitioned survival model was used to simulate a cohort of pediatric patients (12 years of age) through different disease states until the end of life (lifetime horizon). Relevant outcomes were life years, quality-adjusted life years (QALYs), healthcare costs, societal costs, and the incremental cost-effectiveness ratio (ICER). Uncertainty was explored through deterministic and probabilistic sensitivity analyses as well as through several scenario analyzes. RESULTS: Total discounted costs for tisagenlecleucel were 552 679 EUR from a societal perspective, which was much higher than the total discounted costs from a healthcare perspective (ie, 409 563 EUR). Total discounted societal costs for the comparator regimens ranged between 160 803 EUR for Clo-M and 267 259 EUR for Blina. Highest QALYs were estimated for tisagenlecleucel (11.26), followed by Blina (2.25), Clo-C (1.70) and Clo-M (0.74). Discounted societal ICERs of tisagenlecleucel ranged between 31 682 EUR/QALY for Blina and 37 531 EUR/QALY for Clo-C and were considered cost-effective with a willingness-to-pay (WTP) threshold of 80 000 EUR/QALY. None of the scenarios exceeded this threshold, and more than 98% of the iterations in the probabilistic sensitivity analysis were cost-effective. DISCUSSION: At the current price and WTP threshold, tisagenlecleucel is cost-effective from both a healthcare and a societal perspective. Nevertheless, long-term effectiveness data are needed to validate the several assumptions that were necessary for this model.

Which Questionnaire Should Be Used to Measure Quality-of-Life Utilities in Patients with Acute Leukemia? An Evaluation of the Validity and Interpretability of the EQ-5D-5L and Preference-Based Questionnaires Derived from the EORTC QLQ-C30.

OBJECTIVES: The aim of this study was to assess the validity and interpretability of different preference-based questionnaires (generic 5-level EuroQol five-dimensional questionnaire [EQ-5D-5L], cancer-specific Quality of Life Questionnaire Preference-Based Measure, and European Organization of Randomized Controlled Trials 8 Dimension [EORTC-8D]) in patients with acute leukemia. METHODS: Patients who participated in Hemato-Oncologie voor Volwassenen Nederland (HOVON - the Haemato Oncology Foundation for Adults in the Netherlands) clinical trials between 1999 and 2011 at a single hospital were invited to complete the questionnaires. Interpretability was evaluated by the frequency of incomplete data and highest and lowest possible scores. Content validity was evaluated by exploring the health-related quality-of-life domains included in the questionnaires. Construct validity was assessed using correlations with other quality-of-life scales (EQ-visual analogue scale score and global quality-of-life scale of the EORTC Quality of Life Questionnaire) and ability to distinguish between patients with different health statuses. RESULTS: Questionnaires were returned by 89% (111 of 125) of the patients. Six to seven respondents did not return full questionnaires. Perfect health on the EQ-5D-5L was reported by 32 respondents and many of them (N = 17) did report health problems on other questionnaires. All questionnaires were strongly correlated (range 0.61-0.78) with other quality-of-life scales and yielded substantially different utility values for patients with different health statuses. Nevertheless, the disease-specific preference-based questionnaires showed greater discriminatory power. CONCLUSIONS: Although the Quality of Life Questionnaire Preference-Based Measure and the EORTC-8D appear to have better validity, this study does not provide any strong evidence against the use of the EQ-5D-5L for measuring quality-of-life utilities in acute leukemia. However, our findings need to be confirmed in larger longitudinal studies.

Impaired health-related quality of life in acute myeloid leukemia survivors: a single-center study.

OBJECTIVES: The purpose of this study was to assess the impact of acute myeloid leukemia (AML) and its treatment on health-related quality of life (HRQOL) by comparing the HRQOL of AML survivors with the HRQOL in the general population. METHODS: Two HRQOL questionnaires (EQ-5D and QLQ-C30) were sent to patients diagnosed with AML between 1999 and 2011 at a single academic hospital and still alive in 2012. HRQOL in AML survivors was compared with general population reference values. Multivariate analysis was used to identify factors associated with HRQOL in AML survivors. RESULTS: Questionnaires were returned by 92 of the 103 patients (89%). AML survivors reported significantly worse functioning, more fatigue, pain, dyspnea, appetite loss, and financial difficulties and lower EQ-VAS scores than the general population (P < 0.05). Impaired HRQOL in AML survivors was mainly found in survivors without a paid job. Other factors associated with a poor HRQOL were allogeneic hematopoietic stem cell transplantation and the absence of social support. CONCLUSION: This single-center study showed that the HRQOL in AML survivors is worse than the HRQOL in the general population. HRQOL in these patients can be improved by adequately treating and preventing fatigue, pain, dyspnea, and appetite loss.

The development and validation of a decision-analytic model representing the full disease course of acute myeloid leukemia.

BACKGROUND: The treatment of acute myeloid leukemia (AML) is moving towards personalized medicine. However, due to the low incidence of AML, it is not always feasible to evaluate the cost-effectiveness of personalized medicine using clinical trials. Decision analytic models provide an alternative data source. OBJECTIVE: The aim of this study was to develop and validate a decision analytic model that represents the full disease course of AML. METHODS: We used a micro simulation with discrete event components to incorporate both patient and disease heterogeneity. Input parameters were calculated from patient-level data. Two hematologists critically evaluated the model to ensure face validity. Internal and external validity was tested by comparing complete remission (CR) rates and survival outcomes of the model with original data, other clinical trials and a population-based study. RESULTS: No significant differences in patient and treatment characteristics, CR rate, 5-year overall and disease-free survival were found between the simulated and original data. External validation showed no significant differences in survival between simulated data and other clinical trials. However, differences existed between the simulated data and a population-based study. CONCLUSIONS: The model developed in this study is proved to be valid for analysis of an AML population participating in a clinical trial. The generalizability of the model to a broader patient population has not been proven yet. Further research is needed to identify differences between the clinical trial population and other AML patients and to incorporate these differences in the model.

The costs of initial treatment for patients with acute myeloid leukemia in the Netherlands.

The aim of this study was to calculate the costs of the current initial treatment of acute myeloid leukemia. Resource use was collected for 202 patients who started with intensive chemotherapy in 2008 or 2009. The costs of the first induction course were significantly higher than the costs of the second induction course. Allogeneic transplantation from a matched unrelated donor was significantly more expensive than the other consolidation treatments. In-hospital stay was the major cost driver in the treatment of AML. Research regarding possibilities of achieving the same or better health outcome with lower costs is warranted.

Condition-specific preference-based measures: benefit or burden?

OBJECTIVES: Some argue that generic preference-based measures (PBMs) are not sensitive to certain disease-specific improvements. To overcome this problem, new condition-specific PBMs (CS-PBMs) are being developed, but it is not yet clear how such measures compare with existing generic PBMs. METHOD: We generated CS-PBMs from three condition-specific questionnaires (Health Assessment Questionnaire for arthritis, Quality of Life Questionnaire for Cancer 30 for cancer, and Multiple Sclerosis Impact Scale 29 for multiple sclerosis). First, the questionnaires were reduced in content, and then, a time trade-off study was conducted in the general public (N = 402) to obtain weights associated with the dimensions and levels of the new questionnaire. Finally, we compared utilities obtained by using the CS-PBMs with utilities obtained by using the EuroQol five-dimensional (EQ-5D) questionnaire in four data sets. RESULTS: Utility values generated by the CS-PBMs were higher than those of the EQ-5D questionnaire. The Health Assessment Questionnaire-based measure for arthritis proved to be insensitive to comorbidities. Measures based on the Multiple Sclerosis Impact Scale 29 and the Quality of Life Questionnaire for Cancer 30 discriminated comorbidities and side effect equally well as the EQ-5D questionnaire and were more sensitive than the EQ-5D questionnaire for mild impairments. CONCLUSIONS: The introduction of PBMs that are specific to a certain disease may have the merit of sensitivity to disease-specific effects of interventions. That gain, however, is traded off to the loss of comparability of utility values and, in some cases, insensitivity to side effects and comorbidity. The use of a CS-PBM for cost-utility analysis is warranted only under strict conditions.

Mapping QLQ-C30, HAQ, and MSIS-29 on EQ-5D.

BACKGROUND: Responses on condition-specific instruments can be mapped on the EQ-5D to estimate utility values for economic evaluation. Mapping functions differ in predictive quality, and not all condition-specific measures are suitable for estimating EQ-5D utilities. We mapped QLQ-C30, HAQ, and MSIS-29 on the EQ-5D and compared the quality of the mapping functions with statistical and clinical indicators. METHODS: We used 4 data sets that included both the EQ-5D and a condition-specific measure to develop ordinary least squares regression equations. For the QLQ-C30, we used a multiple myeloma data set and a non-Hodgkin lymphoma one. An early arthritis cohort was used for the HAQ, and a cohort of patients with relapsing remitting or secondary progressive multiple sclerosis was used for the MSIS-29. We assessed the predictive quality of the mapping functions with the root mean square error (RMSE) and mean absolute error (MAE) and the ability to discriminate among relevant clinical subgroups. Pearson correlations between the condition-specific measures and items of the EQ-5D were used to determine if there is a relationship between the quality of the mapping functions and the amount of correlated content between the used measures. RESULTS: The QLQ-C30 had the highest correlation with EQ-5D items. Average %RMSE was best for the QLQ-C30 with 10.9%, 12.2% for the HAQ, and 13.6% for the MSIS-29. The mappings predicted mean EQ-5D utilities without significant differences with observed utilities and discriminated between relevant clinical groups, except for the HAQ model. CONCLUSIONS: The preferred mapping functions in this study seem suitable for estimating EQ-5D utilities for economic evaluation. However, this research shows that lower correlations between instruments lead to less predictive quality. Using additional validation tests besides reporting statistical measures of error improves the assessment of predictive quality.