Do we know enough about the effect of low-dose computed tomography screening for lung cancer on mortality to act? An updated systematic review, meta-analysis and network meta-analysis of randomised controlled trials 2017 to 2021.

BACKGROUND: For people at high risk of lung cancer, low-dose computed tomography (LDCT) is proposed as a method to reduce mortality. METHODS: Our objective was to estimate the effect of LDCT lung cancer screening on mortality in high-risk populations. A systematic review of randomised controlled trials (RCTs) comparing LDCT screening programmes with usual care (no screening) or other imaging screening programme (such as chest X-ray (CXR)) was conducted. RCTs of CXR screening were additionally included in the network meta-analyses. Bibliographic sources including MEDLINE, Embase, Web of Science and the Cochrane Library were searched to January 2017, and then further extended to November 2021. All key review steps were done by two persons. Quality assessment used the Cochrane Risk of Bias tool. Meta-analyses were performed. RESULTS: Nine RCTs, with up to 12.3 years of follow-up from randomisation, were included in the direct meta-analysis, which showed that LDCT screening was associated with a statistically significant decrease in lung cancer mortality (pooled relative risk (RR) 0.86, 95% confidence interval [CI] 0.77 to 0.96). There was a statistically non-significant decrease in all-cause mortality (pooled RR 0.98, 95% CI 0.95 to 1.01). The statistical heterogeneity for both outcomes was minimal. Network meta-analysis including the nine RCTs in the direct meta-analysis plus two further RCTs comparing CXR with usual care confirmed the size of the effect of LDCT on lung cancer mortality and that this was very similar irrespective of whether the comparator was usual care or CXR screening. CONCLUSIONS: LDCT screening is effective in reducing lung cancer mortality in high-risk populations. The uncertainty of its effect on lung cancer mortality observed in 2018 has been much reduced with new trial results and updates to existing trials, emphasising the importance of updating systematic reviews. Although there are still a number of RCTs unreported or in progress, we predict that further evolution of summary mortality estimates is unlikely. The focus for debate now moves to resolving uncertainty about the cost-effectiveness of LDCT screening taking into account the balance between benefits and harms which occur in all screening programmes.

Test accuracy of artificial intelligence-based grading of fundus images in diabetic retinopathy screening: A systematic review.

OBJECTIVES: To systematically review the accuracy of artificial intelligence (AI)-based systems for grading of fundus images in diabetic retinopathy (DR) screening. METHODS: We searched MEDLINE, EMBASE, the Cochrane Library and the ClinicalTrials.gov from 1st January 2000 to 27th August 2021. Accuracy studies published in English were included if they met the pre-specified inclusion criteria. Selection of studies for inclusion, data extraction and quality assessment were conducted by one author with a second reviewer independently screening and checking 20% of titles. Results were analysed narratively. RESULTS: Forty-three studies evaluating 15 deep learning (DL) and 4 machine learning (ML) systems were included. Nine systems were evaluated in a single study each. Most studies were judged to be at high or unclear risk of bias in at least one QUADAS-2 domain. Sensitivity for referable DR and higher grades was ≥85% while specificity varied and was <80% for all ML systems and in 6/31 studies evaluating DL systems. Studies reported high accuracy for detection of ungradable images, but the latter were analysed and reported inconsistently. Seven studies reported that AI was more sensitive but less specific than human graders. CONCLUSIONS: AI-based systems are more sensitive than human graders and could be safe to use in clinical practice but have variable specificity. However, for many systems evidence is limited, at high risk of bias and may not generalise across settings. Therefore, pre-implementation assessment in the target clinical pathway is essential to obtain reliable and applicable accuracy estimates.

Serial high-sensitivity cardiac troponin testing for the diagnosis of myocardial infarction: a scoping review.

OBJECTIVES: We aimed to assess the diversity and practices of existing studies on several assays and algorithms for serial measurements of high-sensitivity cardiac troponin (hs-cTn) for risk stratification and the diagnosis of myocardial infarction (MI) and 30-day outcomes in patients suspected of having non-ST-segment elevation MI (NSTEMI). METHODS: We searched multiple databases including MEDLINE, EMBASE, Science Citation Index, the Cochrane Database of Systematic Reviews and the CENTRAL databases for studies published between January 2006 and November 2021. Studies that assessed the diagnostic accuracy of serial hs-cTn testing in patients suspected of having NSTEMI in the emergency department (ED) were eligible. Data were analysed using the scoping review method. RESULTS: We included 86 publications, mainly from research centres in Europe, North America and Australasia. Two hs-cTn assays, manufactured by Abbott (43/86) and Roche (53/86), dominated the evaluations. The studies most commonly measured the concentrations of hs-cTn at two time points, at presentation and a few hours thereafter, to assess the two-strata or three-strata algorithm for diagnosing or ruling out MI. Although data from 83 studies (97%) were prospectively collected, 0%-90% of the eligible patients were excluded from the analysis due to missing blood samples or the lack of a final diagnosis in 53 studies (62%) that reported relevant data. Only 19 studies (22%) reported on head-to-head comparisons of alternative assays. CONCLUSION: Evidence on the accuracy of serial hs-cTn testing was largely derived from selected research institutions and relied on two specific assays. The proportions of the eligible patients excluded from the study raise concerns about directly applying the study findings to clinical practice in frontline EDs. PROSPERO REGISTRATION NUMBER: CRD42018106379.

Variation in Model-Based Economic Evaluations of Low-Dose Computed Tomography Screening for Lung Cancer: A Methodological Review.

OBJECTIVES: There is significant heterogeneity in the results of published model-based economic evaluations of low-dose computed tomography (LDCT) screening for lung cancer. We sought to understand and demonstrate how these models differ. METHODS: An expansion and update of a previous systematic review (N = 19). Databases (including MEDLINE and Embase) were searched. Studies were included if strategies involving (single or multiple) LDCT screening were compared with no screening or other imaging modalities, in a population at risk of lung cancer. More detailed data extraction of studies from the previous review was conducted. Studies were critically appraised using the Consensus Health Economic Criteria list. RESULTS: A total of 16 new studies met the inclusion criteria, giving a total of 35 studies. There are geographic and temporal differences and differences in screening intervals and eligible populations. Studies varied in the types of models used, for example, decision tree, Markov, and microsimulation models. Most conducted a cost-effectiveness analysis (using life-years gained) or cost-utility analysis. The potential for overdiagnosis was considered in many models, unlike with other potential consequences of screening. Some studies report considering lead-time bias, but fewer mention length bias. Generally, the more recent studies, involving more complex modeling, tended to meet more of the critical appraisal criteria, with notable exceptions. CONCLUSIONS: There are many differences across the economic evaluations contributing to variation in estimates of the cost-effectiveness of LDCT screening for lung cancer. Several methodological factors and evidence needs have been highlighted that will require consideration in future economic evaluations to achieve better agreement.

Symptom scores in the diagnosis of pediatric cow's milk protein allergy: A systematic review.

BACKGROUND: Cow's milk protein allergy (CMPA) is an immune-mediated allergic response to proteins in milk that is common in infants. Broad CMPA symptoms make diagnosis a challenge, particularly in primary care. Symptom scores may improve a clinician's awareness of symptoms, indicating a need for further testing. This systematic review examined the development and evaluation of such symptom scores for use in infants. METHODS: CENTRAL, MEDLINE, EMBASE and CINAHL databases were searched from inception to 3 December 2019 (Updated 14 November 2020) for diagnostic accuracy studies, randomised controlled trials, observational studies, economic evaluations, qualitative studies and studies reporting development of the tools. Data were not suitable for meta-analysis due to clinical and methodological heterogeneity, so were narratively synthesised. RESULTS: We found two symptom scores evaluated in one and fourteen studies, respectively. Estimated sensitivity and specificity ranged from 37% to 98% and 38% to 93%. The evaluations of each tool were at high risk of bias or failed to address issues such as clinical and cost-effectiveness. CONCLUSIONS: Estimates of accuracy of symptom scores for CMPA offered so far should be interpreted cautiously. Rigorous, conflict-free research based on well-defined roles for the tools is urgently required.

Development, validation and effectiveness of diagnostic prediction tools for colorectal cancer in primary care: a systematic review.

BACKGROUND: Tools based on diagnostic prediction models are available to help general practitioners (GP) diagnose colorectal cancer. It is unclear how well they perform and whether they lead to increased or quicker diagnoses and ultimately impact on patient quality of life and/or survival. The aim of this systematic review is to evaluate the development, validation, effectiveness, and cost-effectiveness, of cancer diagnostic tools for colorectal cancer in primary care. METHODS: Electronic databases including Medline and Web of Science were searched in May 2017 (updated October 2019). Two reviewers independently screened titles, abstracts and full-texts. Studies were included if they reported the development, validation or accuracy of a prediction model, or assessed the effectiveness or cost-effectiveness of diagnostic tools based on prediction models to aid GP decision-making for symptomatic patients presenting with features potentially indicative of colorectal cancer. Data extraction and risk of bias were completed by one reviewer and checked by a second. A narrative synthesis was conducted. RESULTS: Eleven thousand one hundred thirteen records were screened and 23 studies met the inclusion criteria. Twenty-studies reported on the development, validation and/or accuracy of 13 prediction models: eight for colorectal cancer, five for cancer areas/types that include colorectal cancer. The Qcancer models were generally the best performing. Three impact studies met the inclusion criteria. Two (an RCT and a pre-post study) assessed tools based on the RAT prediction model. The third study looked at the impact of GP practices having access to RAT or Qcancer. Although the pre-post study reported a positive impact of the tools on outcomes, the results of the RCT and cross-sectional survey found no evidence that use of, or access to, the tools was associated with better outcomes. No study evaluated cost effectiveness. CONCLUSIONS: Many prediction models have been developed but none have been fully validated. Evidence demonstrating improved patient outcome of introducing the tools is the main deficiency and is essential given the imperfect classification achieved by all tools. This need is emphasised by the equivocal results of the small number of impact studies done so far.

Cancer diagnostic tools to aid decision-making in primary care: mixed-methods systematic reviews and cost-effectiveness analysis.

BACKGROUND: Tools based on diagnostic prediction models are available to help general practitioners diagnose cancer. It is unclear whether or not tools expedite diagnosis or affect patient quality of life and/or survival. OBJECTIVES: The objectives were to evaluate the evidence on the validation, clinical effectiveness, cost-effectiveness, and availability and use of cancer diagnostic tools in primary care. METHODS: Two systematic reviews were conducted to examine the clinical effectiveness (review 1) and the development, validation and accuracy (review 2) of diagnostic prediction models for aiding general practitioners in cancer diagnosis. Bibliographic searches were conducted on MEDLINE, MEDLINE In-Process, EMBASE, Cochrane Library and Web of Science) in May 2017, with updated searches conducted in November 2018. A decision-analytic model explored the tools' clinical effectiveness and cost-effectiveness in colorectal cancer. The model compared patient outcomes and costs between strategies that included the use of the tools and those that did not, using the NHS perspective. We surveyed 4600 general practitioners in randomly selected UK practices to determine the proportions of general practices and general practitioners with access to, and using, cancer decision support tools. Association between access to these tools and practice-level cancer diagnostic indicators was explored. RESULTS: Systematic review 1 - five studies, of different design and quality, reporting on three diagnostic tools, were included. We found no evidence that using the tools was associated with better outcomes. Systematic review 2 - 43 studies were included, reporting on prediction models, in various stages of development, for 14 cancer sites (including multiple cancers). Most studies relate to QCancer® (ClinRisk Ltd, Leeds, UK) and risk assessment tools. DECISION MODEL: In the absence of studies reporting their clinical outcomes, QCancer and risk assessment tools were evaluated against faecal immunochemical testing. A linked data approach was used, which translates diagnostic accuracy into time to diagnosis and treatment, and stage at diagnosis. Given the current lack of evidence, the model showed that the cost-effectiveness of diagnostic tools in colorectal cancer relies on demonstrating patient survival benefits. Sensitivity of faecal immunochemical testing and specificity of QCancer and risk assessment tools in a low-risk population were the key uncertain parameters. SURVEY: Practitioner- and practice-level response rates were 10.3% (476/4600) and 23.3% (227/975), respectively. Cancer decision support tools were available in 83 out of 227 practices (36.6%, 95% confidence interval 30.3% to 43.1%), and were likely to be used in 38 out of 227 practices (16.7%, 95% confidence interval 12.1% to 22.2%). The mean 2-week-wait referral rate did not differ between practices that do and practices that do not have access to QCancer or risk assessment tools (mean difference of 1.8 referrals per 100,000 referrals, 95% confidence interval -6.7 to 10.3 referrals per 100,000 referrals). LIMITATIONS: There is little good-quality evidence on the clinical effectiveness and cost-effectiveness of diagnostic tools. Many diagnostic prediction models are limited by a lack of external validation. There are limited data on current UK practice and clinical outcomes of diagnostic strategies, and there is no evidence on the quality-of-life outcomes of diagnostic results. The survey was limited by low response rates. CONCLUSION: The evidence base on the tools is limited. Research on how general practitioners interact with the tools may help to identify barriers to implementation and uptake, and the potential for clinical effectiveness. FUTURE WORK: Continued model validation is recommended, especially for risk assessment tools. Assessment of the tools' impact on time to diagnosis and treatment, stage at diagnosis, and health outcomes is also recommended, as is further work to understand how tools are used in general practitioner consultations. STUDY REGISTRATION: This study is registered as PROSPERO CRD42017068373 and CRD42017068375. FUNDING: This project was funded by the National Institute for Health Research (NIHR) Health Technology programme and will be published in full in Health Technology Assessment; Vol. 24, No. 66. See the NIHR Journals Library website for further project information.

In the UK, people with cancer tend to die sooner than people with cancer in other European countries. This may be because their cancers are caught at a later stage, perhaps after they have spread. Spotting cancer earlier in people, and testing them sooner, may extend people's lives. Researchers have developed 'diagnostic tools', which give the probability of having cancer, based on a patient's symptoms, blood test results and other information. The tools help family doctors decide who needs further testing for possible cancer, including cancers of the digestive, urinary and reproductive systems, and in the blood. We do not know how many family doctors have these tools, or how well the tools work. We systematically reviewed published studies about how these tools were developed, how good and accurate they are, and what effects their use has on patients. We found that many tools have been developed, but there is little evidence that they improve the quality or length of life. We sent surveys to family doctors all over the UK asking if they had the tools at their practice and if they used them. Based on the replies we received, we estimate that the tools are in about one in three practices. They are likely to be used in about half of the practices where they are available. For practices in England only, we looked for, but did not find, any association between using the tools and the number of urgent appointments made for cancer testing. We used a computer model to show what might happen if family doctors used the tools for patients who have symptoms of bowel cancer. In our model, if general practitioners used the tools, patients would need fewer appointments before they were referred to a specialist. This should reduce the time to diagnosis and treatment, compared with not using the tools. However, there is very little evidence as to whether or not this is indeed the case. Therefore, at the moment, we cannot say whether or not the use of such tools by general practitioners is better for patients and the NHS. More research is needed on what effect these tools have on patients, especially as to whether or not quality and length of life are improved.

At what times during infection is SARS-CoV-2 detectable and no longer detectable using RT-PCR-based tests? A systematic review of individual participant data.

BACKGROUND: Tests for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) viral ribonucleic acid (RNA) using reverse transcription polymerase chain reaction (RT-PCR) are pivotal to detecting current coronavirus disease (COVID-19) and duration of detectable virus indicating potential for infectivity. METHODS: We conducted an individual participant data (IPD) systematic review of longitudinal studies of RT-PCR test results in symptomatic SARS-CoV-2. We searched PubMed, LitCOVID, medRxiv, and COVID-19 Living Evidence databases. We assessed risk of bias using a QUADAS-2 adaptation. Outcomes were the percentage of positive test results by time and the duration of detectable virus, by anatomical sampling sites. RESULTS: Of 5078 studies screened, we included 32 studies with 1023 SARS-CoV-2 infected participants and 1619 test results, from - 6 to 66 days post-symptom onset and hospitalisation. The highest percentage virus detection was from nasopharyngeal sampling between 0 and 4 days post-symptom onset at 89% (95% confidence interval (CI) 83 to 93) dropping to 54% (95% CI 47 to 61) after 10 to 14 days. On average, duration of detectable virus was longer with lower respiratory tract (LRT) sampling than upper respiratory tract (URT). Duration of faecal and respiratory tract virus detection varied greatly within individual participants. In some participants, virus was still detectable at 46 days post-symptom onset. CONCLUSIONS: RT-PCR misses detection of people with SARS-CoV-2 infection; early sampling minimises false negative diagnoses. Beyond 10 days post-symptom onset, lower RT or faecal testing may be preferred sampling sites. The included studies are open to substantial risk of bias, so the positivity rates are probably overestimated.

Strategies to identify individuals with monogenic diabetes: results of an economic evaluation.

OBJECTIVES: To evaluate and compare the lifetime costs associated with strategies to identify individuals with monogenic diabetes and change their treatment to more appropriate therapy. DESIGN: A decision analytical model from the perspective of the National Health Service (NHS) in England and Wales was developed and analysed. The model was informed by the literature, routinely collected data and a clinical study conducted in parallel with the modelling. SETTING: Secondary care in the UK. PARTICIPANTS: Simulations based on characteristics of patients diagnosed with diabetes <30 years old. INTERVENTIONS: Four test-treatment strategies to identify individuals with monogenic diabetes in a prevalent cohort of diabetics diagnosed under the age of 30 years were modelled: clinician-based genetic test referral, targeted genetic testing based on clinical prediction models, targeted genetic testing based on biomarkers, and blanket genetic testing. The results of the test-treatment strategies were compared with a strategy of no genetic testing. PRIMARY AND SECONDARY OUTCOME MEASURES: Discounted lifetime costs, proportion of cases of monogenic diabetes identified. RESULTS: Based on current evidence, strategies using clinical characteristics or biomarkers were estimated to save approximately £100-£200 per person with diabetes over a lifetime compared with no testing. Sensitivity analyses indicated that the prevalence of monogenic diabetes, the uptake of testing, and the frequency of home blood glucose monitoring had the largest impact on the results (ranging from savings of £400-£50 per person), but did not change the overall findings. The model is limited by many model inputs being based on very few individuals, and some long-term data informed by clinical opinion. CONCLUSIONS: Costs to the NHS could be saved with targeted genetic testing based on clinical characteristics or biomarkers. More research should focus on the economic case for the use of such strategies closer to the time of diabetes diagnosis. TRIAL REGISTRATION NUMBER: NCT01238380.

Exploring the Cost-Effectiveness of Mechanical Thrombectomy Beyond 6 Hours Following Advanced Imaging in the United Kingdom.

Background and Purpose- In the United Kingdom, mechanical thrombectomy (MT) for acute ischemic stroke patients assessed beyond 6 hours from symptom onset will be commissioned up to 12 hours provided that advanced imaging (AdvImg) demonstrates salvageable brain tissue. While the accuracy of AdvImg differs across technologies, evidence is limited regarding the proportion of patients who would benefit from late MT. We compared the cost-effectiveness of 2 care pathways: (1) MT within and beyond 6 hours based on AdvImg selection versus (2) MT only within 6 hours based on conventional imaging selection. The impact of varying AdvImg accuracy and prior probability for acute ischemic stroke patients to benefit from late MT was assessed. Methods- A decision tree and a Markov trace were developed. A hypothetical United Kingdom cohort of suspected stroke patients aged 71 years with first event was modeled. Costs, health outcomes, and probabilities were obtained from the literature. Outcomes included costs, life years (LYs), quality-adjusted life years (QALYs), and incremental cost-effectiveness ratios. Probabilistic sensitivity analyses were performed. Various scenarios with prior probabilities of 10%, 20%, and 30%, respectively, for acute ischemic stroke patients to benefit from late MT, and with perfect accuracy, 80% sensitivity, and 70% specificity of AdvImg were studied. Results- Incremental cost-effectiveness ratios resulting from our deterministic analyses varied from $8199 (£6164) to $49 515 (£37 229) per QALY gained. AdvImg accuracy impacted the incremental cost-effectiveness ratio only when its specificity decreased. Over lifetime horizons, all scenarios including late MT improved QALYs and LYs. Depending on the scenario, the probabilistic sensitivity analyses showed probabilities varying between 46% and 93% for the late MT pathway to be cost-effective at a willingness to pay threshold of $39 900 (£30 000) per QALY. Conclusions- Late MT based on AdvImg selection may be good value for money. However, additional data regarding the implementation of AdvImg and prior probability to benefit from late MT are needed before its cost-effectiveness can be fully assessed.

Diagnostic accuracy of contemporary and high-sensitivity cardiac troponin assays used in serial testing, versus single-sample testing as a comparator, to triage patients suspected of acute non-ST-segment elevation myocardial infarction: a systematic review protocol.

INTRODUCTION: Although the new generation of cardiac troponin assays have revolutionised the diagnosis of myocardial infarction (MI), their application in triaging patients with suspected acute coronary syndrome requires further investigation. The objectives of the current systematic review are to evaluate the diagnostic accuracy of contemporary and high-sensitivity cardiac troponin assays used in serial testing, versus single-sample testing as a comparator, to identify patients with non-ST-segment-elevation MI in the emergency department. METHODS AND ANALYSIS: We will conduct systematic searches of MEDLINE, EMBASE, Science Citation Index, the Cochrane Database of Systematic Reviews and the CENTRAL database covering the period from 1 January 2006 to present, with no restrictions on language or publication status. Two review authors will independently screen studies for inclusion, extract data from eligible studies and assess their methodological quality using Quality Assessment of Diagnostic Accuracy Studies version 2. Studies will be included if they evaluate contemporary or high-sensitivity cardiac troponin assays used in serial testing, in patients presenting to the ED with suspicion of MI. Estimates of sensitivity and specificity from each study will be presented in forest plots and in the receiver-operating characteristics space. If appropriate, we will pool the results using Bayesian hierarchical models that allow correction for imperfect reference standard. We will obtain summary estimates of sensitivity and specificity of alternative testing protocols and compare their accuracy. We will also investigate the impact of prespecified sources of heterogeneity and methodological quality items. If pooling of results is considered inappropriate, we will present our findings in tables and diagrams and will describe them narratively. ETHICS AND DISSEMINATION: No formal ethical approval will be sought, but we will report on the ethical approval of the included studies. Dissemination of findings will be through publications in peer-reviewed journals, presentations at conferences and the websites of the universities. PROSPERO REGISTRATION NUMBER: CRD42018106379.

Do we know enough about the effect of low-dose computed tomography screening for lung cancer on survival to act? A systematic review, meta-analysis and network meta-analysis of randomised controlled trials.

BACKGROUND: Diagnosis of lung cancer frequently occurs in its later stages. Low-dose computed tomography (LDCT) could detect lung cancer early. METHODS: Our objective was to estimate the effect of LDCT lung cancer screening on mortality in high-risk populations. A systematic review of randomised controlled trials (RCTs) comparing LDCT screening programmes with usual care (no screening) or other imaging screening programme (such as chest X-ray (CXR)) was conducted. RCTs of CXR screening were additionally included in the network meta-analysis. Bibliographic sources including MEDLINE, Embase, Web of Science and the Cochrane Library were searched to January 2017. All key review steps were done by two persons. Quality assessment used the Cochrane Risk of Bias tool. Meta-analyses were performed. RESULTS: Four RCTs were included. More will provide data in the future. Meta-analysis demonstrated that LDCT screening with up to 9.80 years of follow-up was associated with a statistically non-significant decrease in lung cancer mortality (pooled relative risk (RR) 0.94, 95% confidence interval (CI) 0.74 to 1.19; p = 0.62). There was a statistically non-significant increase in all-cause mortality. Given the considerable heterogeneity for both outcomes, the results should be treated with caution.Network meta-analysis including the four original RCTs plus two further RCTs assessed the relative effectiveness of LDCT, CXR and usual care. The results showed that in terms of lung cancer mortality reduction LDCT was ranked as the best screening strategy, CXR screening as the worst strategy and usual care intermediate. CONCLUSIONS: LDCT screening may be effective in reducing lung cancer mortality but there is considerable uncertainty: the largest of the RCTs compared LDCT with CXR screening rather than no screening; there is imprecision of the estimates; and there is important heterogeneity between the included study results. The uncertainty about the effect on all-cause mortality is even greater. Maturing trials may resolve the uncertainty.

Everolimus, lutetium-177 DOTATATE and sunitinib for advanced, unresectable or metastatic neuroendocrine tumours with disease progression: a systematic review and cost-effectiveness analysis.

BACKGROUND: Neuroendocrine tumours (NETs) are a group of heterogeneous cancers that develop in cells in the diffuse neuroendocrine system. OBJECTIVES: To estimate the clinical effectiveness of three interventions [everolimus (Afinitor®; Novartis International AG, Basel, Switzerland), lutetium-177 DOTATATE (177Lu-DOTATATE) (Lutathera®; Imaging Equipment Ltd, Radstock, UK) and sunitinib (Sutent®; Pfizer Inc., New York, NY, USA)] for treating unresectable or metastatic NETs with disease progression and establish the cost-effectiveness of these interventions. DATA SOURCES: The following databases were searched from inception to May 2016: MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations, MEDLINE Daily, Epub Ahead of Print, EMBASE, Cochrane Central Register of Controlled Trials and Web of Science. REVIEW METHODS: We systematically reviewed the clinical effectiveness and cost-effectiveness literature on everolimus, 177Lu-DOTATATE and sunitinib for treating advanced, unresectable or metastatic progressive NETs. The following NET locations were considered separately: pancreas, gastrointestinal (GI) tract and lung, and GI tract (midgut only). We wrote a survival partition cohort-based economic evaluation in Microsoft Excel® 2013 (Microsoft Corporation, Redmond, WA, USA) from the UK NHS and Personal Social Services perspective. This comprised three health states: (1) progression-free survival (PFS), (2) progressed disease and (3) death. RESULTS: Three randomised controlled trials (RCTs), RADIANT-3 [RAD001 in Advanced Neuroendocrine Tumors, Third Trial; pancreatic NETs (pNETs): everolimus vs. best supportive care (BSC)], A6181111 (pNETs: sunitinib vs. BSC) and RADIANT-4 (RAD001 in Advanced Neuroendocrine Tumors, Fourth Trial; GI and lung NETs: everolimus vs. BSC), met the inclusion criteria for the clinical effectiveness systematic review. The risk of bias was low. Although the NETTER-1 (Neuroendocrine Tumors Therapy) RCT, of 177Lu-DOTATATE plus 30 mg of octreotide (Sandostatin®, Novartis) compared with 60 mg of octreotide, was excluded from the review, we nonetheless present the results of this trial, as it informs our estimate of the cost-effectiveness of 177Lu-DOTATATE. The pNETs trials consistently found that the interventions improved PFS and overall survival (OS) compared with BSC. Our indirect comparison found no significant difference in PFS between everolimus and sunitinib. Estimates of OS gain were confounded because of high rates of treatment switching. After adjustment, our indirect comparison suggested a lower, but non-significant, hazard of death for sunitinib compared with everolimus. In GI and lung NETs, everolimus significantly improved PFS compared with BSC and showed a non-significant trend towards improved OS compared with BSC. Adverse events were more commonly reported following treatment with targeted interventions than after treatment with BSC. In the base case for pNETs, assuming list prices, we estimated incremental cost-effectiveness ratios (ICERs) for everolimus compared with BSC of £45,493 per quality-adjusted life-year (QALY) and for sunitinib compared with BSC of £20,717 per QALY. These ICERs increased substantially without the adjustment for treatment switching. For GI and lung NETs, we estimated an ICER for everolimus compared with BSC of £44,557 per QALY. For GI (midgut) NETs, the ICERs were £199,233 per QALY for everolimus compared with BSC and £62,158 per QALY for a scenario analysis comparing 177Lu-DOTATATE with BSC. We judge that no treatment meets the National Institute for Health and Care Excellence's (NICE) end-of-life criteria, although we cannot rule out that sunitinib in the A6181111 trial does. LIMITATIONS: A RCT with included comparators was not identified for 177Lu-DOTATATE. The indirect treatment comparison that our economic analysis was based on was of a simple Bucher type, unadjusted for any differences in the baseline characteristics across the two trials. CONCLUSIONS: Given NICE's current stated range of £20,000-30,000 per QALY for the cost-effectiveness threshold, based on list prices, only sunitinib might be considered good value for money in England and Wales. FUTURE WORK: Further analysis of individual patient data from RADIANT-3 would allow assessment of the robustness of our findings. The data were not made available to us by the company sponsoring the trial. STUDY REGISTRATION: This study is registered as PROSPERO CRD42016041303. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Revisiting the need for a literature search narrative: A brief methodological note.

In this method note, we question if the primary search strategy in a systematic review should be accompanied by a search narrative. A search narrative could offer a conceptual and contextual report on the search strategy, which we suggest might benefit the peer review of literature searches and increase engagement with, and discussion of, the literature search strategy from review stakeholders, topic experts, and lay users of research. Search narratives would also increase the transparency of decision-making in literature searching.

A methodology review on the incremental prognostic value of computed tomography biomarkers in addition to Framingham risk score in predicting cardiovascular disease: the use of association, discrimination and reclassification.

BACKGROUND: Computed tomography (CT) biomarkers claim to improve cardiovascular risk stratification. This review focuses on significant differences in incremental measures between adequate and inadequate reporting practise. METHODS: Studies included were those that used Framingham Risk Score as a baseline and described the incremental value of adding calcium score or CT coronary angiogram in predicting cardiovascular risk. Searches of MEDLINE, EMBASE, Web of Science and Cochrane Central were performed with no language restriction. RESULTS: Thirty five studies consisting of 206,663 patients (men = 118,114, 55.1%) were included. The baseline Framingham Risk Score included the 1998, 2002 and 2008 iterations. Selective reporting, inconsistent reference groupings and thresholds were found. Twelve studies (34.3%) had major and 23 (65.7%) had minor alterations and the respective Δ AUC were significantly different (p = 0.015). When the baseline model performed well, the Δ AUC was relatively lower with the addition of a CT biomarker (Spearman coefficient = - 0.46, p < 0.0001; n = 33; 76 pairs of data). Other factors that influenced AUC performance included exploration of data analysis, calibration, validation, multivariable and AUC documentation (all p < 0.05). Most studies (68.7%) that reported categorical NRI (n = 16; 46 pairs of data) subjectively drew strong conclusions along with other poor reporting practices. However, no significant difference in values of NRI was found between adequate and inadequate reporting. CONCLUSIONS: The widespread practice of poor reporting particularly association, discrimination, reclassification, calibration and validation undermines the claimed incremental value of CT biomarkers over the Framingham Risk Score alone. Inadequate reporting of discrimination inflates effect estimate, however, that is not necessarily the case for reclassification.

Immunosuppressive agents in adult kidney transplantation in the National Health Service: a model-based economic evaluation.

BACKGROUND: Immunosuppression is required in kidney transplantation to prevent rejection and prolong graft survival. We conducted an economic evaluation to support England's National Institute for Health and Care Excellence in developing updated guidance on the use of immunosuppression, incorporating new immunosuppressive agents, and addressing changes in pricing and the evidence base. METHODS: A discrete-time state transition model was developed to simulate adult kidney transplant patients over their lifetime. A total of 16 different regimens were modelled to assess the cost-effectiveness of basiliximab and rabbit anti-thymocyte globulin (rabbit ATG) as induction agents (with no antibody induction as a comparator) and immediate-release tacrolimus, prolonged-release tacrolimus, mycophenolate mofetil, mycophenolate sodium, sirolimus, everolimus and belatacept as maintenance agents (with ciclosporin and azathioprine as comparators). Graft survival was extrapolated from acute rejection rates, graft function and post-transplant diabetes rates, all estimated at 12 months post-transplantation. National Health Service (NHS) and personal social services costs were included. Cost-effectiveness thresholds of £20 000 and £30 000 per quality-adjusted life year were used. RESULTS: Basiliximab was predicted to be more effective and less costly than rabbit ATG and induction without antibodies. Immediate-release tacrolimus and mycophenolate mofetil were cost-effective as maintenance therapies. Other therapies were either more expensive and less effective or would only be cost-effective if a threshold in excess of £100 000 per quality-adjusted life year were used. CONCLUSIONS: A regimen comprising induction with basiliximab, followed by maintenance therapy with immediate-release tacrolimus and mycophenolate mofetil, is likely to be effective for uncomplicated adult kidney transplant patients and a cost-effective use of NHS resources.

EXPLICIT: a feasibility study of remote expert elicitation in health technology assessment.

BACKGROUND: Expert opinion is often sought to complement available information needed to inform model-based economic evaluations in health technology assessments. In this context, we define expert elicitation as the process of encoding expert opinion on a quantity of interest, together with associated uncertainty, as a probability distribution. When availability for face-to-face expert elicitation with a facilitator is limited, elicitation can be conducted remotely, overcoming challenges of finding an appropriate time to meet the expert and allowing access to experts situated too far away for practical face-to-face sessions. However, distance elicitation is associated with reduced response rates and limited assistance for the expert during the elicitation session. The aim of this study was to inform the development of a remote elicitation tool by exploring the influence of mode of elicitation on elicited beliefs. METHODS: An Excel-based tool (EXPLICIT) was developed to assist the elicitation session, including the preparation of the expert and recording of their responses. General practitioners (GPs) were invited to provide expert opinion about population alcohol consumption behaviours. They were randomised to complete the elicitation by either a face-to-face meeting or email. EXPLICIT was used in the elicitation sessions for both arms. RESULTS: Fifteen GPs completed the elicitation session. Those conducted by email were longer than the face-to-face sessions (13 min 30 s vs 10 min 26 s, p = 0.1) and the email-elicited estimates contained less uncertainty. However, the resulting aggregated distributions were comparable. CONCLUSIONS: EXPLICIT was useful in both facilitating the elicitation task and in obtaining expert opinion from experts via email. The findings support the opinion that remote, self-administered elicitation is a viable approach within the constraints of HTA to inform policy making, although poor response rates may be observed and additional time for individual sessions may be required.

Population-Based Assessment of a Biomarker-Based Screening Pathway to Aid Diagnosis of Monogenic Diabetes in Young-Onset Patients.

OBJECTIVE: Monogenic diabetes, a young-onset form of diabetes, is often misdiagnosed as type 1 diabetes, resulting in unnecessary treatment with insulin. A screening approach for monogenic diabetes is needed to accurately select suitable patients for expensive diagnostic genetic testing. We used C-peptide and islet autoantibodies, highly sensitive and specific biomarkers for discriminating type 1 from non-type 1 diabetes, in a biomarker screening pathway for monogenic diabetes. RESEARCH DESIGN AND METHODS: We studied patients diagnosed at age 30 years or younger, currently younger than 50 years, in two U.K. regions with existing high detection of monogenic diabetes. The biomarker screening pathway comprised three stages: 1) assessment of endogenous insulin secretion using urinary C-peptide/creatinine ratio (UCPCR); 2) if UCPCR was ≥0.2 nmol/mmol, measurement of GAD and IA2 islet autoantibodies; and 3) if negative for both autoantibodies, molecular genetic diagnostic testing for 35 monogenic diabetes subtypes. RESULTS: A total of 1,407 patients participated (1,365 with no known genetic cause, 34 with monogenic diabetes, and 8 with cystic fibrosis-related diabetes). A total of 386 out of 1,365 (28%) patients had a UCPCR ≥0.2 nmol/mmol, and 216 out of 386 (56%) were negative for GAD and IA2 and underwent molecular genetic testing. Seventeen new cases of monogenic diabetes were diagnosed (8 common Maturity Onset Diabetes of the Young [Sanger sequencing] and 9 rarer causes [next-generation sequencing]) in addition to the 34 known cases (estimated prevalence of 3.6% [51/1,407] [95% CI 2.7-4.7%]). The positive predictive value was 20%, suggesting a 1-in-5 detection rate for the pathway. The negative predictive value was 99.9%. CONCLUSIONS: The biomarker screening pathway for monogenic diabetes is an effective, cheap, and easily implemented approach to systematically screening all young-onset patients. The minimum prevalence of monogenic diabetes is 3.6% of patients diagnosed at age 30 years or younger.

The clinical effectiveness and cost-effectiveness of cetuximab (review of technology appraisal no. 176) and panitumumab (partial review of technology appraisal no. 240) for previously untreated metastatic colorectal cancer: a systematic review and economic evaluation.

BACKGROUND: Colorectal cancer is the fourth most commonly diagnosed cancer in the UK after breast, lung and prostate cancer. People with metastatic disease who are sufficiently fit are usually treated with active chemotherapy as first- or second-line therapy. Targeted agents are available, including the antiepidermal growth factor receptor (EGFR) agents cetuximab (Erbitux®, Merck Serono UK Ltd, Feltham, UK) and panitumumab (Vecitibix®, Amgen UK Ltd, Cambridge, UK). OBJECTIVE: To investigate the clinical effectiveness and cost-effectiveness of panitumumab in combination with chemotherapy and cetuximab in combination with chemotherapy for rat sarcoma (RAS) wild-type (WT) patients for the first-line treatment of metastatic colorectal cancer. DATA SOURCES: The assessment included a systematic review of clinical effectiveness and cost-effectiveness studies, a review and critique of manufacturer submissions, and a de novo cohort-based economic analysis. For the assessment of effectiveness, a literature search was conducted up to 27 April 2015 in a range of electronic databases, including MEDLINE, EMBASE and The Cochrane Library. REVIEW METHODS: Studies were included if they were randomised controlled trials (RCTs) or systematic reviews of RCTs of cetuximab or panitumumab in participants with previously untreated metastatic colorectal cancer with RAS WT status. All steps in the review were performed by one reviewer and checked independently by a second. Narrative synthesis and network meta-analyses (NMAs) were conducted for outcomes of interest. An economic model was developed focusing on first-line treatment and using a 30-year time horizon to capture costs and benefits. Costs and benefits were discounted at 3.5% per annum. Scenario analyses and probabilistic and univariate deterministic sensitivity analyses were performed. RESULTS: The searches identified 2811 titles and abstracts, of which five clinical trials were included. Additional data from these trials were provided by the manufacturers. No data were available for panitumumab plus irinotecan-based chemotherapy (folinic acid + 5-fluorouracil + irinotecan) (FOLFIRI) in previously untreated patients. Studies reported results for RAS WT subgroups. First-line treatment with anti-EGFR therapies in combination with chemotherapy appeared to have statistically significant benefits for patients who are RAS WT. For the independent economic evaluation, the base-case incremental cost-effectiveness ratio (ICER) for RAS WT patients for cetuximab plus oxaliplatin-based chemotherapy (folinic acid + 5-fluorouracil + oxaliplatin) (FOLFOX) compared with FOLFOX was £104,205 per quality-adjusted life-year (QALY) gained; for panitumumab plus FOLFOX compared with FOLFOX was £204,103 per QALY gained; and for cetuximab plus FOLFIRI compared with FOLFIRI was £122,554 per QALY gained. The ICERs were sensitive to treatment duration, progression-free survival, overall survival (resected patients only) and resection rates. LIMITATIONS: The trials included RAS WT populations only as subgroups. No evidence was available for panitumumab plus FOLFIRI. Two networks were used for the NMA and model, based on the different chemotherapies (FOLFOX and FOLFIRI), as insufficient evidence was available to the assessment group to connect these networks. CONCLUSIONS: Although cetuximab and panitumumab in combination with chemotherapy appear to be clinically beneficial for RAS WT patients compared with chemotherapy alone, they are likely to represent poor value for money when judged by cost-effectiveness criteria currently used in the UK. It would be useful to conduct a RCT in patients with RAS WT. STUDY REGISTRATION: This study is registered as PROSPERO CRD42015016111. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Informing Reimbursement Decisions Using Cost-Effectiveness Modelling: A Guide to the Process of Generating Elicited Priors to Capture Model Uncertainties.

In informing decisions, utilising health technology assessment (HTA), expert elicitation can provide valuable information, particularly where there is a less-developed evidence-base at the point of market access. In these circumstances, formal methods to elicit expert judgements are preferred to improve the accountability and transparency of the decision-making process, help reduce bias and the use of heuristics, and also provide a structure that allows uncertainty to be expressed. Expert elicitation is the process of transforming the subjective and implicit knowledge of experts into their quantifiable expressions. The use of expert elicitation in HTA is gaining momentum, and there is particular interest in its application to diagnostics, medical devices and complex interventions such as in public health or social care. Compared with the gathering of experimental evidence, elicitation constitutes a reasonably low-cost source of evidence. Given its inherent subject nature, the potential biases in elicited evidence cannot be ignored and, due to its infancy in HTA, there is little guidance to the analyst wishing to conduct a formal elicitation exercise. This article attempts to summarise the stages of designing and conducting an expert elicitation, drawing on key literature and examples, most of which are not in HTA. In addition, we critique their applicability to HTA, given its distinguishing features. There are a number of issues that the analyst should be mindful of, in particular the need to appropriately characterise the uncertainty associated with model inputs and the fact that there are often numerous parameters required, not all of which can be defined using the same quantities. This increases the need for the elicitation task to be as straightforward as possible for the expert to complete.