An evaluation of DistillerSR's machine learning-based prioritization tool for title/abstract screening - impact on reviewer-relevant outcomes.

BACKGROUND: Systematic reviews often require substantial resources, partially due to the large number of records identified during searching. Although artificial intelligence may not be ready to fully replace human reviewers, it may accelerate and reduce the screening burden. Using DistillerSR (May 2020 release), we evaluated the performance of the prioritization simulation tool to determine the reduction in screening burden and time savings. METHODS: Using a true recall @ 95%, response sets from 10 completed systematic reviews were used to evaluate: (i) the reduction of screening burden; (ii) the accuracy of the prioritization algorithm; and (iii) the hours saved when a modified screening approach was implemented. To account for variation in the simulations, and to introduce randomness (through shuffling the references), 10 simulations were run for each review. Means, standard deviations, medians and interquartile ranges (IQR) are presented. RESULTS: Among the 10 systematic reviews, using true recall @ 95% there was a median reduction in screening burden of 47.1% (IQR: 37.5 to 58.0%). A median of 41.2% (IQR: 33.4 to 46.9%) of the excluded records needed to be screened to achieve true recall @ 95%. The median title/abstract screening hours saved using a modified screening approach at a true recall @ 95% was 29.8 h (IQR: 28.1 to 74.7 h). This was increased to a median of 36 h (IQR: 32.2 to 79.7 h) when considering the time saved not retrieving and screening full texts of the remaining 5% of records not yet identified as included at title/abstract. Among the 100 simulations (10 simulations per review), none of these 5% of records were a final included study in the systematic review. The reduction in screening burden to achieve true recall @ 95% compared to @ 100% resulted in a reduced screening burden median of 40.6% (IQR: 38.3 to 54.2%). CONCLUSIONS: The prioritization tool in DistillerSR can reduce screening burden. A modified or stop screening approach once a true recall @ 95% is achieved appears to be a valid method for rapid reviews, and perhaps systematic reviews. This needs to be further evaluated in prospective reviews using the estimated recall.

Clinical interpretation of the Uremic Pruritus in Dialysis Patients (UP-Dial) scale: a novel instrument for the assessment of uremic pruritus.

BACKGROUND: The Uremic Pruritus in Dialysis Patients (UP-Dial) scale is valid and reliable for uremic pruritus (UP) assessment. However, it remains unknown how the scores should be interpreted in clinical practices. OBJECTIVES: To establish a clinical interpretation of the UP-Dial by identifying severity cut-off scores according to the disease severity and burden of pruritus. METHODS: This cross-sectional study developed a classification system for the UP-Dial scores using the patient-based anchors method. From May 2012 through January 2017, 697 dialysis patients were screened. Of these, a total of 258 met the criteria for UP and completed the UP-Dial scale and three sets of patient-assessed anchor questions: (i) global UP intensity by visual analogue scale (VAS)-UP, (ii) Dermatology Life Quality Index and (iii) global kidney disease-related quality of life. The cut-off scores were generated based on the kappa (κ) coefficient of agreement and the area under receiver operating characteristic curve (AuROC) statistics. Subgroup analyses were performed to explore associations between patient characteristics and the UP-Dial severity bands. RESULTS: The proposed scores were ≤12 (mild), 13-21 (moderate) and ≥22 (severe) with κ coefficient ranging between 0.39 and 0.46. Assigned scores were associated with all patient-based anchors. The highest association was with the VAS-UP, and AuROC was 0.80 (mild; 95% CI, 0.75-0.86), 0.66 (moderate; 0.60-0.71) and 0.83 (severe; 0.77-0.89). In subgroup analysis according to patient characteristics, we did not find any significant difference. CONCLUSIONS: The estimated UP-Dial severity band can facilitate the interpretation of UP in practice-based research settings and can be used to support treatment decisions.

Cost implications of unwarranted imaging for distant metastasis in women with early-stage breast cancer in Ontario.

INTRODUCTION: Despite the publication of multiple evidence-based guidelines recommending against routine imaging for distant metastasis in patients with early-stage (i/ii) breast cancer, such imaging is frequently performed. The present retrospective cohort study was conducted to estimate the cost of unnecessary imaging tests in women with stage i and ii breast cancer diagnosed between 1 January 2007 and 31 December 2012 in Ontario. METHODS: We obtained patient-level demographic and tumour data from a large provincial dataset. The total cost of unwarranted imaging tests (in 2015 Canadian dollars) was considered to be equal to the sum of imaging costs incurred between 2007 and 2012 and was stratified by disease stage, imaging modality, and body site. RESULTS: Of the 26,547 identified patients with early-stage breast cancer, 22,811 (85.9%) underwent at least 1 imaging test, with an average of 3.7 tests per patient (3.2 for stage i patients and 4.0 for stage ii patients) over 5 years. At least 1 imaging test was performed in 79.6% of stage i and 92.7% of stage ii patients. During a 5-year period, the cost of unwarranted imaging in patients with early-stage breast cancer ranged from CA$4,418,139 to CA$6,865,856, depending on guideline recommendations. CONCLUSIONS: Our study highlights the substantial cost of excess imaging that could be saved and re-allocated to patient care if evidence-based guidelines are followed. Future studies should assess strategies to ensure that evidence-based guidelines are followed and to increase awareness of the cost implications of nonadherence to guidelines.

Transient Elastography and Controlled Attenuation Parameter for Diagnosing Liver Fibrosis and Steatosis in Ontario: An Economic Analysis.

BACKGROUND: Liver fibrosis is characterized by a buildup of connective tissue due to chronic liver damage. Steatosis is the collection of excessive amounts of fat inside liver cells. Liver biopsy remains the gold standard for the diagnosis of liver fibrosis and steatosis, but its use as a diagnostic tool is limited by its invasive nature and high cost. OBJECTIVES: To evaluate the cost-effectiveness and budget impact of transient elastography (TE) with and without controlled attenuation parameter (CAP) for the diagnosis of liver fibrosis or steatosis in patients with hepatitis B, hepatitis C, alcoholic liver disease, and nonalcoholic fatty liver disease. DATA SOURCES: An economic literature search was performed using computerized databases. For primary economic and budget impact analyses, we obtained data from various sources, such as the Health Quality Ontario evidence-based analysis, published literature, and the Institute for Clinical Evaluative Sciences. REVIEW METHODS: A systematic review of existing TE cost-effectiveness studies was conducted, and a primary economic evaluation was undertaken from the perspective of the Ontario Ministry of Health and Long-Term Care. Decision analytic models were used to compare short-term costs and outcomes of TE compared to liver biopsy. Outcomes were expressed as incremental cost per correctly diagnosed cases gained. A budget impact analysis was also conducted. RESULTS: We included 10 relevant studies that evaluated the cost-effectiveness of TE compared to other noninvasive tests and to liver biopsy; no cost-effectiveness studies of TE with CAP were identified. All studies showed that TE was less expensive but associated with a decrease in the number of correctly diagnosed cases. TE also improved quality-adjusted life-years in patients with hepatitis B and hepatitis C. Our primary economic analysis suggested that TE led to cost savings but was less effective than liver biopsy in the diagnosis of liver fibrosis. TE became more economically attractive with a higher degree of liver fibrosis. TE with CAP was also less expensive and less accurate than liver biopsy. LIMITATIONS: The model did not take into account long-term costs and consequences associated with TE and liver biopsy and did not include costs to patients and their families, or patient preferences related to diagnostic information. CONCLUSIONS: TE showed potential cost savings compared to liver biopsy. Further investigation is needed to determine the long-term impacts of TE on morbidity and mortality in Canada and the optimal diagnostic modality for liver fibrosis and steatosis.

A cost-effectiveness analysis of a community pharmacist-based smoking cessation programme in Thailand.

OBJECTIVE: To estimate the incremental cost-effectiveness ratio of a structured community pharmacist-based smoking cessation programme compared with usual care. DESIGN: A cost-effectiveness study using a healthcare system perspective Population: Two simulated cohorts of smokers: male and female aged 40, 50 and 60 years who regularly smoke 10-20 cigarettes per day. Intervention and comparator: A structured community pharmacist-based smoking cessation (CPSC) programme compared to usual care. MAIN OUTCOME MEASURE: Cost per life year gained (LYG) attributable to the smoking cessation programme. RESULTS: The CPSC programme results in cost savings of 17,503.53 baht ( pound250; euro325; $500) to the health system and life year gains of 0.18 years for men and; costs savings of 21,499.75 baht ( pound307; euro399; $614) and life year gains of 0.24 years for women. A series of sensitivity analyses demonstrate that both cost savings and life year gains are sensitive to variations in the discount rate and the long-term smoking quit rate associated with the intervention. CONCLUSION: From the perspective of the health system, the CPSC programme yields cost savings and life year gains. This finding provides important information for health policy decision-makers when determining the magnitude of resources to be allocated to smoking cessation service in community pharmacy.