Confidence score: a data-driven measure for inclusive systematic reviews considering unpublished preprints.

OBJECTIVES: COVID-19, since its emergence in December 2019, has globally impacted research. Over 360 000 COVID-19-related manuscripts have been published on PubMed and preprint servers like medRxiv and bioRxiv, with preprints comprising about 15% of all manuscripts. Yet, the role and impact of preprints on COVID-19 research and evidence synthesis remain uncertain. MATERIALS AND METHODS: We propose a novel data-driven method for assigning weights to individual preprints in systematic reviews and meta-analyses. This weight termed the "confidence score" is obtained using the survival cure model, also known as the survival mixture model, which takes into account the time elapsed between posting and publication of a preprint, as well as metadata such as the number of first 2-week citations, sample size, and study type. RESULTS: Using 146 preprints on COVID-19 therapeutics posted from the beginning of the pandemic through April 30, 2021, we validated the confidence scores, showing an area under the curve of 0.95 (95% CI, 0.92-0.98). Through a use case on the effectiveness of hydroxychloroquine, we demonstrated how these scores can be incorporated practically into meta-analyses to properly weigh preprints. DISCUSSION: It is important to note that our method does not aim to replace existing measures of study quality but rather serves as a supplementary measure that overcomes some limitations of current approaches. CONCLUSION: Our proposed confidence score has the potential to improve systematic reviews of evidence related to COVID-19 and other clinical conditions by providing a data-driven approach to including unpublished manuscripts.

Price Transparency for Primary Care Office Visits and Routine Tests: Results From a 2016 Audit Study.

Introduction: Price transparency is a central component of the shift from volume to value in healthcare delivery. Price transparency in primary care, the most common point of contact with the healthcare system for patients in the U.S., has not been widely studied.Methods: Using an audit study across 10 states in 2016, we examined the characteristics of primary care practices that were able to provide price information for office visits and routine tests.Results: Most primary care practices were able to disclose some price information for office visits and routine tests. Results indicate that larger, integrated primary care practices in urban areas and in areas with a higher percentage of minority residents were less likely to provide prices than smaller, standalone practices.Conclusion: These findings suggest that future efforts to increase price transparency in primary care should be tailored to practice characteristics, including practice location and whether the practice is embedded in an integrated health system.