Identifying behaviour change techniques in 287 randomized controlled trials of audit and feedback interventions targeting practice change among healthcare professionals.

BACKGROUND: Audit and feedback (A&F) is among the most widely used implementation strategies, providing healthcare professionals with summaries of their practice performance to prompt behaviour change and optimize care. Wide variability in effectiveness of A&F has spurred efforts to explore why some A&F interventions are more effective than others. Unpacking the variability of the content of A&F interventions in terms of their component behaviours change techniques (BCTs) may help advance our understanding of how A&F works best. This study aimed to systematically specify BCTs in A&F interventions targeting healthcare professional practice change. METHODS: We conducted a directed content analysis of intervention descriptions in 287 randomized trials included in an ongoing Cochrane systematic review update of A&F interventions (searched up to June 2020). Three trained researchers identified and categorized BCTs in all trial arms (treatment & control/comparator) using the 93-item BCT Taxonomy version 1. The original BCT definitions and examples in the taxonomy were adapted to include A&F-specific decision rules and examples. Two additional BCTs ('Education (unspecified)' and 'Feedback (unspecified)') were added, such that 95 BCTs were considered for coding. RESULTS: In total, 47/95 BCTs (49%) were identified across 360 treatment arms at least once (median = 5.0, IQR = 2.3, range = 129 per arm). The most common BCTs were 'Feedback on behaviour' (present 89% of the time; e.g. feedback on drug prescribing), 'Instruction on how to perform the behaviour' (71%; e.g. issuing a clinical guideline), 'Social comparison' (52%; e.g. feedback on performance of peers), 'Credible source' (41%; e.g. endorsements from respected professional body), and 'Education (unspecified)' (31%; e.g. giving a lecture to staff). A total of 130/287 (45%) control/comparator arms contained at least one BCT (median = 2.0, IQR = 3.0, range = 0-15 per arm), of which the most common were identical to those identified in treatment arms. CONCLUSIONS: A&F interventions to improve healthcare professional practice include a moderate range of BCTs, focusing predominantly on providing behavioural feedback, sharing guidelines, peer comparison data, education, and leveraging credible sources. We encourage the use of our A&F-specific list of BCTs to improve knowledge of what is being delivered in A&F interventions. Our study provides a basis for exploring which BCTs are associated with intervention effectiveness. TRIAL REGISTRATIONS: N/A.

Embedding rapid reviews in health policy and systems decision-making: Impacts and lessons learned from four low- and middle-income countries.

BACKGROUND: Demand for rapid evidence-based syntheses to inform health policy and systems decision-making has increased worldwide, including in low- and middle-income countries (LMICs). To promote use of rapid syntheses in LMICs, the WHO's Alliance for Health Policy and Systems Research (AHPSR) created the Embedding Rapid Reviews in Health Systems Decision-Making (ERA) Initiative. Following a call for proposals, four LMICs were selected (Georgia, India, Malaysia and Zimbabwe) and supported for 1 year to embed rapid response platforms within a public institution with a health policy or systems decision-making mandate. METHODS: While the selected platforms had experience in health policy and systems research and evidence syntheses, platforms were less confident conducting rapid evidence syntheses. A technical assistance centre (TAC) was created from the outset to develop and lead a capacity-strengthening program for rapid syntheses, tailored to the platforms based on their original proposals and needs as assessed in a baseline questionnaire. The program included training in rapid synthesis methods, as well as generating synthesis demand, engaging knowledge users and ensuring knowledge uptake. Modalities included live training webinars, in-country workshops and support through phone, email and an online platform. LMICs provided regular updates on policy-makers' requests and the rapid products provided, as well as barriers, facilitators and impacts. Post-initiative, platforms were surveyed. RESULTS: Platforms provided rapid syntheses across a range of AHPSR themes, and successfully engaged national- and state-level policy-makers. Examples of substantial policy impact were observed, including for COVID-19. Although the post-initiative survey response rate was low, three quarters of those responding felt confident in their ability to conduct a rapid evidence synthesis. Lessons learned coalesced around three themes - the importance of context-specific expertise in conducting reviews, facilitating cross-platform learning, and planning for platform sustainability. CONCLUSIONS: The ERA initiative successfully established rapid response platforms in four LMICs. The short timeframe limited the number of rapid products produced, but there were examples of substantial impact and growing demand. We emphasize that LMICs can and should be involved not only in identifying and articulating needs but as co-designers in their own capacity-strengthening programs. More time is required to assess whether these platforms will be sustained for the long-term.

Audit and feedback interventions involving pharmacists to influence prescribing behaviour in general practice: a systematic review and meta-analysis.

INTRODUCTION: Pharmacists, as experts in medicines, are increasingly employed in general practices and undertake a range of responsibilities. Audit and feedback (A&F) interventions are effective in achieving behaviour change, including prescribing. The extent of pharmacist involvement in A&F interventions to influence prescribing is unknown. This review aimed to assess the effectiveness of A&F interventions involving pharmacists on prescribing in general practice compared with no A&F/usual care and to describe features of A&F interventions and pharmacist characteristics. METHODS: Electronic databases (MEDLINE, EMBASE, CINAHL, Cochrane Central Register of Controlled Trials, (Social) Science Citation Indexes, ISI Web of Science) were searched (2012, 2019, 2020). Cochrane systematic review methods were applied to trial identification, selection, and risk of bias. Results were summarized descriptively and heterogeneity was assessed. A random-effects meta-analysis was conducted where studies were sufficiently homogenous in design and outcome. RESULTS: Eleven cluster-randomized studies from 9 countries were included. Risk of bias across most domains was low. Interventions focussed on older patients, specific clinical area(s), or specific medications. Meta-analysis of 6 studies showed improved prescribing outcomes (pooled risk ratio: 0.78, 95% confidence interval: 0.64-0.94). Interventions including both verbal and written feedback or computerized decision support for prescribers were more effective. Pharmacists who received study-specific training, provided ongoing support to prescribers or reviewed prescribing for individual patients, contributed to more effective interventions. CONCLUSIONS: A&F interventions involving pharmacists can lead to small improvements in evidence-based prescribing in general practice settings. Future implementation of A&F within general practice should compare different ways of involving pharmacists to determine how to optimize effectiveness.PRISMA-compliant abstract included in Supplementary Material 1.

Comparative-effectiveness research of COVID-19 treatment: a rapid scoping review.

OBJECTIVES: The COVID-19 pandemic has stimulated growing research on treatment options. We aim to provide an overview of the characteristics of studies evaluating COVID-19 treatment. DESIGN: Rapid scoping review DATA SOURCES: Medline, Embase and biorxiv/medrxiv from inception to 15 May 2021. SETTING: Hospital and community care. PARTICIPANTS: COVID-19 patients of all ages. INTERVENTIONS: COVID-19 treatment. RESULTS: The literature search identified 616 relevant primary studies of which 188 were randomised controlled trials and 299 relevant evidence syntheses. The studies and evidence syntheses were conducted in 51 and 39 countries, respectively.Most studies enrolled patients admitted to acute care hospitals (84%), included on average 169 participants, with an average age of 60 years, study duration of 28 days, number of effect outcomes of four and number of harm outcomes of one. The most common primary outcome was death (32%).The included studies evaluated 214 treatment options. The most common treatments were tocilizumab (11%), hydroxychloroquine (9%) and convalescent plasma (7%). The most common therapeutic categories were non-steroidal immunosuppressants (18%), steroids (15%) and antivirals (14%). The most common therapeutic categories involving multiple drugs were antimalarials/antibiotics (16%), steroids/non-steroidal immunosuppressants (9%) and antimalarials/antivirals/antivirals (7%). The most common treatments evaluated in systematic reviews were hydroxychloroquine (11%), remdesivir (8%), tocilizumab (7%) and steroids (7%).The evaluated treatment was in favour 50% and 36% of the evaluations, according to the conclusion of the authors of primary studies and evidence syntheses, respectively. CONCLUSIONS: This rapid scoping review characterised a growing body of comparative-effectiveness primary studies and evidence syntheses. The results suggest future studies should focus on children, elderly ≥65 years of age, patients with mild symptoms, outpatient treatment, multimechanism therapies, harms and active comparators. The results also suggest that future living evidence synthesis and network meta-analysis would provide additional information for decision-makers on managing COVID-19.

Economic evaluations of audit and feedback interventions: a systematic review.

BACKGROUND: The effectiveness of audit and feedback (A&F) interventions to improve compliance to healthcare guidelines is supported by randomised controlled trials (RCTs) and meta-analyses of RCTs. However, there is currently a knowledge gap on their cost-effectiveness. OBJECTIVE: We aimed to assess whether A&F interventions targeting improvements in compliance to recommended care are economically favourable. METHODS: We conducted a systematic review including experimental, observational and simulation-based economic evaluation studies of A&F interventions targeting healthcare providers. Comparators were a 'do nothing' strategy, or any other intervention not involving A&F or involving a subset of A&F intervention components. We searched MEDLINE, CINAHL, CENTRAL, Econlit, EMBASE, Health Technology Assessment Database, MEDLINE, NHS Economic Evaluation Database, ABI/INFORM, Web of Science, ProQuest and websites of healthcare quality associations to December 2021. Outcomes were incremental cost-effectiveness ratios, incremental cost-utility ratios, incremental net benefit and incremental cost-benefit ratios. Pairs of reviewers independently selected eligible studies and extracted relevant data. Reporting quality was evaluated using CHEERS (Consolidated Health Economic Evaluation Reporting Standards). Results were synthesised using permutation matrices for all studies and predefined subgroups. RESULTS: Of 13 221 unique citations, 35 studies met our inclusion criteria. The A&F intervention was dominant (ie, at least as effective with lower cost) in 7 studies, potentially cost-effective in 26 and was dominated (ie, the same or less effectiveness and higher costs) in 2 studies. A&F interventions were more likely to be economically favourable in studies based on health outcomes rather than compliance to recommended practice, considering medical costs in addition to intervention costs, published since 2010, and with high reporting quality. DISCUSSION: Results suggest that A&F interventions may have a high potential to be cost-effective. However, as is common in systematic reviews of economic evaluations, publication bias could have led to an overestimation of their economic value.

The Cost-Effectiveness of Intermediate-Acting, Long-Acting, Ultralong-Acting, and Biosimilar Insulins for Type 1 Diabetes Mellitus: A Systematic Review.

OBJECTIVES: The incidence of type 1 diabetes mellitus is increasing every year requiring substantial expenditure on treatment and complications. A systematic review was conducted on the cost-effectiveness of insulin formulations, including ultralong-, long-, or intermediate-acting insulin, and their biosimilar insulin equivalents. METHODS: MEDLINE, EMBASE, the Cochrane Central Register of Controlled Trials, HTA, and NHS EED were searched from inception to June 11, 2021. Cost-effectiveness and cost-utility analyses were included if insulin formulations in adults (≥ 16 years) with type 1 diabetes mellitus were evaluated. Two reviewers independently screened titles, abstracts, and full-text articles, extracted study data, and appraised their quality using the Drummond 10-item checklist. Costs were converted to 2020 US dollars adjusting for inflation and purchasing power parity across currencies. RESULTS: A total of 27 studies were included. Incremental cost-effectiveness ratios ranged widely across the studies. All pairwise comparisons (11 of 11, 100%) found that ultralong-acting insulin was cost-effective compared with other long-acting insulins, including a long-acting biosimilar. Most pairwise comparisons (24 of 27, 89%) concluded that long-acting insulin was cost-effective compared with intermediate-acting insulin. Few studies compared long-acting insulins with one another. CONCLUSIONS: Long-acting insulin may be cost-effective compared with intermediate-acting insulin. Future studies should directly compare biosimilar options and long-acting insulin options and evaluate the long-term consequences of ultralong-acting insulins.

Safety and effectiveness of dose-sparing strategies for intramuscular seasonal influenza vaccine: a rapid scoping review.

BACKGROUND: The objective of this rapid scoping review was to identify studies of dose-sparing strategies for administration of intramuscular seasonal influenza vaccines in healthy individuals of all ages. METHODS: Comprehensive literature searches were executed in MEDLINE, Embase and the Cochrane library. The grey literature was searched via international clinical trial registries for relevant studies published in English in the last 20 years. We included studies in healthy humans of any age that used any dose-sparing strategy to administer intramuscular seasonal influenza vaccines. Title/abstract and full-text screening were carried out by pairs of reviewers independently. Data extraction was conducted by a single reviewer and verified by a second reviewer. Our outcomes were influenza infections, intensive care unit admission, pneumonia, hospitalisations, adverse events and mortality. Results were summarised descriptively. RESULTS: A total of 13 studies with 10 351 participants were included in the review and all studies were randomised controlled trials (RCTs) conducted between 2006 and 2019. The most common interventions were the trivalent influenza vaccine (n=10), followed by the quadrivalent influenza vaccine (n=4). Nine studies included infants/toddlers 6-36 months old and one of these studies also included children and adolescents. In these nine studies, no clinical effectiveness outcomes were reported. Of the four adult studies (≥18 years), two studies reported on effectiveness outcomes, however, only one RCT reported on laboratory-confirmed influenza. CONCLUSIONS: Due to the low number of studies in healthy adults and the lack of studies assessing confirmed influenza and influenza-like illness, there remains a need for further evaluation.

Text mining to support abstract screening for knowledge syntheses: a semi-automated workflow.

BACKGROUND: Current text mining tools supporting abstract screening in systematic reviews are not widely used, in part because they lack sensitivity and precision. We set out to develop an accessible, semi-automated "workflow" to conduct abstract screening for systematic reviews and other knowledge synthesis methods. METHODS: We adopt widely recommended text-mining and machine-learning methods to (1) process title-abstracts into numerical training data; and (2) train a classification model to predict eligible abstracts. The predicted abstracts are screened by human reviewers for ("true") eligibility, and the newly eligible abstracts are used to identify similar abstracts, using near-neighbor methods, which are also screened. These abstracts, as well as their eligibility results, are used to update the classification model, and the above steps are iterated until no new eligible abstracts are identified. The workflow was implemented in R and evaluated using a systematic review of insulin formulations for type-1 diabetes (14,314 abstracts) and a scoping review of knowledge-synthesis methods (17,200 abstracts). Workflow performance was evaluated against the recommended practice of screening abstracts by 2 reviewers, independently. Standard measures were examined: sensitivity (inclusion of all truly eligible abstracts), specificity (exclusion of all truly ineligible abstracts), precision (inclusion of all truly eligible abstracts among all abstracts screened as eligible), F1-score (harmonic average of sensitivity and precision), and accuracy (correctly predicted eligible or ineligible abstracts). Workload reduction was measured as the hours the workflow saved, given only a subset of abstracts needed human screening. RESULTS: With respect to the systematic and scoping reviews respectively, the workflow attained 88%/89% sensitivity, 99%/99% specificity, 71%/72% precision, an F1-score of 79%/79%, 98%/97% accuracy, 63%/55% workload reduction, with 12%/11% fewer abstracts for full-text retrieval and screening, and 0%/1.5% missed studies in the completed reviews. CONCLUSION: The workflow was a sensitive, precise, and efficient alternative to the recommended practice of screening abstracts with 2 reviewers. All eligible studies were identified in the first case, while 6 studies (1.5%) were missed in the second that would likely not impact the review's conclusions. We have described the workflow in language accessible to reviewers with limited exposure to natural language processing and machine learning, and have made the code available to reviewers.

Comparative Efficacy and Safety of Ultra-Long-Acting, Long-Acting, Intermediate-Acting, and Biosimilar Insulins for Type 1 Diabetes Mellitus: a Systematic Review and Network Meta-Analysis.

BACKGROUND: Increasing availability of competing biosimilar alternatives makes it challenging to make treatment decisions. The purpose of this review is to evaluate the comparative efficacy and safety of ultra-long-/long-/intermediate-acting insulin products and biosimilar insulin compared to human/animal insulin in adults with type 1 diabetes mellitus (T1DM). METHODS: MEDLINE, EMBASE, CENTRAL, and grey literature were searched from inception to March 27, 2019. Randomized controlled trials (RCTs), quasi-experimental studies, and cohort studies of adults with T1DM receiving ultra-long-/long-/intermediate-acting insulin, compared to each other, as well as biosimilar insulin compared to human/animal insulin were eligible for inclusion. Two reviewers independently screened studies, abstracted data, and appraised risk-of-bias. Pairwise meta-analyses and network meta-analyses (NMA) were conducted. Summary effect measures were mean differences (MD) and odds ratios (OR). RESULTS: We included 65 unique studies examining 14,200 patients with T1DM. Both ultra-long-acting and long-acting insulin were superior to intermediate-acting insulin in reducing A1c, FPG, weight gain, and the incidence of major, serious, or nocturnal hypoglycemia. For fasting blood glucose, long-acting once a day (od) was superior to long-acting twice a day (bid) (MD - 0.44, 95% CI: - 0.81 to - 0.06) and ultra-long-acting od was superior to long-acting bid (MD - 0.73, 95% CI - 1.36 to - 0.11). For weight change, long-acting od was inferior to long-acting bid (MD 0.58, 95% CI: 0.05 to 1.10) and long-acting bid was superior to long-action biosimilar od (MD - 0.90, 95% CI: - 1.67 to - 0.12). CONCLUSIONS: Our results can be used to tailor insulin treatment according to the desired results of patients and clinicians and inform strategies to establish a competitive clinical market, address systemic barriers, expand the pool of potential suppliers, and favor insulin price reduction. PROSPERO REGISTRATION: CRD42017077051.

Global evidence of gender inequity in academic health research: a living scoping review protocol.

OBJECTIVE: The objective of this review is to describe the global evidence of gender inequity among individuals with appointments at academic institutions that conduct health research, and examine how gender intersects with other social identities to influence outcomes. INTRODUCTION: The gender demographics of universities have shifted, yet the characteristics of those who lead academic health research institutions have not reflected this change. Synthesized evidence will guide decision-making and policy development to support the progress of gender and other under-represented social identities in academia. INCLUSION CRITERIA: This review will consider any quantitative, qualitative, or mixed methods primary research that reports outcome data related to gender equity and other social identities among individuals affiliated with academic or research institutions that conduct health research, originating from any country. METHODS: The JBI Manual for Evidence Synthesis and the Cochrane Collaboration's guidance on living reviews will inform the review methods. Information sources will include electronic databases, unpublished literature sources, reference scanning of relevant systematic reviews, and sources provided by experts on the research team. Searches will be run regularly to monitor the development of new literature and determine when the review will be updated. Study selection and data extraction will be conducted by two reviewers working independently, and all discrepancies will be resolved by discussion or a third reviewer. Data synthesis will summarize information using descriptive frequencies and simple thematic analysis. Results will be reported using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis extension to scoping reviews. REGISTRATION: Open Science Framework: https://osf.io/8wk7e/.

Interventions for the prevention and management of occupational stress injury in first responders: a rapid overview of reviews.

BACKGROUND: First responders are a high-risk population for occupational stress injuries as they often encounter prolonged stress within their line of work. The aim of this rapid overview of reviews is to summarize existing evidence on interventions for the prevention and management of occupational stress injury (OSI) in first responders. METHODS: MEDLINE, EMBASE, PsycINFO, CINAHL, Web of Science, and Cochrane Library were searched for systematic reviews examining the impact of prevention, rehabilitation, and resilience-building strategies targeting frontline community safety personnel in February 2019. Pairs of reviewers screened titles and abstracts followed by full-text articles and conducted data abstraction and quality appraisal using the AMSTAR II tool. To ensure a rapid overview process, the search strategy was limited to the last 10 years, quality appraisal of reviews and abstraction of study-level data was completed by one person and verified by another, and the quality of the individual primary studies was not appraised. The findings were summarized descriptively. RESULTS: A total of 14 reviews with 47 unique primary studies were found after screening 1393 records. A majority of studies targeted OSI in police officers (78.7%), followed by firefighters (17%) and correctional officers (4.3%). Of the 47 included primary studies, 24 targeted prevention of OSI (i.e., resilience training, stress management, suicide prevention, and other health promotions) and 23 targeted rehabilitation (i.e., drug therapy, psychotherapy, and other therapies). Prevention strategies including resilience training programs had positive outcomes, while suicide prevention and psychotherapy interventions reported mixed results. CONCLUSIONS: Some promising interventions targeting the prevention and rehabilitation of OSI among police officers, firefighters, and correctional officers were identified in the included studies, and these results will serve as a basis for the development of evidence-based strategies to mitigate future risks in this population. However, several gaps were also identified in this area that will require further investigation prior to widespread implementation of effective interventions. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42019125945.

Patient safety initiatives in obstetrics: a rapid review.

OBJECTIVES: This review was commissioned by WHO, South Africa-Country office because of an exponential increase in medical litigation claims related to patient safety in obstetrical care in the country. A rapid review was conducted to examine the effectiveness of quality improvement (QI) strategies on maternal and newborn patient safety outcomes, risk of litigation and burden of associated costs. DESIGN: A rapid review of the literature was conducted to provide decision-makers with timely evidence. Medical and legal databases (eg, MEDLINE, Embase, LexisNexis Academic, etc) and reference lists of relevant studies were searched. Two reviewers independently performed study selection, abstracted data and appraised risk of bias. Results were summarised narratively. INTERVENTIONS: We included randomised clinical trials (RCTs) of QI strategies targeting health systems (eg, team changes) and healthcare providers (eg, clinician education) to improve the safety of women and their newborns. Eligible studies were limited to trials published in English between 2004 and 2015. PRIMARY AND SECONDARY OUTCOME MEASURES: RCTs reporting on patient safety outcomes (eg, stillbirths, mortality and caesarean sections), litigation claims and associated costs were included. RESULTS: The search yielded 4793 citations, of which 10 RCTs met our eligibility criteria and provided information on over 500 000 participants. The results are presented by QI strategy, which varied from one study to another. Studies including provider education alone (one RCT), provider education in combination with audit and feedback (two RCTs) or clinician reminders (one RCT), as well as provider education with patient education and audit and feedback (one RCT), reported some improvements to patient safety outcomes. None of the studies reported on litigation claims or the associated costs. CONCLUSIONS: Our results suggest that provider education and other QI strategy combinations targeting healthcare providers may improve the safety of women and their newborns during childbirth.

Comparative safety and effectiveness of perinatal antiretroviral therapies for HIV-infected women and their children: Systematic review and network meta-analysis including different study designs.

BACKGROUND: Nearly all newly infected children acquire Human Immunodeficiency virus (HIV) via mother-to-child transmission (MTCT) during pregnancy, labour or breastfeeding from untreated HIV-positive mothers. Antiretroviral therapy (ART) is the standard care for pregnant women with HIV. However, evidence of ART effectiveness and harms in infants and children of HIV-positive pregnant women exposed to ART has been largely inconclusive. The aim of our systematic review and network meta-analysis (NMA) was to evaluate the comparative safety and effectiveness of ART drugs in children exposed to maternal HIV and ART (or no ART/placebo) across different study designs. METHODS: We searched MEDLINE, EMBASE, and Cochrane Central Register of Controlled Trials (inception until December 7, 2015). Primary outcomes were any congenital malformations (CMs; safety), including overall major and minor CMs, and mother-to-child transmission (MTCT; effectiveness). Random-effects Bayesian pairwise meta-analyses and NMAs were conducted. After screening 6,468 citations and 1,373 full-text articles, 90 studies of various study designs and 90,563 patients were included. RESULTS: The NMA on CMs (20 studies, 7,503 children, 16 drugs) found that none of the ART drugs examined here were associated with a significant increase in CMs. However, zidovudine administered with lamivudine and indinavir was associated with increased risk of preterm births, zidovudine administered with nevirapine was associated with increased risk of stillbirths, and lamivudine administered with stavudine and efavirenz was associated with increased risk of low birth weight. A NMA on MTCT (11 studies, 10,786 patients, 6 drugs) found that zidovudine administered once (odds ratio [OR] = 0.39, 95% credible interval [CrI]: 0.19-0.83) or twice (OR = 0.43, 95% CrI: 0.21-0.68) was associated with significantly reduced risk of MTCT. CONCLUSIONS: Our findings suggest that ART drugs are not associated with an increased risk of CMs, yet some may increase adverse birth events. Some ART drugs (e.g., zidovudine) effectively reduce MTCT.

Same family, different species: methodological conduct and quality varies according to purpose for five types of knowledge synthesis.

OBJECTIVES: The aim of the study was to characterize methodological conduct, reporting, and quality of five knowledge synthesis (KS) approaches. STUDY DESIGN AND SETTING: Retrospective analysis of a convenience sample of five published databases of KS approaches: overview of reviews (n = 74), scoping reviews (n = 494), rapid reviews (n = 84), systematic reviews (n = 300), and network meta-analyses (NMAs; n = 456). Data in the five published databases were abstracted by two reviewers independently, any missing data for this retrospective analysis were abstracted by one experienced reviewer. Methods were appraised using the A MeaSurement Tool to Assess systematic Reviews (AMSTAR) tool. Descriptive analysis was performed. RESULTS: Reporting the use of a protocol ranged from 4% for rapid reviews to 32% for systematic reviews. The use of two reviewers for citation and full-text screening ranged from 20% for scoping reviews to 60% for NMAs. Data abstraction was performed in duplicate for 11% of rapid reviews and 54% of NMAs, and for risk of bias appraisal, this ranged from 6% for scoping reviews to 41% for NMAs. NMAs had the highest median percentage of maximum obtainable AMSTAR score (64%; Q1-Q3:45-73%), while scoping reviews had the lowest (25%; Q1-Q3:13-38%). CONCLUSION: NMAs consistently scored the highest on the AMSTAR tool likely because the purpose is to estimate treatment effects statistically. Scoping reviews scored the lowest (even after adjusting the score for not relevant items) likely because the purpose is to characterize the literature.

Characteristics and knowledge synthesis approach for 456 network meta-analyses: a scoping review.

BACKGROUND: Network meta-analysis (NMA) has become a popular method to compare more than two treatments. This scoping review aimed to explore the characteristics and methodological quality of knowledge synthesis approaches underlying the NMA process. We also aimed to assess the statistical methods applied using the Analysis subdomain of the ISPOR checklist. METHODS: Comprehensive literature searches were conducted in MEDLINE, PubMed, EMBASE, and Cochrane Database of Systematic Reviews from inception until April 14, 2015. References of relevant reviews were scanned. Eligible studies compared at least four different interventions from randomised controlled trials with an appropriate NMA approach. Two reviewers independently performed study selection and data abstraction of included articles. All discrepancies between reviewers were resolved by a third reviewer. Data analysis involved quantitative (frequencies) and qualitative (content analysis) methods. Quality was evaluated using the AMSTAR tool for the conduct of knowledge synthesis and the ISPOR tool for statistical analysis. RESULTS: After screening 3538 citations and 877 full-text papers, 456 NMAs were included. These were published between 1997 and 2015, with 95% published after 2006. Most were conducted in Europe (51%) or North America (31%), and approximately one-third reported public sources of funding. Overall, 84% searched two or more electronic databases, 62% searched for grey literature, 58% performed duplicate study selection and data abstraction (independently), and 62% assessed risk of bias. Seventy-eight (17%) NMAs relied on previously conducted systematic reviews to obtain studies for inclusion in their NMA. Based on the AMSTAR tool, almost half of the NMAs incorporated quality appraisal results to formulate conclusions, 36% assessed publication bias, and 16% reported the source of funding. Based on the ISPOR tool, half of the NMAs did not report if an assessment for consistency was conducted or whether they accounted for inconsistency when present. Only 13% reported heterogeneity assumptions for the random-effects model. CONCLUSIONS: The knowledge synthesis methods and analytical process for NMAs are poorly reported and need improvement.

Strategies to Prevent or Reduce Gender Bias in Peer Review of Research Grants: A Rapid Scoping Review.

OBJECTIVE: To review the literature on strategies implemented or identified to prevent or reduce gender bias in peer review of research grants. METHODS: Studies of any type of qualitative or quantitative design examining interventions to reduce or prevent gender bias during the peer review of health-related research grants were included. Electronic databases including MEDLINE, EMBASE, Education Resources Information Center (ERIC), PsycINFO, Joanna Briggs, the Cochrane Library, Evidence Based Medicine (EBM) Reviews, and the Campbell Library were searched from 2005 to April 2016. A search for grey (i.e., difficult to locate or unpublished) literature was conducted and experts in the field were consulted to identify additional potentially relevant articles. Two individuals screened titles and abstracts, full-text articles, and abstracted data with discrepancies resolved by a third person consistently. RESULTS: After screening 5524 citations and 170 full-text articles, one article evaluating gender-blinding of grant applications using an uncontrolled before-after study design was included. In this study, 891 applications for long-term fellowships in 2006 were included and 47% of the applicants were women. These were scored by 13 peer reviewers (38% were women). The intervention included eliminating references to gender from the applications, letters of recommendations, and interview reports that were sent to the committee members for evaluation. The proportion of successful applications led by women did not change with gender-blinding, although the number of successful applications that were led by men increased slightly. CONCLUSIONS: There is limited research on interventions to mitigate gender bias in the peer review of grants. Only one study was identified and no difference in the proportion of women who were successful in receiving grant funding was observed. Our results suggest that interventions to prevent gender bias should be adapted and tested in the context of grant peer review to determine if they will have an impact.

Comparative safety and effectiveness of serotonin receptor antagonists in patients undergoing chemotherapy: a systematic review and network meta-analysis.

BACKGROUND: Although serotonin (5-HT3) receptor antagonists are effective in reducing nausea and vomiting, they may be associated with increased cardiac risk. Our objective was to examine the comparative safety and effectiveness of 5-HT3 receptor antagonists (e.g., dolasetron, granisetron, ondansetron, palonosetron, tropisetron) alone or combined with steroids for patients undergoing chemotherapy. METHODS: We searched MEDLINE, Embase, and the Cochrane Central Register of Controlled Trials from inception until December 2015 for studies comparing 5-HT3 receptor antagonists with each other or placebo in chemotherapy patients. The search results were screened, data were abstracted, and risk of bias was appraised by pairs of reviewers, independently. Random-effects meta-analyses and network meta-analyses (NMAs) were conducted. RESULTS: After screening 9226 citations and 970 full-text articles, we included 299 studies (n = 58,412 patients). None of the included studies reported harms for active treatment versus placebo. For NMAs on the risk of arrhythmia (primary outcome; three randomized controlled trials [RCTs], 627 adults) and mortality (secondary outcome; eight RCTs, 4823 adults), no statistically significant differences were observed between agents. A NMA on the risk of QTc prolongation showed a significantly greater risk for dolasetron + dexamethasone versus ondansetron + dexamethasone (four RCTs, 3358 children and adults, odds ratio 2.94, 95% confidence interval 2.13-4.17). For NMAs on the number of patients without nausea (44 RCTs, 11,664 adults, 12 treatments), number of patients without vomiting (63 RCTs, 15,460 adults, 12 treatments), and number of patients without chemotherapy-induced nausea or vomiting (27 RCTs, 10,924 adults, nine treatments), all agents were significantly superior to placebo. For a NMA on severe vomiting (10 RCTs, 917 adults), all treatments decreased the risk, but only ondansetron and ramosetron were significantly superior to placebo. According to a rank-heat plot with the surface under the cumulative ranking curve results, palonosetron + steroid was ranked the safest and most effective agent overall. CONCLUSIONS: Most 5-HT3 receptor antagonists were relatively safe when compared with each other, yet none of the studies compared active treatment with placebo for harms. However, dolasetron + dexamethasone may prolong the QTc compared to ondansetron + dexamethasone. All agents were effective for reducing risk of nausea, vomiting, and chemotherapy-induced nausea or vomiting. TRIAL REGISTRATION: This study was registered at PROSPERO: ( CRD42013003564 ).