ABSTRACT
BACKGROUND: The Core Outcome Measures in Effectiveness Trials (COMET) working group proposed core outcome sets (COS) to address the heterogeneity in outcome measures in clinical studies. According to the recommendations of COMET, performing systematic reviews (SRs) usually was the first step for COS development. However, the SRs that serve as a basis for COS are not specifically appraised by organizations such as COMET regarding their quality. Here, we investigated the status of SRs related to development of COS and evaluated their methodological quality. METHODS: We conducted a search on PubMed to identify SRs related to COS development published from inception to May 2022. We qualitatively summarized the disease included in SR topics, and the studies included in the SRs. We evaluated the methodological quality of the SRs using AMSTAR 2.0 and compared the overall quality of SRs with and without protocols using the Mann-Whitney U test. RESULTS: We included 175 SRs from 23 different countries or regions, and they mainly focused on five diseases: musculoskeletal system or connective tissue disease (n = 19, 10.86%), injury, poisoning, or certain other consequences of external causes (n = 18, 10.29%), digestive system disease (n = 16, 9.14%), nervous system disease (n = 15, 8.57%), and genitourinary system disease (n = 15, 8.57%). Although 88.00% of SRs included randomized controlled trials (RCTs), only a few SRs (23.38%) employed appropriate tools to assess the risk of bias in RCTs. The assessment results on the basis of AMSTAR 2.0 indicated that most SRs (93.71%) were rated as ''critically low'' to ''low'' in terms of overall confidence. The overall confidence of SRs with protocols was significantly higher than that without protocols (P <.001). Compared to the SRs with protocols on Core Outcome Measures in Effectiveness Trials (COMET), SRs with protocols on PROSPERO were of better overall confidence (P = .017). CONCLUSION: The overall quality of published SRs regarding COS development was poor. Our findings emphasize the need for researchers to carefully select the disease topic and strictly adhere to the requirements of optimal methodology when conducting a SR for the establishment of a COS.
Subject(s)
Outcome Assessment, Health Care , Research Design , Humans , Systematic Reviews as Topic , BiasABSTRACT
The systematic reviews (SRs) of acupuncture published before December 31 of 2020 in PubMed, Cochrane and EMbase databases were searched, and the publication overview of international acupuncture SRs were analyzed. As a result, a total of 717 SRs were included, and the overall number of published SRs showed a fluctuating upward trend. A total of 15 categories of diseases were involved, of which 113 SRs suggested that acupuncture was effective, and 12 SRs did not support acupuncture, and the remaining SRs showed uncertain conclusions. It is suggested that the standard of evidence-based medicine should be adopted to standardize the design of acupuncture trial and improve the level of clinical research; SRs should include high-quality literature that met the standards according to the principles and methods of PRISMA, so as to provide reliable clinical evidence for acupuncture.
Subject(s)
Acupuncture Therapy , Acupuncture , Periodicals as Topic , Evidence-Based Medicine , PubMedABSTRACT
The systematic reviews (SRs) of acupuncture published before December 31 of 2020 in PubMed, Cochrane and EMbase databases were searched, and the publication overview of international acupuncture SRs were analyzed. As a result, a total of 717 SRs were included, and the overall number of published SRs showed a fluctuating upward trend. A total of 15 categories of diseases were involved, of which 113 SRs suggested that acupuncture was effective, and 12 SRs did not support acupuncture, and the remaining SRs showed uncertain conclusions. It is suggested that the standard of evidence-based medicine should be adopted to standardize the design of acupuncture trial and improve the level of clinical research; SRs should include high-quality literature that met the standards according to the principles and methods of PRISMA, so as to provide reliable clinical evidence for acupuncture.
Subject(s)
Acupuncture , Acupuncture Therapy , Evidence-Based Medicine , Periodicals as Topic , PubMedABSTRACT
BACKGROUND: Low-intensity extracorporeal shockwave therapy (LI-ESWT) may be a successful complementary treatment approach for erectile dysfunction (ED). In this study, we aimed to review and summarize the research evidence from systematic reviews (SRs)/meta-analyses (MAs) regarding the clinical effectiveness of LI-ESWT for ED. METHODS: Studies on LI-ESWT for ED were searched using eight electronic databases from establishment of each database to 31 June 2021 with the language restrictions of Chinese and English. All articles were screened, and qualifying data were recorded based on the inclusion criteria. Methods including: the Assessing the Methodological Quality of Systematic Reviews 2 (AMSTAR-2); the Risk of Bias in Systematic Reviews (ROBIS); the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA); and Grading of Recommendations, Assessment Development, and the Evaluation (GRADE) were used by two independent raters to assess methodological quality, risk of bias, reporting quality, and SR evidence of quality, respectively. RESULTS: Eight SRs/MAs met all inclusion criteria. Seven reviews were rated as critically low on overall confidence and one review was low on confidence based on the AMSTAR-2 appraisal tool. While most PRISMA criteria were met, the major reporting flaws were in relation the financial statements not being included, along with no protocol registrations. Three SRs/MAs were classed as low risk regarding bias as measured by the ROBIS tool. Based on the GRADE method, only one SRs/MAs of high-quality evidence and seven SRs/MAs of moderate-quality evidence were found. The present research results supported LI-ESWT as a complementary therapy for ED patients, but the evidence should be considered carefully due to the methodological flaws identified. DISCUSSION: Our results showed that LI-ESWT as an adjunctive therapy has benefits for ED patients. There were no obvious side effects, and the number of shockwave treatments and energy flux density (EFD) would affect the IIEF-EF, EHS and PSV scores. However, due to the limited sample size and the quality of reporting evidence, our conclusions may not be fully representative.
ABSTRACT
BACKGROUND: Acupuncture therapy is a method of piercing needles into acupoints to treat diseases with/without corresponding manipulations, which could serve as a useful supplementary therapy for psoriasis. The present study aimed to outline and sum up current evidence from systematic reviews (SRs)/meta-analyses (MAs) that investigate the clinical efficacy of acupuncture on psoriasis. METHODS: A comprehensive search involving eight electronic databases was conducted from the date of inception to July 2021, and grey literatures were manually searched. The research was selected according to prespecified inclusion criteria and relevant data were obtained. The methodological quality of the included SRs was scrutinized using the Assessing the Methodological Quality of Systematic Reviews 2 (AMSTAR-2) tool. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was used to appraise the reporting quality of the included SRs. Risk of Bias in Systematic Reviews (ROBIS) was selected for the evaluation of bias risk of the included SRs. Grading of Recommendations Assessment, Development, and Evaluation (GRADE) was applied to determine the quality of evidence from primary outcome measures. RESULTS: After screening, seven SRs/MAs met the inclusion criteria, including two English and five Chinese articles. All of the SRs were published between 2015 and 2020. Based on AMSTAR-2, the quality of all SRs was rated as dangerously low. Using the PRISMA-A checklist, major reporting flaws were observed in the financial statements, protocols, and registrations of the included literature. According to the ROBIS tool, two SRs/MAs were classed as low bias risk. Using the GRADE tool, this review contained 27 outcomes, with only one being classified as high-quality evidence, seven moderate-quality evidences, and 19 as low-quality evidence. The present research results advocated acupuncture therapy as a supplementary treatment for psoriasis patients; however, the evidence should still be treated with caution due to certain limitations. CONCLUSIONS: Our overview suggests that acupuncture could be used as a complementary therapy to produce effective clinical result for psoriasis. Nonetheless, considering the poor quality of SRs/Mas that advocate these findings, studies with more rigorous design, larger populations samples and of higher quality are called for to provide stronger evidence for definitive conclusions.
Subject(s)
Acupuncture Therapy , Psoriasis , Humans , Psoriasis/therapy , Research Design , Research ReportABSTRACT
BACKGROUND: Systematic reviews (SRs) with or without meta-analyses (MAs) are widely used in resolving questions in various healthcare areas (such as, traditional Chinese medicine, public health and surgery), and they are the cornerstone of evidence-based healthcare. However, the reliability of SRs is typically influenced by their methodological quality. AMSTAR (A Measurement Tool to Assess Systematic Reviews) and AMSTAR-2 tools can assess the methodological quality of SRs, and the use of AMSTAR has been investigated. However, AMSTAR-2 is now widely used to evaluate the methodological quality of SRs, but the use of AMSTAR-2 for determining the methodological quality of SRs has not yet been investigated and assessed thoroughly. Thus, we designed the present study to investigate the use of AMSTAR-2 in studies that assessed the methodological quality of a sample of SRs with the AMSTAR-2 and provide references to potential users of AMSTAR-2 tool. METHODS: Four commonly used electronic databases including PubMed, EmBase, the Cochrane Library, and Web of Science will be searched following a comprehensive search strategy to identify and retrieve studies that have used AMSTAR-2 tool for evaluating the methodological quality of SRs. Two independent authors will retrieve bibliometric information and methodological data, including all author names, time of publication, and journal names, whether a specific score value was given for each item, and whether overall quality assessment was performed. Descriptive statistical analyses will be used to present the study results, e.g., frequencies and percentages, mean and standard deviation (SD) or median and interquartile range (IQR). In addition, subgroup analyses will be performed to identify the methodological differences (e.g., the reporting of study designs included in SRs) between overviews and methodological studies. The risk ratio (RR) with 95% confidence interval (95% CI) will be calculated to measure the methodological differences. Cytoscape 3.7.1 software tool will be used to construct collaboration network maps. Further, Microsoft Office Excel 2016 and Stata 12.0 will be used to manage and analyze data. DISCUSSION: The results of this study will identify any gaps in the use of AMSTAR-2 and important bibliometric features, such as active researchers and journals, provide guidance to researchers in various healthcare areas (such as, traditional Chinese medicine and public health) for using AMSTAR-2 tool and help them in developing cooperation and submitting their manuscripts.
