Grading the evidence of systematic reviews on animal studies will contribute to the improvement in the feasibility of transforming the results of animal studies into clinical trials or clinical practice. High quality evidence from animal studies is more likely to be successfully applied into clinical practice (i.e. more confident). Therefore, the present study will introduce the principles, methods and challenges of the application of GRADE in systematic reviews on animal studies.
ObjectiveTo describe the current status of the evaluation index for the performance of diagnostic reagents compared with gold standards in systematic reviews and develop the list of evaluation indexes. MethodsPubMed, Embase (OVID), Cochrane Library (OVID), CBM, WanFang Data and CNKI databases were searched for systematic reviews about the performance of diagnostic reagents compared with gold standards from inception to 28th April, 2023. Two reviewers independently screened literature and extracted data. The frequency and ratio were used to describe the current status, while the qualitative synthesis was used to develop the list. ResultsA total of 133 systematic reviews were included. Sensitivity (133/133, 100.0%), specificity (131/133, 98.5%) and AUC (80/133, 60.2%) were used more frequently than 50%. Q index (6/133, 4.5%), false positive rate (3/133, 2.3%), Kappa value (2/133, 1.5%), false negative rate (1/133, 5%) and Youden's index were used less frequently than 5%. In order to evaluate the performance of diagnostic reagents compared with gold standards in systematic reviews comprehensively, a total of 14 index related to validity and predictability could be considered. ConclusionThe evaluation index for the performance of diagnostic reagents in systematic reviews are inconsistent and limited, so there is an urgent need to develop standardized evaluation indicators based on expert consensus.
Objective To investigate the current status of systematic reviews/meta-analyses published by pharmacists in hospital in China by using bibliometric analysis and assessing the methodological quality of these studies. Methods The literatures were searched from CNKI, WanFang Data, VIP, CBM, CMCI, PubMed, EMbase, The Cochrane Library (Issue 2, 2016) from the establishment to March 17th, 2016. According to the inclusive and exclusive criteria, the authors independently screened literature and extracted the data. Methodology quality and reporting quality were evaluated by using AMSTAR tool and PRIMSA statement. Data analysis was conducted by using Excel 2013 and SPSS 20.0 software. Results A total of 1 018 systematic reviews/meta-analyses were included of which 871 were published in Chinese and 147 were in English. The published literature increased year by year, as well as the reporting quality and methodological quality. All of the included studies were published in 146 Chinese journals and 97 English journals. The authors were from 308 hospitals of 27 provinces. Drug effectiveness and drug safety were mainly assessed, and western medicine was the main category. Most of these studies were focused on anti-tummor drugs. Conclusion Evidenced-based drug evaluation by hospital pharmacists in China is rapidly increasing as well as the methodological quality and reporting quality, however, the development is unbalanced in China, and evidence-based medicine should be further promoted in the field of hospital pharmacy.
ObjectiveTo interpret ROBIS, a new tool to evaluate the risk of bias in systematic reviews, to promote the comprehension of it and its proper application. MethodsWe explained each item of ROBIS tool, used it to evaluate the risk of bias of a selected intervention review whose title was Cyclophosphamide for Primary Nephrotic Syndrome of Children: A Systematic Review, and judged the risk of bias in the review. ResultsThe selected systematic review as a whole was rated as “high risk of bias”, because there existed high risk of bias in domain 2 to 4, namely identification and selection of studies, data collection and study appraisal, synthesis and findings. The risk of bias in domain 1 (study eligibility criteria) was low. The relevance of identified studies and the review’s research question was appropriately considered and the reviewers avoided emphasizing results on the basis of their statistical significance. ConclusionROBIS is a new tool worthy of being recommended to evaluate risk of bias in systematic reviews. Reviewers should use ROBIS items as standards to conduct and produce high quality systematic reviews.
Systematic reviews (SRs) serve as a core methodology in evidence-based medicine (EBM), providing critical evidence for clinical practice and health decision-making. However, the manual screening of titles and abstracts in SRs is labor-intensive and time-consuming, becoming a major bottleneck in research efficiency. Recent advancements in artificial intelligence (AI), particularly large language models (LLMs), have introduced new opportunities and transformations in this field. This article provided an overview of the current status of intelligent screening for titles and abstracts in systematic reviews, with a focus on the application and effectiveness of LLMs. It aims to provide recommendations for users and developers, facilitating the better integration of automation algorithms into the SR process.
Objective To make an individualized treatment plan for newly diagnosed irritable bowel syndrome by means of evidence-based medicine. Methods After clinical problems were put forward, systematic reviews and randomized controlled trials were collected from The Cochrane Library (Issue 3, 2008) and PubMed (1990 to 2008). Treatment protocol was produced by combining the evidence and the values of the patient. Results A total of 114 RCTs and 21 systematic reviews were identified. A rational treatment plan was made upon a serious evaluation of the data to control symptoms and improve the quality of life for the patient. After a sixteen-month follow-up, the plan proved to be optimal. Conclusion The treatment efficacy in diagnosed irritable bowel syndrome has been improved by determining an individualized treatment plan according to evidence-based methods.
ObjectiveTo evaluate the method quality of systematic reviews/Meta analysis published in nursing journals. MethodsWe retrieved Chinese Biomedical Literature Database, Chinese academic literature online publishing pool and Chinese Scientific Journals Database (the duration was from the beginning to August, 2013). The systematic reviews and Meta analysis published in nursing journals were included, and were evaluated by 10 items in OQAQ (Oxman-Guyatt Overview Quality Assessment Questionnaire). ResultsA total of 74 literatures were included in the analysis, including 17 systematic reviews and 57 Meta-analyses. It showed that the mean OQAQ score was 2.92±1.63. About 4.1%, 8.1%, 31.1%, 43.2%, 29.7%, 55.4%, 16.2%, 37.8%, and 60.8% studies stated literature research methods used to find evidence; had reasonably comprehensive search; avoided bias in the selection of studies by duplicate screening; reported the criteria used for assessing the validity of the included studies; concluded the findings by the data or analysis; provided a list of studies; assessed using appropriate criteria; reported the methods used to synthesis the findings; and combined the findings of the included studies appropriately. ConclusionThe systematic reviews/Meta analysis of the overall quality in nursing field is low. The search strategy, inclusion and exclusion criteria, quality assessment and data analysis is particularly prominent, researchers should conduct rigorous methodological training.
ObjectiveTo investigate the reporting and methodological quality of systematic reviews/ meta-analyses conducted by hospital pharmacists in China, so as to improve the quality of systematic reviews/ meta-analyses in this field. MethodsThe literatures were retrieved from CNKI, WanFang Data, VIP, CBM, CMCI, PubMed, EMbase, The Cochrane Library from the establishment date to March 17th, 2016. According to the inclusive and exclusive criteria, authors independently screened and extracted the published information. Reporting and methodological quality of included reviews were evaluated by PRIMSA statements and AMSTAR checklists. Data analysis was conducted by using Excel 2013 software and SPSS 20.0 software. ResultsOne thousand and eighteen systematic reviews/ meta-analyses were included, including 871 Chinese literatures and 147 English literatures. The average score of PRIMSA was 18.41±2.84, and the average score of AMSTAR was 7.38±1.28. The main problems of PRIMSA were structured summary, objectives, protocol and registration, additional analyses and funding. The main problems of AMSTAR were priori design, status of publication and list of studies (included and excluded). Univariate analysis showed that some factors could improve the quality of methodology and reporting, including studies in English (P<0.000 1), published after checklists' (P<0.000 1), hospital in higher-level (P<0.000 1), illuminating the funding or interest conflict (P<0.000 1). Pearson analysis indicated that linear correlation were detected between PRISMA scores and AMSTAR scores (P<0.000 1), as well as citations and AMSTAR scores (P=0.045). ConclusionEvidenced-based pharmacy in hospital has developed rapidly, the quality of methodology and reporting have increaseed year by year, but further improvement should be considered in different aspects. The methods to evaluate the clinical application of these systematic reviews/ meta-analyses should be developed in the future.
Objective To compare the effectiveness of aspheric intraocular lenses(IOL) versus spherical IOL in the treatment of cataract. Method Randomized controlled trials comparing aspheric IOL with spherical IOL were identified by searching PubMed (2000 to October, 2008), EMbase (2000 to October, 2008), MEDLINE (2000 to October, 2008), and The Cochrane Library (Issue 3, 2008). Two reviewers independently assessed trials for eligibility and quality, as well as the extracted data. Data were synthesized using RevMan software (release 5) provided by the Cochrane Collaboration. Results A total of 14 trials (1383 eyes) were included for systematic review, and 11 out of 14 studies were included in the meta-analysis. Subgroup analyses were used according to different aberrations of aspheric IOL. The results showed a significant difference in the mean best corrected visual acuity at 3 months after cataract surgery in the AcrySof IQ IOL group with WMD -0.02, 95% CI -0.03 to -0.01(Plt;0.0001). It showed a significantly worse difference in the mean of the best corrected visual acuity at 3 months after cataract surgery in the AcrySof IQ IOL group with WMD –0.02, 95%CI –0.03 to –0.01 (Plt;0.000 1). It showed a significant worse in the mean the best corrected visual acuity in the Tecnis Z9000 IOL group with WMD 0.02, 95%CI 0.01 to 0.03 (P=0.002); and there was no significant difference between the two groups with WMD 0.00, 95%CI –0.02 to –0.03 (P=0.71). The results did display markedly less spherical aberration and total higher order aberrations than eyes implanted with the traditional spheric IOL in all subgroups (WMD –0.06, 95%CI –0.07 to –0.06, Plt;0.000 01, WMD –0.06, 95%CI –0.07 to –0.02, Plt;0.000 1, respectively). The majority of studies suggested significant improvement in the aspheric IOL group in contrast sensitivity, especially at mesopic low spatial frequencies, although some trials showed no significant difference. Conclusion The effectiveness of aspheric IOL is superior to spherical IOL during cataract surgery. No differences in aspheric IOL with different aberration are found in this series, and further study is required.
Objective To review systematically the effectiveness and safety of astragaulus membranaceus in the treatment of diabetic nephropathy (DN). Methods A Cochrane systematic review of all relevant randomized or quasi-randomized controlled trials of astragaulus membranaceus for diabetic nephropathy was performed. Clinical trials were searched for in the Cochrane Central Refister of Controlled Trials, MEDLINE, EMBASE, the Chinese Biological Medicine Database, and the Chinese Science and Technology Journal Full-text Database as well as in the references lists of all included trials. Two reviewers works independently to select studies, assess methodological quality and extract data. The following indexes were included to assess the clinical effectiveness and safety of astragaulus membranaceus: 24-hour urinary albumin excretion rate (UAER), 24-hour urinary protein, clearance of creatinine (Ccr), serum creatinine (Scr), blood urea nitrogen (BUN), fasting plasma glucose (FPG), hemoglobin A1c (HbA1c), triglyceride (TG), total cholesterol (TC), and serious adverse events. Results Thirty-four clinical trials involving 2 356 patients met the inclusion criteria, but most of these trials were small and of low quality . A “funnel plot” showed asymmetry, which indicated possible publication bias, such that trials with negativeresults might not have been published. Meta-analyses showed that astragaulus membranaceus had some effects on the decrease of the 24-hour UAER, 24-hour urinary protein, Scr and BUN, and also on the improvement of Ccr. Therefore, astragaulus membranaceus, to a certain extent, was found to be effective in improving renal functions of DN patients. However, astragaulus membranaceus might have similar effects in decreasing the 24-hour UAER and Scr compared with angiotensin-converting enzyme inhibitor and angiotensin receptor blockers. Compared with other Chinese medicines, astragaulus membranaceus was more effective in decreasing the 24-hour urinary protein. No serious adverse events were observed during the treatment period. Conclusion Astragaulus membranaceus has some effect and is relatively safe in treating patients with diabetic nephropathy. However, the present evidence was not enough to support the recommendation of astragaulus membranaceus as a routine drug in the clinical management of DN.Since most included trials are small and of low quality, high-quality, large-sample, multi-centre, randomized, double-blind and placebo-controlled trials of astragaulus membranaceus for DN are needed.