Volume 14 Issue 2
Mar.  2023
Turn off MathJax
Article Contents
LIU Hui, SU Renfeng, SHI Anya, YAO Yuanyuan, ZHOU Qi, WANG Zijun, TIE Rui, LU Mengying, ZHANG Hao, SUN Haonan, ZHAO Junxian, ZHAO Siya, YANG Kehu, LIU Xingrong, CHEN Yaolong. Methodological Quality Analysis of Systematic Review/Meta-analysis Published in Chinese Science Citation Database Journals[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(2): 390-398. doi: 10.12290/xhyxzz.2022-0317
Citation: LIU Hui, SU Renfeng, SHI Anya, YAO Yuanyuan, ZHOU Qi, WANG Zijun, TIE Rui, LU Mengying, ZHANG Hao, SUN Haonan, ZHAO Junxian, ZHAO Siya, YANG Kehu, LIU Xingrong, CHEN Yaolong. Methodological Quality Analysis of Systematic Review/Meta-analysis Published in Chinese Science Citation Database Journals[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(2): 390-398. doi: 10.12290/xhyxzz.2022-0317

Methodological Quality Analysis of Systematic Review/Meta-analysis Published in Chinese Science Citation Database Journals

doi: 10.12290/xhyxzz.2022-0317

Fundamental Research Funds for the Central Universities lzujbky-2021-ey13

CAMS Innovation Fund for Medical Sciences- Research Unit of Evidence-based Evaluation and Guidelines 2021RU017

More Information
  • Corresponding author: LIU Xingrong, E-mail: liuxr@lzu.edu.cn; CHEN Yaolong, E-mail: chevidence@lzu.edu.cn
  • Received Date: 2022-06-09
  • Accepted Date: 2022-07-04
  • Available Online: 2022-07-27
  • Publish Date: 2023-03-30
  •   Objective  To evaluate the methodological quality of systematic review/meta analysis (SR/MA) published in Chinese Science Citation Database (CSCD) journals in 2020, with the aim of providing suggestions for researchers in China to develop SR/MA and reference for editors and reviewers to review SR/MA.  Methods  The list of journals was formed with a sample of journals published by the Chinese Medical Association Publishing House and included in CSCD. Four researchers working in pairs conducted independently manual searches on the official websites of the journals to include SR/MA published in 2020, and one researcher conducted a supplementary search on China National Knowledge Infrastructure. After identifying the included literature, the researchers worked in pairs to extract information independently, evaluated methodological quality by using AMSTAR 2(A Measurement Tool to Assess Systematic Reviews 2) and performed statistical analysis of the results.  Results  A total of 79 journals from the Chinese Medical Association Publishing House were included in CSCD, 46 of which published SR/MA in 2020, and 126 SR/MA were included for analysis after screening according to inclusion and exclusion criteria. AMSTAR 2 evaluation results showed that the average score of SR/MA was 10.38±1.91. The scored proportion of 9 items was more than 70%. SR/MA met partially/met a minimum of 5 AMSTAR 2 items and a maximum of 12 items. Before the key items were adjusted, over 90% of SR/MA's credibility rating was critically low. After adjusting the key items according to the actual Chinese situation, about 40% of SR/MA's credibility rating was medium and low, respectively. The results of the stratified analysis showed that the use of GRADE, adherence to the PRISMA statement, the number of authors greater than 5, the language of publication, the type of included studies including RCTs, and the reporting of funding were not factors that influenced the methodological quality of SR/MA.  Conclusions  The methodological quality of SR/MA published in CSCD journals in 2020 need to improve. Attention should be paid to the registration, retrieval, inclusion and exclusion criteria of SR/MA as well as financial support, so as to effectively improve the quality of SR/MA.
  • loading
  • [1] Muka T, Glisic M, Milic J, et al. A 24-step guide on how to design, conduct, and successfully publish a systematic review and meta-analysis in medical research[J]. Eur J Epidemiol, 2020, 35: 49-60. doi:  10.1007/s10654-019-00576-5
    [2] 靳英辉, 吴世文, 拜争刚, 等. 系统评价与Meta分析的内涵及价值[J]. 同济大学学报(医学版), 2019, 40: 105-111. https://www.cnki.com.cn/Article/CJFDTOTAL-TJIY201901021.htm
    [3] Djulbegovic B, Guyatt GH. Progress in evidence-based medicine: a quarter century on[J]. Lancet, 2017, 390: 415-423. doi:  10.1016/S0140-6736(16)31592-6
    [4] 李幼平, 刘雪梅. 系统评价的起源、发展和作用[J]. 中国循证医学杂志, 2011, 11: 2-6. doi:  10.3969/j.issn.1672-2531.2011.01.002
    [5] Manchikanti L. Evidence-based medicine, systematic reviews, and guidelines in interventional pain management, part I: introduction and general considerations[J]. Pain Physician, 2008, 11: 161-186.
    [6] Patsopoulos NA, Analatos AA, Ioannidis JP. Relative citation impact of various study designs in the health sciences[J]. JAMA, 2005, 293: 2362-2366. doi:  10.1001/jama.293.19.2362
    [7] Young C, Horton R. Putting clinical trials into context[J]. Lancet, 2005, 366: 107-108. doi:  10.1016/S0140-6736(05)66846-8
    [8] Ioannidis JP, Greenland S, Hlatky MA, et al. Increasing value and reducing waste in research design, conduct, and analysis[J]. Lancet, 2014, 383: 166-175. doi:  10.1016/S0140-6736(13)62227-8
    [9] 李秀霞, 郭康乐, 商雪, 等. 针刺临床有效性优势病症的系统评价再评价[J]. 中国循证医学杂志, 2021, 21: 703-709. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ202106012.htm
    [10] 王志稳, 冷敏敏, 赵雅洁, 等. 近5年我国护理领域干预性研究系统评价的方法学质量分析[J]. 中国护理管理, 2020, 20: 485-489. https://www.cnki.com.cn/Article/CJFDTOTAL-GLHL202004006.htm
    [11] 钟娟, 郑芸, 李刚, 等. 中草药治疗变应性鼻炎系统评价再评价[J]. 中华中医药杂志, 2017, 32: 263-266. https://www.cnki.com.cn/Article/CJFDTOTAL-BXYY201701072.htm
    [12] 王盼杰, 王稼祥, 蔡润津, 等. 我国学者发表系统评价再评价研究现状分析[J]. 中国药物评价, 2019, 36: 5-9. https://www.cnki.com.cn/Article/CJFDTOTAL-YAPJ201901003.htm
    [13] 中华医学会杂志社指南与标准研究中心, 世界卫生组织指南实施与知识转化合作中心. 2020中华医学会系列杂志发表指南评价报告[J]. 中华医学杂志, 2021, 101: 1839-1847.
    [14] 张方圆, 沈傲梅, 曾宪涛, 等. 系统评价方法学质量评价工具AMSTAR 2解读[J]. 中国循证心血管医学杂志, 2018, 10: 14-18. https://www.cnki.com.cn/Article/CJFDTOTAL-PZXX201801003.htm
    [15] Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both[J]. BMJ, 2017, 358: j4008.
    [16] 葛龙, 潘蓓, 潘佳雪, 等. 解读AMSTAR-2: 基于随机和(或)非随机对照试验系统评价的质量评价工具[J]. 中国药物评价, 2017, 34: 334-338. https://www.cnki.com.cn/Article/CJFDTOTAL-YAPJ201705004.htm
    [17] 方程, 邓巍, 樊景春, 等. 系统评价与Meta分析的注册平台简介[J]. 同济大学学报(医学版), 2019, 40: 380-387. https://www.cnki.com.cn/Article/CJFDTOTAL-TJIY201903023.htm
    [18] 董悦颖. Meta分析方法学质量与报告质量评价的主要问题[J]. 中国卫生统计, 2017, 34: 1006-1008. https://www.cnki.com.cn/Article/CJFDTOTAL-ZGWT201706048.htm
    [19] 中华医学会杂志社.中华医学会系列杂志稿约通则[EB/OL]. (2008-12)[2022-03-24]. http://www.cmaph.org/r/cms/guanwang/pdf/web/viewer.html?file=/files/u/cms/guanwang/201910/25101508od3v.pdf.
    [20] Cao L, Yao L, Hui X, et al. Clinical Epidemiology in China series. Paper 3: The methodological and reporting quality of systematic reviews and meta-analyses published by China' researchers in English-language is higher than those published in Chinese-language[J]. J Clin Epidemiol, 2021, 140: 178-188.
    [21] 王虎城, 杨丰文, 庞稳泰, 等. 参附注射液治疗心力衰竭的系统评价再评价[J]. 中国中医急症, 2020, 29: 41-45. https://www.cnki.com.cn/Article/CJFDTOTAL-ZYJZ202001011.htm
    [22] Gao Y, Cai Y, Yang K, et al. Methodological and reporting quality in non-Cochrane systematic review updates could be improved: a comparative study[J]. J Clin Epidemiol, 2020, 119: 36-46.
    [23] Ji Z, Zhang J, Menniti-Ippolito F, et al. The quality of Cochrane systematic reviews of acupuncture: an overview[J]. BMC Complement Med Ther, 2020, 20: 307.
    [24] Booth A, Clarke M, Ghersi D, et al. An international registry of systematic-review protocols[J]. Lancet, 2011, 377: 108-109.
    [25] 陶欢, 杨乐天, 平安, 等. 随机或非随机防治性研究系统评价的质量评价工具AMSTAR 2解读[J]. 中国循证医学杂志, 2018, 18: 101-108. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201801017.htm
    [26] 张旭, 左丽倩, 刘明秀, 等. 108篇系统评价或Meta分析的方法学质量评价: 基于AMSTAR-2[J]. 中国社会医学杂志, 2021, 38: 476-480. https://www.cnki.com.cn/Article/CJFDTOTAL-GWSY202104028.htm
    [27] 张夏天, 胡烨胤, 张晓雨, 等. 2013-2017年发表的推拿系统评价的再评价[J]. 中国循证医学杂志, 2019, 19: 361-367. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201903019.htm
    [28] 王娅, 刘艳飞, 王哲, 等. 2015-2019年中药治疗原发性高血压的系统评价再评价[J]. 中国循证医学杂志, 2019, 19: 1460-1469. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201912013.htm
    [29] 王佳琳, 闫佰荟, 王璐, 等. 中文肿瘤学干预类Meta分析论文摘要报告质量评价分析[J]. 中华医学图书情报杂志, 2020, 29: 24-31. https://www.cnki.com.cn/Article/CJFDTOTAL-YXTS202010004.htm
    [30] 周建国, 吕水萍, 张钰, 等. 中国学者在PROSPERO平台注册系统评价/Meta分析的现状调查[J]. 中国循证医学杂志, 2016, 16: 466-470. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201604014.htm
    [31] 《临床肝胆病杂志》编辑部. 《临床肝胆病杂志》优先录用在PROSPERO平台注册的Meta分析[J]. 临床肝胆病杂志, 2020, 36: 2328. https://www.cnki.com.cn/Article/CJFDTOTAL-LCGD202010049.htm
    [32] 王晓宇, 王虎城, 刘蕾蕾, 等. 小儿推拿类系统评价/Meta分析的质量评价[J]. 中国循证医学杂志, 2019, 19: 1106-1112. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201909015.htm
    [33] 韦所苏, 韦挥德, 黄晓红, 等. 1998-2014年《中华医学杂志》发表的Meta分析文献质量评价[J]. 中华医学杂志, 2015, 95: 621-626. https://www.cnki.com.cn/Article/CJFDTOTAL-ZYLN201611012.htm
    [34] DeAngelis CD, Fontanarosa PB. Impugning the integrity of medical science: the adverse effects of industry influence[J]. JAMA, 2008, 299: 1833-1835.
    [35] Yaphe J, Edman R, Knishkowy B, et al. The association between funding by commercial interests and study outcome in randomized controlled drug trials[J]. Fam Pract, 2001, 18: 565-568.
    [36] 代欣玥, 张菀桐, 刘艳飞, 等. 高压氧治疗糖尿病足的系统评价再评价[J]. 中国循证医学杂志, 2020, 20: 809-816. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ202007011.htm
    [37] 谭香艺, 杨祎玲, 赵久波, 等. 正念冥想治疗创伤后应激障碍有效性及安全性的系统评价再评价[J]. 中国全科医学, 2021, 24: 2721-2728. https://www.cnki.com.cn/Article/CJFDTOTAL-QKYX202121017.htm
    [38] 杨珂璐, 金鑫瑶, 刘明, 等. 中药注射剂治疗病毒性肺炎的系统评价再评价[J]. 中国循证医学杂志, 2020, 20: 1326-1333. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ202011013.htm
    [39] Werner SS, Binder N, Toews I, et al. Use of GRADE in evidence syntheses published in high-impact-factor nutrition journals: A methodological survey[J]. J Clin Epidemiol, 2021, 35: 54-69.
  • 加载中


    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(2)  / Tables(3)

    Article Metrics

    Article views (570) PDF downloads(53) Cited by()
    Proportional views


    DownLoad:  Full-Size Img  PowerPoint