LIU Yunlan, ZHANG Jingyi, SHI Qianling, YANG Nan, WANG Zijun, LUO Xufei, REN Mengjuan, XUN Yangqin, ZHOU Qi, LIU Hui, LYU Meng, CHEN Yaolong. Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Methodological and Reporting Quality[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(2): 324-331. DOI: 10.12290/xhyxzz.2022-0027
Citation: LIU Yunlan, ZHANG Jingyi, SHI Qianling, YANG Nan, WANG Zijun, LUO Xufei, REN Mengjuan, XUN Yangqin, ZHOU Qi, LIU Hui, LYU Meng, CHEN Yaolong. Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Methodological and Reporting Quality[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(2): 324-331. DOI: 10.12290/xhyxzz.2022-0027

Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Methodological and Reporting Quality

Funds: 

National Social Science Fund of China 19ZDA142

National Key Research and Development Program of China 2018YFC1705500

Fundamental Research Funds for the Central Universities lzujbky-2021-ey13

More Information
  • Corresponding author:

    CHEN Yaolong, E-mail: chevidence@lzu.edu.cn

  • Received Date: January 15, 2022
  • Accepted Date: February 13, 2022
  • Available Online: March 13, 2022
  • Issue Publish Date: March 29, 2022
  •   Objective  To evaluate the methodological and reporting quality of Chinese clinical practice guidelines published in medical journals in 2019, so as to understand their current quality and provide suggestions for the improvement of guideline development.
      Methods  We used the AGREE Ⅱ tool and the RIGHT checkilist to assess the methodological and reporting quality of Chinese clinical practice guidelines respectively. The average score or average reporting rate was calculated for each domain and the overall. We used 60% as the qualified threshold.
      Results  A total of 226 guidelines meeting the criteria were included. The average score of AGREE Ⅱ was 22.3%, and the scores of six domains were as follows: 37.9% (scope and purpose), 23.2% (stakeholder involvement), 14.9% (rigour of development), 39.1% (clarity of presentation), 14.6% (applicability), and 22.5%(editorial independence). The average reporting rate of RIGHT was 33.9%, and the reporting rates of seven domains were as follows: 59.2% (basic information), 51.9% (background), 10.8% (evidence), 31.5% (recommendation), 4.4% (review and quality assurance), 22.3%(funding and declaration and management of interests), and 14.5% (other information). Compared to unregistered guidelines, 12 registered guidelines had a 24.3% higher mean score (48.3% vs. 24.0%) in AGREE Ⅱ and a 21.2% higher mean reporting rate (54.0% vs. 32.8%) in RIGHT.
      Conclusions  The overall methodological and reporting quality of Chinese clinical practice guidelines published in medical journals in 2019 were relatively low. Registered guidelines had higher overall scores than unregistered guidelines.
  • [1]
    Qaseem A, Forland F, Macbeth F, et al. Guidelines International Network: toward international standards for clinical practice guidelines[J]. Ann Intern Med, 2012, 156: 525-531. DOI: 10.7326/0003-4819-156-7-201204030-00009
    [2]
    陈耀龙, 王小琴, 王琪, 等. 遵循指南报告规范提升指南报告质量[J]. 中华内科杂志, 2018, 57: 168-170. DOI: 10.3760/cma.j.issn.0578-1426.2018.03.003

    Chen YL, Wang XQ, Wang Q, et al. Follow the guideline reporting standards to improve the quality of guideline reports[J]. Zhonghua Neike Zazhi, 2018, 57: 168-170. DOI: 10.3760/cma.j.issn.0578-1426.2018.03.003
    [3]
    Armstrong JJ, Goldfarb AM, Instrum RS, et al. Improve-ment evident but still necessary in clinical practice guideline quality: a systematic review[J]. J Clin Epidemiol, 2017, 81: 13-21. DOI: 10.1016/j.jclinepi.2016.08.005
    [4]
    Moher D, Schulz KF, Simera I, et al. Guidance for developers of health research reporting guidelines[J]. PLoS Med, 2010, 7: e1000217. DOI: 10.1371/journal.pmed.1000217
    [5]
    Brouwers MC, Kho ME, Browman GP, et al. AGREE Ⅱ: advancing guideline development, reporting and evaluation in health care[J]. CMAJ, 2010, 182: E839-E842. DOI: 10.1503/cmaj.090449
    [6]
    Chen YL, Yang KH, Marusic A, et al. A reporting tool for practice guidelines in health care: the RIGHT statement[J]. Ann Intern Med, 2017, 166: 128-132. DOI: 10.7326/M16-1565
    [7]
    Zhou Q, Wang ZJ, Shi QL, et al. Clinical Epidemiology in China series. Paper 4: The reporting and methodological quality of Chinese clinical practice guidelines published between 2014 and 2018: A systematic review[J]. J Clin Epidemiol, 2021, 140: 189-199. DOI: 10.1016/j.jclinepi.2021.08.013
    [8]
    李楠, 姚亮, 吴琼芳, 等. 2012~2013年中国大陆期刊发表临床实践指南质量评价[J]. 中国循证医学杂志, 2015, 15: 259-263. DOI: 10.7507/1672-2531.20150045

    Li N, Yao L, Wu QF, et al. Quality Evaluation of Clinical Practice Guidelines Published in. Journals of Mainland China during 2012—2013[J]. Zhongguo Xunzheng Yixue Zazhi, 2015, 15: 259-263. DOI: 10.7507/1672-2531.20150045
    [9]
    中华医学会杂志社指南与标准研究中心, 世界卫生组织指南实施与知识转化合作中心. 2020中华医学会系列杂志发表指南评价报告[J]. 中华医学杂志, 2021, 101: 1839-1847. DOI: 10.3760/cma.j.cn112137-20210402-00803

    Guidelines and Standards Research Center, Journal of the Chinese Medical Association, WHO Collaborating Center for Guideline Implementation and Knowledge Translation. The evaluation report of 2020 Chinese Medical Association series publishes guideline[J]. Zhonghua Yixue Zazhi, 2021, 101: 1839-1847. DOI: 10.3760/cma.j.cn112137-20210402-00803
    [10]
    Institute of Medicine. Clinical Practice Guidelines We Can Trust[M]. Washington DC: the National Academies Press, 2011.
    [11]
    王子君, 史乾灵, 刘云兰, 等. 2019年期刊公开发表的中国临床实践指南文献调查与评价——制订人员及工作组情况[J]. 协和医学杂志, 2021, 12: 552-559. DOI: 10.12290/xhyxzz.2021-0438

    Wang ZJ, Shi QL, Liu YL, et al. Investigation and Evaluation of Chinese C linical Practice Guidelines Published in Medical Journals in 2019: Status of the Auth orship and Guideline Development Group[J]. Xiehe Yixue Zazhi, 2021, 12: 552-559. DOI: 10.12290/xhyxzz.2021-0438
    [12]
    Lin I, Wiles LK, Waller R, et al. Poor overall quality of clinical practice guidelines for musculoskeletal pain: a systematic review[J]. Br J Sports Med, 2018, 52: 337-343. DOI: 10.1136/bjsports-2017-098375
    [13]
    Hoffmann-Eβer W, Siering U, Neugebauer EAM, et al. Systematic review of current guideline appraisals performed with the Appraisal of Guidelines for Research & Evaluation Ⅱ instrument—A third of AGREE Ⅱ users apply a cut-off for guideline quality[J]. J Clin Epidemiol, 2018, 95: 120-127. DOI: 10.1016/j.jclinepi.2017.12.009
    [14]
    Molino CGRC, Leite-Santos NC, Gabriel FC, et al. Factors associated with high-quality guidelines for the pharmacologic management of chronic diseases in primary care: a systematic review[J]. JAMA Intern Med, 2019, 179: 553-560. DOI: 10.1001/jamainternmed.2018.7529
    [15]
    Wang XQ, Zhou Q, Chen YL, et al. Using RIGHT (Reporting Items for Practice Guidelines in Healthcare) to evaluate the reporting quality of WHO guidelines[J]. Health Res Policy Syst, 2020, 18: 75. DOI: 10.1186/s12961-020-00578-w
    [16]
    Chen YL, Yao L, Xiao XJ, et al. Quality assessment of clinical guidelines in China: 1993—2010[J]. Chin Med J (Engl), 2012, 125: 3660-3664.
    [17]
    韦当, 王小琴, 吴琼芳, 等. 2011年中国临床实践指南质量评价[J]. 中国循证医学杂志, 2013, 13: 760-763. DOI: 10.7507/1672-2531.20130134

    Wei D, Wang XQ, Wu QF, et al. Quality Evaluation on Chinese Clinical Practice guidelines in 2011[J]. Zhongguo Xunzheng Yixue Zazhi, 2013, 13: 760-763. DOI: 10.7507/1672-2531.20130134
    [18]
    王云云, 靳英辉, 陈耀龙, 等. 循证临床实践指南推荐意见形成的方法分析[J]. 中国循证医学杂志, 2017, 17: 1085-1092. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201709015.htm

    Wang YY, Jin YH, Chen YL, et al. The methodology of recommendations in evidence-based clinical practice guide-line[J]. Zhongguo Xunzheng Yixue Zazhi, 2017, 17: 1085-1092. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201709015.htm
    [19]
    靳英辉, 赵志慧, 黄粲然, 等. 临床实践指南实施性评价工具的研制和验证评价[J]. 中国循证医学杂志, 2022, 22: 111-119.

    Jin YH, Zhao ZH, Huang CR, et al. Development and validation for evaluation of an evaluation tool for guideline implementation[J]. Zhongguo Xunzheng Yixue Zazhi, 2022, 22: 111-119.
    [20]
    Wang DQ, Huang Q, Huang X, et al. Knowledge of and Compliance With Guidelines in the Management of Non-Muscle-Invasive Bladder Cancer: A Survey of Chinese Urologists[J]. Front Oncol, 2021, 11: 735704. DOI: 10.3389/fonc.2021.735704
    [21]
    Traversy G, Barnieh L, Akl EA, et al. Managing conflicts of interest in the development of health guidelines[J]. CMAJ, 2021, 193: E49-E54. DOI: 10.1503/cmaj.200651
    [22]
    Chen YL, Guyatt GH, Munn Z, et al. Clinical Practice Guidelines Registry: Toward Reducing Duplication, Improving Collaboration, and Increasing Transparency[J]. Ann Intern Med, 2021, 174: 705-707. DOI: 10.7326/M20-7884
  • Related Articles

    [1]ZHOU Jiong, WANG Shuchang, MA Xiaojun. Improving Medical Quality and Safety Through DRG Payment Model[J]. Medical Journal of Peking Union Medical College Hospital, 2024, 15(5): 981-986. DOI: 10.12290/xhyxzz.2024-0479
    [2]WANG Ziyi, LU Cuncun, HUANG Jiayi, ZHANG Jinglei, SHANG Wenru, CUI Lu, LIU Wendi, DENG Xiuxiu, ZHAO Xiaoxiao, YANG Kehu, LI Xiuxia. Investigation and Evaluation of Systematic Reviews of Prediction Models Published in Chinese Journals: Methodological and Reporting Quality[J]. Medical Journal of Peking Union Medical College Hospital, 2024, 15(4): 927-935. DOI: 10.12290/xhyxzz.2023-0418
    [3]LIU Hui, SU Renfeng, SHI Anya, YAO Yuanyuan, ZHOU Qi, WANG Zijun, TIE Rui, LU Mengying, ZHANG Hao, SUN Haonan, ZHAO Junxian, ZHAO Siya, YANG Kehu, LIU Xingrong, CHEN Yaolong. Methodological Quality Analysis of Systematic Review/Meta-analysis Published in Chinese Science Citation Database Journals[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(2): 390-398. DOI: 10.12290/xhyxzz.2022-0317
    [4]SUN Yajia, SHI Qianling, YANG Nan, GUO Qiangqiang, SU Renfeng, CHEN Ze, ZHANG Guangxin, CAO Xichao, CHEN Yaolong. Rethinking and Exploring the Comprehensive Evaluation of Clinical Practice Guidelines[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(1): 22-30. DOI: 10.12290/xhyxzz.2022-0612
    [5]REN Mengjuan, YANG Nan, LIU Yunlan, SUN Yajia, SHI Qianling, ZHOU Qi, WANG Zijun, CHEN Yaolong. Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Reporting Status of Abstract[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(5): 880-887. DOI: 10.12290/xhyxzz.2022-0190
    [6]LIU Hui, LAN Hui, ZHAO Siya, WANG Zijun, SHI Qianling, LIU Xiao, ZHOU Qi, WANG Jianjian, LYU Meng, LIU Yunlan, YANG Nan, XUN Yangqin, LI Qinyuan, PEI Hang, LIU Xingrong, CHEN Yaolong. Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Research Gaps[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(3): 498-505. DOI: 10.12290/xhyxzz.2022-0029
    [7]LU Shuya, ZHAO Siya, WU Shouyuan, LUO Xufei, LIU Yunlan, LYU Meng, YANG Nan, WANG Xiaohui, CHEN Yaolong. Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:the Quality of Evidence and Strength of Recommendations[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(1): 130-137. DOI: 10.12290/xhyxzz.2021-0784
    [8]YANG Nan, CHEN Yaolong. Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019[J]. Medical Journal of Peking Union Medical College Hospital, 2021, 12(3): 407-410. DOI: 10.12290/xhyxzz.2021-0323
    [9]WANG Zi-jun, ZHOU Qi, XING Dan, YANG Nan, LUO Xu-fei, ZHANG Jing-yi, SHI Qian-ling, ZHAO Si-ya, LIU Hui, LIU Xiao, LI Qin-yuan, DU Liang, YANG Ke-hu, CHEN Yao-long. Reporting Quality of Literature Interpreting Clinical Practice Guidelines/Consensus: A Cross-sectional Study[J]. Medical Journal of Peking Union Medical College Hospital, 2021, 12(2): 260-267. DOI: 10.12290/xhyxzz.20200250
    [10]Yao-long CHEN, Ke-hu YANG. How to Correctly Understand, Develop, and Apply Clinical Practice Guidelines[J]. Medical Journal of Peking Union Medical College Hospital, 2018, 9(4): 367-373. DOI: 10.3969/j.issn.1674-9081.2018.04.015
  • Cited by

    Periodical cited type(4)

    1. 贾棋茹. 孟鲁司特钠治疗活动性肺结核的疗效及对患者生活质量的影响. 医师在线. 2025(01): 11-14 .
    2. 马锡慧,李彬钰,韩永,孔祥瑞,孙玉洁,郭宗伟,郭欣鑫,崔文哲,肖漓. 结核病患者外周血淋巴细胞亚群以及12项血浆细胞因子流式检测分析. 中华检验医学杂志. 2024(07): 755-762 .
    3. 杨晨晨,如克亚木·阿不都沙拉木,徐茜. 肺结核患者外周血T细胞协同刺激分子表达和NK细胞比例. 细胞与分子免疫学杂志. 2024(07): 629-635 .
    4. 陈志祥,艾克拜尔,陈存存,车勇. 结核T细胞斑点试验联合外周血T淋巴细胞亚群检测在临床诊断中的价值. 贵州医药. 2024(11): 1683-1686 .

    Other cited types(2)

Catalog

    Article Metrics

    Article views (774) PDF downloads (96) Cited by(6)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return
    x Close Forever Close