LIU Yunlan, ZHANG Jingyi, SHI Qianling, YANG Nan, WANG Zijun, LUO Xufei, REN Mengjuan, XUN Yangqin, ZHOU Qi, LIU Hui, LYU Meng, CHEN Yaolong. Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Methodological and Reporting Quality[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(2): 324-331. DOI: 10.12290/xhyxzz.2022-0027
Citation: LIU Yunlan, ZHANG Jingyi, SHI Qianling, YANG Nan, WANG Zijun, LUO Xufei, REN Mengjuan, XUN Yangqin, ZHOU Qi, LIU Hui, LYU Meng, CHEN Yaolong. Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Methodological and Reporting Quality[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(2): 324-331. DOI: 10.12290/xhyxzz.2022-0027

Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Methodological and Reporting Quality

Funds: 

National Social Science Fund of China 19ZDA142

National Key Research and Development Program of China 2018YFC1705500

Fundamental Research Funds for the Central Universities lzujbky-2021-ey13

More Information
  • Corresponding author:

    CHEN Yaolong, E-mail: chevidence@lzu.edu.cn

  • Received Date: January 15, 2022
  • Accepted Date: February 13, 2022
  • Available Online: March 13, 2022
  • Issue Publish Date: March 29, 2022
  •   Objective  To evaluate the methodological and reporting quality of Chinese clinical practice guidelines published in medical journals in 2019, so as to understand their current quality and provide suggestions for the improvement of guideline development.
      Methods  We used the AGREE Ⅱ tool and the RIGHT checkilist to assess the methodological and reporting quality of Chinese clinical practice guidelines respectively. The average score or average reporting rate was calculated for each domain and the overall. We used 60% as the qualified threshold.
      Results  A total of 226 guidelines meeting the criteria were included. The average score of AGREE Ⅱ was 22.3%, and the scores of six domains were as follows: 37.9% (scope and purpose), 23.2% (stakeholder involvement), 14.9% (rigour of development), 39.1% (clarity of presentation), 14.6% (applicability), and 22.5%(editorial independence). The average reporting rate of RIGHT was 33.9%, and the reporting rates of seven domains were as follows: 59.2% (basic information), 51.9% (background), 10.8% (evidence), 31.5% (recommendation), 4.4% (review and quality assurance), 22.3%(funding and declaration and management of interests), and 14.5% (other information). Compared to unregistered guidelines, 12 registered guidelines had a 24.3% higher mean score (48.3% vs. 24.0%) in AGREE Ⅱ and a 21.2% higher mean reporting rate (54.0% vs. 32.8%) in RIGHT.
      Conclusions  The overall methodological and reporting quality of Chinese clinical practice guidelines published in medical journals in 2019 were relatively low. Registered guidelines had higher overall scores than unregistered guidelines.
  • [1]
    Qaseem A, Forland F, Macbeth F, et al. Guidelines International Network: toward international standards for clinical practice guidelines[J]. Ann Intern Med, 2012, 156: 525-531. DOI: 10.7326/0003-4819-156-7-201204030-00009
    [2]
    陈耀龙, 王小琴, 王琪, 等. 遵循指南报告规范提升指南报告质量[J]. 中华内科杂志, 2018, 57: 168-170. DOI: 10.3760/cma.j.issn.0578-1426.2018.03.003

    Chen YL, Wang XQ, Wang Q, et al. Follow the guideline reporting standards to improve the quality of guideline reports[J]. Zhonghua Neike Zazhi, 2018, 57: 168-170. DOI: 10.3760/cma.j.issn.0578-1426.2018.03.003
    [3]
    Armstrong JJ, Goldfarb AM, Instrum RS, et al. Improve-ment evident but still necessary in clinical practice guideline quality: a systematic review[J]. J Clin Epidemiol, 2017, 81: 13-21. DOI: 10.1016/j.jclinepi.2016.08.005
    [4]
    Moher D, Schulz KF, Simera I, et al. Guidance for developers of health research reporting guidelines[J]. PLoS Med, 2010, 7: e1000217. DOI: 10.1371/journal.pmed.1000217
    [5]
    Brouwers MC, Kho ME, Browman GP, et al. AGREE Ⅱ: advancing guideline development, reporting and evaluation in health care[J]. CMAJ, 2010, 182: E839-E842. DOI: 10.1503/cmaj.090449
    [6]
    Chen YL, Yang KH, Marusic A, et al. A reporting tool for practice guidelines in health care: the RIGHT statement[J]. Ann Intern Med, 2017, 166: 128-132. DOI: 10.7326/M16-1565
    [7]
    Zhou Q, Wang ZJ, Shi QL, et al. Clinical Epidemiology in China series. Paper 4: The reporting and methodological quality of Chinese clinical practice guidelines published between 2014 and 2018: A systematic review[J]. J Clin Epidemiol, 2021, 140: 189-199. DOI: 10.1016/j.jclinepi.2021.08.013
    [8]
    李楠, 姚亮, 吴琼芳, 等. 2012~2013年中国大陆期刊发表临床实践指南质量评价[J]. 中国循证医学杂志, 2015, 15: 259-263. DOI: 10.7507/1672-2531.20150045

    Li N, Yao L, Wu QF, et al. Quality Evaluation of Clinical Practice Guidelines Published in. Journals of Mainland China during 2012—2013[J]. Zhongguo Xunzheng Yixue Zazhi, 2015, 15: 259-263. DOI: 10.7507/1672-2531.20150045
    [9]
    中华医学会杂志社指南与标准研究中心, 世界卫生组织指南实施与知识转化合作中心. 2020中华医学会系列杂志发表指南评价报告[J]. 中华医学杂志, 2021, 101: 1839-1847. DOI: 10.3760/cma.j.cn112137-20210402-00803

    Guidelines and Standards Research Center, Journal of the Chinese Medical Association, WHO Collaborating Center for Guideline Implementation and Knowledge Translation. The evaluation report of 2020 Chinese Medical Association series publishes guideline[J]. Zhonghua Yixue Zazhi, 2021, 101: 1839-1847. DOI: 10.3760/cma.j.cn112137-20210402-00803
    [10]
    Institute of Medicine. Clinical Practice Guidelines We Can Trust[M]. Washington DC: the National Academies Press, 2011.
    [11]
    王子君, 史乾灵, 刘云兰, 等. 2019年期刊公开发表的中国临床实践指南文献调查与评价——制订人员及工作组情况[J]. 协和医学杂志, 2021, 12: 552-559. DOI: 10.12290/xhyxzz.2021-0438

    Wang ZJ, Shi QL, Liu YL, et al. Investigation and Evaluation of Chinese C linical Practice Guidelines Published in Medical Journals in 2019: Status of the Auth orship and Guideline Development Group[J]. Xiehe Yixue Zazhi, 2021, 12: 552-559. DOI: 10.12290/xhyxzz.2021-0438
    [12]
    Lin I, Wiles LK, Waller R, et al. Poor overall quality of clinical practice guidelines for musculoskeletal pain: a systematic review[J]. Br J Sports Med, 2018, 52: 337-343. DOI: 10.1136/bjsports-2017-098375
    [13]
    Hoffmann-Eβer W, Siering U, Neugebauer EAM, et al. Systematic review of current guideline appraisals performed with the Appraisal of Guidelines for Research & Evaluation Ⅱ instrument—A third of AGREE Ⅱ users apply a cut-off for guideline quality[J]. J Clin Epidemiol, 2018, 95: 120-127. DOI: 10.1016/j.jclinepi.2017.12.009
    [14]
    Molino CGRC, Leite-Santos NC, Gabriel FC, et al. Factors associated with high-quality guidelines for the pharmacologic management of chronic diseases in primary care: a systematic review[J]. JAMA Intern Med, 2019, 179: 553-560. DOI: 10.1001/jamainternmed.2018.7529
    [15]
    Wang XQ, Zhou Q, Chen YL, et al. Using RIGHT (Reporting Items for Practice Guidelines in Healthcare) to evaluate the reporting quality of WHO guidelines[J]. Health Res Policy Syst, 2020, 18: 75. DOI: 10.1186/s12961-020-00578-w
    [16]
    Chen YL, Yao L, Xiao XJ, et al. Quality assessment of clinical guidelines in China: 1993—2010[J]. Chin Med J (Engl), 2012, 125: 3660-3664.
    [17]
    韦当, 王小琴, 吴琼芳, 等. 2011年中国临床实践指南质量评价[J]. 中国循证医学杂志, 2013, 13: 760-763. DOI: 10.7507/1672-2531.20130134

    Wei D, Wang XQ, Wu QF, et al. Quality Evaluation on Chinese Clinical Practice guidelines in 2011[J]. Zhongguo Xunzheng Yixue Zazhi, 2013, 13: 760-763. DOI: 10.7507/1672-2531.20130134
    [18]
    王云云, 靳英辉, 陈耀龙, 等. 循证临床实践指南推荐意见形成的方法分析[J]. 中国循证医学杂志, 2017, 17: 1085-1092. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201709015.htm

    Wang YY, Jin YH, Chen YL, et al. The methodology of recommendations in evidence-based clinical practice guide-line[J]. Zhongguo Xunzheng Yixue Zazhi, 2017, 17: 1085-1092. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201709015.htm
    [19]
    靳英辉, 赵志慧, 黄粲然, 等. 临床实践指南实施性评价工具的研制和验证评价[J]. 中国循证医学杂志, 2022, 22: 111-119.

    Jin YH, Zhao ZH, Huang CR, et al. Development and validation for evaluation of an evaluation tool for guideline implementation[J]. Zhongguo Xunzheng Yixue Zazhi, 2022, 22: 111-119.
    [20]
    Wang DQ, Huang Q, Huang X, et al. Knowledge of and Compliance With Guidelines in the Management of Non-Muscle-Invasive Bladder Cancer: A Survey of Chinese Urologists[J]. Front Oncol, 2021, 11: 735704. DOI: 10.3389/fonc.2021.735704
    [21]
    Traversy G, Barnieh L, Akl EA, et al. Managing conflicts of interest in the development of health guidelines[J]. CMAJ, 2021, 193: E49-E54. DOI: 10.1503/cmaj.200651
    [22]
    Chen YL, Guyatt GH, Munn Z, et al. Clinical Practice Guidelines Registry: Toward Reducing Duplication, Improving Collaboration, and Increasing Transparency[J]. Ann Intern Med, 2021, 174: 705-707. DOI: 10.7326/M20-7884
  • Related Articles

    [1]ZHOU Jiong, WANG Shuchang, MA Xiaojun. Improving Medical Quality and Safety Through DRG Payment Model[J]. Medical Journal of Peking Union Medical College Hospital, 2024, 15(5): 981-986. DOI: 10.12290/xhyxzz.2024-0479
    [2]WANG Ziyi, LU Cuncun, HUANG Jiayi, ZHANG Jinglei, SHANG Wenru, CUI Lu, LIU Wendi, DENG Xiuxiu, ZHAO Xiaoxiao, YANG Kehu, LI Xiuxia. Investigation and Evaluation of Systematic Reviews of Prediction Models Published in Chinese Journals: Methodological and Reporting Quality[J]. Medical Journal of Peking Union Medical College Hospital, 2024, 15(4): 927-935. DOI: 10.12290/xhyxzz.2023-0418
    [3]LIU Hui, SU Renfeng, SHI Anya, YAO Yuanyuan, ZHOU Qi, WANG Zijun, TIE Rui, LU Mengying, ZHANG Hao, SUN Haonan, ZHAO Junxian, ZHAO Siya, YANG Kehu, LIU Xingrong, CHEN Yaolong. Methodological Quality Analysis of Systematic Review/Meta-analysis Published in Chinese Science Citation Database Journals[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(2): 390-398. DOI: 10.12290/xhyxzz.2022-0317
    [4]SUN Yajia, SHI Qianling, YANG Nan, GUO Qiangqiang, SU Renfeng, CHEN Ze, ZHANG Guangxin, CAO Xichao, CHEN Yaolong. Rethinking and Exploring the Comprehensive Evaluation of Clinical Practice Guidelines[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(1): 22-30. DOI: 10.12290/xhyxzz.2022-0612
    [5]REN Mengjuan, YANG Nan, LIU Yunlan, SUN Yajia, SHI Qianling, ZHOU Qi, WANG Zijun, CHEN Yaolong. Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Reporting Status of Abstract[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(5): 880-887. DOI: 10.12290/xhyxzz.2022-0190
    [6]LIU Hui, LAN Hui, ZHAO Siya, WANG Zijun, SHI Qianling, LIU Xiao, ZHOU Qi, WANG Jianjian, LYU Meng, LIU Yunlan, YANG Nan, XUN Yangqin, LI Qinyuan, PEI Hang, LIU Xingrong, CHEN Yaolong. Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Research Gaps[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(3): 498-505. DOI: 10.12290/xhyxzz.2022-0029
    [7]LU Shuya, ZHAO Siya, WU Shouyuan, LUO Xufei, LIU Yunlan, LYU Meng, YANG Nan, WANG Xiaohui, CHEN Yaolong. Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:the Quality of Evidence and Strength of Recommendations[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(1): 130-137. DOI: 10.12290/xhyxzz.2021-0784
    [8]YANG Nan, CHEN Yaolong. Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019[J]. Medical Journal of Peking Union Medical College Hospital, 2021, 12(3): 407-410. DOI: 10.12290/xhyxzz.2021-0323
    [9]WANG Zi-jun, ZHOU Qi, XING Dan, YANG Nan, LUO Xu-fei, ZHANG Jing-yi, SHI Qian-ling, ZHAO Si-ya, LIU Hui, LIU Xiao, LI Qin-yuan, DU Liang, YANG Ke-hu, CHEN Yao-long. Reporting Quality of Literature Interpreting Clinical Practice Guidelines/Consensus: A Cross-sectional Study[J]. Medical Journal of Peking Union Medical College Hospital, 2021, 12(2): 260-267. DOI: 10.12290/xhyxzz.20200250
    [10]Yao-long CHEN, Ke-hu YANG. How to Correctly Understand, Develop, and Apply Clinical Practice Guidelines[J]. Medical Journal of Peking Union Medical College Hospital, 2018, 9(4): 367-373. DOI: 10.3969/j.issn.1674-9081.2018.04.015
  • Cited by

    Periodical cited type(13)

    1. 于玉东,闫菁菁,李彬,李佳,于鹏真,梁贝贝,钟兰芳. 基于多种工具评价冠心病中医临床实践指南的方法学质量. 世界科学技术-中医药现代化. 2025(01): 110-120 .
    2. 吕晗,王悍,刘军,刘辉,罗旭飞,周奇,陈耀龙,王振常. 提升指南及共识质量,促进影像医学高质量发展. 放射学实践. 2025(02): 137-140 .
    3. 王玲,任亚轩,罗旭飞,朱迪,李哲玮,王晔,王冰怡,张化语,杨书,陈耀龙. 中国改编指南的现状分析. 协和医学杂志. 2024(01): 192-201 . 本站查看
    4. 刘辉,杨楠,史乾灵,罗旭飞,张海荣,田金徽,靳英辉,陈耀龙. 医学期刊发表中国指南和共识类文献科学性、透明性和适用性评级方法学——样本确定及专科分配. 协和医学杂志. 2024(02): 429-434 . 本站查看
    5. 邓辉,王梦琪,孟祥然,龙政莉,曹雪,刘佳. 基于AGREE Ⅱ及RIGHT的儿童孤独症诊疗指南/共识质量评价研究. 解放军医学杂志. 2024(09): 977-985 .
    6. 廖少君,詹吉恒,侯宇,罗俊华,韦以锋,龙遨洋,高梓博,林涌鹏,温泽淮,林定坤. 神经根型颈椎病临床实践指南和专家共识方法学与报告质量评价. 中国中西医结合杂志. 2024(10): 1197-1205 .
    7. 安易,陈红,周彦吉,刘鲁平,陈千吉,雷园,孙艳艳,王锡友,刘长信,张洋,于长禾. 退行性腰椎管狭窄症相关指南的质量评价和推荐意见比较研究. 中国全科医学. 2023(11): 1310-1317 .
    8. 李玉乐,李娜,林琳,刘洋,施学忠,钱锋,董哲,赵娜,孙静,陈耀龙. 我国医学科技期刊编辑对临床实践指南/专家共识认知情况的调查研究. 中国科技期刊研究. 2023(03): 297-304 .
    9. 李玉乐,李娜,刘冰,刘洋,林琳,孙静,陈耀龙,董哲,赵娜. 提升指南/共识报告质量 推进医学期刊高质量发展. 编辑学报. 2023(02): 175-178 .
    10. Wang Zijun,Lou Ying,Liu Yunlan,Zhao Junxian,Su Renfeng,Sun Yajia,Liu Hui,Shi Qianling,Cai Jun,Chen Yaolong. Methodological and reporting quality of comprehensive hypertension guidelines published between 2017 and 2022. 中华医学杂志英文版. 2023(14): 1735-1737 .
    11. 王子君,罗旭飞,陈耀龙. 应重视规范撰写指南计划书. 中华心血管病杂志. 2022(07): 627-629 .
    12. 杨楠,赵巍,潘旸,吕相征,郝秀原,齐文安,杜亮,刘恩梅,陈彤,张卫社,张崇凡,朱冠男,王启鸣,孟文勃,梁远波,靳英辉,王伟,邢丹,田金徽,马彬,王晓辉,宋旭萍,葛龙,杨克虎,刘晓清,魏均民,陈耀龙. 针对临床实践指南科学性、透明性和适用性的评级工具研发. 中华医学杂志. 2022(30): 2329-2337 .
    13. 任梦娟,杨楠,刘云兰,孙雅佳,史乾灵,周奇,王子君,陈耀龙. 2019年期刊公开发表的中国临床实践指南文献调查与评价——摘要报告现状分析. 协和医学杂志. 2022(05): 880-887 . 本站查看

    Other cited types(5)

Catalog

    Article Metrics

    Article views (774) PDF downloads (96) Cited by(18)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return
    x Close Forever Close