LIU Yunlan, ZHANG Jingyi, SHI Qianling, YANG Nan, WANG Zijun, LUO Xufei, REN Mengjuan, XUN Yangqin, ZHOU Qi, LIU Hui, LYU Meng, CHEN Yaolong. Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Methodological and Reporting Quality[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(2): 324-331. DOI: 10.12290/xhyxzz.2022-0027
Citation: LIU Yunlan, ZHANG Jingyi, SHI Qianling, YANG Nan, WANG Zijun, LUO Xufei, REN Mengjuan, XUN Yangqin, ZHOU Qi, LIU Hui, LYU Meng, CHEN Yaolong. Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Methodological and Reporting Quality[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(2): 324-331. DOI: 10.12290/xhyxzz.2022-0027

Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Methodological and Reporting Quality

Funds: 

National Social Science Fund of China 19ZDA142

National Key Research and Development Program of China 2018YFC1705500

Fundamental Research Funds for the Central Universities lzujbky-2021-ey13

More Information
  • Corresponding author:

    CHEN Yaolong, E-mail: chevidence@lzu.edu.cn

  • Received Date: January 15, 2022
  • Accepted Date: February 13, 2022
  • Available Online: March 13, 2022
  • Issue Publish Date: March 29, 2022
  •   Objective  To evaluate the methodological and reporting quality of Chinese clinical practice guidelines published in medical journals in 2019, so as to understand their current quality and provide suggestions for the improvement of guideline development.
      Methods  We used the AGREE Ⅱ tool and the RIGHT checkilist to assess the methodological and reporting quality of Chinese clinical practice guidelines respectively. The average score or average reporting rate was calculated for each domain and the overall. We used 60% as the qualified threshold.
      Results  A total of 226 guidelines meeting the criteria were included. The average score of AGREE Ⅱ was 22.3%, and the scores of six domains were as follows: 37.9% (scope and purpose), 23.2% (stakeholder involvement), 14.9% (rigour of development), 39.1% (clarity of presentation), 14.6% (applicability), and 22.5%(editorial independence). The average reporting rate of RIGHT was 33.9%, and the reporting rates of seven domains were as follows: 59.2% (basic information), 51.9% (background), 10.8% (evidence), 31.5% (recommendation), 4.4% (review and quality assurance), 22.3%(funding and declaration and management of interests), and 14.5% (other information). Compared to unregistered guidelines, 12 registered guidelines had a 24.3% higher mean score (48.3% vs. 24.0%) in AGREE Ⅱ and a 21.2% higher mean reporting rate (54.0% vs. 32.8%) in RIGHT.
      Conclusions  The overall methodological and reporting quality of Chinese clinical practice guidelines published in medical journals in 2019 were relatively low. Registered guidelines had higher overall scores than unregistered guidelines.
  • [1]
    Qaseem A, Forland F, Macbeth F, et al. Guidelines International Network: toward international standards for clinical practice guidelines[J]. Ann Intern Med, 2012, 156: 525-531. DOI: 10.7326/0003-4819-156-7-201204030-00009
    [2]
    陈耀龙, 王小琴, 王琪, 等. 遵循指南报告规范提升指南报告质量[J]. 中华内科杂志, 2018, 57: 168-170. DOI: 10.3760/cma.j.issn.0578-1426.2018.03.003

    Chen YL, Wang XQ, Wang Q, et al. Follow the guideline reporting standards to improve the quality of guideline reports[J]. Zhonghua Neike Zazhi, 2018, 57: 168-170. DOI: 10.3760/cma.j.issn.0578-1426.2018.03.003
    [3]
    Armstrong JJ, Goldfarb AM, Instrum RS, et al. Improve-ment evident but still necessary in clinical practice guideline quality: a systematic review[J]. J Clin Epidemiol, 2017, 81: 13-21. DOI: 10.1016/j.jclinepi.2016.08.005
    [4]
    Moher D, Schulz KF, Simera I, et al. Guidance for developers of health research reporting guidelines[J]. PLoS Med, 2010, 7: e1000217. DOI: 10.1371/journal.pmed.1000217
    [5]
    Brouwers MC, Kho ME, Browman GP, et al. AGREE Ⅱ: advancing guideline development, reporting and evaluation in health care[J]. CMAJ, 2010, 182: E839-E842. DOI: 10.1503/cmaj.090449
    [6]
    Chen YL, Yang KH, Marusic A, et al. A reporting tool for practice guidelines in health care: the RIGHT statement[J]. Ann Intern Med, 2017, 166: 128-132. DOI: 10.7326/M16-1565
    [7]
    Zhou Q, Wang ZJ, Shi QL, et al. Clinical Epidemiology in China series. Paper 4: The reporting and methodological quality of Chinese clinical practice guidelines published between 2014 and 2018: A systematic review[J]. J Clin Epidemiol, 2021, 140: 189-199. DOI: 10.1016/j.jclinepi.2021.08.013
    [8]
    李楠, 姚亮, 吴琼芳, 等. 2012~2013年中国大陆期刊发表临床实践指南质量评价[J]. 中国循证医学杂志, 2015, 15: 259-263. DOI: 10.7507/1672-2531.20150045

    Li N, Yao L, Wu QF, et al. Quality Evaluation of Clinical Practice Guidelines Published in. Journals of Mainland China during 2012—2013[J]. Zhongguo Xunzheng Yixue Zazhi, 2015, 15: 259-263. DOI: 10.7507/1672-2531.20150045
    [9]
    中华医学会杂志社指南与标准研究中心, 世界卫生组织指南实施与知识转化合作中心. 2020中华医学会系列杂志发表指南评价报告[J]. 中华医学杂志, 2021, 101: 1839-1847. DOI: 10.3760/cma.j.cn112137-20210402-00803

    Guidelines and Standards Research Center, Journal of the Chinese Medical Association, WHO Collaborating Center for Guideline Implementation and Knowledge Translation. The evaluation report of 2020 Chinese Medical Association series publishes guideline[J]. Zhonghua Yixue Zazhi, 2021, 101: 1839-1847. DOI: 10.3760/cma.j.cn112137-20210402-00803
    [10]
    Institute of Medicine. Clinical Practice Guidelines We Can Trust[M]. Washington DC: the National Academies Press, 2011.
    [11]
    王子君, 史乾灵, 刘云兰, 等. 2019年期刊公开发表的中国临床实践指南文献调查与评价——制订人员及工作组情况[J]. 协和医学杂志, 2021, 12: 552-559. DOI: 10.12290/xhyxzz.2021-0438

    Wang ZJ, Shi QL, Liu YL, et al. Investigation and Evaluation of Chinese C linical Practice Guidelines Published in Medical Journals in 2019: Status of the Auth orship and Guideline Development Group[J]. Xiehe Yixue Zazhi, 2021, 12: 552-559. DOI: 10.12290/xhyxzz.2021-0438
    [12]
    Lin I, Wiles LK, Waller R, et al. Poor overall quality of clinical practice guidelines for musculoskeletal pain: a systematic review[J]. Br J Sports Med, 2018, 52: 337-343. DOI: 10.1136/bjsports-2017-098375
    [13]
    Hoffmann-Eβer W, Siering U, Neugebauer EAM, et al. Systematic review of current guideline appraisals performed with the Appraisal of Guidelines for Research & Evaluation Ⅱ instrument—A third of AGREE Ⅱ users apply a cut-off for guideline quality[J]. J Clin Epidemiol, 2018, 95: 120-127. DOI: 10.1016/j.jclinepi.2017.12.009
    [14]
    Molino CGRC, Leite-Santos NC, Gabriel FC, et al. Factors associated with high-quality guidelines for the pharmacologic management of chronic diseases in primary care: a systematic review[J]. JAMA Intern Med, 2019, 179: 553-560. DOI: 10.1001/jamainternmed.2018.7529
    [15]
    Wang XQ, Zhou Q, Chen YL, et al. Using RIGHT (Reporting Items for Practice Guidelines in Healthcare) to evaluate the reporting quality of WHO guidelines[J]. Health Res Policy Syst, 2020, 18: 75. DOI: 10.1186/s12961-020-00578-w
    [16]
    Chen YL, Yao L, Xiao XJ, et al. Quality assessment of clinical guidelines in China: 1993—2010[J]. Chin Med J (Engl), 2012, 125: 3660-3664.
    [17]
    韦当, 王小琴, 吴琼芳, 等. 2011年中国临床实践指南质量评价[J]. 中国循证医学杂志, 2013, 13: 760-763. DOI: 10.7507/1672-2531.20130134

    Wei D, Wang XQ, Wu QF, et al. Quality Evaluation on Chinese Clinical Practice guidelines in 2011[J]. Zhongguo Xunzheng Yixue Zazhi, 2013, 13: 760-763. DOI: 10.7507/1672-2531.20130134
    [18]
    王云云, 靳英辉, 陈耀龙, 等. 循证临床实践指南推荐意见形成的方法分析[J]. 中国循证医学杂志, 2017, 17: 1085-1092. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201709015.htm

    Wang YY, Jin YH, Chen YL, et al. The methodology of recommendations in evidence-based clinical practice guide-line[J]. Zhongguo Xunzheng Yixue Zazhi, 2017, 17: 1085-1092. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201709015.htm
    [19]
    靳英辉, 赵志慧, 黄粲然, 等. 临床实践指南实施性评价工具的研制和验证评价[J]. 中国循证医学杂志, 2022, 22: 111-119.

    Jin YH, Zhao ZH, Huang CR, et al. Development and validation for evaluation of an evaluation tool for guideline implementation[J]. Zhongguo Xunzheng Yixue Zazhi, 2022, 22: 111-119.
    [20]
    Wang DQ, Huang Q, Huang X, et al. Knowledge of and Compliance With Guidelines in the Management of Non-Muscle-Invasive Bladder Cancer: A Survey of Chinese Urologists[J]. Front Oncol, 2021, 11: 735704. DOI: 10.3389/fonc.2021.735704
    [21]
    Traversy G, Barnieh L, Akl EA, et al. Managing conflicts of interest in the development of health guidelines[J]. CMAJ, 2021, 193: E49-E54. DOI: 10.1503/cmaj.200651
    [22]
    Chen YL, Guyatt GH, Munn Z, et al. Clinical Practice Guidelines Registry: Toward Reducing Duplication, Improving Collaboration, and Increasing Transparency[J]. Ann Intern Med, 2021, 174: 705-707. DOI: 10.7326/M20-7884
  • Related Articles

    [1]YAN Xinchun, HUO Li. Evaluation of Von Hippel-Lindau Syndrome Through Novel Small Molecular Tracer 68Ga-NY104 PET/CT Imaging[J]. Medical Journal of Peking Union Medical College Hospital, 2024, 15(4): 911-915. DOI: 10.12290/xhyxzz.2024-0216
    [2]WU Haiting, LI Hang. ANCA Associated Vasculitis Treated with Ultra-low Dose Rituximab: A Case Report[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(6): 1330-1334. DOI: 10.12290/xhyxzz.2023-0263
    [3]ZHANG Lu, LI Jian. Castleman Disease in China: State-of-the-art Technology Before the Era of IL-6 Targeted Therapy[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(5): 911-914. DOI: 10.12290/xhyxzz.2023-0227
    [4]ZHAO Zhe, TANG Yan, ZHOU Jingya, CHEN Xiaoguang, ZHANG Lei, CHEN Limeng, YUAN Tao. Analysis of Clinical Manifestations and Drug Therapies of Gitelman Syndrome[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(2): 277-286. DOI: 10.12290/xhyxzz.2021-0180
    [5]Xiao-bo ZHANG, Zheng-yu JIN. Does Acute Cerebral Venous Sinus Thrombosis Require Endovascular Treatment?[J]. Medical Journal of Peking Union Medical College Hospital, 2020, 11(2): 140-143. DOI: 10.3969/j.issn.1674-9081.20190271
    [6]Ming-sheng MA, Xü-de ZHANG, Min WEI, Shi-min ZHAO, Zheng-qing QIU. Efficacy of Low Dose Corticosteroid Therapy in Duchenne Muscular Dystrophy[J]. Medical Journal of Peking Union Medical College Hospital, 2014, 5(4): 384-388. DOI: 10.3969/j.issn.1674-9081.2014.04.006
    [7]Ying ZHANG, Jin-song GAO, Jun-tao LIU, Hai-yuan LIU, Ying-na SONG, Xiao-ming GONG, Zhi-jing SUN. Effectiveness of B-lynch Suture in Treatment and Prevention of Postpartum Hemorrhage[J]. Medical Journal of Peking Union Medical College Hospital, 2013, 4(2): 174-177. DOI: 10.3969/j.issn.1674-9081.2013.02.019
    [8]Ya-gang ZUO, Hong-wei WANG, Jia-bi WANG. Dual-wavelength Laser with 595 nm and 1064 nm Combination for Resistant Port-wine Stains[J]. Medical Journal of Peking Union Medical College Hospital, 2012, 3(4): 386-389. DOI: 10.3969/j.issn.1674-9081.2012.04.005
    [9]Jie LIU, Yue-ping ZENG, Chun-xia HE, Qin LONG, Hong-zhong JIN, Qiu-ning SUN. Corticosteroids plus Intravenous Immunoglobulin in the Treatment of 7 Cases with Stevens-Johnson Syndrome and Toxic Epidermal Necrolysis[J]. Medical Journal of Peking Union Medical College Hospital, 2012, 3(4): 381-385. DOI: 10.3969/j.issn.1674-9081.2012.04.004
    [10]Shuai TANG, Jie YI, Yu-guang HUANG. Cardiovascular Responses of Intubation with Shikani Seeing Optical Stylet and Macintosh Laryngoscope[J]. Medical Journal of Peking Union Medical College Hospital, 2012, 3(3): 314-317. DOI: 10.3969/j.issn.1674-9081.2012.03.015
  • Cited by

    Periodical cited type(1)

    1. 任姣姣,张茜,高红,齐晶,白瑞北,李红娟,王朝晖. 维生素D调节肠道菌群改善孤独症谱系障碍儿童临床症状. 中国妇幼健康研究. 2025(01): 74-80 .

    Other cited types(1)

Catalog

    Article Metrics

    Article views (839) PDF downloads (97) Cited by(2)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return
    x Close Forever Close