Email Alert RSS
Volume 14 Issue 5
Sep.  2023
Turn off MathJax
Article Contents
Abstract
References
LIANG Changhao, YIN Guanxiang, WANG Yaqi, LIU Siqi, GAO Yicheng, LIU Pengwei, SU Xiangfei, FEI Yutong. Application of Delphi Method in the Development and Revision of Clinical Practice Guidelines of Traditional Chinese Medicine: Process and Suggestions[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(5): 1084-1090. DOI: 10.12290/xhyxzz.2022-0649
Citation: LIANG Changhao, YIN Guanxiang, WANG Yaqi, LIU Siqi, GAO Yicheng, LIU Pengwei, SU Xiangfei, FEI Yutong. Application of Delphi Method in the Development and Revision of Clinical Practice Guidelines of Traditional Chinese Medicine: Process and Suggestions[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(5): 1084-1090. DOI: 10.12290/xhyxzz.2022-0649
shu

Application of Delphi Method in the Development and Revision of Clinical Practice Guidelines of Traditional Chinese Medicine: Process and Suggestions

  • 1.

    Center for Evidence-based Medicine, Beijing University of Traditional Chinese Medicine, Beijing 100029, China

  • 2.

    School of Traditional Chinese Medicine, Beijing University of Traditional Chinese Medicine, Beijing 100029, China

  • 3.

    China Association of Chinese Medicine, Beijing 100000, China

  • 4.

    International Institute of Evidence-based Chinese Medicine, Beijing University of Traditional Chinese Medicine, Beijing 100029, China

  • 5.

    Beijing GRADE Center, Beijing 100029, China

Funds: 

Xinjiang Uygur Autonomous Region Key Research and Development Program 2022B03011-4

China Association of Traditional Chinese Medicine Research and Evaluation Special Project CACMRE2021-A-04

More Information
  • Corresponding author:

    FEI Yutong, E-mail: yutong_fei@163.com

  • Received Date: November 14, 2022
  • Accepted Date: January 15, 2023
  • Available Online: May 30, 2023
  • Issue Publish Date: September 29, 2023
    Graphical Abstract
    • Abstract
  • In the process of developing clinical practice guidelines, consensus method is essential to determine clinical problems and recommendations, among which Delphi method and modified Delphi method are the most common. Therefore, scientific and standardized application of Delphi method to reach a consensus (such as expert selection, process design) has become an important topic in urgent need of study. In the process of using Delphi method, it is necessary to refer to mature methodological suggestions to make theconsensus process structured and transparent. This article focuses on the key elements of Delphi method in the development of clinical practice guidelines, and elaborates its basic methods and processes, including the number, composition, standards and selection methods of the "expert group", as well as the key points of patients' participation. In terms of technical points, anonymity, consensus threshold and time control are described. Furthermore, the limitations of Delphi method and the highlights of the report are presented, in order to promote the standardized application of Delphi method in the development of the guidelines.
    • FullText(HTML)
    • References (49)
  • [1]
    Dalkey N. An experimental study of group opinion: The Delphi method[J]. Futures, 1969, 1: 408-426. DOI: 10.1016/S0016-3287(69)80025-X
    [2]
    Black N, Murphy M, Lamping D, et al. Consensus development methods: a review of best practice in creating clinical guidelines[J]. J Health Serv Res Policy, 1999, 4: 236-248. DOI: 10.1177/135581969900400410
    [3]
    Fink A, Kosecoff J, Chassin M, et al. Consensus methods: characteristics and guidelines for use[J]. Am J Public Health, 1984, 74: 979-983. DOI: 10.2105/AJPH.74.9.979
    [4]
    Nair R, Aggarwal R, Khanna D. Methods of formal consensus in classification/diagnostic criteria and guideline development[J]. Semin Arthritis Rheum, 2011, 41: 95-105. DOI: 10.1016/j.semarthrit.2010.12.001
    [5]
    Steurer J. The Delphi method: an efficient procedure to generate knowledge[J]. Skeletal Radiol, 2011, 40: 959-961. DOI: 10.1007/s00256-011-1145-z
    [6]
    梁昌昊, 夏如玉, 黄子玮, 等. 共识法在中医临床实践指南及专家共识中的应用及方法学报告特征分析[J]. 中医杂志, 2022, 63: 26-34. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZYZ202201008.htm
    [7]
    Diamond IR, Grant RC, Feldman BM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies[J]. J Clin Epidemiol, 2014, 67: 401-409. DOI: 10.1016/j.jclinepi.2013.12.002
    [8]
    Sandford BA, Hsu CC. The Delphi Technique: Making Sense of Consensus[J]. Pract Assess Res Evaluation, 2007, 26: 289-304.
    [9]
    Keeney S, Hasson F, Mckenna H. Consulting the oracle: ten lessons from using the Delphi technique in nursing research[J]. J Adv Nurs, 2010, 53: 2.
    [10]
    Gaakeer MI, Veugelers R, Patka P, et al. On behalf of the Dutch ED Study Group. Minimum operational standards for 24/7 available emergency departments in the Nether-lands: a first step taken by emergency physicians using an e-Delphi approach[J]. Eur J Emerg Med, 2019, 26: 86-93. DOI: 10.1097/MEJ.0000000000000494
    [11]
    曾照云, 程晓康. 德尔菲法应用研究中存在的问题分析: 基于38种CSSCI(2014—2015)来源期刊[J]. 图书情报工作, 2016, 60: 116-120. https://www.cnki.com.cn/Article/CJFDTOTAL-TSQB201616020.htm
    [12]
    Mckenna H, Keeney S, Hasson F. The Delphi Technique in Nursing and Health Research[M]. New Jersey: John Wiley & Sons Ltd, 2011: 1-17.
    [13]
    廖星, 谢雁鸣, 张俊华, 等. 中医临床实践指南制修订中专家共识技术规范[J]. 中国中药杂志, 2019, 44: 4354-4359. https://www.cnki.com.cn/Article/CJFDTOTAL-ZGZY201920034.htm
    [14]
    McMillan SS, King M, Tully MP. How to use the nominal group and Delphi techniques[J]. Int J Clin Pharm, 2016, 38: 655-662.
    [15]
    McKenna HP. The Delphi technique: a worthwhile research approach for nursing?[J]. J Adv Nurs, 1994, 19: 1221-1225. DOI: 10.1111/j.1365-2648.1994.tb01207.x
    [16]
    Wolf R. The decision Delphi[J]. Technol Forecast Soc Change, 1979, 15: 159-169. DOI: 10.1016/0040-1625(79)90011-8
    [17]
    Crisp J, Pelletier D, Duffield C, et al. The Delphi method?[J]. Nurs Res, 1997, 46: 116-118. DOI: 10.1097/00006199-199703000-00010
    [18]
    Beretta R. A critical review of the Delphi technique[J]. Nurse Res, 1996, 3: 79-89. DOI: 10.7748/nr.3.4.79.s8
    [19]
    Dean P, Schumacher D, Florin TA. Defining Pneumonia Severity in Children: A Delphi Study[J]. Pediatr Emerg Care, 2021, 37: e1482-e1490. DOI: 10.1097/PEC.0000000000002088
    [20]
    Jordans IPM, de Leeuw RA, Stegwee SI, et al. Sono-graphic examination of uterine niche in non-pregnant women: a modified Delphi procedure[J]. Ultrasound Obstet Gynecol, 2019, 53: 107-115. DOI: 10.1002/uog.19049
    [21]
    Gordon T, Pease A. RT Delphi: An efficient, "round-less" almost real time Delphi method[J]. Technol Forecast Soc Change, 2006, 73: 321-333. DOI: 10.1016/j.techfore.2005.09.005
    [22]
    Varndell W, Fry M, Elliott D. Applying real-time Delphi methods: development of a pain management survey in emergency nursing[J]. BMC Nurs, 2021, 20: 149. DOI: 10.1186/s12912-021-00661-9
    [23]
    Guyatt GH, Oxman AD, Kunz R, et al. Going from evidence to recommendations[J]. BMJ, 2008, 336: 1049-1051. DOI: 10.1136/bmj.39493.646875.AE
    [24]
    Moberg J, Oxman AD, Rosenbaum S, et al. The GRADE Evidence to Decision (EtD) framework for health system and public health decisions[J]. Health Res Policy Syst, 2018, 16: 45. DOI: 10.1186/s12961-018-0320-2
    [25]
    Guyatt G, Oxman AD, Akl EA, et al. GRADE guide-lines: 1. Introduction-GRADE evidence profiles and summary of findings tables[J]. J Clin Epidemiol, 2011, 64: 383-394. DOI: 10.1016/j.jclinepi.2010.04.026
    [26]
    WHO. Handbook for Guideline Development[EB/OL]. (2014-12-08)[2023-05-28]. https://www.who.int/publications/i/item/9789241548960.
    [27]
    胡晶, 张会娜, 康群甫, 等. 共识法在中医临床实践指南制定中的应用[J]. 中医杂志, 2016, 57: 1658-1661. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZYZ201619010.htm
    [28]
    Goodman CM. The Delphi technique: a critique[J]. J Adv Nurs, 2010, 12: 729-734.
    [29]
    Ishikawa A, Amagasa M, Shiga T, et al. The max-min Delphi method and fuzzy Delphi method via fuzzy integration[J]. Fuzzy Sets Syst, 1993, 55: 241-253. DOI: 10.1016/0165-0114(93)90251-C
    [30]
    NICE. Developing Nice Guidelines the Manual[EB/OL]. (2014-10-31)[2023-05-28]. https://www.nice.org.uk/process/pmg20/chapter/introduction.
    [31]
    周芬. 患者及公众参与临床实践指南构建及其方法的研究进展[J]. 护理学报, 2020, 27: 14-17. https://www.cnki.com.cn/Article/CJFDTOTAL-NFHL202005006.htm
    [32]
    Roman BR, Feingold J. Patient-centered Guideline Develop-ment Best Practices Can Improve the Quality and Impact of Guidelines[J]. Otolaryngol Head Neck Surg, 2014, 151: 530-532. DOI: 10.1177/0194599814544878
    [33]
    靳英辉, 王丹琦, 李艳, 等. 临床实践指南制定方法: 国内外临床实践指南制定手册概要[J]. 中国循证心血管医学杂志, 2018, 10: 1-10. https://www.cnki.com.cn/Article/CJFDTOTAL-PZXX201801001.htm
    [34]
    解染, 陈耀龙, 陈昊, 等. 循证指南制定中患者价值观和偏好的研究方法[J]. 中国循证医学杂志, 2015, 15: 586-591. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201505015.htm
    [35]
    宁允, 李文姣, 程侣, 等. 患者及公众参与患者指南制定的思考[J]. 中国循证心血管医学杂志, 2020, 12: 908-911. https://www.cnki.com.cn/Article/CJFDTOTAL-PZXX202008004.htm
    [36]
    张颖, 季聪华, 李秋爽, 等. 中医临床实践指南制修订中德尔菲法的统计分析方法[J]. 中华中医药杂志, 2018, 33: 249-251. https://www.cnki.com.cn/Article/CJFDTOTAL-BXYY201801064.htm
    [37]
    付红艳. 关于变异系数、偏度系数和峰度系数的U统计量检验法[D]. 长春: 吉林师范大学, 2014.
    [38]
    Dai F, Wei K, Chen Y, et al. Construction of an index system for qualitative evaluation of undergraduate nursing students innovative ability: A Delphi study[J]. J Clin Nurs, 2019, 28: 4379-4388.
    [39]
    Li Y, Ehiri J, Hu D, et al. Framework of behavioral indicators for outcome evaluation of TB health promotion: a Delphi study of TB suspects and Tb patients[J]. BMC Infect Dis, 2014, 14: 268.
    [40]
    刘弘. 关于痛经辨证分型的专家问卷分析[J]. 中医杂志, 2008, 49: 984-985. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZYZ200811010.htm
    [41]
    Green P. The Outdoor Leadership Handbook. A Manual for Leaders of Land-based Outdoor Pursuits in the Pacific Northwest[M]. Tacoma: Emergency Response Institute, 1982: 7-14.
    [42]
    Chen L, Wu Y, Wang S, et al. Construction of evidence-based practice competencies for nurses in China: A modified Delphi study[J]. Nurse Educ Today, 2021, 102: 104927.
    [43]
    Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique[J]. J Adv Nurs, 2000, 32: 1008-1015.
    [44]
    Martino JP. The Delphi method: Techniques and applica-tions[J]. Technol Forecast Soc Change, 1976, 8: 441-442.
    [45]
    Sandrey MA, Bulger SM. The Delphi Method: An App-roach for Facilitating Evidence Based Practice in Athletic Training[J]. Athl Train Educ J, 2008, 3: 135-142.
    [46]
    李博, 任晨儿, 刘阳. 辨证与厘清: 体育科学研究中"德尔菲法"应用存在的问题及程序规范[J]. 体育科学, 2021, 41: 89-97. https://www.cnki.com.cn/Article/CJFDTOTAL-TYKX202101011.htm
    [47]
    管慧, 戴国华, 高武霖, 等. 中医药临床研究中应用德尔菲法的系统评价[J]. 中国循证医学杂志, 2021, 21: 186-190. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ202102009.htm
    [48]
    Jünger S, Payne SA, Brine J, et al. Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological syste-matic review[J]. Palliat Med, 2017, 31: 684-706.
    [49]
    O'Connor N, Clark S. Beware bandwagons! The bandwagon phenomenon in medicine, psychiatry and management[J]. Australas Psychiatry, 2019, 27: 603-606.
    • Related Articles

  • Cited by

    Periodical cited type(20)

    1. 王建新，孙明月，吕行，郭曼萍，代欣玥，杨巧宁，申春悌，元唯安，王天芳，连凤梅，刘树林，张磊，谢雁鸣，王忠，王保和，黄宇虹，刘文娜，高蕊. 中医证候疗效评价量表研制指南. 中国新药杂志. 2025(02): 113-122 .
    2. 唐晓颇，姜泉. 基于临床需求的干燥综合征诊疗体系构建与示范应用. 中国中医基础医学杂志. 2025(02): 231-235 .
    3. 杨一玖，张海力，刘斌，梁宁，李慧珍，宋填，曹文杰，胡紫腾，马厚芳，王燕平，韩晟，史楠楠. 中成药特征价格变量指标体系构建研究. 中国卫生经济. 2025(02): 18-23 .
    4. 薛飞飞，郝闻致，陈家旭. 层次分析法在中医证候标准化研究的应用探讨. 中华中医药杂志. 2025(01): 271-274 .
    5. 潘轶竹，郭默宁，蒋锋，李晓虹，王明刚，肖存利. DRGs背景下基于改良德尔菲法的精神专科医院医疗绩效评价指标体系构建研究. 中国医疗管理科学. 2024(01): 105-111 .
    6. 刘晓雨，刘志华，李京璠，李润泽，王玉曼，薛滨清，张心千，杨倩，杜艳茹. 浊毒证诊断量表的研制与权重赋值——基于德尔菲法及层次分析法. 中医杂志. 2024(07): 684-690 .
    7. 胡卓慕，吴进，方玢茹，毛旭，郭莉萍，朱利明. 《中国叙事医学专家共识(2023)》的德尔菲法研究. 叙事医学. 2024(02): 105-112 .
    8. 黄栖，唐乐微，刘茹茹，林丹，黄佳丽，彭雯清，李一靖，陈燕燕，王毓琴. 基于德尔菲法初步构建急性前葡萄膜炎患者报告结局量表. 中华眼视光学与视觉科学杂志. 2024(07): 507-515 .
    9. 王雅琪，高一城，苏澄元，刘美君，李迅，费宇彤. 临床实践指南中临床问题结构化分级及评价. 中国循证医学杂志. 2024(07): 827-831 .
    10. 梁昌昊，尹丁冉，刘美君，尹冠翔，李迅，王雅琪，刘思岐，佟敏，刘鹏伟，苏祥飞，费宇彤. 中医药指南制订中共识法应用关键要素的定性研究. 协和医学杂志. 2024(04): 942-952 . 本站查看
    11. 车前子，郭敬，佟琳，蔡秋杰，陈琳，李慧珍，张海力，郑丹平，胡明智，宋填，程翠翠，蒋寅，刘晨曦，胡妮娜，张华敏，史楠楠. 基于人用经验的中药新药临床定位研究策略与方法. 中国中医基础医学杂志. 2024(08): 1337-1340 .
    12. 赵越，李宵，薛朝军，白万军，董占军. 医疗机构静脉用药评价与遴选专家共识. 医药导报. 2024(09): 1369-1375 .
    13. 彭蓉晏，孙凌云，刘稼玺，庞英，王子旭，唐末，丁亚丛，梁昌昊，唐丽丽，杨宇飞. 基于改良德尔菲法构建《早中期结直肠癌根治术后中西医结合心理康复干预指南》临床问题. 中国中西医结合杂志. 2024(08): 912-920 .
    14. 马思成，张宸铭，唐硕彤，郝晓慧，刘稳榜，马瑞敏，胡静，王祖龙，孙自学. 中医药治疗精子DNA损伤的德尔菲研究. 中华男科学杂志. 2024(09): 854-860 .
    15. 周旋，方格，马庆宇，李晓娟，李永欣，胡志希，李先涛，陈家旭. 基于德尔菲法和层次分析法的气滞证诊断条目筛选及权重确定. 中医杂志. 2024(21): 2211-2216 .
    16. 吴雪，王文雅，廖星，王永炎. 中医药卫生技术评估实施规范的构建与内容介绍. 中国中药杂志. 2024(20): 5643-5651 .
    17. 孟庆莉，姜德春，李达，纪立伟，刘宪军，冀召帅，陶小妹，王海莲，于晓佳，贾自力，张景富，陈世财，顾红燕. 北京地区基层医疗机构药物治疗管理服务门诊工作实施评价体系构建——基于德尔菲法和层次分析法. 中国医院药学杂志. 2024(24): 2909-2914 .
    18. 中国医师协会外科医师分会肥胖代谢病综合管理与护理专家工作组，中国医师协会外科医师分会肥胖和代谢病外科专家工作组，中国肥胖代谢外科研究协作组. 肥胖代谢外科医学科普中国专家共识(2024版). 中华消化外科杂志. 2024(12): 1471-1478 .
    19. 张红银，朱红梅，张慧琴，姚宏文，朱桂荣，李琳. 云南省静脉用药调配中心工作人员细胞毒药物职业暴露及防护调查分析. 昆明医科大学学报. 2023(07): 105-112 .
    20. 张佳佳，杨超，杜世豪，陈晟，杜朔，赵吉平. 基于制定WFAS《女性尿失禁临床实践指南》探讨改良德尔菲法在针灸指南推荐意见研制过程中的应用价值. 中国针灸. 2023(12): 1449-1453 .

    Other cited types(5)

Catalog

    Get Citation
    PDF
    XML

    Article Metrics

    Article views (869) PDF downloads (92) Cited by(25)
    Related
    Links: National Health Commission of the People's Republic of China Chinese Academy of Medical Sciences(CAMS) AMLC Check CNKI Database CNKI Term Online Chinese General Practice
    Address：Room 302,Third Floor,Building 7, No. 1 Shuaifuyuan, Wangfujing, Dongcheng District, Beijing 100730, China
    Tel：010-69154261/4262
    E - mail：medj@pumch.cn mjpumch@126.com
    Copyright of website：Editorial Office of Medical Journal of Peking Union Medical College Hospital

    Supported by: Beijing Renhe Information Technology Co., Ltd.  Baidu Analytics

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return
    x Close Forever Close