Li-fan ZHANG, Xiao-qing LIU. Study Design and Clinical Practice of Diagnostic Accucary Test[J]. Medical Journal of Peking Union Medical College Hospital, 2020, 11(1): 96-101. DOI: 10.3969/j.issn.1674-9081.20190276
Citation: Li-fan ZHANG, Xiao-qing LIU. Study Design and Clinical Practice of Diagnostic Accucary Test[J]. Medical Journal of Peking Union Medical College Hospital, 2020, 11(1): 96-101. DOI: 10.3969/j.issn.1674-9081.20190276

Study Design and Clinical Practice of Diagnostic Accucary Test

More Information
  • Corresponding author:

    LIU Xiao-qing Tel: 86-10-69155087, E-mail: liuxq@pumch.cn

  • Received Date: December 10, 2019
  • Issue Publish Date: January 29, 2020
  • New diagnostic methods must be evaluated by rigorously designed diagnostic accuracy studies before clinical implementation. Designing a diagnostic accuracy study includes 8 procedures:constructing the research question with the PICOS (P:Patient; I:Intervention; C:Comparison; O:Outcome; S:Study design)framework, identifying an appropriate gold standard, choosing a representative patient sample, estimating the sample size, interpreting results of diagnostic tests and the gold standard blind to the other, setting up the optimal threshold, evaluating the diagnostic accuracy, and finally drafting a report according to the standards for reporting diagnostic accuracy. The accuracy of diagnostic tests includes sensitivity, specificity, predictive value (PV), and likelihood ratio (LR). The LR estimated by diagnostic tests can move clinicians from the pretest probability to a posttest probability. If the clinical setting is similar to that of the study and the patient meets all eligibility criteria of the study, the LR may facilitate the diagnostic process in clinical practice.
  • [1]
    Yerushalmy J. Statistical problems in assessing methods of medical diagnosis, with special reference to X-ray techniques[J]. Public Health Rep, 1947, 62:1432-1449. DOI: 10.2307/4586294
    [2]
    Vecchio TJ. Predictive value of a single diagnostic test in unselected populations[J]. N Engl J Med, 1966, 274:1171-1173. DOI: 10.1056/NEJM196605262742104
    [3]
    Grimes DA, Schulz KF. Refining clinical diagnosis with likelihood ratios[J]. Lancet, 2005, 365:1500-1505. DOI: 10.1016/S0140-6736(05)66422-7
    [4]
    Sackett DL, Haynes RB. The architecture of diagnostic research[J]. BMJ, 2002, 324:539-541. DOI: 10.1136/bmj.324.7336.539
    [5]
    Lijmer JG, Mol BW, Heisterkamp S, et al. Empirical evidence of design-related bias in studies of diagnostic tests[J]. JAMA, 1999, 282:1061-1066. DOI: 10.1001/jama.282.11.1061
    [6]
    Glasziou P, Irwig L, Deeks JJ. When should a new test become the current reference standard?[J]. Ann Intern Med, 2008, 149:816-822. DOI: 10.7326/0003-4819-149-11-200812020-00009
    [7]
    Worster A, Carpenter C. Incorporation bias in studies of diagnostic tests:how to avoid being biased about bias[J]. CJEM, 2008, 10:174-175. DOI: 10.1017/S1481803500009891
    [8]
    Weiss NS. Control definition in case-control studies of the efficacy of screening and diagnostic testing[J]. Am J Epidemiol, 1983, 118:457-460. DOI: 10.1093/oxfordjournals.aje.a113650
    [9]
    Whiting PF, Rutjes AW, Westwood ME, et al. A systematic review classifies sources of bias and variation in diagnostic test accuracy studies[J]. J Clin Epidemiol, 2013, 66:1093-1104. DOI: 10.1016/j.jclinepi.2013.05.014
    [10]
    Rutjes AW, Reitsma JB, Di Nisio M, et al. Evidence of bias and variation in diagnostic accuracy studies[J]. CMAJ, 2006, 174:469-476. DOI: 10.1503/cmaj.050090
    [11]
    Hajian-Tilaki K. Sample size estimation in diagnostic test studies of biomedical informatics[J]. J Biomed Inform, 2014, 48:193-204. DOI: 10.1016/j.jbi.2014.02.013
    [12]
    Simel DL, Samsa GP, Matchar DB. Likelihood ratios with confidence:sample size estimation for diagnostic test studies[J]. J Clin Epidemiol, 1991, 44:763-770. DOI: 10.1016/0895-4356(91)90128-V
    [13]
    Whiting P, Rutjes AW, Reitsma JB, et al. Sources of variation and bias in studies of diagnostic accuracy:a systematic review[J]. Ann Intern Med, 2004, 140:189-202. DOI: 10.7326/0003-4819-140-3-200402030-00010
    [14]
    Leeflang MM, Rutjes AW, Reitsma JB, et al. Variation of a test's sensitivity and specificity with disease prevalence[J]. CMAJ, 2013, 185:E537-E544. DOI: 10.1503/cmaj.121286
    [15]
    Akobeng AK. Understanding diagnostic tests 1:sensitivity, specificity and predictive values[J]. Acta Paediatr, 2007, 96:338-341. DOI: 10.1111/j.1651-2227.2006.00180.x
    [16]
    Akobeng AK. Understanding diagnostic tests 2:likelihood ratios, pre- and post-test probabilities and their use in clinical practice[J]. Acta Paediatr, 2007, 96:487-491. DOI: 10.1111/j.1651-2227.2006.00179.x
    [17]
    Bossuyt PM, Reitsma JB, Bruns DE, et al. Towards complete and accurate reporting of studies of diagnostic accuracy:the STARD initiative[J]. BMJ, 2003, 326:41-44. DOI: 10.1136/bmj.326.7379.41
    [18]
    Bossuyt PM, Reitsma JB, Bruns DE, et al. STARD 2015:an updated list of essential items for reporting diagnostic accuracy studies[J]. BMJ, 2015, 351:h5527. http://www.bmj.com/content/351/bmj.h5527
    [19]
    王波, 詹思延.如何撰写高质量的流行病学研究论文第三讲诊断试验准确性研究的报告规范——STARD介绍[J].中华流行病学杂志, 2006, 27:909-912. http://d.wanfangdata.com.cn/Periodical/zhlxbx200610020
    [20]
    朱一丹, 李会娟, 武阳丰.诊断准确性研究报告规范(STARD)2015介绍与解读[J].中国循证医学杂志, 2016, 16:730-735. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgxzyx201606017
    [21]
    孙凤.医学研究报告规范解读[M].北京:北京大学医学出版社, 2015:181-188.
    [22]
    Whiting P, Rutjes AW, Reitsma JB, et al. The development of QUADAS:a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews[J]. BMC Med Res Methodol, 2003, 3:25. DOI: 10.1186/1471-2288-3-25
    [23]
    Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2:a revised tool for the quality assessment of diagnostic accuracy studies[J]. Ann Intern Med, 2011, 155:529-536. DOI: 10.7326/0003-4819-155-8-201110180-00009
    [24]
    Schunemann HJ, Oxman AD, Brozek J, et al. Grading quality of evidence and strength of recommendations for diagnostic tests and strategies[J]. BMJ, 2008, 336:1106-1110. https://core.ac.uk/display/77296584
    [25]
    Richardson WS. Where do pretest probabilities come from?[J]. Evid Based Med, 1999, 4:68-69. http://www.onacademic.com/detail/journal_1000038118494510_f71d.html
    [26]
    Fagan TJ. Letter:Nomogram for Bayes theorem[J]. N Engl J Med, 1975, 293:257. http://europepmc.org/abstract/med/1143310
    [27]
    Shi X, Zhang L, Zhang Y, et al. Utility of T-Cell Interferon-gamma Release Assays for Etiological Diagnosis of Classic Fever of Unknown Origin in a High Tuberculosis Endemic Area-a pilot prospective cohort[J]. PLoS One, 2016, 11:e0146879. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4718655/
  • Related Articles

    [1]ZHOU Qi, LI Qinyuan, HE Hongfeng, PENG Dongrui, ZHANG Huayu, WANG Ye, YANG Kehu, CHEN Yaolong. A Standardized Approach to Recommending Diagnostic Criteria in Chinese Clinical Practice Guidelines[J]. Medical Journal of Peking Union Medical College Hospital, 2024, 15(6): 1432-1438. DOI: 10.12290/xhyxzz.2024-0729
    [2]GUO Qiangqiang, XUN Yangqin, LIU Hui, LUO Xufei, YU Xuan, SHI Qianling, ZHOU Qi, WANG Zijun, CHEN Yaolong. Registration of Clinical Practice Guidelines[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(1): 203-208. DOI: 10.12290/xhyxzz.2022-0521
    [3]BAI Xiaoyin, YANG Hong. Interpretation of Guidance for the Design and Implementation of Drug Clinical Studies: Based on E8 (R1): General Considerations for Clinical Trials[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(1): 81-85. DOI: 10.12290/xhyxzz.2022-0611
    [4]SHEN Quan, LUO Xufei, SHI An'ya, LEI Ruobing, LYU Meng, HOU Tianchun, ZHANG Shu, LIU Enmei, LI Qiu, CHEN Yaolong. Design and Thought for Establishing Decision Trees Based on Clinical Practice Guidelines[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(6): 1081-1087. DOI: 10.12290/xhyxzz.2022-0355
    [5]LIU Yuan, ZHAO Lin. Update and Interpretation of 2022 National Comprehensive Cancer Network Clinical Practice Guidelines for Gastric Cancer[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(6): 999-1004. DOI: 10.12290/xhyxzz.2022-0271
    [6]Gynecological Oncology Society of Chinese Medical Association. Clinical Practice Guidelines for Immune Checkpoint Inhibitor Therapy in Gynecological Tumors[J]. Medical Journal of Peking Union Medical College Hospital, 2021, 12(6): 854-880. DOI: 10.12290/xhyxzz.2021-0683
    [7]YANG Nan, CHEN Yaolong. Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019[J]. Medical Journal of Peking Union Medical College Hospital, 2021, 12(3): 407-410. DOI: 10.12290/xhyxzz.2021-0323
    [8]Gynecological Oncology Society of Chinese Medical Association, Chinese Society for Colposcopy and Cervical Pathology. Chinese Expert Consensus on Clinical Application of Human Papilloma Virus Vaccine[J]. Medical Journal of Peking Union Medical College Hospital, 2021, 12(2): 189-201. DOI: 10.12290/xhyxzz.2021-0082
    [9]Yao-long CHEN, Xian-zhuo ZHANG, Qi ZHOU, Xiao-xia PENG, Yan-ming XIE, Jing HU, Liang FU, Ke-hu YANG. Adaptation of Clinical Practice Guidelines[J]. Medical Journal of Peking Union Medical College Hospital, 2020, 11(1): 102-108. DOI: 10.3969/j.issn.1674-9081.20200001
    [10]Juan DU, Jia XU, Ye GUO, Feng ZHANG, Wei WU, Jian-ying LI, Yue LI, Jing JIN, Min CHENG, Wei CUI. Clinical Application of A Fully-automatic Urine Sediment Analyzer[J]. Medical Journal of Peking Union Medical College Hospital, 2014, 5(3): 290-296. DOI: 10.3969/j.issn.1674-9081.2014.03.009
  • Cited by

    Periodical cited type(19)

    1. 严广璇,王雪钰,王宇津,兰汀隆,聂文娟. 宏基因组二代测序对疑似骨关节结核患者的诊断价值. 中国防痨杂志. 2025(02): 175-180 .
    2. 王海谦,黄思瑞,黄晓强,朴胜华,荣向路,王超,郭姣. 糖尿病性冠心病湿热证诊断标准的量化诊断研究. 中国中医基础医学杂志. 2024(02): 263-268 .
    3. 刘轶凡,刘媛媛,黄为钧,傅强,赵进喜,黄延芹. 糖尿病肾脏病风邪证候量表信效度评价与诊断阈值的探讨. 时珍国医国药. 2024(14): 3290-3294 .
    4. 刘晓龙,邬娜,李亚斐. 诊断试验准确性研究的设计类型和选择. 中华流行病学杂志. 2024(12): 1705-1714 .
    5. 徐超,郑生伟,方丽,李冉,吕允凤. 病理图像人工智能分析软件临床评价思考. 中国数字医学. 2023(05): 23-26+31 .
    6. 汪波,李阳,肖丽,徐洪涛,咸建春. 血小板压积对ALT小于2倍正常值上限慢性HBV感染者肝纤维化程度的预测价值分析. 中华肝脏病杂志. 2023(08): 862-868 .
    7. 庄静,王奕萍,张婷,缪青. 多模态超声对乳腺非肿块样病变的诊断价值. 医学研究生学报. 2022(03): 300-302 .
    8. 杨秋玉,陆瑶,田晨,赖鸿皓,谢欣玲,田金徽,李霓,李江,葛龙. 诊断试验准确性比较研究:研究设计. 中国循证医学杂志. 2022(06): 739-744 .
    9. 梅仲秋,曾婷,蔡新婷,胡本骄,李胜明,周杰,贾铁武. 间接血凝试验对洞庭湖区渔船民血吸虫感染的诊断效能. 中国血吸虫病防治杂志. 2022(03): 300-306 .
    10. 高飞,胡泽斌,贾峥,董喆,黄杰. Fuchs角膜内皮营养不良tcf4基因变异检测国家参考品的研制. 中国医药生物技术. 2022(06): 542-544+555 .
    11. 田晨,杨秋玉,赖鸿皓,陆瑶,田金徽,李霓,王慧琳,郑亚迪,李江,申希平,葛龙. 诊断试验准确性比较研究的统计分析. 中国循证医学杂志. 2022(12): 1474-1482 .
    12. 谭朵廷,梁昊,余怡嫔,谈宇权,方格,钟俐芹,胡志希. 诊断试验中纳入、排除标准的报告质量评价. 湖南中医药大学学报. 2022(11): 1916-1921 .
    13. 黄丹,蒋红丽. 二维联合四维超声对胎儿畸形的早期诊断价值. 浙江实用医学. 2022(05): 392-395 .
    14. 张丹妮,沈理,张俊,倪艳. 胃超声检查对胃癌诊断价值的Meta分析. 中华医学超声杂志(电子版). 2021(04): 344-354 .
    15. 胡海殷,季昭臣,王虎城,王辉,郑文科,李先涛,张俊华. 火热炽盛证(实热火毒)诊断标准的建立及诊断阈值的探讨. 中医杂志. 2021(20): 1769-1775 .
    16. 韦焘,张璐平,黄芩,赵霞,何尔纯,刘敏,李红梅. 循证医学课程中证据分类的教学内容改革探索. 高教学刊. 2021(35): 112-115+119 .
    17. 徐超,何静云,方丽,李冉. 罕见病相关体外诊断试剂的临床试验要求. 国际检验医学杂志. 2020(24): 3045-3049 .
    18. 吕晗,王振常,刘晓清,孔媛媛,曾娜,李梦伊,赵鹏飞,尤红,杨正汉,张忠涛. 影像学检查的临床适用性评价:基于循证医学证据, 合理选择检查方法. 中华外科杂志. 2020(11): 831-834 .
    19. 吕晗,王振常,刘晓清,孔媛媛,曾娜,李梦伊,赵鹏飞,尤红,杨正汉,张忠涛. 影像学检查的临床适用性评价:基于循证医学证据, 合理选择检查方法. 中华外科杂志. 2020(11): E004-E004 .

    Other cited types(9)

Catalog

    Article Metrics

    Article views (2070) PDF downloads (636) Cited by(28)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return
    x Close Forever Close