HAO Ye, WANG Hao, LI Jiage. Interpretation On Sectoral Standard Artificial Intelligence Medical Device-Quality Requirements and Evaluation-Part 3: General Requirements for Data Annotation[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(6): 1185-1188. DOI: 10.12290/xhyxzz.2023-0463
Citation: HAO Ye, WANG Hao, LI Jiage. Interpretation On Sectoral Standard Artificial Intelligence Medical Device-Quality Requirements and Evaluation-Part 3: General Requirements for Data Annotation[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(6): 1185-1188. DOI: 10.12290/xhyxzz.2023-0463

Interpretation On Sectoral Standard Artificial Intelligence Medical Device-Quality Requirements and Evaluation-Part 3: General Requirements for Data Annotation

Funds: 

Key Technology Fund of National Institutes for Food and Drug Control GJJS-2022-3-1

More Information
  • Corresponding author:

    LI Jiage, E-mail: lijiage@nifdc.org.cn

  • Received Date: October 06, 2023
  • Accepted Date: October 29, 2023
  • Issue Publish Date: November 29, 2023
  • With the upgrading of machine learning technology, artificial intelligence has become an emerging direction in the field of medical devices. Especially in recent years, it has developed rapidly. In 2022, the National Medical Products Administration released the industry standard YY/T 1833 "Artificial Intelligence Medical Device-Quality Requirements and Evaluation" series, marking the initial establishment of a standard system for artificial intelligence medical devices in China. The standardization of data annotation is not only an important part of the standard system, but also determines the accuracy and reliability of reference standards, which has a significant impact on the quality of the dataset and product quality. Part 3 of "Artificial Intelligence Medical Device-Quality Requirements and Evaluation", a general requirement for data annotation, proposes the quality requirements for artificial intelligence medical devices in the data annotation process and standardizes the evaluation methods. This paper highlights its important contents, in order to better carry out product quality control and promote high-quality development of products and industries.
  • [1]
    王浩, 孟祥峰, 林晓兰, 等. 人工智能医疗器械数据集质控解决方案[J]. 医疗卫生装备, 2023, 44: 12-15. https://www.cnki.com.cn/Article/CJFDTOTAL-YNWS202302002.htm
    [2]
    唐娜, 王浩, 钟代笛. 人工智能医疗器械监管现状分析[J]. 医疗卫生装备, 2022, 43: 54-58, 68. https://www.cnki.com.cn/Article/CJFDTOTAL-YNWS202208011.htm
    [3]
    王浩, 李澍, 王晨希, 等. 人工智能医疗器械质量管理标准化趋势分析[J]. 中国医疗设备, 2021, 36: 20-23. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX202103005.htm
    [4]
    刘毅, 王浩, 李澍, 等. 人工智能医疗器械企业质量管理体系构建关键指标筛选研究[J]. 中国医疗设备, 2021, 36: 24-27, 43. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX202103006.htm
    [5]
    王浩, 唐桥虹, 郝烨, 等. 人工智能医疗器械标准体系设计探索[J]. 中国医疗设备, 2021, 36: 15-18, 28. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX202112003.htm
    [6]
    彭亮, 刘枭寅, 张宇晶, 等. 人工智能医疗器械国际监管比较研究[J]. 中国数字医学, 2023, 18: 1-7. https://www.cnki.com.cn/Article/CJFDTOTAL-YISZ202305001.htm
    [7]
    国家药品监督管理局. 人工智能医疗器械 质量要求和评价 第3部分: 数据标注通用要求[S]. YY/T 1833.3-2022.
    [8]
    王浩, 孟祥峰, 王权, 等. 人工智能医疗器械用数据集管理与评价方法研究[J]. 中国医疗设备, 2018, 33: 1-5. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX201812001.htm
    [9]
    蔡莉, 王淑婷, 刘俊晖, 等. 数据标注研究综述[J]. 软件学报, 2020, 31: 302-320. https://www.cnki.com.cn/Article/CJFDTOTAL-RJXB202002004.htm
    [10]
    王权, 王浩, 孟祥峰, 等. 人员管理对人工智能医疗器械用数据集质量的影响分析[J]. 中国医疗设备, 2018, 33: 6-9. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX201812002.htm
    [11]
    孟祥峰, 王浩, 李佳戈. 行业标准《人工智能医疗器械 质量要求和评价 第1部分: 术语》解析[J]. 协和医学杂志, 2023, 14: 1175-1179. DOI: 10.12290/xhyxzz.2023-0351
    [12]
    孟祥峰, 王浩, 张超, 等. 医学人工智能产品检测平台的设计[J]. 医疗卫生装备, 2023, 44: 1-7. https://www.cnki.com.cn/Article/CJFDTOTAL-YNWS202301016.htm
    [13]
    李澍, 王浩, 王晨希, 等. 人工智能医疗器械软件生产质量管理体系特殊要求研究[J]. 中国医疗设备, 2021, 36: 15-18, 22. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX202109005.htm
    [14]
    曾雪, 王浩, 李佳戈. 分析人工智能医疗器械环境特殊要求[J]. 中国医疗设备, 2021, 36: 19-22. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX202109006.htm
    [15]
    王浩, 孟祥峰, 李澍, 等. 数据集在人工智能医疗器械质控中的角色与要求[J]. 中国医疗器械杂志, 2019, 43: 54-57. https://www.cnki.com.cn/Article/CJFDTOTAL-ZYLZ201901015.htm
    [16]
    王海林, 冯瑞, 张晓波. 融合深度主动学习的医学图像半自动标注系统[J]. 计算机系统应用, 2023, 32: 75-82. https://www.cnki.com.cn/Article/CJFDTOTAL-XTYY202302008.htm
    [17]
    尹兆杰. 基于人机交互的深度学习训练数据标注系统[J]. 铁路通信信号工程技术, 2021, 18: 24-30. https://www.cnki.com.cn/Article/CJFDTOTAL-TLTX202108006.htm
    [18]
    王浩, 孟祥峰, 郝烨, 等. 行业标准《人工智能医疗器械 质量要求和评价 第2部分: 数据集通用要求》解析[J]. 协和医学杂志, 2023, 14: 1180-1184. DOI: 10.12290/xhyxzz.2023-0464
  • Related Articles

    [1]MAO Run, CAI Yiyuan, YANG Wei, LIU Zhiguo, LINGHU Lang, CHEN Jiajia, LIANG Mengjiao, HUANG Lieyu, LIU Siyuan, XU Dong. Stakeholder Preference Assessment in Implementation Research: Application of Best-worst Scaling[J]. Medical Journal of Peking Union Medical College Hospital, 2025, 16(1): 224-234. DOI: 10.12290/xhyxzz.2024-0693
    [2]ZHANG Shan, LIU Jie. Interpretation of NCCN Clinical Practice Guidelines for Primary Cutaneous Lymphomas (Version 1.2024) Based on the Current Diagnosis and Treatment Status of China[J]. Medical Journal of Peking Union Medical College Hospital, 2024, 15(5): 1029-1037. DOI: 10.12290/xhyxzz.2024-0605
    [3]YAN Xinchun, HUO Li. Evaluation of Von Hippel-Lindau Syndrome Through Novel Small Molecular Tracer 68Ga-NY104 PET/CT Imaging[J]. Medical Journal of Peking Union Medical College Hospital, 2024, 15(4): 911-915. DOI: 10.12290/xhyxzz.2024-0216
    [4]LIU Yuan, ZHAO Lin. Update and Interpretation of 2022 National Comprehensive Cancer Network Clinical Practice Guidelines for Gastric Cancer[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(6): 999-1004. DOI: 10.12290/xhyxzz.2022-0271
    [5]ZHAO Luo, HE Jia, QIN Yingzhi, HAN Zhijun, LIU Hongsheng, LI Shanqing, LI Li. Application of Laparoscopic Jejunostomy in Minimal Invasive McKeown Esophagectomy[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(5): 845-851. DOI: 10.12290/xhyxzz.2021-0635
    [8]Ming-sheng MA, Xü-de ZHANG, Min WEI, Shi-min ZHAO, Zheng-qing QIU. Efficacy of Low Dose Corticosteroid Therapy in Duchenne Muscular Dystrophy[J]. Medical Journal of Peking Union Medical College Hospital, 2014, 5(4): 384-388. DOI: 10.3969/j.issn.1674-9081.2014.04.006
    [9]Shuai TANG, Jie YI, Yu-guang HUANG. Cardiovascular Responses of Intubation with Shikani Seeing Optical Stylet and Macintosh Laryngoscope[J]. Medical Journal of Peking Union Medical College Hospital, 2012, 3(3): 314-317. DOI: 10.3969/j.issn.1674-9081.2012.03.015
    [10]Zhi-lan MENG, Liang GAO, Jian-gang GU, Yu-feng LUO, Tao-ling ZHONG, Chen-yan ZHU. Application of Automatic DNA Image Cytometry in Diagnosis of Pleural Effusion[J]. Medical Journal of Peking Union Medical College Hospital, 2012, 3(1): 36-40. DOI: 10.3969/j.issn.1674-9081.2012.01.009
  • Cited by

    Periodical cited type(1)

    1. 钟乐,赵智聪. 中国国家公园特许经营制度利益相关者权利义务分析. 风景园林. 2025(02): 36-42 .

    Other cited types(0)

Catalog

    Article Metrics

    Article views (532) PDF downloads (103) Cited by(1)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return
    x Close Forever Close