HAO Ye, WANG Hao, LI Jiage. Interpretation On Sectoral Standard Artificial Intelligence Medical Device-Quality Requirements and Evaluation-Part 3: General Requirements for Data Annotation[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(6): 1185-1188. DOI: 10.12290/xhyxzz.2023-0463
Citation: HAO Ye, WANG Hao, LI Jiage. Interpretation On Sectoral Standard Artificial Intelligence Medical Device-Quality Requirements and Evaluation-Part 3: General Requirements for Data Annotation[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(6): 1185-1188. DOI: 10.12290/xhyxzz.2023-0463

Interpretation On Sectoral Standard Artificial Intelligence Medical Device-Quality Requirements and Evaluation-Part 3: General Requirements for Data Annotation

Funds: 

Key Technology Fund of National Institutes for Food and Drug Control GJJS-2022-3-1

More Information
  • Corresponding author:

    LI Jiage, E-mail: lijiage@nifdc.org.cn

  • Received Date: October 06, 2023
  • Accepted Date: October 29, 2023
  • Issue Publish Date: November 29, 2023
  • With the upgrading of machine learning technology, artificial intelligence has become an emerging direction in the field of medical devices. Especially in recent years, it has developed rapidly. In 2022, the National Medical Products Administration released the industry standard YY/T 1833 "Artificial Intelligence Medical Device-Quality Requirements and Evaluation" series, marking the initial establishment of a standard system for artificial intelligence medical devices in China. The standardization of data annotation is not only an important part of the standard system, but also determines the accuracy and reliability of reference standards, which has a significant impact on the quality of the dataset and product quality. Part 3 of "Artificial Intelligence Medical Device-Quality Requirements and Evaluation", a general requirement for data annotation, proposes the quality requirements for artificial intelligence medical devices in the data annotation process and standardizes the evaluation methods. This paper highlights its important contents, in order to better carry out product quality control and promote high-quality development of products and industries.
  • [1]
    王浩, 孟祥峰, 林晓兰, 等. 人工智能医疗器械数据集质控解决方案[J]. 医疗卫生装备, 2023, 44: 12-15. https://www.cnki.com.cn/Article/CJFDTOTAL-YNWS202302002.htm
    [2]
    唐娜, 王浩, 钟代笛. 人工智能医疗器械监管现状分析[J]. 医疗卫生装备, 2022, 43: 54-58, 68. https://www.cnki.com.cn/Article/CJFDTOTAL-YNWS202208011.htm
    [3]
    王浩, 李澍, 王晨希, 等. 人工智能医疗器械质量管理标准化趋势分析[J]. 中国医疗设备, 2021, 36: 20-23. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX202103005.htm
    [4]
    刘毅, 王浩, 李澍, 等. 人工智能医疗器械企业质量管理体系构建关键指标筛选研究[J]. 中国医疗设备, 2021, 36: 24-27, 43. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX202103006.htm
    [5]
    王浩, 唐桥虹, 郝烨, 等. 人工智能医疗器械标准体系设计探索[J]. 中国医疗设备, 2021, 36: 15-18, 28. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX202112003.htm
    [6]
    彭亮, 刘枭寅, 张宇晶, 等. 人工智能医疗器械国际监管比较研究[J]. 中国数字医学, 2023, 18: 1-7. https://www.cnki.com.cn/Article/CJFDTOTAL-YISZ202305001.htm
    [7]
    国家药品监督管理局. 人工智能医疗器械 质量要求和评价 第3部分: 数据标注通用要求[S]. YY/T 1833.3-2022.
    [8]
    王浩, 孟祥峰, 王权, 等. 人工智能医疗器械用数据集管理与评价方法研究[J]. 中国医疗设备, 2018, 33: 1-5. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX201812001.htm
    [9]
    蔡莉, 王淑婷, 刘俊晖, 等. 数据标注研究综述[J]. 软件学报, 2020, 31: 302-320. https://www.cnki.com.cn/Article/CJFDTOTAL-RJXB202002004.htm
    [10]
    王权, 王浩, 孟祥峰, 等. 人员管理对人工智能医疗器械用数据集质量的影响分析[J]. 中国医疗设备, 2018, 33: 6-9. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX201812002.htm
    [11]
    孟祥峰, 王浩, 李佳戈. 行业标准《人工智能医疗器械 质量要求和评价 第1部分: 术语》解析[J]. 协和医学杂志, 2023, 14: 1175-1179. DOI: 10.12290/xhyxzz.2023-0351
    [12]
    孟祥峰, 王浩, 张超, 等. 医学人工智能产品检测平台的设计[J]. 医疗卫生装备, 2023, 44: 1-7. https://www.cnki.com.cn/Article/CJFDTOTAL-YNWS202301016.htm
    [13]
    李澍, 王浩, 王晨希, 等. 人工智能医疗器械软件生产质量管理体系特殊要求研究[J]. 中国医疗设备, 2021, 36: 15-18, 22. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX202109005.htm
    [14]
    曾雪, 王浩, 李佳戈. 分析人工智能医疗器械环境特殊要求[J]. 中国医疗设备, 2021, 36: 19-22. https://www.cnki.com.cn/Article/CJFDTOTAL-YLSX202109006.htm
    [15]
    王浩, 孟祥峰, 李澍, 等. 数据集在人工智能医疗器械质控中的角色与要求[J]. 中国医疗器械杂志, 2019, 43: 54-57. https://www.cnki.com.cn/Article/CJFDTOTAL-ZYLZ201901015.htm
    [16]
    王海林, 冯瑞, 张晓波. 融合深度主动学习的医学图像半自动标注系统[J]. 计算机系统应用, 2023, 32: 75-82. https://www.cnki.com.cn/Article/CJFDTOTAL-XTYY202302008.htm
    [17]
    尹兆杰. 基于人机交互的深度学习训练数据标注系统[J]. 铁路通信信号工程技术, 2021, 18: 24-30. https://www.cnki.com.cn/Article/CJFDTOTAL-TLTX202108006.htm
    [18]
    王浩, 孟祥峰, 郝烨, 等. 行业标准《人工智能医疗器械 质量要求和评价 第2部分: 数据集通用要求》解析[J]. 协和医学杂志, 2023, 14: 1180-1184. DOI: 10.12290/xhyxzz.2023-0464
  • Related Articles

    [1]JIA Chunyu, WANG Gangan, WANG Jiahui, CHEN Gang, ZHENG Ke, LI Xuemei. Correlation Between Neutrophil to Lymphocyte Ratio and eGFR in Diabetic Patients: A Cross-sectional Analysis Based on NHANES Data[J]. Medical Journal of Peking Union Medical College Hospital, 2025, 16(2): 379-385. DOI: 10.12290/xhyxzz.2024-0908
    [2]WEN Bei, ZHU He, XU Li, HUANG Yuguang. Association Between Coffee Consumption and Pain: A Cross-sectional Study Based on American National Health and Nutrition Examination Survey[J]. Medical Journal of Peking Union Medical College Hospital, 2024, 15(2): 351-358. DOI: 10.12290/xhyxzz.2023-0553
    [3]WANG Hao, MENG Xiangfeng, HAO Ye, LI Jiage, LI Jingli. Interpretation on the Standard Artificial Intelligence Medical Device-Quality Requirements and Evaluation-Part 2: General Requirements for Datasets[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(6): 1180-1184. DOI: 10.12290/xhyxzz.2023-0464
    [4]MENG Xiangfeng, WANG Hao, LI Jiage. Interpretation on the Standard Artificial Intelligence Medical Device- Quality Requirements and Evaluation-Part 1: Terminology[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(6): 1175-1179. DOI: 10.12290/xhyxzz.2023-0351
    [5]Zhejiang University, National Institutes for Food and Drug Control, Shanghai Changzheng Hospital. Expert Consensus on General Methods for Performance Evaluation of Artificial Intelligence Medical Devices (2023)[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(3): 494-503. DOI: 10.12290/xhyxzz.2023-0137
    [6]LI Yang, DU Leilei, XU Fei, LI Yixuan, QIAO En. Big Data and Artificial Intelligence in Medicine[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(1): 184-189. DOI: 10.12290/xhyxzz.2022-0182
    [7]YU Weihong, ZHANG Xiao, WU Chan, CHEN Huan, YANG Zhikun, HE Feng, ZHANG Zhiqiao, ZHANG Bilei, GONG Di, WANG Yuelin, YANG Jingyuan, LI Bing, SUN Yanyuan, MA Yajing, LU Huiqin, XIA Wei, ZHOU Wei, ZHANG Donglei, PAN Qingmin, YANG Ning, WANG Shuna, SUN Xiaolei, YU Ying, SU Chang, WAN Bo, WANG Mingqi, WANG Min, CHEN Youxin. Procedures of Establishing a Well-annotated Database of Color Fundus Photography of Diabetic Retinopathy for Artificial Intelligence Research[J]. Medical Journal of Peking Union Medical College Hospital, 2021, 12(5): 684-688. DOI: 10.12290/xhyxzz.2021-0613
    [8]ZHANG Zhifei, YANG Zhengxin, HUANG Yunyou, ZHAN Jianfeng. Big Medical Data and Medical AI Standards: Status Quo, Opportunities and Challenges[J]. Medical Journal of Peking Union Medical College Hospital, 2021, 12(5): 614-620. DOI: 10.12290/xhyxzz.2021-0472
    [9]SHI Zhenwei, LIU Zaiyi. Attaching Importance to the Standardized Construction of Artificial Intelligence Database of Medical Imaging[J]. Medical Journal of Peking Union Medical College Hospital, 2021, 12(5): 599-601. DOI: 10.12290/xhyxzz.2021-0507
    [10]Yue-song PAN. Data Management and Quality Control for Clinical Research[J]. Medical Journal of Peking Union Medical College Hospital, 2018, 9(5): 458-462. DOI: 10.3969/j.issn.1674-9081.2018.05.016
  • Cited by

    Periodical cited type(1)

    1. 周俊林,洪楠,张惠茅,陈敏,刘士远,李昇霖,袁隆,卢婷. 结直肠癌CT影像数据库构建及质量控制专家共识. 中国医学影像学杂志. 2025(01): 1-9 .

    Other cited types(0)

Catalog

    Article Metrics

    Article views (566) PDF downloads (103) Cited by(1)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return
    x Close Forever Close