[1]伍亚辉,朱世祺,吴宇东,等.基于少样本学习算法的结直肠粘膜下肿瘤和息肉内镜图像分类系统[J].中国医学物理学杂志,2024,41(7):897-904.[doi:DOI:10.3969/j.issn.1005-202X.2024.07.017]
 WU Yahui,ZHU Shiqi,et al.Development of a few-shot learning based model for the classification of colorectal submucosal tumors and polyps on endoscopic images[J].Chinese Journal of Medical Physics,2024,41(7):897-904.[doi:DOI:10.3969/j.issn.1005-202X.2024.07.017]
点击复制

基于少样本学习算法的结直肠粘膜下肿瘤和息肉内镜图像分类系统()
分享到:

《中国医学物理学杂志》[ISSN:1005-202X/CN:44-1351/R]

卷:
41卷
期数:
2024年第7期
页码:
897-904
栏目:
医学人工智能
出版日期:
2024-07-25

文章信息/Info

Title:
Development of a few-shot learning based model for the classification of colorectal submucosal tumors and polyps on endoscopic images
文章编号:
1005-202X(2024)07-0897-08
作者:
伍亚辉12朱世祺1吴宇东3张儒发4朱锦舟1
1.苏州大学附属第一医院消化内科, 江苏 苏州215006;2.同济大学附属东方医院儿内科, 上海 200120; 3.苏州市相城区阳澄湖人民医院内科, 江苏 苏州 215138; 4.苏州大学附属常熟医院消化内科, 江苏 苏州 215500
Author(s):
WU Yahui1 2 ZHU Shiqi1 WU Yudong3 ZHANG Rufa4 ZHU Jinzhou1
1. Department of Gastroenterology, the First Affiliated Hospital of Soochow University, Suzhou 215006, China 2. Department of Pediatric Internal Medicine, Shanghai East Hospital, Tongji University, Shanghai 200120, China 3. Department of Internal Medicine, Suzhou Xiangcheng District Yangcheng Lake Peoples Hospital, Suzhou 215138, China 4. Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou 215500, China
关键词:
少样本学习结直肠粘膜下肿瘤结直肠息肉消化内镜图像深度学习
Keywords:
Keywords: few-shot learning colorectal submucosal tumor colorectal polyp endoscopic image deep learning
分类号:
R318;R574
DOI:
DOI:10.3969/j.issn.1005-202X.2024.07.017
文献标志码:
A
摘要:
目的:为解决难以收集足够结直肠粘膜下肿瘤样本训练深度学习模型的问题,基于少样本学习算法构建了粘膜下肿瘤和息肉内镜图像分类模型。方法:收集多中心来源的结直肠粘膜下肿瘤内镜图像共172张,包括结直肠脂肪瘤(CRLs)、神经内分泌肿瘤(NETs)、锯齿状病变及息肉、传统腺瘤各43张。基于这些内镜图像构建支持集和查询集,在ImageNet和食管内镜图像上二次预训练的ResNet50提取图像特征,计算欧氏距离,使用K近邻算法进行分类。与原始模型和低、高年资内镜医师进行对比,评估少样本学习模型的分类性能。结果:提出的少样本学习模型分类准确率、宏曲线下面积和Macro F1值分别为0.831、0.925和0.831,诊断CRLs的准确率和F1值分别为0.925和0.850,诊断NETs的准确率和F1值分别为0.906和0.805。同时,该模型具有较好的分类一致性(Kappa=0.775)和可解释性。结论:构建的少样本学习模型在区分CRLs、NETs、锯齿状病变及息肉、传统腺瘤内镜图像上表现出优异性能,可用于辅助内镜下识别结直肠粘膜下肿瘤。
Abstract:
Abstract: Objective To address the difficulty in collecting sufficient endoscopic images of colorectal submucosal tumors for traditional deep learning model training, a few-shot learning based model (FSL model) is proposed for classifying colorectal submucosal tumors and polyps on endoscopic images. Methods A total of 172 endoscopic images of colorectal submucosal tumors were collected from different centers, including 43 each of colorectal lipomas (CRLs), neuroendocrine tumors (NETs), serrated lesions and polyps (SLPs), and traditional adenomas. A support set and a query set were constructed using these endoscopic images. ResNet50 which was pre-trained on ImageNet and esophageal endoscopic images was used to extract image features. Subsequently, K-nearest neighbors algorithm was used for classification based on the calculated Euclidean distance. The classification performance of FSL model was evaluated through the comparison with the original model and endoscopists. Results FSL model had a 4-class classification accuracy of 0.831, Macro AUC of 0.925, Macro F1-score of 0.831 moreover, the proposed model achieved diagnostic accuracies of 0.925 and 0.906 for CRLs and NETs, with F1 score of 0.850 and 0.805. Additionally, the proposed model exhibited high classification consistency (Kappa=0.775) and interpretability. Conclusion The established FSL model performs well in distinguishing CRLs, NETs, SLPs and traditional adenomas on endoscopic images, indicating its potential utility in assisting the identification of colorectal submucosal tumors under endoscopy.

备注/Memo

备注/Memo:
【收稿日期】2024-04-10 【基金项目】国家自然科学基金(82000540);肝脾外科教育部重点实验室开放基金(GPKF202304);苏州市科教兴卫项目(KJXW2019001);苏州大学医学部学生课外科研项目(2021YXBKWKY050) 【作者简介】伍亚辉,硕士研究生,主任医师,研究方向:人工智能在消化病、儿内科中的应用,E-mail: wuyahui8@163.com 【通信作者】朱锦舟,博士,副主任医师,硕士生导师,研究方向:人工智能在消化病中的应用,E-mail: jzzhu@zju.edu.cn
更新日期/Last Update: 2024-07-13