[1]方新林,方艳红,王迪.基于多模态特征融合的脑瘤图像分割方法[J].中国医学物理学杂志,2022,39(6):682-689.[doi:DOI:10.3969/j.issn.1005-202X.2022.06.005]
　FANG Xinlin,FANG Yanhong,WANG Di.Brain tumor image segmentation method based on multi-modal feature fusion[J].Chinese Journal of Medical Physics,2022,39(6):682-689.[doi:DOI:10.3969/j.issn.1005-202X.2022.06.005]
点击复制

基于多模态特征融合的脑瘤图像分割方法()
分享到：

《中国医学物理学杂志》[ISSN:1005-202X/CN:44-1351/R]

卷:
39卷
期数:
2022年第6期
页码:
682-689
栏目:
医学影像物理
出版日期:
2022-06-27

文章信息/Info

Title:
Brain tumor image segmentation method based on multi-modal feature fusion
文章编号:
1005-202X（2022）06-0682-08
作者:
方新林; 方艳红; 王迪
西南科技大学信息工程学院， 四川 绵阳 621010
Author(s):
FANG Xinlin;  FANG Yanhong;  WANG Di
School of Information Engineering, Southwest University of Science and Technology, Mianyang 621010, China
关键词:
多模态图像; 脑肿瘤; 特征融合; 医学图像分割; 深度学习
Keywords:
Keywords: multi-modal image brain tumor feature fusion medical image segmentation deep learning
分类号:
R318；TP391.4
DOI:
DOI:10.3969/j.issn.1005-202X.2022.06.005
文献标志码:
A
摘要:
针对目前大多数医学图像分割方法难以对多模态图像进行特征融合进而完成精确分割任务的问题，提出一种基于编码器-解码器总体架构的多模态脑瘤图像特征融合策略。首先，编码阶段利用孪生网络对不同模态数据进行特征提取，孪生网络结构参数和权值共享的特性可有效减少网络参数量；其次，在进行特征提取的编码阶段加入级间融合，保留不同模态的共性特征的同时强调其互补特征；然后，在解码阶段引入密集跳跃连接思想，最大程度结合不同尺度特征图的低级细节和高级语义信息；最后，设计混合损失函数，在网络生成的预测图受真值图监督的同时让最高级特征融合图也受同倍下采样真值图的监督。所提方法在公开数据集BraTS2019上进行实验，并用图像分割常用的5种指标进行评估。在脑瘤及水肿区域分割任务中得到平均Dice系数为0.884，阳性预测率为0.870，灵敏度为0.898，豪斯多夫距离为3.917，平均交并比达到79.1%，与较先进的算法U-Net和PA-Net相比多项指标均有提升。实验结果说明，级间融合和层间跳跃连接的加入对多模态医学图像的分割效果有所提升，在医学上对脑肿瘤磁共振图像进行病变区域分割具有重要的应用价值和理论意义。
Abstract:
Abstract: Aiming at the problem that most of the current medical image segmentation methods are difficult to perform feature fusion for multi-modal images to achieve accurate segmentation, a multi-modal brain tumor image feature fusion strategy based on encoder and decoder overall architecture is proposed. In the coding phase, twin networks are used to extract features from different modal data. The number of network parameters can be effectively reduced by sharing the structural parameters and weights of twin networks. In addition, the interstage fusion is added in the coding phase of feature extraction to keep the common features of different modes while emphasizing their complementary features. Then, the idea of dense skip connection is introduced in the decoding phase to maximize the combination of low-level details and high-level semantic information of feature maps at different scales. Finally, a mixed loss function is designed, so that the prediction graph generated by the network is supervised by the truth graph, and that the highest-level feature fusion graph is also supervised by the truth graph sampled under the same multiplier. The proposed method is tested on the public data set BraTS2019 and evaluated with 5 commonly used indexes for image segmentation. For the segmentations of brain tumor and edema area, the proposed method are superior to more advanced algorithms U-NET and PA-NET in many indexes, and the average Dice coefficient, positive prediction rate, sensitivity, Hausdorff distance and mean intersection over union of the proposed method are 0.884, 0.870, 0.898, 3.917 and 79.1%, respectively. The experimental results reveal that the addition of interstage fusion and interlayer skip connection can improve the segmentation performance of multimodal medical images, and it has important application value and theoretical significance in the segmentation of brain tumor in magnetic resonance image.

相似文献/References:

[1]王晓飞,聂生东,王远军,等.基于MRI的脑肿瘤计算机辅助检测技术研究进展[J].中国医学物理学杂志,2014,31(01):4635.[doi:10.3969/j.issn.1005-202X.2014.01.010]
[2]万俊,聂生东,王远军,等.基于MRI的脑肿瘤分割技术研究进展[J].中国医学物理学杂志,2013,30(04):4266.[doi:10.3969/j.issn.1005-202X.2013.04.013]
[3]赖胜圣,刘虔铖,张刚平.基于模糊C均值自动随机游走算法在脑肿瘤分割中的应用[J].中国医学物理学杂志,2015,32(05):707.[doi:doi:10.3969/j.issn.1005-202X.2015.05.021]
[4]谷珊珊,张怀文,王运来.基于水平集稳健特征统计算法的脑肿瘤自动分割研究[J].中国医学物理学杂志,2016,33(1):63.[doi:10.3969/j.issn.1005-202X.2016.01.014]
　[J].Chinese Journal of Medical Physics,2016,33(6):63.[doi:10.3969/j.issn.1005-202X.2016.01.014]
[5]徐艳红,张晋建,黎静,等.影像增强剂对脑瘤螺旋断层放疗剂量计算的影响[J].中国医学物理学杂志,2016,33(8):757.[doi:10.3969/j.issn.1005-202X.2016.08.001]
　[J].Chinese Journal of Medical Physics,2016,33(6):757.[doi:10.3969/j.issn.1005-202X.2016.08.001]
[6]宋婷婷,盛晓芳,汪洋,等.Compass剂量验证系统在VMAT脑肿瘤瘤床同步追量中的应用[J].中国医学物理学杂志,2016,33(10):1012.[doi:10.3969/j.issn.1005-202X.2016.10.008]
　[J].Chinese Journal of Medical Physics,2016,33(6):1012.[doi:10.3969/j.issn.1005-202X.2016.10.008]
[7]薛彩强,柯晓艾,邓娟,等.MRI征象鉴别IDH-1突变型与野生型较低级别胶质瘤[J].中国医学物理学杂志,2020,37(11):1384.[doi:DOI:10.3969/j.issn.1005-202X.2020.11.008]
　XUE Caiqiang,,et al.MRI signs in differentiation of IDH-1 mutant type and wild type of lower-grade gliomas[J].Chinese Journal of Medical Physics,2020,37(6):1384.[doi:DOI:10.3969/j.issn.1005-202X.2020.11.008]
[8]王佳琦,崔勇,栾琨,等.双时相PET CT扫描在脑肿瘤的诊断价值[J].中国医学物理学杂志,2023,40(2):157.[doi:DOI:10.3969/j.issn.1005-202X.2023.02.005]
　WANG Jiaqi,CUI Yong,LUAN Kun,et al.[J].Chinese Journal of Medical Physics,2023,40(6):157.[doi:DOI:10.3969/j.issn.1005-202X.2023.02.005]
[9]田恒屹,肖洪兵,计亚荣,等.基于三维UNet与混合焦点损失函数的脑肿瘤全自动分割算法[J].中国医学物理学杂志,2023,40(9):1114.[doi:DOI:10.3969/j.issn.1005-202X.2023.09.009]
　TIAN Hengyi,XIAO Hongbing,JI Yarong,et al.Fully automatic segmentation algorithm of brain tumor based on three-dimensional UNet and hybrid focal loss function[J].Chinese Journal of Medical Physics,2023,40(6):1114.[doi:DOI:10.3969/j.issn.1005-202X.2023.09.009]
[10]林嘉豪,王瑜,肖洪兵,等.LRAE-Unet：轻量级MRI脑肿瘤全自动分割网络[J].中国医学物理学杂志,2024,41(1):43.[doi:DOI:10.3969/j.issn.1005-202X.2024.01.006]
　LIN Jiahao,WANG Yu,XIAO Hongbing,et al.LRAE-Unet: a lightweight network for fully automatic segmentation of brain tumor from MRI[J].Chinese Journal of Medical Physics,2024,41(6):43.[doi:DOI:10.3969/j.issn.1005-202X.2024.01.006]

备注/Memo

备注/Memo:
【收稿日期】2021-12-19 【基金项目】国家重点实验室开放基金（SKLA20200203） 【作者简介】方新林，硕士，研究方向：深度学习、医学图像处理，E-mail: 18140341994@163.com 【通信作者】方艳红，博士，研究方向：智能仪器设备、图像处理与模式识别，E-mail: 19137088@qq.com
更新日期/Last Update: 2022-06-27