Colorectal polyp segmentation method based on fusion of transformer and cross-level phase awareness

被引:0
|
作者
Liang L. [1 ]
He A. [1 ]
Zhu C. [1 ]
Sheng X. [2 ]
机构
[1] School of Electrical Engineering and Automation, Jiangxi University of Science and Technology, 341000, Jiangxi
[2] School of Computer Science and Engineering, South China University of Technology, Guangzhou
关键词
Colorectal polyps; Image segmentation; Phase-aware fusion module; Position oriented function module; Transformer;
D O I
10.7507/1001-5515.202211067
中图分类号
学科分类号
摘要
针对结肠息肉图像分割时空间归纳偏差和全局上下文信息的有效表示缺失,导致边缘细节信息丢失和病变区域误分割等问题,提出一种融合Transformer和跨级相位感知的结肠息肉分割方法。该方法一是从变换的全局特征角度出发,运用分层Transformer编码器逐层提取病变区域的语义信息和空间细节;二是通过相位感知融合模块(PAFM)捕获各阶段跨层次交互信息,有效聚合多尺度上下文信息;三是设计位置导向功能模块(POF)有效整合全局与局部特征信息,填补语义空白,抑制背景噪声;四是利用残差轴反向注意力模块(RA-IA)来提升网络对边缘像素点的识别能力。在公共数据集CVC-ClinicDB、Kvasir、CVC-ColonDB和EITS上进行实验测试,其Dice相似性系数分别为94.04%、92.04%、80.78%和76.80%,平均交并比分别为89.31%、86.81%、73.55%和69.10%。仿真实验结果表明,本文提出的方法能有效地分割结肠息肉图像,为结直肠息肉的诊断提供了新窗口。.; In order to address the issues of spatial induction bias and lack of effective representation of global contextual information in colon polyp image segmentation, which lead to the loss of edge details and mis-segmentation of lesion areas, a colon polyp segmentation method that combines Transformer and cross-level phase-awareness is proposed. The method started from the perspective of global feature transformation, and used a hierarchical Transformer encoder to extract semantic information and spatial details of lesion areas layer by layer. Secondly, a phase-aware fusion module (PAFM) was designed to capture cross-level interaction information and effectively aggregate multi-scale contextual information. Thirdly, a position oriented functional module (POF) was designed to effectively integrate global and local feature information, fill in semantic gaps, and suppress background noise. Fourthly, a residual axis reverse attention module (RA-IA) was used to improve the network's ability to recognize edge pixels. The proposed method was experimentally tested on public datasets CVC-ClinicDB, Kvasir, CVC-ColonDB, and EITS, with Dice similarity coefficients of 94.04%, 92.04%, 80.78%, and 76.80%, respectively, and mean intersection over union of 89.31%, 86.81%, 73.55%, and 69.10%, respectively. The simulation experimental results show that the proposed method can effectively segment colon polyp images, providing a new window for the diagnosis of colon polyps.
引用
收藏
页码:234 / 243
页数:9
相关论文
共 50 条
  • [31] Cross-level collaborative context-aware framework for medical image segmentation
    Suo, Chao
    Zhou, Tianxin
    Hu, Kai
    Zhang, Yuan
    Gao, Xieping
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 236
  • [32] Camouflaged Object Detection via Context-Aware Cross-Level Fusion
    Chen, Geng
    Liu, Si-Jie
    Sun, Yu-Jia
    Ji, Ge-Peng
    Wu, Ya-Feng
    Zhou, Tao
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) : 6981 - 6993
  • [33] A Road Crack Segmentation Method Based on Transformer and Multi-Scale Feature Fusion
    Xu, Yang
    Xia, Yonghua
    Zhao, Quai
    Yang, Kaihua
    Li, Qiang
    [J]. ELECTRONICS, 2024, 13 (12)
  • [34] Context-aware Cross-level Fusion Network for Camouflaged Object Detection
    Sun, Yujia
    Chen, Geng
    Zhou, Tao
    Zhang, Yi
    Liu, Nian
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1025 - 1031
  • [35] Defocus blur detection via adaptive cross-level feature fusion and refinement
    Zhao, Zijian
    Yang, Hang
    Liu, Peiyu
    Nie, Haitao
    Zhang, Zhongbo
    Li, Chunyu
    [J]. VISUAL COMPUTER, 2024, 40 (11): : 8141 - 8153
  • [36] TCCFusion: An infrared and visible image fusion method based on transformer and cross correlation
    Tang, Wei
    He, Fazhi
    Liu, Yu
    [J]. PATTERN RECOGNITION, 2023, 137
  • [37] TACT: Text attention based CNN-Transformer network for polyp segmentation
    Zhao, Yiyang
    Li, Jinjiang
    Hua, Zhen
    [J]. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2024, 34 (02)
  • [38] Cross-level Requirement Tracing Method of Open-source Systems Based on Correlation Feedback
    Tian J.-H.
    Zhang L.
    Lian X.-L.
    Zhao Q.-H.
    [J]. Ruan Jian Xue Bao/Journal of Software, 2024, 35 (03): : 1321 - 1340
  • [39] HIGF-Net: Hierarchical information-guided fusion network for polyp segmentation based on transformer and convolution feature learning
    Wang J.
    Tian S.
    Yu L.
    Zhou Z.
    Wang F.
    Wang Y.
    [J]. Computers in Biology and Medicine, 2023, 161
  • [40] Hybridizing Cross-Level Contextual and Attentive Representations for Remote Sensing Imagery Semantic Segmentation
    Li, Xin
    Xu, Feng
    Xia, Runliang
    Lyu, Xin
    Gao, Hongmin
    Tong, Yao
    [J]. REMOTE SENSING, 2021, 13 (15)