TRC-Unet: Transformer Connections for Near-infrared Blurred Image Segmentation

被引:1
|
作者
Wang, Jiazhe [1 ]
Osamu, Yoshie [2 ]
Shimizu, Koichi [3 ]
机构
[1] Waseda Univ, Sch Informat Prod & Syst, Fukuoka, Japan
[2] Waseda Univ, Fukuoka, Japan
[3] Xidian Univ, Sch Optoelect Engn, Xian, Peoples R China
关键词
VESSEL SEGMENTATION;
D O I
10.1109/ICPR56361.2022.9956727
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Imaging blood vessel networks is useful in many biomedical applications, such as injection-assist, cancer detection, various surgery, and vein identification. In NIR (near-infrared) transillumination imaging, we can visualize the subcutaneous blood vessel network. However, such images are severely blurred by the strong scattering of body tissue, and it remains challenging for most models to accurately segment these blurred images. In addition, the convolution operation in the deep learning approach means that it extracts a mixture of blurred edges and clear centers, resulting in gradual distortion during upsampling. In this paper, we propose a novel and efficient deep learning model called TRC-Unet for segmenting blurred NIR images. The transformer connection (TRC) block extracts global spatial information from different scales by adaptively suppressing scattering and increasing the clarity of features. Our proposed transformer feature fusion (TFF) module closes the gap between the highly semantic feature maps of CNN and the adaptive fuzzy transformer output to enable a precise reconstruction of the segmentation. We evaluated TRC-Unet on both a simulated blurred DRIVE dataset and a NIR vessel dataset, and we achieved competitive results. (i.e., 83.86% Dice score on DRIVE and an average boost of 4.6% on simulated images at different depths).
引用
收藏
页码:4211 / 4218
页数:8
相关论文
共 50 条
  • [1] Transformer Connections: Improving Segmentation in Blurred Near-Infrared Blood Vessel Image in Different Depth
    Wang, Jiazhe
    Shimizu, Koichi
    Yoshie, Osamu
    IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2024, : 1828 - 1841
  • [2] AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentation
    Yan, Xiangyi
    Tang, Hao
    Sun, Shanlin
    Ma, Haoyu
    Kong, Deying
    Xie, Xiaohui
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 3270 - 3280
  • [3] Semantic Image Segmentation Using Visible and Near-Infrared Channels
    Salamati, Neda
    Larlus, Diane
    Csurka, Gabriela
    Suesstrunk, Sabine
    COMPUTER VISION - ECCV 2012, PT II, 2012, 7584 : 461 - 471
  • [4] TransCUNet: UNet cross fused transformer for medical image segmentation
    Jiang, Shen
    Li, Jinjiang
    COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 150
  • [5] SMESwin Unet: Merging CNN and Transformer for Medical Image Segmentation
    Wang, Ziheng
    Min, Xiongkuo
    Shi, Fangyu
    Jin, Ruinian
    Nawrin, Saida S.
    Yu, Ichen
    Nagatomi, Ryoichi
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT V, 2022, 13435 : 517 - 526
  • [6] Near-Infrared Vessels Image Enhancement Using Segmentation and Fusion Technique
    Goh, C. M.
    Saad, N. M.
    Shahzad, A.
    Malik, Aamir Saeed
    2015 IEEE INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING APPLICATIONS (ICSIPA), 2015, : 383 - 388
  • [7] Lower extremity ulcer image segmentation of visual and near-infrared imagery
    Bochko, Vladimir
    Valisuo, Petri
    Harju, Toni
    Alander, Jarmo
    SKIN RESEARCH AND TECHNOLOGY, 2010, 16 (02) : 190 - 197
  • [8] CSWin-UNet: Transformer UNet with cross-shaped windows for medical image segmentation
    Liu, Xiao
    Gao, Peng
    Yu, Tao
    Wang, Fei
    Yuan, Ru-Yue
    INFORMATION FUSION, 2025, 113
  • [9] Combining Swin Transformer With UNet for Remote Sensing Image Semantic Segmentation
    Fan, Lili
    Zhou, Yu
    Liu, Hongmei
    Li, Yunjie
    Cao, Dongpu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 11
  • [10] Swin Transformer Embedding UNet for Remote Sensing Image Semantic Segmentation
    He, Xin
    Zhou, Yong
    Zhao, Jiaqi
    Zhang, Di
    Yao, Rui
    Xue, Yong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60