TRC-Unet: Transformer Connections for Near-infrared Blurred Image Segmentation

被引:1
|
作者
Wang, Jiazhe [1 ]
Osamu, Yoshie [2 ]
Shimizu, Koichi [3 ]
机构
[1] Waseda Univ, Sch Informat Prod & Syst, Fukuoka, Japan
[2] Waseda Univ, Fukuoka, Japan
[3] Xidian Univ, Sch Optoelect Engn, Xian, Peoples R China
关键词
VESSEL SEGMENTATION;
D O I
10.1109/ICPR56361.2022.9956727
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Imaging blood vessel networks is useful in many biomedical applications, such as injection-assist, cancer detection, various surgery, and vein identification. In NIR (near-infrared) transillumination imaging, we can visualize the subcutaneous blood vessel network. However, such images are severely blurred by the strong scattering of body tissue, and it remains challenging for most models to accurately segment these blurred images. In addition, the convolution operation in the deep learning approach means that it extracts a mixture of blurred edges and clear centers, resulting in gradual distortion during upsampling. In this paper, we propose a novel and efficient deep learning model called TRC-Unet for segmenting blurred NIR images. The transformer connection (TRC) block extracts global spatial information from different scales by adaptively suppressing scattering and increasing the clarity of features. Our proposed transformer feature fusion (TFF) module closes the gap between the highly semantic feature maps of CNN and the adaptive fuzzy transformer output to enable a precise reconstruction of the segmentation. We evaluated TRC-Unet on both a simulated blurred DRIVE dataset and a NIR vessel dataset, and we achieved competitive results. (i.e., 83.86% Dice score on DRIVE and an average boost of 4.6% on simulated images at different depths).
引用
收藏
页码:4211 / 4218
页数:8
相关论文
共 50 条
  • [31] Near-Infrared Image Filtering for Pedestrian Surveillance
    Rodhouse, Kathryn N.
    Watkins, Steve E.
    NONDESTRUCTIVE CHARACTERIZATION FOR COMPOSITE MATERIALS, AEROSPACE ENGINEERING, CIVIL INFRASTRUCTURE, AND HOMELAND SECURITY 2012, 2012, 8347
  • [32] NEAR-INFRARED VIDEO IMAGE-ANALYSIS
    ROBERT, P
    DEVAUX, MF
    BERTRAND, D
    SCIENCES DES ALIMENTS, 1991, 11 (04) : 565 - 574
  • [33] COLOR IMAGE DEHAZING USING THE NEAR-INFRARED
    Schaul, Lex
    Fredembach, Clement
    Suesstrunk, Sabine
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 1629 - 1632
  • [34] AFC-Unet: Attention-fused full-scale CNN-transformer unet for medical image segmentation
    Meng, Wenjie
    Liu, Shujun
    Wang, Huajun
    Biomedical Signal Processing and Control, 2025, 99
  • [35] Detecting digital image forgery in near-infrared image of CCTV
    Park, Jin-Seok
    Hyun, Dai-Kyung
    Hou, Jong-Uk
    Kim, Do-Guk
    Lee, Heung-Kyu
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (14) : 15817 - 15838
  • [36] Image Dehazing Method by Fusing Weighted Near-Infrared Image
    Kudo, Yuhei
    Kubota, Akira
    2018 INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT), 2018,
  • [37] Detecting digital image forgery in near-infrared image of CCTV
    Jin-Seok Park
    Dai-Kyung Hyun
    Jong-Uk Hou
    Do-Guk Kim
    Heung-Kyu Lee
    Multimedia Tools and Applications, 2017, 76 : 15817 - 15838
  • [38] H2MaT-Unet:Hierarchical hybrid multi-axis transformer based Unet for medical image segmentation
    Ju Z.
    Zhou Z.
    Qi Z.
    Yi C.
    Computers in Biology and Medicine, 2024, 174
  • [39] LATrans-Unet: Improving CNN-Transformer with Location Adaptive for Medical Image Segmentation
    Lin, Qiqin
    Yao, Junfeng
    Hong, Qingqi
    Cao, Xianpeng
    Zhou, Rongzhou
    Xie, Weixing
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XIII, 2024, 14437 : 223 - 234
  • [40] TGDAUNet: Transformer and GCNN based dual-branch attention UNet for medical image segmentation
    Song, Pengfei
    Li, Jinjiang
    Fan, Hui
    Fan, Linwei
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 167