Tiny-Lesion Segmentation in OCT via Multi-scale Wavelet Enhanced Transformer

被引:4
|
作者
Wang, Meng [1 ]
Yu, Kai [2 ]
Xu, Xinxing [1 ]
Zhou, Yi [3 ]
Peng, Yuanyuan [3 ]
Xu, Yanyu [1 ]
Goh, Rick Siow Mong [1 ]
Liu, Yong [1 ]
Fu, Huazhu [1 ]
机构
[1] ASTAR, Inst High Performance Comp, Singapore 138632, Singapore
[2] Zhejiang Univ, Childrens Hosp, Natl Clin Res Ctr Child Hlth, Sch Med, Hangzhou 310057, Zhejiang, Peoples R China
[3] Soochow Univ, Sch Elect & Informat Engn, Suzhou 215006, Jiangsu, Peoples R China
关键词
OCT images; Lesion segmentation; Wavelet; Transformer; NETWORK;
D O I
10.1007/978-3-031-16525-2_13
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
The accurate segmentation of retinal lesions from OCT images can greatly aid ophthalmologists in evaluating retinal diseases. However, it remains a challenge to accurately segment retinal lesions in OCT images. This is due to the complicated pathological features of retinal diseases, resulting in severe regional scale imbalance between different lesions, and leading to the problem of target tendency of the network during training, subsequently resulting in the segmentation performance reduction for tiny-lesion. Aiming to solve these challenges, we propose a novel multi-scale wavelet enhanced transformer network for tiny-lesion segmentation in retinal OCT images. In the proposed model, we first design a novel adaptive wavelet down-sampling module combined with the pre-trained ResNet blocks as the feature extractor network, which can generate a wavelet representation to improve the model's interpretability while avoiding feature loss, and further enhancing the ability of the network to represent local detailed features. Meanwhile, we also develop a novel multi-scale transformer module to further improve the model's capacity of extracting the multi-scale long-dependent global features of the retinal lesions in OCT images. Finally, the proposed method is evaluated on the public database of AI-Challenge 2018 for retinal edema lesions joint segmentation, and the results indicate that the proposed method achieves better segmentation performance than other state-of-the-art networks, especially for tiny PED lesions with very small regional proportions.
引用
收藏
页码:125 / 134
页数:10
相关论文
共 50 条
  • [21] PolarFormer: A Transformer-Based Method for Multi-Lesion Segmentation in Intravascular OCT
    Huang, Zhili
    Sun, Jingyi
    Shao, Yifan
    Wang, Zixuan
    Wang, Su
    Li, Qiyong
    Li, Jinsong
    Yu, Qian
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (12) : 4190 - 4199
  • [22] Diabetic Retinopathy Lesion Segmentation Method Based on Multi-Scale Attention and Lesion Perception
    Bian, Ye
    Si, Chengyong
    Wang, Lei
    ALGORITHMS, 2024, 17 (04)
  • [23] Multi-scale Gaussian Segmentation via Graph Cuts
    Zhang, Ye
    He, Kun
    INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATION ENGINEERING (CSAE), 2017, 190 : 767 - 773
  • [24] Multi-Scale High-Resolution Vision Transformer for Semantic Segmentation
    Gu, Jiaqi
    Kwon, Hyoukjun
    Wang, Dilin
    Ye, Wei
    Li, Meng
    Chen, Yu-Hsin
    Lai, Liangzhen
    Chandra, Vikas
    Pan, David Z.
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12084 - 12093
  • [25] MSEDTNet: Multi-Scale Encoder and Decoder with Transformer for Bladder Tumor Segmentation
    Wang, Yixing
    Ye, Xiufen
    ELECTRONICS, 2022, 11 (20)
  • [26] MESTrans: Multi-scale embedding spatial transformer for medical image segmentation
    Liu, Yatong
    Zhu, Yu
    Xin, Ying
    Zhang, Yanan
    Yang, Dawei
    Xu, Tao
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 233
  • [27] Multi-Scale Liver Tumor Segmentation Algorithm by Fusing Convolution and Transformer
    Chen, Lifang
    Luo, Shiyong
    Computer Engineering and Applications, 2024, 60 (04) : 270 - 279
  • [28] Hierarchical Transformer with Multi-Scale Parallel Aggregation for Breast Tumor Segmentation
    Xia, Ping
    Wang, Yudie
    Lei, Bangjun
    Peng, Cheng
    Zhang, Guangyi
    Tang, Tinglong
    LASER & OPTOELECTRONICS PROGRESS, 2025, 62 (02)
  • [29] MUSTER: A Multi-Scale Transformer-Based Decoder for Semantic Segmentation
    Xu, Jing
    Shi, Wentao
    Gao, Pan
    Li, Qizhu
    Wang, Zhengwei
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2025, 9 (01): : 202 - 212
  • [30] Multi-scale contrast based skin lesion segmentation in digital images
    Filali, Idir
    Belkadi, Malika
    OPTIK, 2019, 185 : 794 - 811