Tiny-Lesion Segmentation in OCT via Multi-scale Wavelet Enhanced Transformer

被引:4
|
作者
Wang, Meng [1 ]
Yu, Kai [2 ]
Xu, Xinxing [1 ]
Zhou, Yi [3 ]
Peng, Yuanyuan [3 ]
Xu, Yanyu [1 ]
Goh, Rick Siow Mong [1 ]
Liu, Yong [1 ]
Fu, Huazhu [1 ]
机构
[1] ASTAR, Inst High Performance Comp, Singapore 138632, Singapore
[2] Zhejiang Univ, Childrens Hosp, Natl Clin Res Ctr Child Hlth, Sch Med, Hangzhou 310057, Zhejiang, Peoples R China
[3] Soochow Univ, Sch Elect & Informat Engn, Suzhou 215006, Jiangsu, Peoples R China
关键词
OCT images; Lesion segmentation; Wavelet; Transformer; NETWORK;
D O I
10.1007/978-3-031-16525-2_13
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
The accurate segmentation of retinal lesions from OCT images can greatly aid ophthalmologists in evaluating retinal diseases. However, it remains a challenge to accurately segment retinal lesions in OCT images. This is due to the complicated pathological features of retinal diseases, resulting in severe regional scale imbalance between different lesions, and leading to the problem of target tendency of the network during training, subsequently resulting in the segmentation performance reduction for tiny-lesion. Aiming to solve these challenges, we propose a novel multi-scale wavelet enhanced transformer network for tiny-lesion segmentation in retinal OCT images. In the proposed model, we first design a novel adaptive wavelet down-sampling module combined with the pre-trained ResNet blocks as the feature extractor network, which can generate a wavelet representation to improve the model's interpretability while avoiding feature loss, and further enhancing the ability of the network to represent local detailed features. Meanwhile, we also develop a novel multi-scale transformer module to further improve the model's capacity of extracting the multi-scale long-dependent global features of the retinal lesions in OCT images. Finally, the proposed method is evaluated on the public database of AI-Challenge 2018 for retinal edema lesions joint segmentation, and the results indicate that the proposed method achieves better segmentation performance than other state-of-the-art networks, especially for tiny PED lesions with very small regional proportions.
引用
收藏
页码:125 / 134
页数:10
相关论文
共 50 条
  • [1] Fusion multi-scale Transformer skin lesion segmentation algorithm
    Liang L.-M.
    Zhou L.-S.
    Yin J.
    Sheng X.-Q.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2024, 54 (04): : 1086 - 1098
  • [2] Efficient multi-scale learning via scale embedding for diabetic retinopathy multi-lesion segmentation
    Guo, Song
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 100
  • [3] Transformer guided self-adaptive network for multi-scale skin lesion image segmentation
    Xin, Chao
    Liu, Zhifang
    Ma, Yizhao
    Wang, Dianchen
    Zhang, Jing
    Li, Lingzhi
    Zhou, Qiongyan
    Xu, Suling
    Zhang, Yingying
    COMPUTERS IN BIOLOGY AND MEDICINE, 2024, 169
  • [4] LTUNet: A Lightweight Transformer-Based UNet with Multi-scale Mechanism for Skin Lesion Segmentation
    Guo, Huike
    Zhang, Han
    Li, Minghe
    Quan, Xiongwen
    ARTIFICIAL INTELLIGENCE, CICAI 2023, PT II, 2024, 14474 : 147 - 158
  • [5] FNeXter: A Multi-Scale Feature Fusion Network Based on ConvNeXt and Transformer for Retinal OCT Fluid Segmentation
    Niu, Zhiyuan
    Deng, Zhuo
    Gao, Weihao
    Bai, Shurui
    Gong, Zheng
    Chen, Chucheng
    Rong, Fuju
    Li, Fang
    Ma, Lan
    SENSORS, 2024, 24 (08)
  • [6] Multi-scale local-global transformer with contrastive learning for biomarkers segmentation in retinal OCT images
    Liu, Xiaoming
    Ding, Yuanzhe
    Zhang, Ying
    Tang, Jinshan
    BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2024, 44 (01) : 231 - 246
  • [7] Gateinst: instance segmentation with multi-scale gated-enhanced queries in transformer decoder
    Lin, Chih-Wei
    Lin, Ye
    Zhou, Shangtai
    Zhu, Lirong
    MULTIMEDIA SYSTEMS, 2024, 30 (05)
  • [8] MAXFormer: Enhanced transformer for medical image segmentation with multi-attention and multi-scale features fusion
    Liang, Zhiwei
    Zhao, Kui
    Liang, Gang
    Li, Siyu
    Wu, Yifei
    Zhou, Yiping
    KNOWLEDGE-BASED SYSTEMS, 2023, 280
  • [9] Multi-scale Wavelet Network Algorithm for Pediatric Echocardiographic Segmentation via Feature Fusion
    Zhao, Cheng
    Xia, Bei
    Guo, Libao
    Du, Jie
    Chen, Weiling
    Wang, Tianfu
    Lei, Baiying
    2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 1402 - 1405
  • [10] Enhanced multi-scale networks for semantic segmentation
    Tianping Li
    Zhaotong Cui
    Yu Han
    Guanxing Li
    Meng Li
    Dongmei Wei
    Complex & Intelligent Systems, 2024, 10 : 2557 - 2568