Tiny-Lesion Segmentation in OCT via Multi-scale Wavelet Enhanced Transformer

被引:4
|
作者
Wang, Meng [1 ]
Yu, Kai [2 ]
Xu, Xinxing [1 ]
Zhou, Yi [3 ]
Peng, Yuanyuan [3 ]
Xu, Yanyu [1 ]
Goh, Rick Siow Mong [1 ]
Liu, Yong [1 ]
Fu, Huazhu [1 ]
机构
[1] ASTAR, Inst High Performance Comp, Singapore 138632, Singapore
[2] Zhejiang Univ, Childrens Hosp, Natl Clin Res Ctr Child Hlth, Sch Med, Hangzhou 310057, Zhejiang, Peoples R China
[3] Soochow Univ, Sch Elect & Informat Engn, Suzhou 215006, Jiangsu, Peoples R China
关键词
OCT images; Lesion segmentation; Wavelet; Transformer; NETWORK;
D O I
10.1007/978-3-031-16525-2_13
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
The accurate segmentation of retinal lesions from OCT images can greatly aid ophthalmologists in evaluating retinal diseases. However, it remains a challenge to accurately segment retinal lesions in OCT images. This is due to the complicated pathological features of retinal diseases, resulting in severe regional scale imbalance between different lesions, and leading to the problem of target tendency of the network during training, subsequently resulting in the segmentation performance reduction for tiny-lesion. Aiming to solve these challenges, we propose a novel multi-scale wavelet enhanced transformer network for tiny-lesion segmentation in retinal OCT images. In the proposed model, we first design a novel adaptive wavelet down-sampling module combined with the pre-trained ResNet blocks as the feature extractor network, which can generate a wavelet representation to improve the model's interpretability while avoiding feature loss, and further enhancing the ability of the network to represent local detailed features. Meanwhile, we also develop a novel multi-scale transformer module to further improve the model's capacity of extracting the multi-scale long-dependent global features of the retinal lesions in OCT images. Finally, the proposed method is evaluated on the public database of AI-Challenge 2018 for retinal edema lesions joint segmentation, and the results indicate that the proposed method achieves better segmentation performance than other state-of-the-art networks, especially for tiny PED lesions with very small regional proportions.
引用
收藏
页码:125 / 134
页数:10
相关论文
共 50 条
  • [41] Progressive Multi-scale Consistent Network for Multi-class Fundus Lesion Segmentation
    He, Along
    Wang, Kai
    Li, Tao
    Bo, Wang
    Kang, Hong
    Fu, Huazhu
    arXiv, 2022,
  • [42] Multi-scale Descriptors For Contour Irregularity Of Skin Lesion Using Wavelet Decomposition
    Ma, Li
    Qin, Bo
    Xu, Weidong
    Zhu, Lei
    2010 3RD INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING AND INFORMATICS (BMEI 2010), VOLS 1-7, 2010, : 414 - 418
  • [43] MSA-MaxNet: Multi-Scale Attention Enhanced Multi-Axis Vision Transformer Network for Medical Image Segmentation
    Wu, Wei
    Huang, Junfeng
    Zhang, Mingxuan
    Li, Yichen
    Yu, Qijia
    Zhao, Qi
    JOURNAL OF CELLULAR AND MOLECULAR MEDICINE, 2024, 28 (24)
  • [44] BreakNet: discontinuity-resilient multi-scale transformer segmentation of retinal layers
    Ganjee, Razieh
    Wang, Bingjie
    Wang, Lingyun
    Zhao, Chengcheng
    Sahel, Jose-Alain
    Pi, Shaohua
    BIOMEDICAL OPTICS EXPRESS, 2024, 15 (12): : 6725 - 6738
  • [45] Multi-Scale Orthogonal Model CNN-Transformer for Medical Image Segmentation
    Zhou, Wuyi
    Zeng, Xianhua
    Zhou, Mingkun
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (10)
  • [46] Feature ensemble network for medical image segmentation with multi-scale atrous transformer
    Gai, Di
    Geng, Yuhan
    Huang, Xia
    Huang, Zheng
    Xiong, Xin
    Zhou, Ruihua
    Wang, Qi
    IET IMAGE PROCESSING, 2024, 18 (11) : 3082 - 3092
  • [47] EMSFomer: Efficient Multi-Scale Transformer for Real-Time Semantic Segmentation
    Xia, Zhengyu
    Kim, Joohee
    IEEE ACCESS, 2025, 13 : 18239 - 18252
  • [48] MulTNet: A Multi-Scale Transformer Network for Marine Image Segmentation toward Fishing
    Xu, Xi
    Qin, Yi
    Xi, Dejun
    Ming, Ruotong
    Xia, Jie
    SENSORS, 2022, 22 (19)
  • [49] MULTI-SCALE CONVOLUTION-TRANSFORMER FUSION NETWORK FOR ENDOSCOPIC IMAGE SEGMENTATION
    Zou, Baosheng
    Zhou, Zongguang
    Han, Ying
    Li, Kang
    Wang, Guotai
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [50] A Road Crack Segmentation Method Based on Transformer and Multi-Scale Feature Fusion
    Xu, Yang
    Xia, Yonghua
    Zhao, Quai
    Yang, Kaihua
    Li, Qiang
    ELECTRONICS, 2024, 13 (12)