Local Reversible Transformer for semantic segmentation of grape leaf diseases

被引:8
|
作者
Zhang, Xinxin [1 ,2 ]
Li, Fei [1 ]
Jin, Haibin [1 ,2 ]
Mu, Weisong [1 ,2 ,3 ]
机构
[1] China Agr Univ, Coll Informat & Elect Engn, Beijing 100083, Peoples R China
[2] Minist Agr, Key Lab Viticulture & Enol, Beijing 100083, Peoples R China
[3] China Agr Univ, POB 121,17 Tsinghua East Rd, Beijing 100083, Peoples R China
关键词
Local learning bottleneck; Reversible downsampling; Grape leaf diseases; Semantic segmentation;
D O I
10.1016/j.asoc.2023.110392
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Grape leaf diseases segmentation is an essential basis for achieving precise diagnosis and identification of diseases. However, the complex background renders it difficult for small disease areas to be precisely segmented. The existing Transformer mainly focuses on utilizing key and value downsampling to improve model performance while neglecting that downsampling is irreversible with the loss of contextual information. To this end, this paper proposed a novel Locally Reversible Transformer (LRT) segmentation model for grape leaf diseases in natural scene images, whose representation is learned in a reversible downsampling manner. Specifically, a Local Learning Bottleneck (LLB) is developed to enhance local perception and extract richer semantic information of grape leaf diseases via inverted residual convolution. Furthermore, motivated by the wavelet theory, the Reversible Attention (RA) is designed to replace the original downsampling operation by introducing wavelet transform into the multi-headed attention and solving the problem of difficult detection and segmentation of small disease targets with complex backgrounds. Extensive experiments demonstrate that the segmentation performance of LRT outperforms state-of-the-art models with comparable GFLOPs and parameters. Moreover, LRT can retain more multi-grain information and can increase the receptive field to focus on small disease regions with complex backgrounds.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] UPFormer: U-sharped Perception lightweight Transformer for segmentation of field grape leaf diseases
    Zhang, Xinxin
    Li, Fei
    Zheng, Haiying
    Mu, Weisong
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 249
  • [2] A reversible transformer for LiDAR point cloud semantic segmentation
    Akwensi, Perpertual Hope
    Wang, Ruisheng
    2023 20TH CONFERENCE ON ROBOTS AND VISION, CRV, 2023, : 19 - 28
  • [3] CRFormer: Cross-Resolution Transformer for segmentation of grape leaf
    Zhang, Xinxin
    Cen, Chaojun
    Li, Fei
    Liu, Meng
    Mu, Weisong
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 229
  • [4] Deep semantic segmentation for the quantification of grape foliar diseases in the vineyard
    Liu, Ertai
    Gold, Kaitlin M.
    Combs, David
    Cadle-Davidson, Lance
    Jiang, Yu
    FRONTIERS IN PLANT SCIENCE, 2022, 13
  • [5] Enhancing Semantically Masked Transformer With Local Attention for Semantic Segmentation
    Xia, Zhengyu
    Kim, Joohee
    IEEE ACCESS, 2023, 11 : 122345 - 122356
  • [6] FSCformernet: A Fourier-Transformer UNet for Efficient Semantic Segmentation of Plant Leaf
    Deng, Jianguo
    Wang, Yuan
    Zhang, Chuanlei
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT XI, ICIC 2024, 2024, 14872 : 266 - 277
  • [7] TrSeg: Transformer for semantic segmentation
    Jin, Youngsaeng
    Han, David
    Ko, Hanseok
    PATTERN RECOGNITION LETTERS, 2021, 148 : 29 - 35
  • [8] Segmenter: Transformer for Semantic Segmentation
    Strudel, Robin
    Garcia, Ricardo
    Laptev, Ivan
    Schmid, Cordelia
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 7242 - 7252
  • [9] Leveraging Swin Transformer for Local-to-Global Weakly Supervised Semantic Segmentation
    Ahmadi, Rozhan
    Kasaei, Shohreh
    PROCEEDINGS OF THE 13TH IRANIAN/3RD INTERNATIONAL MACHINE VISION AND IMAGE PROCESSING CONFERENCE, MVIP, 2024, : 117 - 123
  • [10] Local Transformer Network on 3D Point Cloud Semantic Segmentation
    Wang, Zijun
    Wang, Yun
    An, Lifeng
    Liu, Jian
    Liu, Haiyang
    INFORMATION, 2022, 13 (04)