Transformer with large convolution kernel decoder network for salient object detection in optical remote sensing images

被引:2
|
作者
Dong, Pengwei [1 ]
Wang, Bo [1 ]
Cong, Runmin [2 ]
Sun, Hai-Han [3 ]
Li, Chongyi [4 ]
机构
[1] Ningxia Univ, Sch Elect & Elect Engn, Yinchuan, Peoples R China
[2] Shandong Univ, Sch Control Sci & Engn, Shandong, Peoples R China
[3] Univ Wisconsin Madison, Dept Elect & Comp Engn, Madison, WI USA
[4] Nankai Univ, Sch Comp Sci, Tianjin, Peoples R China
关键词
Salient object detection; Optical remote sensing image; Transformer; Large convolutional kernel; ATTENTION; MODEL;
D O I
10.1016/j.cviu.2023.103917
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Despite salient object detection in optical remote sensing images (ORSI-SOD) has made great strides in recent years, it is still a very challenging topic due to various scales and shapes of objects, cluttered backgrounds, and diverse imaging orientations. Most previous deep learning-based methods fails to effectively capture local and global features, resulting in ambiguous localization and semantic information and inaccurate detail and boundary prediction for ORSI-SOD. In this paper, we propose a novel Transformer with large convolutional kernel decoding network, named TLCKD-Net, which effectively models the long-range dependence that is indispensable for feature extraction of ORSI-SOD. First, we utilize Transformer backbone network to perceive global and local details of salient objects. Second, a large convolutional kernel decoding module based on self-attention mechanism is designed for different sizes of salient objects to extract feature information at different scales. Then, a large convolutional refinement and a Salient Feature Enhancement Module are used to recover and refine the saliency features to obtain high quality saliency maps. Extensive experiments on two public ORSI-SOD datasets show that our proposed method outperforms 16 state-of-the-art methods both qualitatively and quantitatively. In addition, a series of ablation studies demonstrate the effectiveness of different modules for ORSI-SOD. Our source code is publicly available at https://github.com/Dpw506/TLCKD-Net.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Edge-Aware Multiscale Feature Integration Network for Salient Object Detection in Optical Remote Sensing Images
    Zhou, Xiaofei
    Shen, Kunye
    Liu, Zhi
    Gong, Chen
    Zhang, Jiyong
    Yan, Chenggang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [42] Adaptive Edge-Aware Semantic Interaction Network for Salient Object Detection in Optical Remote Sensing Images
    Zeng, Xiangyu
    Xu, Mingzhu
    Hu, Yijun
    Tang, Haoyu
    Hu, Yupeng
    Nie, Liqiang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [43] MEANet: An effective and lightweight solution for salient object detection in optical remote sensing images
    Liang, Bocheng
    Luo, Huilan
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [44] Scribble-attention hierarchical network for weakly supervised salient object detection in optical remote sensing images
    Ma, Lei
    Luo, Xinyi
    Hong, Hanyu
    Zhang, Yaozong
    Wang, Lei
    Wu, Jinmeng
    [J]. APPLIED INTELLIGENCE, 2023, 53 (10) : 12999 - 13017
  • [45] Scribble-attention hierarchical network for weakly supervised salient object detection in optical remote sensing images
    Lei Ma
    Xinyi Luo
    Hanyu Hong
    Yaozong Zhang
    Lei Wang
    Jinmeng Wu
    [J]. Applied Intelligence, 2023, 53 : 12999 - 13017
  • [46] Lightweight Salient Object Detection in Optical Remote Sensing Images via Feature Correlation
    Li, Gongyang
    Liu, Zhi
    Bai, Zhen
    Lin, Weisi
    Ling, Haibin
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [47] An Important Pick-and-Pass Gated Refinement Network for Salient Object Detection in Optical Remote Sensing Images
    Yang, Mo
    Liu, Ziyan
    Dong, Wen
    Wu, Ying
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 6505 - 6516
  • [48] PRNet: Parallel Refinement Network With Group Feature Learning for Salient Object Detection in Optical Remote Sensing Images
    Gu, Shengyu
    Song, Yong
    Zhou, Ya
    Bai, Yashuo
    Yang, Xin
    He, Yuxin
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [49] Boundary-Aware Salient Object Detection in Optical Remote-Sensing Images
    Yu, Longxuan
    Zhou, Xiaofei
    Wang, Lingbo
    Zhang, Jiyong
    [J]. ELECTRONICS, 2022, 11 (24)
  • [50] Object Detection in Optical Remote Sensing Images Based on Residual Network
    Li, Da
    Gong, Shaoxing
    Liu, Dong
    [J]. 2020 4TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND INFORMATION TECHNOLOGY (CMVIT 2020), 2020, 1518