An Attention-Enhanced End-to-End Discriminative Network With Multiscale Feature Learning for Remote Sensing Image Retrieval

被引:0
|
作者
Hou, Dongyang [1 ]
Wang, Siyuan [1 ]
Tian, Xueqing [1 ]
Xing, Huaqiao [2 ]
机构
[1] Cent South Univ, Sch Geosci & Infophys, Changsha 410000, Peoples R China
[2] Shandong Jianzhu Univ, Sch Surveying & Geoinformat, Jinan 250101, Peoples R China
基金
中国国家自然科学基金;
关键词
Convolution; Feature extraction; Remote sensing; Smoothing methods; Image retrieval; Residual neural networks; Representation learning; Attention mechanism; convolutional neural networks (CNNs); multiscale features; remote sensing image (RSI) retrieval;
D O I
10.1109/JSTARS.2022.3208107
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The discriminative ability of image features plays a decisive role in content-based remote sensing image retrieval (CBRSIR). However, the widely-used convolutional neural networks cannot focus on the discriminative features of important scenes, resulting in unsatisfactory retrieval performance in complex contexts. In this article, an attention-enhanced end-to-end discriminative network with multiscale learning for CBRSIR is proposed to solve this issue. First, a multiscale dilated convolution module is embedded into some of ResNet50's residual blocks to increase the perceptual field and capture the multiscale features of remote sensing image scenes. Then, a lightweight and efficient triplet attention module is added behind each residual block to capture the salient features of remote sensing images and establish the interdimensional dependencies using residual transform. In addition, the end-to-end training approach is performed using an online label smoothing loss to reduce the intraclass variance of features and enhance interclass differentiability. Experimental results on four publicly available remote sensing image datasets show that our network achieves state-of-the-art or competitive performance, especially on complex scene dataset UCMD with an average retrieval precision improvement of 3.23% to 29.35% compared to other new methods.
引用
收藏
页码:8245 / 8255
页数:11
相关论文
共 50 条
  • [1] An Attention-Enhanced End-to-End Discriminative Network With Multiscale Feature Learning for Remote Sensing Image Retrieval
    Hou, Dongyang
    Wang, Siyuan
    Tian, Xueqing
    Xing, Huaqiao
    [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022, 15 : 8245 - 8255
  • [2] Joint learning using multiscale attention-enhanced features for remote sensing image scene classification
    Yu, Donghang
    Xu, Qing
    Liu, Xiangyun
    Lv, Liang
    Guo, Haitao
    Lu, Jun
    Lin, Yuzhun
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (03)
  • [3] END-TO-END LEARNING OF POLYGONS FOR REMOTE SENSING IMAGE CLASSIFICATION
    Girard, Nicolas
    Tarabalka, Yuliya
    [J]. IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 2083 - 2086
  • [4] A Discriminative Feature Learning Approach for Remote Sensing Image Retrieval
    Xiong, Wei
    Lv, Yafei
    Cui, Yaqi
    Zhang, Xiaohan
    Gu, Xiangqi
    [J]. REMOTE SENSING, 2019, 11 (03)
  • [5] End-to-end Learning for Encrypted Image Retrieval
    Feng, Qihua
    Li, Peiya
    Lu, ZhiXun
    Liu, Guan
    Huang, Feiran
    [J]. 2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2021, : 1839 - 1845
  • [6] Learning to localize image forgery using end-to-end attention network
    Ganapathi, Iyyakutti Iyappan
    Javed, Sajid
    Ali, Syed Sadaf
    Mahmood, Arif
    Vu, Ngoc-Son
    Werghi, Naoufel
    [J]. NEUROCOMPUTING, 2022, 512 : 25 - 39
  • [7] AN END-TO-END ADVERSARIAL HASHING METHOD FOR UNSUPERVISED MULTISPECTRAL REMOTE SENSING IMAGE RETRIEVAL
    Chen, Xuelei
    Lu, Cunyue
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 1536 - 1540
  • [8] An End-to-End Local-Global-Fusion Feature Extraction Network for Remote Sensing Image Scene Classification
    Lv, Yafei
    Zhang, Xiaohan
    Xiong, Wei
    Cui, Yaqi
    Cai, Mi
    [J]. REMOTE SENSING, 2019, 11 (24)
  • [9] End-to-End Detail-Enhanced Dehazing Network for Remote Sensing Images
    Dong, Weida
    Wang, Chunyan
    Sun, Hao
    Teng, Yunjie
    Liu, Huan
    Zhang, Yue
    Zhang, Kailin
    Li, Xiaoyan
    Xu, Xiping
    [J]. REMOTE SENSING, 2024, 16 (02)
  • [10] Remote sensing image description based on word embedding and end-to-end deep learning
    Yuan Wang
    Hongbing Ma
    Kuerban Alifu
    Yalong Lv
    [J]. Scientific Reports, 11