MFST: A Multi-Level Fusion Network for Remote Sensing Scene Classification

被引:14
|
作者
Wang, Guoqing [1 ]
Zhang, Ning [1 ]
Liu, Wenchao [1 ]
Chen, He [1 ]
Xie, Yizhuang [1 ]
机构
[1] Beijing Inst Technol, Beijing Key Lab Embedded Real Time Informat Proc, Beijing 100081, Peoples R China
关键词
Transformers; Semantics; Merging; Feature extraction; Computational modeling; Remote sensing; Computer architecture; Feature fusion; multi-level; remote sensing (RS) scene classification; Transformer;
D O I
10.1109/LGRS.2022.3205417
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Scene classification has become an active research area in remote sensing (RS) image interpretation. Recently, Transformer-based methods have shown great potential in modeling global semantic information and have been exploited in RS scene classification. In this letter, we propose a multi-level fusion Swin Transformer (MFST), which integrates a multi-level feature merging (MFM) module and an adaptive feature compression (AFC) module to further boost the performance for RS scene classification. The MFM module narrows the semantic gaps in multi-level features via patch merging in lower-level feature maps and lateral connections in the top-down pathway. The AFC module makes multi-level features have smaller dimensions and more coherent semantic information by adaptive channel reduction. We evaluate the proposed network on the aerial image dataset (AID) and NWPU-RESISC45 (NWPU) datasets, and the classification results reveal that the proposed network outperforms several state-of-the-art (SOTA) methods.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Remote Sensing Scene Classification Using Heterogeneous Feature Extraction and Multi-Level Fusion
    Wang, Xin
    Xu, Mingjun
    Xiong, Xingnan
    Ning, Chen
    [J]. IEEE ACCESS, 2020, 8 : 217628 - 217641
  • [2] Remote Sensing Scene Image Classification Based on Dense Fusion of Multi-level Features
    Shi, Cuiping
    Zhang, Xinlei
    Sun, Jingwei
    Wang, Liguo
    [J]. REMOTE SENSING, 2021, 13 (21)
  • [3] Remote Sensing Image Scene Classification via Multi-Level Representation Learning
    Fu, Wei
    Yang, Lishuang
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2942 - 2948
  • [4] Optical Remote Sensing Image Scene Classification Based on Multi-level Cross-layer Bilinear Fusion
    Yu Tianwei
    Zheng Enrang
    Shen Junge
    Wang Kai
    [J]. ACTA PHOTONICA SINICA, 2022, 51 (02)
  • [5] A Multi-Level Feature Fusion Network for Remote Sensing Image Segmentation
    Dong, Sijun
    Chen, Zhengchao
    [J]. SENSORS, 2021, 21 (04) : 1 - 18
  • [6] Enhanced multi-level features for very high resolution remote sensing scene classification
    Sitaula, Chiranjibi
    Sumesh, K. C.
    Aryal, Jagannath
    [J]. NEURAL COMPUTING & APPLICATIONS, 2024, 36 (13): : 7071 - 7083
  • [7] Enhanced multi-level features for very high resolution remote sensing scene classification
    Chiranjibi Sitaula
    Sumesh KC
    Jagannath Aryal
    [J]. Neural Computing and Applications, 2024, 36 : 7071 - 7083
  • [8] Multilayer Feature Fusion Network for Scene Classification in Remote Sensing
    Xu, Kejie
    Huang, Hong
    Li, Yuan
    Shi, Guangyao
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (11) : 1894 - 1898
  • [9] A Multi-Level Convolution Pyramid Semantic Fusion Framework for High-Resolution Remote Sensing Image Scene Classification and Annotation
    Sun, Xiongli
    Zhu, Qiqi
    Qin, Qianqing
    [J]. IEEE ACCESS, 2021, 9 : 18195 - 18208
  • [10] Multi-Level Manifolds for Remote Sensing Imagery Classification
    Mangalraj, P.
    Agrawal, Anupam
    [J]. ELEVENTH INTERNATIONAL CONFERENCE ON COMMUNICATION NETWORKS, ICCN 2015/INDIA ELEVENTH INTERNATIONAL CONFERENCE ON DATA MINING AND WAREHOUSING, ICDMW 2015/NDIA ELEVENTH INTERNATIONAL CONFERENCE ON IMAGE AND SIGNAL PROCESSING, ICISP 2015, 2015, 54 : 654 - 660