Object Detection of Remote Sensing Image Based on Multi-Scale Feature Fusion and Attention Mechanism

被引:4
|
作者
Du, Zuoqiang [1 ]
Liang, Yuan [2 ]
机构
[1] Harbin Univ Commerce, Sch Comp & Informat Engn, Harbin 150028, Peoples R China
[2] Jinan Inspur Data Technol Co Ltd, Jinan 250000, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Deep Learning; object detection; remote sensing image; multi-scale feature fusion pyramid network; adaptive channel spatial attention mechanism; joint teacher knowledge distillation; CLASSIFICATION;
D O I
10.1109/ACCESS.2024.3352601
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In view of the small size and dense distribution of remote sensing image targets, this paper adds a detection head P2 specifically for small-scale targets on the basis of the three detection layers of the original YOLOv5 model, and involves the shallow high-resolution feature map in the subsequent multi-scale feature fusion module. The problem of losing the key feature information of the small-scale target in the process of multiple downsampling is effectively avoided. Firstly, an enhanced multi-scale feature fusion pyramid network DSI-FPN is designed. The FPN+PAN network is optimized by using DepthwiseSparable Convolution and Involution operators with fewer parameters and computations, as well as a spatial attention mechanism to generate feature graphs with richer information for network detection tasks. Secondly, we propose an adaptive channel spatial attention mechanism SCBAM, which introduces a self-attention mechanism into CBAM module to add non-local information to the interaction that originally had only local information, breaks the convolution kernel limit, expands the model receptive field, and improves the feature expression ability of the model. Thirdly, in order to solve the problem of insufficient computing power when deploying the target detector for equipment, we propose a network knowledge distillation framework for joint teachers based on the feature layer. The distillation loss of teacher is designed, and the trend of student online learning is adjusted dynamically by balancing the contributions of teacher network and truth value. The detection accuracy of the student network is obviously improved, and the parameters and model size of the network are effectively reduced. Finally, Comparing with other remote sensing image object detection methods, the experimental results show that the approach presented has better detection effect for small-scale targets of remote sensing images under different lighting conditions. The detection accuracy reached 43.9%, and 7.4% higher than that of the original model. After knowledge distillation, the model parameters are reduced to 1/3 of the original, and the detection accuracy is 40.2%.
引用
收藏
页码:8619 / 8632
页数:14
相关论文
共 50 条
  • [1] Remote Sensing Object Detection Method Based on Attention Mechanism and Multi-scale Feature Fusion
    Liu, Yang
    Xiao, Yewei
    [J]. 2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 7155 - 7160
  • [2] Small object detection in remote sensing images based on attention mechanism and multi-scale feature fusion
    Zhang, Li-guo
    Wang, Lei
    Jin, Mei
    Geng, Xing-shuo
    Shen, Qian
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (09) : 3280 - 3297
  • [3] Remote Sensing Small Object Detection Network Based on Attention Mechanism and Multi-Scale Feature Fusion
    Qu, Junsuo
    Tang, Zongbing
    Zhang, Le
    Zhang, Yanghai
    Zhang, Zhenguo
    [J]. REMOTE SENSING, 2023, 15 (11)
  • [4] SGMFNet: a remote sensing image object detection network based on spatial global attention and multi-scale feature fusion
    Gong, Xiaolin
    Liu, Daqing
    [J]. REMOTE SENSING LETTERS, 2024, 15 (05) : 466 - 477
  • [5] A Multi-Feature Fusion and Attention Network for Multi-Scale Object Detection in Remote Sensing Images
    Cheng, Yong
    Wang, Wei
    Zhang, Wenjie
    Yang, Ling
    Wang, Jun
    Ni, Huan
    Guan, Tingzhao
    He, Jiaxin
    Gu, Yakang
    Tran, Ngoc Nguyen
    [J]. REMOTE SENSING, 2023, 15 (08)
  • [6] Object Detection in Remote Sensing Images Based on Adaptive Multi-Scale Feature Fusion Method
    Liu, Chun
    Zhang, Sixuan
    Hu, Mengjie
    Song, Qing
    [J]. REMOTE SENSING, 2024, 16 (05)
  • [7] Multi-scale feature fusion with attention mechanism for crowded road object detection
    Wu, Jingtao
    Dai, Guojun
    Zhou, Wenhui
    Zhu, Xudong
    Wang, Zengguan
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (02)
  • [8] Multi-scale feature fusion with attention mechanism for crowded road object detection
    Jingtao Wu
    Guojun Dai
    Wenhui Zhou
    Xudong Zhu
    Zengguan Wang
    [J]. Journal of Real-Time Image Processing, 2024, 21
  • [9] Residual attention mechanism and weighted feature fusion for multi-scale object detection
    Zhang, Jie
    Qi, Qiye
    Zhang, Huanlong
    Du, Qifan
    Wang, Fengxian
    Shi, Xiaoping
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (26) : 40873 - 40889
  • [10] Residual attention mechanism and weighted feature fusion for multi-scale object detection
    Jie Zhang
    Qiye Qi
    Huanlong Zhang
    Qifan Du
    Fengxian Wang
    Xiaoping Shi
    [J]. Multimedia Tools and Applications, 2023, 82 : 40873 - 40889