A Multi-Feature Fusion and Attention Network for Multi-Scale Object Detection in Remote Sensing Images

被引:6
|
作者
Cheng, Yong [1 ]
Wang, Wei [2 ]
Zhang, Wenjie [3 ]
Yang, Ling [1 ]
Wang, Jun [1 ]
Ni, Huan [4 ]
Guan, Tingzhao [1 ]
He, Jiaxin [2 ]
Gu, Yakang [1 ]
Tran, Ngoc Nguyen [5 ,6 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Software, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Automat, Nanjing 210044, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Geog Sci, Nanjing 210044, Peoples R China
[4] Nanjing Univ Informat Sci & Technol, Sch Remote Sensing & Geomat Engn, Nanjing 210044, Peoples R China
[5] Hanoi Univ Sci & Technol, Sch Informat & Commun Technol, Hanoi 100803, Vietnam
[6] Univ Technol Sydney, Sch Life Sci, Ultimo 2007, Australia
基金
中国国家自然科学基金;
关键词
remote sensing images; multi-scale object detection; multi-feature fusion and attention network; multi-branch convolution; attention mechanism; loss function;
D O I
10.3390/rs15082096
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Accurate multi-scale object detection in remote sensing images poses a challenge due to the complexity of transferring deep features to shallow features among multi-scale objects. Therefore, this study developed a multi-feature fusion and attention network (MFANet) based on YOLOX. By reparameterizing the backbone, fusing multi-branch convolution and attention mechanisms, and optimizing the loss function, the MFANet strengthened the feature extraction of objects at different sizes and increased the detection accuracy. The ablation experiment was carried out on the NWPU VHR-10 dataset. Our results showed that the overall performance of the improved network was around 2.94% higher than the average performance of every single module. Based on the comparison experiments, the improved MFANet demonstrated a high mean average precision of 98.78% for 9 classes of objects in the NWPU VHR-10 10-class detection dataset and 94.91% for 11 classes in the DIOR 20-class detection dataset. Overall, MFANet achieved an mAP of 96.63% and 87.88% acting on the NWPU VHR-10 and DIOR datasets, respectively. This method can promote the development of multi-scale object detection in remote sensing images and has the potential to serve and expand intelligent system research in related fields such as object tracking, semantic segmentation, and scene understanding.
引用
收藏
页数:19
相关论文
共 50 条
  • [41] A lightweight multi-scale context network for salient object detection in optical remote sensing images
    Lin, Yuhan
    Sun, Han
    Liu, Ningzhong
    Bian, Yetong
    Cen, Jun
    Zhou, Huiyu
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 238 - 244
  • [42] Transformer-based multi-scale feature fusion network for remote sensing change detection
    Liang, Shike
    Hua, Zhen
    Li, Jinjiang
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (04)
  • [43] MFSFNet: Multi-Scale Feature Subtraction Fusion Network for Remote Sensing Image Change Detection
    Huang, Zhiqi
    You, Hongjian
    [J]. REMOTE SENSING, 2023, 15 (15)
  • [44] Remote sensing image target detection based on a multi-scale deep feature fusion network
    Fan X.
    Yan W.
    Shi P.
    Zhang X.
    [J]. National Remote Sensing Bulletin, 2022, 26 (11): : 2292 - 2303
  • [45] Accurate Retrieval of Multi-scale Clothing Images Based on Multi-feature Fusion
    Wang Z.-W.
    Pu Y.-Y.
    Wang X.
    Zhao Z.-P.
    Xu D.
    Qian W.-H.
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2020, 43 (04): : 740 - 754
  • [46] Multi-Scale Feature Interaction Network for Remote Sensing Change Detection
    Zhang, Chong
    Zhang, Yonghong
    Lin, Haifeng
    [J]. REMOTE SENSING, 2023, 15 (11)
  • [47] Multi-scale feature fusion with attention mechanism for crowded road object detection
    Wu, Jingtao
    Dai, Guojun
    Zhou, Wenhui
    Zhu, Xudong
    Wang, Zengguan
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (02)
  • [48] Multi-scale feature fusion with attention mechanism for crowded road object detection
    Jingtao Wu
    Guojun Dai
    Wenhui Zhou
    Xudong Zhu
    Zengguan Wang
    [J]. Journal of Real-Time Image Processing, 2024, 21
  • [49] Residual attention mechanism and weighted feature fusion for multi-scale object detection
    Zhang, Jie
    Qi, Qiye
    Zhang, Huanlong
    Du, Qifan
    Wang, Fengxian
    Shi, Xiaoping
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (26) : 40873 - 40889
  • [50] A Multi-Feature Fusion-Based Change Detection Method for Remote Sensing Images
    Cai, Liping
    Shi, Wenzhong
    Hao, Ming
    Zhang, Hua
    Gao, Lipeng
    [J]. JOURNAL OF THE INDIAN SOCIETY OF REMOTE SENSING, 2018, 46 (12) : 2015 - 2022