MFFSODNet: Multiscale Feature Fusion Small Object Detection Network for UAV Aerial Images

被引:4
|
作者
Jiang, Lingjie [1 ,2 ,3 ]
Yuan, Baoxi [1 ,2 ,3 ]
Du, Jiawei [1 ]
Chen, Boyu [4 ]
Xie, Hanfei [1 ,2 ,3 ]
Tian, Juan [5 ]
Yuan, Ziqi [6 ]
机构
[1] Xijing Univ, Sch Elect Informat, Xian 710123, Peoples R China
[2] Xijing Univ, Xian Key Lab High Precis Ind Intelligent Vis Measu, Xian 710123, Peoples R China
[3] Shaanxi Jiurui Technol Co Ltd, Xian 710065, Shaanxi, Peoples R China
[4] Air Force Engn Univ, Air Traff Control & Ground Control Intercept Coll, Xian 710038, Peoples R China
[5] Xijing Univ, Sch Humanities & Educ, Xian 710123, Peoples R China
[6] Minzu Univ China, Sch Econ, Beijing 100081, Peoples R China
关键词
Deep learning; feature pyramid network (FPN); multiscale feature extraction; small object detection; unmanned aerial vehicle (UAV) aerial image;
D O I
10.1109/TIM.2024.3381272
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Unmanned aerial vehicle (UAV) aerial image object detection is a valuable and challenging research field. Despite the breakthrough of deep learning-based object detection networks in natural scenes, UAV images often exhibit characteristics such as a high proportion of small objects, dense distribution, and significant variations in object scales, posing great challenges for accurate detection. To address these issues, we propose an innovative multiscale feature fusion small object detection network (MFFSODNet). First, concerning the high proportion of small objects in UAV images, an additional tiny object prediction head is introduced instead of the large object prediction head. This approach provides a good detection accuracy of small objects and significantly reduces the parameters. Second, to enhance the feature extraction capability of the network for fine-grained information from small objects, a multiscale feature extraction module (MSFEM) is designed, which could extract rich and valuable multiscale feature information through convolution operation of different scales on multiple branches. Third, to fuse the fine-grained information from shallow feature maps and the semantic information from deep feature maps, a new bidirectional dense feature pyramid network (BDFPN) is proposed. By expanding the feature pyramid network scale and introducing skip connections, BDFPN achieves efficient multiscale information fusion. Extensive experiments on the VisDrone and UAVDT benchmark datasets demonstrate that MFFSODNet outperforms the state-of-the-art object detection methods and further validate the effectiveness and generalization of MFFSODNet on photovoltaic array defect datasets (PVDs).
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [41] Self-Attention Guidance and Multiscale Feature Fusion-Based UAV Image Object Detection
    Zhang, Yunzuo
    Wu, Cunyu
    Zhang, Tian
    Liu, Yameng
    Zheng, Yuxin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [42] Scale Enhancement Pyramid Network for Small Object Detection from UAV Images
    Sun, Jian
    Gao, Hongwei
    Wang, Xuna
    Yu, Jiahui
    ENTROPY, 2022, 24 (11)
  • [43] Multiscale Feature Aggregation Network for Salient Object Detection in Optical Remote Sensing Images
    Yan, Longquan
    Geng, Guohua
    Zhang, Qi
    Feng, Long
    Liu, Yangyang
    Ge, Xing
    Jia, Haotian
    IEEE SENSORS JOURNAL, 2023, 23 (16) : 18362 - 18373
  • [44] Multiscale Feature Enhancement Network for Salient Object Detection in Optical Remote Sensing Images
    Wang, Zhen
    Guo, Jianxin
    Zhang, Chuanlei
    Wang, Buhong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [45] Global attention network with multiscale feature fusion for infrared small target detection
    Zhang, Fan
    Lin, Shunlong
    Xiao, Xiaoyang
    Wang, Yun
    Zhao, Yuqian
    OPTICS AND LASER TECHNOLOGY, 2024, 168
  • [46] Small Object Detection in Remote Sensing Images Based on Feature Fusion and Attention
    Zhang Yin
    Zhu Guiyi
    Shi Tianjun
    Zhang Kun
    Yan Junhua
    ACTA OPTICA SINICA, 2022, 42 (24)
  • [47] A Self-Adaptive Object Detection Network for Aerial Images Based on Feature Enhancement
    Zhao, Ming
    Zhao, Kai
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [48] LGFF-YOLO: small object detection method of UAV images based on efficient local-global feature fusion
    Peng, Hongxing
    Xie, Haopei
    Liu, Huanai
    Guan, Xianlu
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (05)
  • [49] Adaptive Feature Fusion for Small Object Detection
    Zhang, Qi
    Zhang, Hongying
    Lu, Xiuwen
    APPLIED SCIENCES-BASEL, 2022, 12 (22):
  • [50] Multiscale Feature Fusion and Anchor Adaptive Object Detection Algorithm
    Zhang Runmei
    Bi Lijun
    Wang Fangbin
    Yuan Bin
    Luo Gu'an
    Jiang Huaizhen
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (12)