MFFSODNet: Multiscale Feature Fusion Small Object Detection Network for UAV Aerial Images

被引:4
|
作者
Jiang, Lingjie [1 ,2 ,3 ]
Yuan, Baoxi [1 ,2 ,3 ]
Du, Jiawei [1 ]
Chen, Boyu [4 ]
Xie, Hanfei [1 ,2 ,3 ]
Tian, Juan [5 ]
Yuan, Ziqi [6 ]
机构
[1] Xijing Univ, Sch Elect Informat, Xian 710123, Peoples R China
[2] Xijing Univ, Xian Key Lab High Precis Ind Intelligent Vis Measu, Xian 710123, Peoples R China
[3] Shaanxi Jiurui Technol Co Ltd, Xian 710065, Shaanxi, Peoples R China
[4] Air Force Engn Univ, Air Traff Control & Ground Control Intercept Coll, Xian 710038, Peoples R China
[5] Xijing Univ, Sch Humanities & Educ, Xian 710123, Peoples R China
[6] Minzu Univ China, Sch Econ, Beijing 100081, Peoples R China
关键词
Deep learning; feature pyramid network (FPN); multiscale feature extraction; small object detection; unmanned aerial vehicle (UAV) aerial image;
D O I
10.1109/TIM.2024.3381272
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Unmanned aerial vehicle (UAV) aerial image object detection is a valuable and challenging research field. Despite the breakthrough of deep learning-based object detection networks in natural scenes, UAV images often exhibit characteristics such as a high proportion of small objects, dense distribution, and significant variations in object scales, posing great challenges for accurate detection. To address these issues, we propose an innovative multiscale feature fusion small object detection network (MFFSODNet). First, concerning the high proportion of small objects in UAV images, an additional tiny object prediction head is introduced instead of the large object prediction head. This approach provides a good detection accuracy of small objects and significantly reduces the parameters. Second, to enhance the feature extraction capability of the network for fine-grained information from small objects, a multiscale feature extraction module (MSFEM) is designed, which could extract rich and valuable multiscale feature information through convolution operation of different scales on multiple branches. Third, to fuse the fine-grained information from shallow feature maps and the semantic information from deep feature maps, a new bidirectional dense feature pyramid network (BDFPN) is proposed. By expanding the feature pyramid network scale and introducing skip connections, BDFPN achieves efficient multiscale information fusion. Extensive experiments on the VisDrone and UAVDT benchmark datasets demonstrate that MFFSODNet outperforms the state-of-the-art object detection methods and further validate the effectiveness and generalization of MFFSODNet on photovoltaic array defect datasets (PVDs).
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [1] An efficient feature aggregation network for small object detection in UAV aerial images
    Xiangqian Liu
    Guangwei Zhang
    Bing Zhou
    The Journal of Supercomputing, 81 (4)
  • [2] Lightweight Feature Fusion Network for Object Detection in Aerial Photography Images
    Fan Qiangqiang
    Shi Zaifeng
    Kong Fanning
    Li Shaoxiong
    Xiao Jun
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (10)
  • [3] GD-PAN: a multiscale fusion architecture applied to object detection in UAV aerial images
    Sun, Fengxi
    He, Ning
    Li, Runjie
    Wang, Xin
    Xu, Sunhan
    MULTIMEDIA SYSTEMS, 2024, 30 (03)
  • [4] Object Detection in Aerial Images Using a Multiscale Keypoint Detection Network
    Su, Jinhe
    Liao, JiaJia
    Gu, Dujuan
    Wang, Zongyue
    Cai, Guorong
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 1389 - 1398
  • [5] Improved Feature Fusion Network for Small Object Detection in Remote Sensing Images
    Li, Chao
    Wang, Kai
    Ding, Caichang
    Zhang, Jinyue
    Li, Jiabao
    Computer Engineering and Applications, 2023, 59 (17) : 232 - 241
  • [6] PSO-YOLO: a contextual feature enhancement method for small object detection in UAV aerial images
    Zhihong Zhao
    Xinyue Liu
    Peng He
    Earth Science Informatics, 2025, 18 (2)
  • [7] MFEFNet: A Multi-Scale Feature Information Extraction and Fusion Network for Multi-Scale Object Detection in UAV Aerial Images
    Zhou, Liming
    Zhao, Shuai
    Wan, Ziye
    Liu, Yang
    Wang, Yadi
    Zuo, Xianyu
    DRONES, 2024, 8 (05)
  • [8] Object Detection in Aerial Images Using Feature Fusion Deep Networks
    Long, Hao
    Chung, Yinung
    Liu, Zhenbao
    Bu, Shuhui
    IEEE ACCESS, 2019, 7 : 30980 - 30990
  • [9] A Multiscale Feature Fusion Method for Automatic Detection of Eggs From Two Pomacea Spp. In UAV Aerial Images
    Xu, Yaxin
    Liu, Ningzhong
    Yin, Tianxiang
    Sun, Han
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [10] Adaptive weighted multiscale feature fusion for small drone object detection
    Yuan, Yuman
    Guo, Hongwei
    Bai, Hongyang
    Qin, Weiwei
    JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (03)