Accurate UAV Small Object Detection Based on HRFPN and EfficentVMamba

被引:0
|
作者
Wu, Shixiao [1 ]
Lu, Xingyuan [2 ]
Guo, Chengcheng [3 ,4 ]
Guo, Hong [5 ]
机构
[1] Wuhan Business Univ, Sch Informat Engn, Wuhan 430056, Peoples R China
[2] Tianjin Univ Technol, Key Lab Comp Vis & Syst, Minist Educ, Tianjin 300384, Peoples R China
[3] Wuhan Coll, Sch Informat Engn, Wuhan 430212, Peoples R China
[4] Wuhan Univ, Sch Elect Informat, Wuhan 430072, Peoples R China
[5] Tianjin Univ Technol, Sch Comp Sci & Engn, Tianjin 300384, Peoples R China
关键词
small object detection; deep learning; HRNet; Mamba; YOLO; feature fusion; NEURAL-NETWORK;
D O I
10.3390/s24154966
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
(1) Background: Small objects in Unmanned Aerial Vehicle (UAV) images are often scattered throughout various regions of the image, such as the corners, and may be blocked by larger objects, as well as susceptible to image noise. Moreover, due to their small size, these objects occupy a limited area in the image, resulting in a scarcity of effective features for detection. (2) Methods: To address the detection of small objects in UAV imagery, we introduce a novel algorithm called High-Resolution Feature Pyramid Network Mamba-Based YOLO (HRMamba-YOLO). This algorithm leverages the strengths of a High-Resolution Network (HRNet), EfficientVMamba, and YOLOv8, integrating a Double Spatial Pyramid Pooling (Double SPP) module, an Efficient Mamba Module (EMM), and a Fusion Mamba Module (FMM) to enhance feature extraction and capture contextual information. Additionally, a new Multi-Scale Feature Fusion Network, High-Resolution Feature Pyramid Network (HRFPN), and FMM improved feature interactions and enhanced the performance of small object detection. (3) Results: For the VisDroneDET dataset, the proposed algorithm achieved a 4.4% higher Mean Average Precision (mAP) compared to YOLOv8-m. The experimental results showed that HRMamba achieved a mAP of 37.1%, surpassing YOLOv8-m by 3.8% (Dota1.5 dataset). For the UCAS_AOD dataset and the DIOR dataset, our model had a mAP 1.5% and 0.3% higher than the YOLOv8-m model, respectively. To be fair, all the models were trained without a pre-trained model. (4) Conclusions: This study not only highlights the exceptional performance and efficiency of HRMamba-YOLO in small object detection tasks but also provides innovative solutions and valuable insights for future research.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] The Research of Small Object Detection based on YOLOX in UAV
    Liu, Xinli
    Yang, Ming
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 507 - 512
  • [2] UAV Image Small Object Detection Based on RSAD Algorithm
    Song, Jian
    Yu, Zhihong
    Qi, Guimei
    Su, Qiang
    Xie, Jingjing
    Liu, Wenhang
    APPLIED SCIENCES-BASEL, 2023, 13 (20):
  • [3] Small-Object Detection for UAV-Based Images
    Yu, Mingrui
    Leung, Henry
    2023 IEEE INTERNATIONAL SYSTEMS CONFERENCE, SYSCON, 2023,
  • [4] EFFICIENT AND ACCURATE GIRAFFE-DET FOR UAV IMAGE BASED OBJECT DETECTION
    Ran, Qinglin
    Zhang, Chenglong
    Wei, Wei
    Zhang, Lei
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6190 - 6193
  • [5] Enhancing Dense Small Object Detection in UAV Images Based on HybridTransformer
    Feng, Changfeng
    Wang, Chunping
    Zhang, Dongdong
    Kou, Renke
    Fu, Qiang
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 78 (03): : 3993 - 4013
  • [6] UAV Image Small Object Detection Based on Composite Backbone Network
    Liu, Wuji
    Qiang, Jun
    Li, Xixi
    Guan, Ping
    Du, Yunlong
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [7] Small object detection based on YOLOv8 in UAV perspective
    Ning, Tao
    Wu, Wantong
    Zhang, Jin
    PATTERN ANALYSIS AND APPLICATIONS, 2024, 27 (03)
  • [8] Dense and Small Object Detection in UAV Vision based on Cascade Network
    Zhang, Xindi
    Izquierdo, Ebroul
    Chandramouli, Krishna
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 118 - 126
  • [9] FAST AND ACCURATE, CONVOLUTIONAL NEURAL NETWORK BASED APPROACH FOR OBJECT DETECTION FROM UAV
    Wang, Xiaoliang
    Cheng, Peng
    Liu, Xinchuan
    Uzochukwu, Benedict
    IECON 2018 - 44TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2018, : 3171 - 3175
  • [10] Super accurate low latency object detection on a surveillance UAV
    Vandersteegen, Maarten
    Van Beeck, Kristof
    Goedeme, Toon
    PROCEEDINGS OF MVA 2019 16TH INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS (MVA), 2019,