Improved YOLOv5-S object detection method for optical remote sensing images based on contextual transformer

被引:9
|
作者
Zhou, Qikai [1 ]
Zhang, Wei [1 ]
Li, Ruizhi [1 ]
Wang, Jin [1 ]
Zhen, Shuhui [1 ]
Niu, Fu [1 ]
机构
[1] Acad Mil Sci Chinese PLA, Inst Syst Engn, Beijing, Peoples R China
关键词
deep learning; object detection; YOLOv5; attention mechanism; multiscale;
D O I
10.1117/1.JEI.31.4.043049
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To address the problems of error and omission detection in remote sensing image detection caused by the diverse scale changes of remote sensing object scales and the abundant proportion of small-scale objects, as well as the global and dense distribution of remote sensing objects, a remote sensing image detection improvement method based on YOLOv5-S is proposed. First, according to the characteristics of remote sensing objects, the data enhancement strategy is adopted to expand the dataset samples for the characteristics of remote sensing objects to improve the generalization ability of the model. Second, the contextual transformer module is introduced to the backbone feature extraction network and the feature fusion network to ensure the local feature extraction capability while improving the global information acquisition capability of the model, making full use of the input contextual information and guiding the dynamic attention matrix learning to improve the visual representation ability. Third, based on the original model, a shallow detection scale is added, and then a multiscale complex fusion structure is adopted. Meanwhile, the K-means++ algorithm replaces the original K-means algorithm and then clusters 12 anchor box sizes. Fourth, the efficient intersection over union loss is used to improve the accuracy of the remote sensing object recognition prediction. In the experiment on the on two optical remote sensing image datasets, a comparison with several object detection algorithms based on convolutional neural network is made, the results show that the mAP@0.5 tested on the remote sensing datasets is higher than the original YOLOv5-S. Compared with other models, the detection efficiency is higher, and the problems of small-scale object detection in remote sensing image have been significantly improved.
引用
收藏
页数:18
相关论文
共 50 条
  • [21] NRT-YOLO: Improved YOLOv5 Based on Nested Residual Transformer for Tiny Remote Sensing Object Detection
    Liu, Yukuan
    He, Guanglin
    Wang, Zehu
    Li, Weizhe
    Huang, Hongfei
    SENSORS, 2022, 22 (13)
  • [22] Medical waste detection base on improved YOLOv5-s
    Zhang Shaowen
    Shi Weiya
    Yang Jingfeng
    FOURTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING, ICGIP 2022, 2022, 12705
  • [23] Automatic Ship Object Detection Model Based on YOLOv4 with Transformer Mechanism in Remote Sensing Images
    Sun, Bowen
    Wang, Xiaofeng
    Oad, Ammar
    Pervez, Amjad
    Dong, Feng
    APPLIED SCIENCES-BASEL, 2023, 13 (04):
  • [24] Arbitrarily Oriented Object Detection in Remote Sensing Images Based on Improved YOLOv4-CSP
    Zheng, Ziyang
    Zhang, Ting
    Liu, Zhaoying
    Liu, Bo
    Li, Yujian
    Sun, Changming
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 9355 - 9368
  • [25] Faster and Lightweight: An Improved YOLOv5 Object Detector for Remote Sensing Images
    Zhang, Jiarui
    Chen, Zhihua
    Yan, Guoxu
    Wang, Yi
    Hu, Bo
    REMOTE SENSING, 2023, 15 (20)
  • [26] An Efficient Object Detection Algorithm Based on Improved YOLOv5 for High-Spatial-Resolution Remote Sensing Images
    Cao, Feng
    Xing, Bing
    Luo, Jiancheng
    Li, Deyu
    Qian, Yuhua
    Zhang, Chao
    Bai, Hexiang
    Zhang, Hu
    REMOTE SENSING, 2023, 15 (15)
  • [27] C3TB-YOLOv5: integrated YOLOv5 with transformer for object detection in high-resolution remote sensing images
    Wu, Qinggang
    Li, Yang
    Huang, Wei
    Chen, Qiqiang
    Wu, Yonglei
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (08) : 2622 - 2650
  • [28] Small target detection with remote sensing images based on an improved YOLOv5 algorithm
    Pei, Wenjing
    Shi, Zhanhao
    Gong, Kai
    FRONTIERS IN NEUROROBOTICS, 2023, 16
  • [29] Small Target Detection Method in Remote Sensing Images Based on Improved YOLOv7
    Miao, Ru
    Yue, Ming
    Zhou, Ke
    Yang, Yang
    Computer Engineering and Applications, 2024, 60 (10) : 246 - 255
  • [30] Object Detection Based on BING in Optical Remote Sensing Images
    Zheng, Jiangbin
    Xi, Yue
    Feng, Mingchen
    Lie, Xiuxiu
    Li, Na
    2016 9TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2016), 2016, : 504 - 509