Enhancing Object Detection in Remote Sensing: A Hybrid YOLOv7 and Transformer Approach with Automatic Model Selection

被引:1
|
作者
Ahmed, Mahmoud [1 ]
El-Sheimy, Naser [2 ]
Leung, Henry [1 ]
Moussa, Adel [2 ,3 ]
Ghamisi, Pedram
Zhang, Ce
Hong, Danfeng
Zhu, Qiqi
机构
[1] Univ Calgary, Dept Elect & Software Engn, Calgary, AB T2N 1N4, Canada
[2] Univ Calgary, Dept Geomat Engn, Calgary, AB T2N 1N4, Canada
[3] Port Said Univ, Dept Elect & Comp Engn, Port Said 42523, Egypt
关键词
object detection; detection transformer; YOLOv7; multimodalities; NETWORKS;
D O I
10.3390/rs16010051
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In the remote sensing field, object detection holds immense value for applications such as land use classification, disaster monitoring, and infrastructure planning, where accurate and efficient identification of objects within images is essential for informed decision making. However, achieving object localization with high precision can be challenging even if minor errors exist at the pixel level, which can significantly impact the ground distance measurements. To address this critical challenge, our research introduces an innovative hybrid approach that combines the capabilities of the You Only Look Once version 7 (YOLOv7) and DEtection TRansformer (DETR) algorithms. By bridging the gap between local receptive field and global context, our approach not only enhances overall object detection accuracy, but also promotes precise object localization, a key requirement in the field of remote sensing. Furthermore, a key advantage of our approach is the introduction of an automatic selection module which serves as an intelligent decision-making component. This module optimizes the selection process between YOLOv7 and DETR, and further improves object detection accuracy. Finally, we validate the improved performance of our new hybrid approach through empirical experimentation, and thus confirm its contribution to the field of target recognition and detection in remote sensing images.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Enhanced object detection in remote sensing images by applying metaheuristic and hybrid metaheuristic optimizers to YOLOv7 and YOLOv8
    Khaled Mohammed Elgamily
    M. A. Mohamed
    Ahmed Mohamed Abou-Taleb
    Mohamed Maher Ata
    Scientific Reports, 15 (1)
  • [2] Improved Architecture and Training Strategies of YOLOv7 for Remote Sensing Image Object Detection
    Zhao, Dewei
    Shao, Faming
    Liu, Qiang
    Zhang, Heng
    Zhang, Zihan
    Yang, Li
    REMOTE SENSING, 2024, 16 (17)
  • [3] Improved YOLOv7 Automatic Driving Object Detection Algorithm
    Hu, Miao
    Jiang, Lin
    Tao, Youfeng
    Zhang, Zhijian
    Computer Engineering and Applications, 60 (11): : 165 - 172
  • [4] Automatic Ship Object Detection Model Based on YOLOv4 with Transformer Mechanism in Remote Sensing Images
    Sun, Bowen
    Wang, Xiaofeng
    Oad, Ammar
    Pervez, Amjad
    Dong, Feng
    APPLIED SCIENCES-BASEL, 2023, 13 (04):
  • [5] Improved remote sensing image target detection based on YOLOv7
    XU Shuanglong
    CHEN Zhihong
    ZHANG Haiwei
    XUE Lifang
    SU Huijun
    Optoelectronics Letters, 2024, 20 (04) : 234 - 242
  • [6] Object Detection with YOLOv7 Model on Smart Mobile Devices
    Karadag, Batuhan
    Ari, Ali
    JOURNAL OF POLYTECHNIC-POLITEKNIK DERGISI, 2023, 26 (03): : 1207 - 1214
  • [7] Improved remote sensing image target detection based on YOLOv7
    Shuanglong Xu
    Zhihong Chen
    Haiwei Zhang
    Lifang Xue
    Huijun Su
    Optoelectronics Letters, 2024, 20 : 234 - 242
  • [8] Improved remote sensing image target detection based on YOLOv7
    Xu, Shuanglong
    Chen, Zhihong
    Zhang, Haiwei
    Xue, Lifang
    Su, Huijun
    OPTOELECTRONICS LETTERS, 2024, 20 (04) : 234 - 242
  • [9] Automatic Acne Detection Model Based on Improved YOLOv7
    Zhang, Delong
    Jin, Chunyang
    Zhang, Zhidong
    Cao, Xiyuan
    Xue, Chenyang
    IEEE Access, 2024, 12 : 194390 - 194398
  • [10] YOLO-FNC: An Improved Method for Small Object Detection in Remote Sensing Images Based on YOLOv7
    Dang, Lanxue
    Liu, Gang
    Hou, Yan-e
    Han, Hongyu
    IAENG International Journal of Computer Science, 2024, 51 (09) : 1281 - 1290