Real-time Single Object Detection on The UAV

被引:0
|
作者
Wu, Hsiang-Huang [1 ]
Zhou, Zejian [2 ]
Feng, Ming [2 ]
Yan, Yuzhong [1 ]
Xu, Hao [2 ]
Qian, Lijun [1 ]
机构
[1] Texas A&M Univ Syst, Prairie View A&M Univ, Ctr Excellence Res & Educ Big Mil Data Intelligen, Prairie View, TX 77446 USA
[2] Univ Nevada, Dept Elect & Biomed Engn, Reno, NV 89557 USA
关键词
Computer Vision; Convolutional Neural Network (CNN); Embedded System; UAV; Multi-task Learning;
D O I
10.1109/icuas.2019.8797866
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The demand for mission critical tasks, especially for tracking on the UAVs, has been increasing due to their superior mobility. Out of necessity, the ability of processing large images emerges for object detection or tracking with UAVs. As such, the requirements of low latency and lack of Internet access under some circumstances become the major challenges. In this paper, we present a modeling method of CNN that is dedicated to single object detection on the UAV without any transfer learning model. Not limited to the features learned by the transfer learning model, the single object can be selected arbitrarily and specifically, even can be distinguished from those other objects in the same category. Our modeling method introduces the inducing neural network that follows the traditional CNN and plays the role of guiding the training in a fast and efficient way with respect to the training convergence and the model capacity. Using the dataset released by DAC 2018, which contains 98 classes and 96,408 images taken by UAVs, we present how our modeling method develops the inducing neural network that integrates multi-task learning drawn from the state-of-the-art works to achieve about 50% of IoU (Intersection over Union of the ground-truth bounding boxes and predicted bounding boxes) and 20 FPS running on NVIDIA Jetson TX2. Experimental results demonstrated fast inference of an image in size of 720x1280 and the UAV navigated itself to track the target (car) using the inference result.
引用
收藏
页码:1013 / 1022
页数:10
相关论文
共 50 条
  • [1] Real-Time Object Detection and Classification by UAV Equipped with SAR
    Gromada, Krzysztof
    Siemiatkowska, Barbara
    Stecz, Wojciech
    Plochocki, Krystian
    Wozniak, Karol
    [J]. SENSORS, 2022, 22 (05)
  • [2] Embedded Real-Time Object Detection for a UAV Warning System
    Tijtgat, Nils
    Van Ranst, Wiebe
    Volckaert, Bruno
    Goedeme, Toon
    De Turck, Filip
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 2110 - 2118
  • [3] Energy-Efficient Real-Time UAV Object Detection on Embedded Platforms
    Deng, Jianing
    Shi, Zhiguo
    Zhuo, Cheng
    [J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2020, 39 (10) : 3123 - 3127
  • [4] Real-time implementation of moving object detection in UAV videos using GPUs
    Deepak Jaiswal
    Praveen Kumar
    [J]. Journal of Real-Time Image Processing, 2020, 17 : 1301 - 1317
  • [5] Real-time implementation of moving object detection in UAV videos using GPUs
    Jaiswal, Deepak
    Kumar, Praveen
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2020, 17 (05) : 1301 - 1317
  • [6] Real-time Small Object Detection Model in the Bird-view UAV Imagery
    Han, Seongkyun
    Kwon, Juwon
    Kwon, Soonchul
    [J]. ICVISP 2019: PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON VISION, IMAGE AND SIGNAL PROCESSING, 2019,
  • [7] An Efficient FPGA Implementation for Real-Time and Low-Power UAV Object Detection
    Li, Guoqing
    Zhang, Jingwei
    Zhang, Meng
    Corporaal, Henk
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 1387 - 1391
  • [8] UAV Embedded Real-Time Object Detection by a DCNN Model Trained on Synthetic Dataset
    Bernardo, Ricardo Maroquio
    Batista da Silva, Luis Claudio
    Ferreira Rosa, Paulo Fernando
    [J]. 2023 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS, ICUAS, 2023, : 580 - 585
  • [9] Real-Time Object Detection Based on UAV Remote Sensing: A Systematic Literature Review
    Cao, Zhen
    Kooistra, Lammert
    Wang, Wensheng
    Guo, Leifeng
    Valente, Joao
    [J]. DRONES, 2023, 7 (10)
  • [10] Real-Time Object Detection Network in UAV-Vision Based on CNN and Transformer
    Ye, Tao
    Qin, Wenyang
    Zhao, Zongyang
    Gao, Xiaozhi
    Deng, Xiangpeng
    Ouyang, Yu
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72