Real-time Single Object Detection on The UAV

被引:0
|
作者
Wu, Hsiang-Huang [1 ]
Zhou, Zejian [2 ]
Feng, Ming [2 ]
Yan, Yuzhong [1 ]
Xu, Hao [2 ]
Qian, Lijun [1 ]
机构
[1] Texas A&M Univ Syst, Prairie View A&M Univ, Ctr Excellence Res & Educ Big Mil Data Intelligen, Prairie View, TX 77446 USA
[2] Univ Nevada, Dept Elect & Biomed Engn, Reno, NV 89557 USA
关键词
Computer Vision; Convolutional Neural Network (CNN); Embedded System; UAV; Multi-task Learning;
D O I
10.1109/icuas.2019.8797866
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The demand for mission critical tasks, especially for tracking on the UAVs, has been increasing due to their superior mobility. Out of necessity, the ability of processing large images emerges for object detection or tracking with UAVs. As such, the requirements of low latency and lack of Internet access under some circumstances become the major challenges. In this paper, we present a modeling method of CNN that is dedicated to single object detection on the UAV without any transfer learning model. Not limited to the features learned by the transfer learning model, the single object can be selected arbitrarily and specifically, even can be distinguished from those other objects in the same category. Our modeling method introduces the inducing neural network that follows the traditional CNN and plays the role of guiding the training in a fast and efficient way with respect to the training convergence and the model capacity. Using the dataset released by DAC 2018, which contains 98 classes and 96,408 images taken by UAVs, we present how our modeling method develops the inducing neural network that integrates multi-task learning drawn from the state-of-the-art works to achieve about 50% of IoU (Intersection over Union of the ground-truth bounding boxes and predicted bounding boxes) and 20 FPS running on NVIDIA Jetson TX2. Experimental results demonstrated fast inference of an image in size of 720x1280 and the UAV navigated itself to track the target (car) using the inference result.
引用
收藏
页码:1013 / 1022
页数:10
相关论文
共 50 条
  • [41] An Efficient Real-Time FPGA Implementation for Object Detection
    Zhao, Jin
    Huang, Xinming
    Massoud, Yehia
    [J]. 2014 IEEE 12TH INTERNATIONAL NEW CIRCUITS AND SYSTEMS CONFERENCE (NEWCAS), 2014, : 313 - 316
  • [42] Real-Time Moving Object Detection for Video Surveillance
    Sagrebin, Maria
    Pauli, Josef
    [J]. AVSS: 2009 6TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE, 2009, : 31 - 36
  • [43] Real-Time Pose Estimation Piggybacked on Object Detection
    Juranek, Roman
    Herout, Adam
    Dubska, Marketa
    Zemcik, Pavel
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 2381 - 2389
  • [44] A robust real-time object detection and tracking system
    Yue, Zhanfeng
    Narasimha, Pramod Lakshmi
    Topiwala, Pankaj
    [J]. ACQUISITION, TRACKING, POINTING, AND LASER SYSTEMS TECHNOLOGIES XXII, 2008, 6971
  • [45] A Framework for Benchmarking Real-Time Embedded Object Detection
    Schlosser, Michael
    Koenig, Daniel
    Teutsch, Michael
    [J]. PATTERN RECOGNITION, DAGM GCPR 2022, 2022, 13485 : 545 - 559
  • [46] Using Genetic Algorithms for Real-Time Object Detection
    Martinez-Gomez, J.
    Gamez, J. A.
    Garcia-Varea, I.
    Matellan, V.
    [J]. ROBOCUP 2009: ROBOT SOCCER WORLD CUP XIII, 2010, 5949 : 215 - +
  • [47] Real-time Robust Algorithm for Circle Object Detection
    Wu, Jianping
    Li, Jinxiang
    Xiao, Changshui
    Tan, Fangyong
    Gu, Caidong
    [J]. PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE FOR YOUNG COMPUTER SCIENTISTS, VOLS 1-5, 2008, : 1722 - 1727
  • [48] Real-Time Object Detection for Visually Challenged People
    Vaidya, Sunit
    Shah, Naisha
    Shah, Niti
    Shankarmani, Radha
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL SYSTEMS (ICICCS 2020), 2020, : 311 - 316
  • [49] Performance Evaluation of Real-Time Object Detection Algorithms
    Srisuk, Sanun
    Suwannapong, Chanwit
    Kitisriworapan, Songrit
    Kaewsong, Apiwut
    Ongkittikul, Surachai
    [J]. 2019 7TH INTERNATIONAL ELECTRICAL ENGINEERING CONGRESS (IEECON 2019), 2019,
  • [50] Real-time multiple object tracking and anomaly detection
    Han, M
    Gong, YH
    [J]. STORAGE AND RETRIEVAL METHODS AND APPLICATIONS FOR MULTIMEDIA 2005, 2005, 5682 : 173 - 182