Real-Time Object Detection and Tracking for Unmanned Aerial Vehicles Based on Convolutional Neural Networks

被引:2
|
作者
Yang, Shao-Yu [1 ]
Cheng, Hsu-Yung [1 ]
Yu, Chih-Chang [2 ]
机构
[1] Natl Cent Univ, Dept Comp Sci & Informat Engn, Taoyuan 32001, Taiwan
[2] Chun Yuan Christian Univ, Dept Informat & Comp Engn, Taoyuan 320, Taiwan
关键词
UAV; deep learning; ROS; convolutional neural network; pruned network; target tracking network; PID control;
D O I
10.3390/electronics12244928
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a system applied to unmanned aerial vehicles based on Robot Operating Systems (ROSs). The study addresses the challenges of efficient object detection and real-time target tracking for unmanned aerial vehicles. The system utilizes a pruned YOLOv4 architecture for fast object detection and the SiamMask model for continuous target tracking. A Proportional Integral Derivative (PID) module adjusts the flight attitude, enabling stable target tracking automatically in indoor and outdoor environments. The contributions of this work include exploring the feasibility of pruning existing models systematically to construct a real-time detection and tracking system for drone control with very limited computational resources. Experiments validate the system's feasibility, demonstrating efficient object detection, accurate target tracking, and effective attitude control. This ROS-based system contributes to advancing UAV technology in real-world environments.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Real-Time, Cloud-based Object Detection for Unmanned Aerial Vehicles
    Lee, Jangwon
    Wang, Jingya
    Crandall, David
    Sabanovic, Selma
    Fox, Geoffrey
    [J]. 2017 FIRST IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING (IRC), 2017, : 36 - 43
  • [2] Methods for real-time optical location and tracking of unmanned aerial vehicles using digital neural networks
    Golyak, Igor S.
    Anfimov, Dmitriy R.
    Golyak, Iliya S.
    Morozov, Andrey N.
    Tabalina, Anastasiya S.
    Fufurin, Igor L.
    [J]. AUTOMATIC TARGET RECOGNITION XXX, 2020, 11394
  • [3] Real-time Golf Ball Detection and Tracking Based on Convolutional Neural Networks
    Zhang, Xiaohan
    Zhang, Tianxiao
    Yang, Yiju
    Wang, Zongbo
    Wang, Guanghui
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 2808 - 2813
  • [4] A REAL-TIME VISUAL TRACKING FOR UNMANNED AERIAL VEHICLES WITH DYNAMIC WINDOW
    Zhang, Jia
    Chen, Tianrun
    Shi, Zhiguo
    [J]. 2020 CHINA SEMICONDUCTOR TECHNOLOGY INTERNATIONAL CONFERENCE 2020 (CSTIC 2020), 2020,
  • [5] Cooperative unmanned aerial vehicles with privacy preserving deep vision for real-time object identification and tracking
    Silva, Samuel Henrique
    Rad, Paul
    Beebe, Nicole
    Choo, Kim-Kwang Raymond
    Umapathy, Mahesh
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2019, 131 : 147 - 160
  • [6] Drone Track: Cloud-Based Real-Time Object Tracking Using Unmanned Aerial Vehicles Over the Internet
    Koubaa, Anis
    Qureshi, Basit
    [J]. IEEE ACCESS, 2018, 6 : 13810 - 13824
  • [7] Object Detection for Unmanned Aerial Vehicle Camera via Convolutional Neural Networks
    Saetchnikov, Ivan V.
    Tcherniavskaia, Elina A.
    Skakun, Victor V.
    [J]. IEEE Journal on Miniaturization for Air and Space Systems, 2021, 2 (02): : 98 - 103
  • [8] Convolutional Neural Networks for Analyzing Unmanned Aerial Vehicles Sound
    Li, Shulin
    Kim, HyunJong
    Lee, Sukhoon
    Gallagher, John C.
    Kim, Daeun
    Park, SungWook
    Matson, Eric T.
    [J]. 2018 18TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2018, : 862 - 866
  • [9] Detection Based Tracking of Unmanned Aerial Vehicles
    Uzun, Bedirhan
    Eker, Onur
    Saribas, Hasan
    Cevikalp, Hakan
    [J]. 2019 27TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2019,
  • [10] Efficient Real-Time Object Detection based on Convolutional Neural Network
    Abd Shehab, Mohanad
    Al-Gizi, Ammar
    Swadi, Salah M.
    [J]. 2021 INTERNATIONAL CONFERENCE ON APPLIED AND THEORETICAL ELECTRICITY (ICATE), 2021,