A Real-Time Tracking Algorithm for Multi-Target UAV Based on Deep Learning

被引:10
|
作者
Hong, Tao [1 ,2 ]
Liang, Hongming [2 ]
Yang, Qiye [3 ]
Fang, Linquan [1 ]
Kadoch, Michel [4 ]
Cheriet, Mohamed [4 ]
机构
[1] Yunnan Innovat Inst BUAA, Kunming 650233, Peoples R China
[2] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[3] AVIC Chengdu Aircraft Design & Res Inst, Chengdu 610041, Peoples R China
[4] Univ Quebec, Ecole Technol Super ETS, Montreal, PQ H2L 2C4, Canada
基金
中国国家自然科学基金;
关键词
UAV; 5G; multi-target detection and tracking; YOLOv4; DeepSORT;
D O I
10.3390/rs15010002
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
UAV technology is a basic technology aiming to help realize smart living and the construction of smart cities. Its vigorous development in recent years has also increased the presence of unmanned aerial vehicles (UAVs) in people's lives, and it has been increasingly used in logistics, transportation, photography and other fields. However, the rise in the number of drones has also put pressure on city regulation. Using traditional methods to monitor small objects flying slowly at low altitudes would be costly and ineffective. This study proposed a real-time UAV tracking scheme that uses the 5G network to transmit UAV monitoring images to the cloud and adopted a machine learning algorithm to detect and track multiple targets. Aiming at the difficulties in UAV detection and tracking, we optimized the network structure of the target detector yolo4 (You Only Look Once V4) and improved the target tracker DeepSORT, adopting the detection-tracking mode. In order to verify the reliability of the algorithm, we built a data set containing 3200 pictures of four UAVs in different environments, conducted training and testing on the model, and achieved 94.35% tracking accuracy and 69FPS detection speed under the GPU environment. The model was then deployed on ZCU104 to prove the feasibility of the scheme.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Real-time detection tracking and recognition algorithm based on multi-target faces
    Li, Jun
    Wang, Yaoru
    Fang, Guokang
    Zeng, Zhigao
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (11) : 17223 - 17238
  • [2] Real-time detection tracking and recognition algorithm based on multi-target faces
    Jun Li
    Yaoru Wang
    Guokang Fang
    Zhigao Zeng
    [J]. Multimedia Tools and Applications, 2021, 80 : 17223 - 17238
  • [3] Toward Real-Time UAV Multi-Target Tracking Using Joint Detection and Tracking
    Keawboontan, Tinnakorn
    Thammawichai, Mason
    [J]. IEEE ACCESS, 2023, 11 : 65238 - 65254
  • [4] Deep learning algorithm based on MobileNet for multi-target tracking
    Xue, Jun-Tao
    Ma, Ruo-Han
    Hu, Chao-Fang
    [J]. Kongzhi yu Juece/Control and Decision, 2021, 36 (08): : 1991 - 1996
  • [5] SEGMENT-WISE ONLINE LEARNING BASED ON GREEDY ALGORITHM FOR REAL-TIME MULTI-TARGET TRACKING
    Lee, Changhoon
    Yoo, Chang D.
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 872 - 876
  • [6] A Multi-target Tracking Algorithm using Texture for Real-time Surveillance
    Zhao, Zhixu
    Yu, Shiqi
    Wu, Xinyu
    Wang, Congling
    Xu, Yangsheng
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS, VOLS 1-4, 2009, : 2150 - +
  • [7] Multi-target tracking algorithm in aquaculture monitoring based on deep learning
    Zhai, Xianyi
    Wei, Honglei
    Wu, Hongda
    Zhao, Qing
    Huang, Meng
    [J]. OCEAN ENGINEERING, 2023, 289
  • [8] A hybrid approach to real-time multi-target tracking
    Scarrica, Vincenzo M.
    Panariello, Ciro
    Ferone, Alessio
    Staiano, Antonino
    [J]. Neural Computing and Applications, 2024, 36 (17) : 10055 - 10066
  • [9] Research Progress of Multi-Target Tracking Based on Deep Learning from Perspective of UAV
    Yang, Yang
    Song, Pinde
    Zhong, Chunlai
    Cao, Lijia
    [J]. Computer Engineering and Applications, 2023, 59 (23) : 48 - 62
  • [10] HoG Based Real-Time Multi-Target Tracking in Bayesian Framework
    Ullah, Mohib
    Cheikh, Faouzi Alaya
    Imran, Ali Shariq
    [J]. 2016 13TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), 2016, : 416 - 422