A Real-Time Tracking Algorithm for Multi-Target UAV Based on Deep Learning

被引:10
|
作者
Hong, Tao [1 ,2 ]
Liang, Hongming [2 ]
Yang, Qiye [3 ]
Fang, Linquan [1 ]
Kadoch, Michel [4 ]
Cheriet, Mohamed [4 ]
机构
[1] Yunnan Innovat Inst BUAA, Kunming 650233, Peoples R China
[2] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[3] AVIC Chengdu Aircraft Design & Res Inst, Chengdu 610041, Peoples R China
[4] Univ Quebec, Ecole Technol Super ETS, Montreal, PQ H2L 2C4, Canada
基金
中国国家自然科学基金;
关键词
UAV; 5G; multi-target detection and tracking; YOLOv4; DeepSORT;
D O I
10.3390/rs15010002
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
UAV technology is a basic technology aiming to help realize smart living and the construction of smart cities. Its vigorous development in recent years has also increased the presence of unmanned aerial vehicles (UAVs) in people's lives, and it has been increasingly used in logistics, transportation, photography and other fields. However, the rise in the number of drones has also put pressure on city regulation. Using traditional methods to monitor small objects flying slowly at low altitudes would be costly and ineffective. This study proposed a real-time UAV tracking scheme that uses the 5G network to transmit UAV monitoring images to the cloud and adopted a machine learning algorithm to detect and track multiple targets. Aiming at the difficulties in UAV detection and tracking, we optimized the network structure of the target detector yolo4 (You Only Look Once V4) and improved the target tracker DeepSORT, adopting the detection-tracking mode. In order to verify the reliability of the algorithm, we built a data set containing 3200 pictures of four UAVs in different environments, conducted training and testing on the model, and achieved 94.35% tracking accuracy and 69FPS detection speed under the GPU environment. The model was then deployed on ZCU104 to prove the feasibility of the scheme.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Resource Constrained Particle Filtering for Real-time Multi-Target Tracking in Sensor Networks
    Ong, Lee-Ling
    Xiao, Wendong
    Tham, Chen-Khong
    Ang, Marcelo H., Jr.
    [J]. 2009 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS (PERCOM), VOLS 1 AND 2, 2009, : 479 - +
  • [42] Multi-Target Tracking Algorithm Based on FIR Filters
    Lee, Chang Joo
    Min, Kyung Min
    Choi, Hyun Duck
    Ahn, Choon Ki
    Lim, Myo Taeg
    [J]. 2014 14TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2014), 2014, : 1112 - 1116
  • [43] A lightweight multi-target real-time detection model
    Qiu, Bo
    Liu, Xiang
    Shi, Yunyu
    Shang, Yanfeng
    [J]. Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2020, 46 (09): : 1778 - 1785
  • [44] Real-time deep learning based multi object tracking of spermatozoa in fresh samples
    Thambawita, V.
    Hicks, S. A.
    Storas, A.
    Witczak, O.
    Andersen, J. M.
    Hammer, H. L.
    Halvorsen, P.
    Riegler, M. A.
    Haugen, T. B.
    [J]. HUMAN REPRODUCTION, 2022, 37 : 241 - 241
  • [45] Real-time infrared multi-class multi-target anchor-free tracking network
    Song, Zizhuang
    Yang, Jiawei
    Zhang, Dongfang
    Wang, Shiqiang
    Zhang, Shuo
    [J]. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2022, 44 (02): : 401 - 409
  • [46] Deep Meta Learning for Real-Time Target-Aware Visual Tracking
    Choi, Janghoon
    Kwon, Junseok
    Lee, Kyoung Mu
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 911 - 920
  • [47] HELOP: Multi-target tracking based on heuristic empirical learning algorithm and occlusion processing✩,✩✩
    Jia, Yunhua
    Zhang, Yukuan
    Zhou, Chengjiang
    Yang, Yang
    [J]. DISPLAYS, 2023, 79
  • [48] Auto-Learning Correlation-Filter-Based Target State Estimation for Real-Time UAV Tracking
    Bian, Ziyang
    Xu, Tingfa
    Chen, Junjie
    Ma, Liang
    Cai, Wenjing
    Li, Jianan
    [J]. REMOTE SENSING, 2022, 14 (21)
  • [49] Real-time Multi-Target Tracking at 210 Megapixels/second in Wide Area Motion Imagery
    Basharat, Arslan
    Turek, Matt
    Xu, Yiliang
    Atkins, Chuck
    Stoup, David
    Fieldhouse, Keith
    Tunison, Paul
    Hoogs, Anthony
    [J]. 2014 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2014, : 839 - 846
  • [50] A Real-Time Target-Tracking Algorithm Based on Improved SiamFC
    Zhang Hongying
    He Pengyi
    Wang Huisan
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (06)