Camera-Based Local and Global Target Detection, Tracking, and Localization Techniques for UAVs

被引:5
|
作者
Daramouskas, Ioannis [1 ,2 ]
Meimetis, Dimitrios [1 ]
Patrinopoulou, Niki [1 ]
Lappas, Vaios [3 ]
Kostopoulos, Vassilios [1 ]
Kapoulas, Vaggelis [2 ]
机构
[1] Univ Patras, Appl Mech Lab, Patras 26504, Greece
[2] Comp Technol Inst & Press Diophantus, N Kazantzaki Str Univ Campus, Patras 26504, Greece
[3] Natl Kapodistrian Univ Athens, Dept Aerosp Sci & Technol, Athens 10563, Greece
关键词
YOLO; multi-object detection; target tracking; target localization; UAV; computer vision; deep SORT; SORT;
D O I
10.3390/machines11020315
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multiple-object detection, localization, and tracking are desirable in many areas and applications, as the field of deep learning has developed and has drawn the attention of academics in computer vision, having a plethora of networks now achieving excellent accuracy in detecting multiple objects in an image. Tracking and localizing objects still remain difficult processes which require significant effort. This work describes an optical camera-based target detection, tracking, and localization solution for Unmanned Aerial Vehicles (UAVs). Based on the well-known network YOLOv4, a custom object detection model was developed and its performance was compared to YOLOv4-Tiny, YOLOv4-608, and YOLOv7-Tiny. The target tracking algorithm we use is based on Deep SORT, providing cutting-edge tracking. The proposed localization approach can accurately determine the position of ground targets identified by the custom object detection model. Moreover, an implementation of a global tracker using localization information from up to four UAV cameras at a time. Finally, a guiding approach is described, which is responsible for providing real-time movement commands for the UAV to follow and cover a designated target. The complete system was evaluated in Gazebo with up to four UAVs utilizing Software-In-The-Loop (SITL) simulation.
引用
收藏
页数:27
相关论文
共 50 条
  • [21] CAMERA-BASED CLEAR PATH DETECTION
    Wu, Qi
    Zhang, Wende
    Chen, Tsuhan
    Kumar, B. V. K. Vijaya
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 1874 - 1877
  • [22] Mixture Density-PoseNet and its Application to Monocular Camera-Based Global Localization
    Jo, HyungGi
    Lee, Woosub
    Kim, Euntai
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (01) : 388 - 397
  • [23] Joint localization and target tracking with a monocular camera
    Basit, Abdul
    Dailey, Matthew N.
    Moonrinta, Jednipat
    Laksanacharoen, Pudit
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2015, 74 : 1 - 14
  • [24] Statistics of camera-based single-particle tracking
    Berglund, Andrew J.
    PHYSICAL REVIEW E, 2010, 82 (01):
  • [25] Camera-based platform and sensor motion tracking for data fusion in a landmine detection system
    van der Mark, W
    van den Heuvel, JC
    den Breejen, E
    Groen, FCA
    UNMANNED GROUND VEHICLE TECHNOLOGY V, 2003, 5083 : 380 - 389
  • [26] Comparing Representations in Tracking for Event Camera-based SLAM
    Jiao, Jianhao
    Huang, Huaiyang
    Li, Liang
    He, Zhijian
    Zhu, Yilong
    Liu, Ming
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 1369 - 1376
  • [27] IMAGE FORGERY LOCALIZATION THROUGH THE FUSION OF CAMERA-BASED, FEATURE-BASED AND PIXEL-BASED TECHNIQUES
    Cozzolino, Davide
    Gragnaniello, Diego
    Verdoliva, Luisa
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 5302 - 5306
  • [28] SWIR Camera-Based Localization and Mapping in Challenging Environments
    Kachurka, Viachaslau
    Roussel, David
    Hadj-Abdelkader, Hicham
    Bonardi, Fabien
    Didier, Jean-Yves
    Bouchafa, Samia
    IMAGE ANALYSIS AND PROCESSING - ICIAP 2019, PT II, 2019, 11752 : 446 - 456
  • [29] Camera-based 3D tracking, system
    Mir-Nasir, Nazim
    TENCON 2005 - 2005 IEEE REGION 10 CONFERENCE, VOLS 1-5, 2006, : 1225 - 1230
  • [30] A Novel Camera-Based Drowning Detection Algorithm
    Zhang, Chi
    Li, Xiaoguang
    Lei, Fei
    ADVANCES IN IMAGE AND GRAPHICS TECHNOLOGIES (IGTA 2015), 2015, 525 : 224 - 233