Camera-Based Local and Global Target Detection, Tracking, and Localization Techniques for UAVs

被引:5
|
作者
Daramouskas, Ioannis [1 ,2 ]
Meimetis, Dimitrios [1 ]
Patrinopoulou, Niki [1 ]
Lappas, Vaios [3 ]
Kostopoulos, Vassilios [1 ]
Kapoulas, Vaggelis [2 ]
机构
[1] Univ Patras, Appl Mech Lab, Patras 26504, Greece
[2] Comp Technol Inst & Press Diophantus, N Kazantzaki Str Univ Campus, Patras 26504, Greece
[3] Natl Kapodistrian Univ Athens, Dept Aerosp Sci & Technol, Athens 10563, Greece
关键词
YOLO; multi-object detection; target tracking; target localization; UAV; computer vision; deep SORT; SORT;
D O I
10.3390/machines11020315
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multiple-object detection, localization, and tracking are desirable in many areas and applications, as the field of deep learning has developed and has drawn the attention of academics in computer vision, having a plethora of networks now achieving excellent accuracy in detecting multiple objects in an image. Tracking and localizing objects still remain difficult processes which require significant effort. This work describes an optical camera-based target detection, tracking, and localization solution for Unmanned Aerial Vehicles (UAVs). Based on the well-known network YOLOv4, a custom object detection model was developed and its performance was compared to YOLOv4-Tiny, YOLOv4-608, and YOLOv7-Tiny. The target tracking algorithm we use is based on Deep SORT, providing cutting-edge tracking. The proposed localization approach can accurately determine the position of ground targets identified by the custom object detection model. Moreover, an implementation of a global tracker using localization information from up to four UAV cameras at a time. Finally, a guiding approach is described, which is responsible for providing real-time movement commands for the UAV to follow and cover a designated target. The complete system was evaluated in Gazebo with up to four UAVs utilizing Software-In-The-Loop (SITL) simulation.
引用
收藏
页数:27
相关论文
共 50 条
  • [1] Cooperative localization and tracking with a camera-based WSN
    Sanchez-Matamoros, J. M.
    Martinez-de Dios, J. R.
    Ollero, A.
    2009 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS, VOLS 1 AND 2, 2009, : 680 - 685
  • [2] Blending of Learning-based Tracking and Object Detection for Monocular Camera-based Target Following
    Panda, Pranoy
    Barczyk, Martin
    IFAC PAPERSONLINE, 2021, 54 (09): : 743 - 748
  • [3] Camera-Based Tracking of Floating Objects using Fixed-wing UAVs
    Håkon Hagen Helgesen
    Torleiv H. Bryne
    Erik F. Wilthil
    Tor Arne Johansen
    Journal of Intelligent & Robotic Systems, 2021, 102
  • [4] Camera-Based Tracking of Floating Objects using Fixed-wing UAVs
    Helgesen, Hakon Hagen
    Bryne, Torleiv H.
    Wilthil, Erik F.
    Johansen, Tor Arne
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2021, 102 (04)
  • [5] A Camera-Based Target Tracking System for Football Playing Robots
    Stephon, Andrew C.
    Khorbotly, Sami
    2012 44TH SOUTHEASTERN SYMPOSIUM ON SYSTEM THEORY (SSST), 2012, : 164 - 167
  • [6] A tracking cooling fan using geofence and camera-based indoor localization
    Liu, Shuo
    Yin, Le
    Ho, Weng Khuen
    Ling, Keck Voon
    Schiavon, Stefano
    BUILDING AND ENVIRONMENT, 2017, 114 : 36 - 44
  • [7] An algorithm for automated detection, localization and measurement of local calcium signals from camera-based imaging
    Ellefsen, Kyle L.
    Settle, Brett
    Parker, Ian
    Smith, Ian F.
    CELL CALCIUM, 2014, 56 (03) : 147 - 156
  • [8] Visual Attention Based Target Detection and Tracking for UAVs
    Wang, Tingting
    Zhang, Yu
    Cai, Zhihao
    Wang, Yingxun
    You, Zhenxing
    2016 IEEE CHINESE GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2016, : 895 - 900
  • [9] Development of a Mobile Robot with Camera-based Target Tracking and Obstacle Avoidance Systems
    Jamatolail, Mohamed Fitri Mohamad
    Ambar, Radzi
    Abd Wahab, Mohd Helmy
    Isa, Khalid
    Kadir, Herdawatie Abdul
    Ahmad, Muhammad Shukri
    Abd Jamil, Muhammad Mahadi
    Mohammadian, Masoud
    INTERNATIONAL JOURNAL OF INTEGRATED ENGINEERING, 2020, 12 (07): : 236 - 245
  • [10] Stereo camera-based automatic target tracking system in the unmanned ground vehicle
    Lee, JH
    Ko, JH
    Lee, KJ
    Jang, JH
    Kim, ES
    UNMANNED GROUND VEHICLE TECHNOLOGY VI, 2004, 5422 : 569 - 583