Camera-Based Local and Global Target Detection, Tracking, and Localization Techniques for UAVs

被引:5
|
作者
Daramouskas, Ioannis [1 ,2 ]
Meimetis, Dimitrios [1 ]
Patrinopoulou, Niki [1 ]
Lappas, Vaios [3 ]
Kostopoulos, Vassilios [1 ]
Kapoulas, Vaggelis [2 ]
机构
[1] Univ Patras, Appl Mech Lab, Patras 26504, Greece
[2] Comp Technol Inst & Press Diophantus, N Kazantzaki Str Univ Campus, Patras 26504, Greece
[3] Natl Kapodistrian Univ Athens, Dept Aerosp Sci & Technol, Athens 10563, Greece
关键词
YOLO; multi-object detection; target tracking; target localization; UAV; computer vision; deep SORT; SORT;
D O I
10.3390/machines11020315
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multiple-object detection, localization, and tracking are desirable in many areas and applications, as the field of deep learning has developed and has drawn the attention of academics in computer vision, having a plethora of networks now achieving excellent accuracy in detecting multiple objects in an image. Tracking and localizing objects still remain difficult processes which require significant effort. This work describes an optical camera-based target detection, tracking, and localization solution for Unmanned Aerial Vehicles (UAVs). Based on the well-known network YOLOv4, a custom object detection model was developed and its performance was compared to YOLOv4-Tiny, YOLOv4-608, and YOLOv7-Tiny. The target tracking algorithm we use is based on Deep SORT, providing cutting-edge tracking. The proposed localization approach can accurately determine the position of ground targets identified by the custom object detection model. Moreover, an implementation of a global tracker using localization information from up to four UAV cameras at a time. Finally, a guiding approach is described, which is responsible for providing real-time movement commands for the UAV to follow and cover a designated target. The complete system was evaluated in Gazebo with up to four UAVs utilizing Software-In-The-Loop (SITL) simulation.
引用
收藏
页数:27
相关论文
共 50 条
  • [31] A Camera-Based Target Detection and Positioning UAV System for Search and Rescue (SAR) Purposes
    Sun, Jingxuan
    Li, Boyang
    Jiang, Yifan
    Wen, Chih-Yung
    SENSORS, 2016, 16 (11)
  • [32] NTable: A Dataset for Camera-Based Table Detection
    Zhu, Ziyi
    Gao, Liangcai
    Li, Yibo
    Huang, Yilun
    Du, Lin
    Lu, Ning
    Wang, Xianfeng
    DOCUMENT ANALYSIS AND RECOGNITION - ICDAR 2021, PT II, 2021, 12822 : 117 - 129
  • [33] Camera-Based Guardrail Detection for Intelligent Vehicle
    Zhu, Hao
    Wang, Xuhua
    Guo, Bin
    2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 777 - 782
  • [34] Deep Regression for Monocular Camera-based 6-DoF Global Localization in Outdoor Environments
    Naseer, Tayyab
    Burgard, Wolfram
    2017 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2017, : 1525 - 1530
  • [35] Camera-Based Crime Behavior Detection and Classification
    Gao, Jerry
    Shi, Jingwen
    Balla, Priyanka
    Sheshgiri, Akshata
    Zhang, Bocheng
    Yu, Hailong
    Yang, Yunyun
    SMART CITIES, 2024, 7 (03): : 1169 - 1198
  • [36] Camera-Based Mobile Interaction Techniques for Physical Objects
    Henze, Niels
    Boll, Susanne
    MOBILEHCI '12: COMPANION PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE ON HUMAN COMPUTER INTERACTION WITH MOBILE DEVICES AND SERVICES, 2012, : 101 - 106
  • [37] Camera-based calibration techniques for seamless multiprojector displays
    Brown, M
    Majumder, A
    Yang, RG
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2005, 11 (02) : 193 - 206
  • [38] An Automatic Target Tracking System Based on Local and Global Features
    Zin, Thi Thi
    Yamada, Kenshiro
    GENETIC AND EVOLUTIONARY COMPUTING, 2017, 536 : 255 - 262
  • [39] Single camera-based tracking of 3D gestures
    Menezes, P
    Lerasle, F
    Dias, J
    Chatila, R
    PROCEEDINGS OF THE SIXTH IASTED INTERNATIONAL CONFERENCE ON ROBOTICS AND APPLICATIONS, 2005, : 300 - 305
  • [40] Camera-Based Localization for Indoor Service Robots using Pictographs
    Hirose, Kei
    Chugo, Daisuke
    Yokota, Sho
    Takase, Kunikatsu
    2011 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS (AIM), 2011, : 924 - 929