DC-MOT: Motion Deblurring and Compensation for Multi-Object Tracking in UAV Videos

被引:7
|
作者
Cheng, Song [1 ,2 ]
Yao, Meibao [1 ,2 ]
Xiao, Xueming [3 ,4 ]
机构
[1] Jilin Univ, Sch Artificial Intelligence, Intelligent Robot Lab IRL, Changchun 130012, Peoples R China
[2] Minist Educ, Engn Res Ctr Knowledge Driven Human Machine Intel, Nanjing, Peoples R China
[3] Changchun Univ Sci & Technol, CVIR Lab, Changchun 130022, Peoples R China
[4] Minist Educ, Key Lab Optoelect Measurement & Opt Informat Tran, Changchun, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-object Tracking; Motion Deblurring; Global Motion Compensation; UAV Vision; CONSENSUS;
D O I
10.1109/ICRA48891.2023.10160931
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a multi-object tracking framework for videos captured by UAVs, considering motion imperfection in the following two aspects: 1) motion blurring of objects due to high-speed motion of the UAV and the objects, deteriorating the performance of the detector; 2) motion coupling of the global movement of the UAV camera with the object motion, resulting in the nonlinearity of objects trajectories in adjacent frames and further more difficult to predict. For motion blurring, this paper proposes a hybrid deblurring module that deals with the blurred frames while retaining the clear frames, trading off between video tracking performance and spatio-temporal consistency. For motion coupling, we proposed a motion compensation module to align adjacent frames by feature matching, and the corrected target position is obtained in the next frame to alleviate the interference of camera movement with tracking. We evaluate the proposed methods on VisDrone dataset and validate that our framework achieves new state-of-the-art performance on UAV-based MOT systems.
引用
收藏
页码:789 / 795
页数:7
相关论文
共 50 条
  • [31] SSL-MOT: self-supervised learning based multi-object tracking
    Sangwon Kim
    Jimi Lee
    Byoung Chul Ko
    Applied Intelligence, 2023, 53 : 930 - 940
  • [32] An image motion compensation system for the multi-object double spectrograph
    Marshall, JL
    Atwood, B
    Byard, PL
    DePoy, DL
    O'Brien, TP
    Pogge, RW
    INSTRUMENT DESIGN AND PERFORMANCE FOR OPTICAL/INFRARED GROUND-BASED TELESCOPES, PTS 1-3, 2003, 4841 : 1273 - 1279
  • [33] Multi-object tracking based on deep associated features for UAV applications
    Xiong, Lingyu
    Tang, Guijin
    OPTOELECTRONICS LETTERS, 2023, 19 (02) : 105 - 111
  • [34] A Multi-Object Tracking Method in Moving UAV Based on IoU Matching
    Qian, Yizhou
    Wang, Zaijun
    Gao, Yaowen
    Zhang, Wenze
    Wang, Hao
    IEEE ACCESS, 2024, 12 : 139076 - 139085
  • [35] Multi-object tracking based on deep associated features for UAV applications
    Lingyu Xiong
    Guijin Tang
    Optoelectronics Letters, 2023, 19 : 105 - 111
  • [36] Multi-object tracking based on deep associated features for UAV applications
    XIONG Lingyu
    TANG Guijin
    OptoelectronicsLetters, 2023, 19 (02) : 105 - 111
  • [37] UAV Multi-object Tracking by Combining Two Deep Neural Architectures
    Mazzeo, Pier Luigi
    Manica, Alessandro
    Distante, Cosimo
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2023, PT I, 2023, 14233 : 257 - 268
  • [38] ETTrack: enhanced temporal motion predictor for multi-object tracking
    Han, Xudong
    Oishi, Nobuyuki
    Tian, Yueying
    Ucurum, Elif
    Young, Rupert
    Chatwin, Chris
    Birch, Philip
    APPLIED INTELLIGENCE, 2025, 55 (01)
  • [39] TracTrac: A fast multi-object tracking algorithm for motion estimation
    Heyman, Joris
    COMPUTERS & GEOSCIENCES, 2019, 128 : 11 - 18
  • [40] Robust Multi-object Tracking for Wide Area Motion Imagery
    AL-Shakarji, Noor M.
    Bunyak, Filiz
    Seetharaman, Guna
    Palaniappan, Kannappan
    2018 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR), 2018,