DC-MOT: Motion Deblurring and Compensation for Multi-Object Tracking in UAV Videos

被引:7
|
作者
Cheng, Song [1 ,2 ]
Yao, Meibao [1 ,2 ]
Xiao, Xueming [3 ,4 ]
机构
[1] Jilin Univ, Sch Artificial Intelligence, Intelligent Robot Lab IRL, Changchun 130012, Peoples R China
[2] Minist Educ, Engn Res Ctr Knowledge Driven Human Machine Intel, Nanjing, Peoples R China
[3] Changchun Univ Sci & Technol, CVIR Lab, Changchun 130022, Peoples R China
[4] Minist Educ, Key Lab Optoelect Measurement & Opt Informat Tran, Changchun, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-object Tracking; Motion Deblurring; Global Motion Compensation; UAV Vision; CONSENSUS;
D O I
10.1109/ICRA48891.2023.10160931
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a multi-object tracking framework for videos captured by UAVs, considering motion imperfection in the following two aspects: 1) motion blurring of objects due to high-speed motion of the UAV and the objects, deteriorating the performance of the detector; 2) motion coupling of the global movement of the UAV camera with the object motion, resulting in the nonlinearity of objects trajectories in adjacent frames and further more difficult to predict. For motion blurring, this paper proposes a hybrid deblurring module that deals with the blurred frames while retaining the clear frames, trading off between video tracking performance and spatio-temporal consistency. For motion coupling, we proposed a motion compensation module to align adjacent frames by feature matching, and the corrected target position is obtained in the next frame to alleviate the interference of camera movement with tracking. We evaluate the proposed methods on VisDrone dataset and validate that our framework achieves new state-of-the-art performance on UAV-based MOT systems.
引用
收藏
页码:789 / 795
页数:7
相关论文
共 50 条
  • [1] OMCTrack: Integrating Occlusion Perception and Motion Compensation for UAV Multi-Object Tracking
    Dang, Zhaoyang
    Sun, Xiaoyong
    Sun, Bei
    Guo, Runze
    Li, Can
    DRONES, 2024, 8 (09)
  • [2] Beyond MOT: Semantic Multi-object Tracking
    Li, Yunhao
    Li, Qin
    Wang, Hao
    Ma, Xue
    Yao, Jiali
    Dong, Shaohua
    Fan, Heng
    Zhang, Libo
    COMPUTER VISION-ECCV 2024, PT XXXV, 2025, 15093 : 276 - 293
  • [3] UMTSS: a unifocal motion tracking surveillance system for multi-object tracking in videos
    Soma Hazra
    Shaurjya Mandal
    Banani Saha
    Sunirmal Khatua
    Multimedia Tools and Applications, 2023, 82 : 12401 - 12422
  • [4] UMTSS: a unifocal motion tracking surveillance system for multi-object tracking in videos
    Hazra, Soma
    Mandal, Shaurjya
    Saha, Banani
    Khatua, Sunirmal
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (08) : 12401 - 12422
  • [5] UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensation
    Yi, Kefu
    Luo, Kai
    Luo, Xiaolei
    Huang, Jiangui
    Wu, Hao
    Hu, Rongdong
    Hao, Wei
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 7, 2024, : 6702 - 6710
  • [6] TR-MOT: Multi-Object Tracking by Reference
    Chen, Mingfei
    Liao, Yue
    Liu, Si
    Wang, Fei
    Hwang, Jenq-Neng
    arXiv, 2022,
  • [7] Multi-Object Tracking Meets Moving UAV
    Liu, Shuai
    Li, Xin
    Lu, Huchuan
    He, You
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 8866 - 8875
  • [8] Motion Compensation Optimization Method for 3D Multi-Object Tracking
    Wang S.-H.
    Zhang Y.
    Shen J.-N.
    Ji J.-M.
    Zhang Y.-Y.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2024, 52 (02): : 528 - 539
  • [9] JDECMC: Improving JDE based multi-object tracking with Camera Motion Compensation
    Sinishaw, Melikamu Liyih
    Liu, Shu
    DISPLAYS, 2024, 83
  • [10] Compensation Tracker: Reprocessing Lost Object for Multi-Object Tracking
    Zou, Zhibo
    Huang, Junjie
    Luo, Ping
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 2673 - 2683