DC-MOT: Motion Deblurring and Compensation for Multi-Object Tracking in UAV Videos

被引:7
|
作者
Cheng, Song [1 ,2 ]
Yao, Meibao [1 ,2 ]
Xiao, Xueming [3 ,4 ]
机构
[1] Jilin Univ, Sch Artificial Intelligence, Intelligent Robot Lab IRL, Changchun 130012, Peoples R China
[2] Minist Educ, Engn Res Ctr Knowledge Driven Human Machine Intel, Nanjing, Peoples R China
[3] Changchun Univ Sci & Technol, CVIR Lab, Changchun 130022, Peoples R China
[4] Minist Educ, Key Lab Optoelect Measurement & Opt Informat Tran, Changchun, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-object Tracking; Motion Deblurring; Global Motion Compensation; UAV Vision; CONSENSUS;
D O I
10.1109/ICRA48891.2023.10160931
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a multi-object tracking framework for videos captured by UAVs, considering motion imperfection in the following two aspects: 1) motion blurring of objects due to high-speed motion of the UAV and the objects, deteriorating the performance of the detector; 2) motion coupling of the global movement of the UAV camera with the object motion, resulting in the nonlinearity of objects trajectories in adjacent frames and further more difficult to predict. For motion blurring, this paper proposes a hybrid deblurring module that deals with the blurred frames while retaining the clear frames, trading off between video tracking performance and spatio-temporal consistency. For motion coupling, we proposed a motion compensation module to align adjacent frames by feature matching, and the corrected target position is obtained in the next frame to alleviate the interference of camera movement with tracking. We evaluate the proposed methods on VisDrone dataset and validate that our framework achieves new state-of-the-art performance on UAV-based MOT systems.
引用
收藏
页码:789 / 795
页数:7
相关论文
共 50 条
  • [21] Motion estimation and image difference for multi-object tracking
    Oron, Eliezer
    IEEE Aerospace Applications Conference Proceedings, 1999, 4 : 401 - 409
  • [22] RSMOT: Remote Sensing Multi-Object Tracking Network with Local Motion Prior for Objects in Satellite Videos
    Xiao, Chao
    Wu, Shuanglin
    Wang, Yingqian
    Li, Miao
    An, Wei
    Chen, Zhijie
    International Geoscience and Remote Sensing Symposium (IGARSS), 2022, 2022-July : 1904 - 1907
  • [23] RSMOT: REMOTE SENSING MULTI-OBJECT TRACKING NETWORK WITH LOCAL MOTION PRIOR FOR OBJECTS IN SATELLITE VIDEOS
    Xiao, Chao
    Wu, Shuanglin
    Wang, Yingqian
    Li, Miao
    An, Wei
    Chen, Zhijie
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1904 - 1907
  • [24] A Unified Object Motion and Affinity Model for Online Multi-Object Tracking
    Yin, Junbo
    Wang, Wenguan
    Meng, Qinghao
    Yang, Ruigang
    Shen, Jianbing
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6767 - 6776
  • [25] SSL-MOT: self-supervised learning based multi-object tracking
    Kim, Sangwon
    Lee, Jimi
    Ko, Byoung Chul
    APPLIED INTELLIGENCE, 2023, 53 (01) : 930 - 940
  • [26] A deep learning framework for multi-object tracking in team sports videos
    Cao, Wei
    Wang, Xiaoyong
    Liu, Xianxiang
    Xu, Yishuai
    IET COMPUTER VISION, 2024, 18 (05) : 574 - 590
  • [27] An image motion compensation system for the multi-object double spectrograph
    Marshall, J. L.
    O'Brien, Thomas P.
    Atwood, Bruce
    Byard, Paul L.
    DePoy, D. L.
    Derwent, Mark
    Eastman, Jason D.
    Gonzalez, Raymond
    Pappalardo, Daniel P.
    Pogge, Richard W.
    GROUND-BASED AND AIRBORNE INSTRUMENTATION FOR ASTRONOMY, PTS 1- 3, 2006, 6269
  • [28] Poly-MOT: A Polyhedral Framework For 3D Multi-Object Tracking
    Li, Xiaoyu
    Xie, Tao
    Liu, Dedong
    Gao, Jinghan
    Dai, Kun
    Jiang, Zhiqiang
    Zhao, Lijun
    Wang, Ke
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 9391 - 9398
  • [29] An image motion compensation system for the Multi-Object Double Spectrograph
    Marshall, JL
    Atwood, B
    Byard, PL
    DePoy, DL
    O'Brien, TP
    Pogge, RW
    GROUND-BASED INSTRUMENTATION FOR ASTRONOMY, PTS 1-3, 2004, 5492 : 739 - 750
  • [30] A Benchmark for Vision-based Multi-UAV Multi-object Tracking
    Shen, Hao
    Yang, Xiwen
    Lin, Defu
    Chai, Jianduo
    Huo, Jiakai
    Xing, Xiaofeng
    He, Shaoming
    2022 IEEE INTERNATIONAL CONFERENCE ON MULTISENSOR FUSION AND INTEGRATION FOR INTELLIGENT SYSTEMS (MFI), 2022,