Video stabilization based on low-rank constraint and trajectory optimization

被引:0
|
作者
Shang, Zhenhong [1 ,2 ]
Chu, Zhishuang [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming, Peoples R China
[2] Kunming Univ Sci & Technol, Yunnan Key Lab Artificial Intelligence, Kunming, Peoples R China
基金
中国国家自然科学基金;
关键词
adaptive filters; computer vision; image enhancement; image registration; motion compensation; motion estimation; video recording; video signal processing;
D O I
10.1049/ipr2.13062
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video stabilization plays a pivotal role in enhancing video quality by eliminating unwanted jitter in shaky videos. This paper introduces a novel video stabilization algorithm that leverages low-rank constraint and trajectory optimization to effectively eliminate undesirable motion and generate stabilized videos. In the proposed algorithm, a low-rank constraint regularization term is incorporated to enhance the smoothness of motion trajectories. Additionally, a predictive path smoothness term is integrated to ensure the consistency of motion across neighbouring frames. To address the problem of excessive cropping resulting from aggressive smoothing, a flexible local window strategy that emphasizes local motion relationships within the trajectories is introduced. The experimental results show that, compared to other excellent video stabilization algorithms, the proposed algorithm improves the stability metric by approximately 2.3%. Furthermore, in the stabilized videos generated by the algorithm, an approximate improvement of 2.18 dB in average image temporal fidelity and a 5.7% increase in average structural similarity between adjacent frames are achieved. The code that implements the proposed method is publicly accessible at . image
引用
收藏
页码:1768 / 1779
页数:12
相关论文
共 50 条
  • [1] Locally Low-Rank Regularized Video Stabilization With Motion Diversity Constraints
    Wu, Huicong
    Xiao, Liang
    Lian, Zhichao
    Shim, Hiuk Jae
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (10) : 2873 - 2887
  • [2] Efficient video hashing based on low-rank frames
    Chen, Zhenhai
    Tang, Zhenjun
    Zhang, Xinpeng
    Sun, Ronghai
    Zhang, Xianquan
    IET IMAGE PROCESSING, 2022, 16 (02) : 344 - 355
  • [3] Low-Rank Approximation based LineCast for Video Broadcasting
    Yin, Wenbin
    Fan, Xiaopeng
    Shi, Yunhui
    Zhao, Debin
    2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [4] A Low-Rank Constraint for Parallel Stereo Cameras
    Cordes, Christian
    Ackermann, Hanno
    Rosenhahn, Bodo
    PATTERN RECOGNITION, GCPR 2013, 2013, 8142 : 31 - 40
  • [5] Low-rank constraint bipartite graph learning
    Zhou, Qian
    Yang, Haizhou
    Gao, Quanxue
    NEUROCOMPUTING, 2022, 511 : 426 - 436
  • [6] Video smoke removal based on low-rank tensor completion via spatial-temporal continuity constraint
    Zhu, Hu
    Xu, Guoxia
    Liu, Lu
    Deng, Lizhen
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (15):
  • [7] Low-rank Approximation based Abnormal Detection in The Video Sequence
    Yu, Bosi
    Liu, Yazhou
    Sun, Quansen
    2016 IEEE INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2016, : 129 - 133
  • [8] Low-Rank Extragradient Method for Nonsmooth and Low-Rank Matrix Optimization Problems
    Garber, Dan
    Kaplan, Atara
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [9] Demosaicking enhancement method for color image based on low-rank constraint
    Li, Qifeng
    Zhang, Shilei
    Sun, Jinglai
    Han, Yangguang
    Fu, Xiaoran
    Yang, Yunpeng
    Ma, Xiangyun
    Wang, Huijie
    JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (05)
  • [10] Video SAR Imaging Based on Low-Rank Tensor Recovery
    Pu, Wei
    Wang, Xiaodong
    Wu, Junjie
    Huang, Yulin
    Yang, Jianyu
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (01) : 188 - 202