Generalized Video Deblurring for Dynamic Scenes

被引:0
|
作者
Kim, Tae Hyun [1 ]
Lee, Kyoung Mu [1 ]
机构
[1] Seoul Natl Univ, Dept ECE, ASRI, Seoul 151742, South Korea
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Several state-of-the-art video deblurring methods are based on a strong assumption that the captured scenes are static. These methods fail to deblur blurry videos in dynamic scenes. We propose a video deblurring method to deal with general blurs inherent in dynamic scenes, contrary to other methods. To handle locally varying and general blurs caused by various sources, such as camera shake, moving objects, and depth variation in a scene, we approximate pixel-wise kernel with bidirectional opticalflows. Therefore, we propose a single energy model that simultaneously estimates optical flows and latent frames to solve our deblurring problem. We also provide a framework and efficient solvers to optimize the energy model. By minimizing the proposed energy junction, we achieve significant improvements in removing blurs and estimating accurate optical flows in blurry frames. Extensive experimental results demonstrate the superiority of the proposed method in real and challenging videos that state-of-the-art methods fail in either deblurring or optical flow estimation.
引用
收藏
页码:5426 / 5434
页数:9
相关论文
共 50 条
  • [1] Concurrent Video Denoising and Deblurring for Dynamic Scenes
    Katsaros, Efklidis
    Ostrowski, Piotr K.
    Wesierski, Daniel
    Jezierska, Anna
    [J]. IEEE ACCESS, 2021, 9 : 157437 - 157446
  • [2] Towards Rolling Shutter Correction and Deblurring in Dynamic Scenes
    Zhong, Zhihang
    Zheng, Yinqiang
    Sato, Imari
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 9215 - 9224
  • [3] Attentive deep network for blind motion deblurring on dynamic scenes
    Xu, Yong
    Zhu, Ye
    Quan, Yuhui
    Ji, Hui
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 205
  • [4] Background estimation for dynamic video scenes
    Harasse, Sebastien
    Bonnaud, Laurent
    Desvignes, Michel
    [J]. IECON 2006 - 32ND ANNUAL CONFERENCE ON IEEE INDUSTRIAL ELECTRONICS, VOLS 1-11, 2006, : 2958 - +
  • [5] Deblurring Dynamic Scenes via Spatially Varying Recurrent Neural Networks
    Ren, Wenqi
    Zhang, Jiawei
    Pan, Jinshan
    Liu, Sifei
    Ren, Jimmy S.
    Du, Junping
    Cao, Xiaochun
    Yang, Ming-Hsuan
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (08) : 3974 - 3987
  • [6] Event-Based Shutter Unrolling and Motion Deblurring in Dynamic Scenes
    Wang, Yangguang
    Jiang, Chenxu
    Jia, Xu
    Guo, Yufei
    Yu, Lei
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1069 - 1073
  • [7] Video based rendering of planar dynamic scenes
    Kale, A
    Chowdhury, AKR
    Chellappa, R
    [J]. 2003 INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOL I, PROCEEDINGS, 2003, : 477 - 480
  • [8] Online Video Deblurring via Dynamic Temporal Blending Network
    Kim, Tae Hyun
    Lee, Kyoung Mu
    Schoelkopf, Bernhard
    Hirsch, Michael
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 4058 - 4067
  • [9] Dynamic Video Deblurring Using a Locally Adaptive Blur Model
    Kim, Tae Hyun
    Nah, Seungjun
    Lee, Kyoung Mu
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (10) : 2374 - 2387
  • [10] HDR video synthesis for vision systems in dynamic scenes
    Shopovska, Ivana
    Jovanov, Ljubomir
    Goossens, Bart
    Philips, Wilfried
    [J]. APPLICATIONS OF DIGITAL IMAGE PROCESSING XXXIX, 2016, 9971