AllFocus: Patch-Based Video Out-of-Focus Blur Reconstruction

被引:15
|
作者
Wang, Yinting [1 ]
Wang, Zhenyang [1 ]
Tao, Dapeng [2 ]
Zhuo, Shaojie [3 ]
Xu, Xianghua [4 ]
Pu, Shiliang [5 ]
Song, Mingli [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Zhejiang Prov Key Lab Serv Robot, Hangzhou 310027, Zhejiang, Peoples R China
[2] Yunnan Univ, Sch Informat Sci & Engn, Kunming 650091, Yunnan, Peoples R China
[3] Qualcomm Canada Inc, Thornhill, ON L3T 7W3, Canada
[4] Hangzhou Dianzi Univ, Sch Comp Sci, Hangzhou 310027, Zhejiang, Peoples R China
[5] HikVis Technol, Res Inst, Hangzhou 310012, Zhejiang, Peoples R China
基金
美国国家科学基金会;
关键词
Out-of-focus blur; patch tracking; sharpness; IMAGES;
D O I
10.1109/TCSVT.2016.2555740
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Amateur videos always contain focusing issues. A focusing mistake may produce out-of-focus blur, which seriously degrades the expressive force of the video. In this paper, we propose a patch-based method to remove the out-of-focus blur of a video and build an all-in-focus video. We assume that the out-of-focus blurry region in one frame will be clear in a portion of other frames; thus, the clear corresponding regions can be used to reconstruct the blurry one. We divide each video frame into a grid of patches and track each patch in the surrounding frames. We independently reconstruct each video frame by building a Markov random field model to identify the optimal target patches that are sharp, similar to the original patches, and are coherent with their neighboring patches within the overlapped regions. To recover an all-in-focus video, an iterative framework is utilized, in which the reconstructed video of each iteration is substituted in the next iteration. Finally, we employ the idea of a bilateral filter to temporally smooth the reconstructed video. The experimental results and the comparison with the previous works demonstrate the effectiveness of our method.
引用
收藏
页码:1895 / 1908
页数:14
相关论文
共 50 条
  • [21] SPARSE REPRESENTATION OF A BLUR KERNEL FOR OUT-OF-FOCUS BLIND IMAGE RESTORATION
    Lee, Chia-Chen
    Hwang, Wen-Liang
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 2698 - 2702
  • [22] Out-of-focus blur estimation and restoration for digital auto-focusing system
    Kim, SK
    Paik, JK
    [J]. ELECTRONICS LETTERS, 1998, 34 (12) : 1217 - 1219
  • [23] Patch-Based HDR Video Processing for Fast Moving Object Reconstruction
    Mai, Yu-Fu
    Chiu, Ching-Te
    [J]. 2017 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS (ICNC), 2016, : 561 - 565
  • [24] Restoration of online video ferrography images for out-of-focus degradations
    Xi, Wenkui
    Wu, Tonghai
    Yan, Ke
    Yang, Xujun
    Jiang, Xiangjun
    Kwok, Ngaiming
    [J]. EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2018,
  • [25] Restoration of online video ferrography images for out-of-focus degradations
    Wenkui Xi
    Tonghai Wu
    Ke Yan
    Xujun Yang
    Xiangjun Jiang
    Ngaiming Kwok
    [J]. EURASIP Journal on Image and Video Processing, 2018
  • [26] Simultaneous out-of-focus blur estimation and restoration for digital auto-focusing system
    Kim, SK
    Park, SR
    Paik, JK
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 1998, 44 (03) : 1071 - 1075
  • [27] Neural Bokeh: Learning Lens Blur for Computational Videography and Out-of-Focus Mixed Reality
    Mandl, David
    Mori, Shohei
    Mohr, Peter
    Peng, Yifan
    Langlotz, Tobias
    Schmalstieg, Dieter
    Kalkofen, Denis
    [J]. 2024 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES, VR 2024, 2024, : 870 - 880
  • [28] Out-of-Focus Blur Estimation for Blind Image Deconvolution: Using Particle Swarm Optimization
    Sun, Tsung-Ying
    Ciou, Sin-Jhe
    Liu, Chan-Cheng
    Huo, Chih-Li
    [J]. 2009 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC 2009), VOLS 1-9, 2009, : 1627 - 1632
  • [29] Parametric Blur Estimation for Blind Restoration of Natural Images: Linear Motion and Out-of-Focus
    Oliveira, Joao P.
    Figueiredo, Mario A. T.
    Bioucas-Dias, Jose M.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (01) : 466 - 477
  • [30] ROBUST IDENTIFICATION OF MOTION AND OUT-OF-FOCUS BLUR PARAMETERS FROM BLURRED AND NOISY IMAGES
    FABIAN, R
    MALAH, D
    [J]. CVGIP-GRAPHICAL MODELS AND IMAGE PROCESSING, 1991, 53 (05): : 403 - 412