AllFocus: Patch-Based Video Out-of-Focus Blur Reconstruction

被引:15
|
作者
Wang, Yinting [1 ]
Wang, Zhenyang [1 ]
Tao, Dapeng [2 ]
Zhuo, Shaojie [3 ]
Xu, Xianghua [4 ]
Pu, Shiliang [5 ]
Song, Mingli [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Zhejiang Prov Key Lab Serv Robot, Hangzhou 310027, Zhejiang, Peoples R China
[2] Yunnan Univ, Sch Informat Sci & Engn, Kunming 650091, Yunnan, Peoples R China
[3] Qualcomm Canada Inc, Thornhill, ON L3T 7W3, Canada
[4] Hangzhou Dianzi Univ, Sch Comp Sci, Hangzhou 310027, Zhejiang, Peoples R China
[5] HikVis Technol, Res Inst, Hangzhou 310012, Zhejiang, Peoples R China
基金
美国国家科学基金会;
关键词
Out-of-focus blur; patch tracking; sharpness; IMAGES;
D O I
10.1109/TCSVT.2016.2555740
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Amateur videos always contain focusing issues. A focusing mistake may produce out-of-focus blur, which seriously degrades the expressive force of the video. In this paper, we propose a patch-based method to remove the out-of-focus blur of a video and build an all-in-focus video. We assume that the out-of-focus blurry region in one frame will be clear in a portion of other frames; thus, the clear corresponding regions can be used to reconstruct the blurry one. We divide each video frame into a grid of patches and track each patch in the surrounding frames. We independently reconstruct each video frame by building a Markov random field model to identify the optimal target patches that are sharp, similar to the original patches, and are coherent with their neighboring patches within the overlapped regions. To recover an all-in-focus video, an iterative framework is utilized, in which the reconstructed video of each iteration is substituted in the next iteration. Finally, we employ the idea of a bilateral filter to temporally smooth the reconstructed video. The experimental results and the comparison with the previous works demonstrate the effectiveness of our method.
引用
收藏
页码:1895 / 1908
页数:14
相关论文
共 50 条
  • [1] Impact of out-of-focus blur on iris recognition
    Sazonova, Nadezhda
    Schuckers, Stephanie
    Johnson, Peter
    Lopez-Meyer, Paulo
    Sazonov, Edward
    Hornak, Lawrence
    [J]. SENSING TECHNOLOGIES FOR GLOBAL HEALTH, MILITARY MEDICINE, DISASTER RESPONSE, AND ENVIRONMENTAL MONITORING AND BIOMETRIC TECHNOLOGY FOR HUMAN IDENTIFICATION VIII, 2011, 8029
  • [2] A REAL-TIME IDENTIFICATION METHOD ON MOTION AND OUT-OF-FOCUS BLUR FOR A VIDEO CAMERA
    JANG, SI
    CHUNG, K
    KIM, W
    LEE, CW
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 1994, 40 (02) : 145 - 153
  • [3] A Face Image Database for Evaluating Out-of-Focus Blur
    Han, Qi
    Zhang, Meihui
    Song, Chen
    Wang, Zhifang
    Niu, Xiamu
    [J]. ISDA 2008: EIGHTH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS, VOL 2, PROCEEDINGS, 2008, : 277 - 282
  • [4] Blur Estimation for Barcode Recognition in Out-of-Focus Images
    Duy Khuong Nguyen
    The Duy Bui
    Thanh Ha Le
    [J]. PATTERN RECOGNITION AND MACHINE INTELLIGENCE, 2011, 6744 : 116 - 121
  • [5] Estimation of out-of-focus blur and its effectiveness for deblurring
    Saitoh, N
    Kuroki, K
    Kurosawa, K
    [J]. INVESTIGATIVE IMAGE PROCESSING, 1997, 2942 : 2 - 9
  • [6] A New Method for Blur Identification of Out-of-Focus Images
    Liu, Aihong
    Hu, Guosheng
    Wu, Haiyan
    [J]. PROCEEDINGS OF THE FIRST INTERNATIONAL WORKSHOP ON EDUCATION TECHNOLOGY AND COMPUTER SCIENCE, VOL III, 2009, : 298 - 301
  • [7] A blur estimation and detection method for out-of-focus images
    Yuzhen Hong
    Guoqiang Ren
    Enhai Liu
    Jian Sun
    [J]. Multimedia Tools and Applications, 2016, 75 : 10807 - 10822
  • [8] A blur estimation and detection method for out-of-focus images
    Hong, Yuzhen
    Ren, Guoqiang
    Liu, Enhai
    Sun, Jian
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (18) : 10807 - 10822
  • [9] EFFICIENT PERCEPTUAL-BASED SPATIALLY VARYING OUT-OF-FOCUS BLUR DETECTION
    Zhu, Tong
    Karam, Lina J.
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 2673 - 2677
  • [10] Partially Blind Deblurring of Barcode from Out-of-Focus Blur
    Lou, Yifei
    Esser, Ernie
    Zhao, Hongkai
    Xin, Jack
    [J]. SIAM JOURNAL ON IMAGING SCIENCES, 2014, 7 (02): : 740 - 760