Blind inpainting using the fully convolutional neural network

被引:1
|
作者
Nian Cai
Zhenghang Su
Zhineng Lin
Han Wang
Zhijing Yang
Bingo Wing-Kuen Ling
机构
[1] Guangdong University of Technology,School of Information Engineering
[2] Guangdong University of Technology,School of Electromechanical Engineering
来源
The Visual Computer | 2017年 / 33卷
关键词
Image processing; Blind inpainting; Deep learning ; Convolutional neural network;
D O I
暂无
中图分类号
学科分类号
摘要
Most of existing inpainting techniques require to know beforehandwhere those damaged pixels are, i.e., non-blind inpainting methods. However, in many applications, such information may not be readily available. In this paper, we propose a novel blind inpainting method based on a fully convolutional neural network. We term this method as blind inpainting convolutional neural network (BICNN). It purely cascades three convolutional layers to directly learn an end-to-end mapping between a pre-acquired dataset of corrupted/ground truth subimage pairs. Stochastic gradient descent with standard backpropagation is used to train the BICNN. Once the BICNN is learned, it can automatically identify and remove the corrupting patterns from a corrupted image without knowing the specific regions. The learned BICNN takes a corrupted image of any size as input and directly produces a clean output by only one pass of forward propagation. Experimental results indicate that the proposed method can achieve a better inpainting performance than the existing inpainting methods for various corrupting patterns.
引用
收藏
页码:249 / 261
页数:12
相关论文
共 50 条
  • [1] Blind inpainting using the fully convolutional neural network
    Cai, Nian
    Su, Zhenghang
    Lin, Zhineng
    Wang, Han
    Yang, Zhijing
    Ling, Bingo Wing-Kuen
    [J]. VISUAL COMPUTER, 2017, 33 (02): : 249 - 261
  • [2] FINGERPRINT IMAGE DENOISING AND INPAINTING USING CONVOLUTIONAL NEURAL NETWORK
    Bae, Jungyoon
    Choi, Han-Soo
    Kim, Sujin
    Kang, Myungjoo
    [J]. JOURNAL OF THE KOREAN SOCIETY FOR INDUSTRIAL AND APPLIED MATHEMATICS, 2020, 24 (04) : 363 - 374
  • [3] Localization of Deep Inpainting Using High-Pass Fully Convolutional Network
    Li, Haodong
    Huang, Jiwu
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 8300 - 8309
  • [4] Speech Enhancement using Fully Convolutional UNET and Gated Convolutional Neural Network
    Baloch, Danish
    Abdullah, Sidrah
    Qaiser, Asma
    Ahmed, Saad
    Nasim, Faiza
    Kanwal, Mehreen
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (11) : 831 - 836
  • [5] SPNet: Shape Prediction Using a Fully Convolutional Neural Network
    Al Arif, S. M. Masudur Rahman
    Knapp, Karen
    Slabaugh, Greg
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 : 430 - 439
  • [6] Traffic Lane Detection using Fully Convolutional Neural Network
    Zang, Jinju
    Zhou, Wei
    Zhang, Guanwen
    Duan, Zhemin
    [J]. 2018 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2018, : 305 - 311
  • [7] Colorectal Polyp Segmentation Using A Fully Convolutional Neural Network
    Li, Qiaoliang
    Yang, Guangyao
    Chen, Zhewei
    Huang, Bin
    Chen, Liangliang
    Xu, Depeng
    Zhou, Xueying
    Zhong, Shi
    Zhang, Huisheng
    Wang, Tianfu
    [J]. 2017 10TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI), 2017,
  • [8] Carpal Bone Segmentation Using Fully Convolutional Neural Network
    Meng, Liang Kim
    Khalil, Azira
    Nizar, Muhamad Hanif Ahmad
    Nisham, Maryam Kamarun
    Pingguan-Murphy, Belinda
    Hum, Yan Chai
    Salim, Maheza Irna Mohamad
    Lai, Khin Wee
    [J]. CURRENT MEDICAL IMAGING, 2019, 15 (10) : 983 - 989
  • [9] BLIND REVERBERATION TIME ESTIMATION USING A CONVOLUTIONAL NEURAL NETWORK
    Gamper, Hannes
    Tashev, Ivan J.
    [J]. 2018 16TH INTERNATIONAL WORKSHOP ON ACOUSTIC SIGNAL ENHANCEMENT (IWAENC), 2018, : 136 - 140
  • [10] Robust Blind Equalization Algorithm Using Convolutional Neural Network
    Mei, Ruru
    Wang, Zhugang
    Hu, Wanru
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 1569 - 1573