Image Inpainting via Enhanced Generative Adversarial Network

被引:1
|
作者
Wang, Qiang [1 ,2 ]
Fan, Huijie [2 ]
机构
[1] Shenyang Univ, Key Lab Mfg Ind Integrated, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/M2VIP49856.2021.9665009
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose an Enhanced Generative Model for Image Inpainting (EGMII). Unlike most state-of-the-art algorithms using extra constraints to enforce the generator network recover semantic texture details, we construct an end-to-end network to generate both the image contents and highfrequency details progressively. Our model contains a twophase generator and two discriminators. In our generator, the previous phase restores the structure information via convolutional encoder-decoder architecture, and the following phase captures high-frequency details via residual learning. For each generator phase, we define different objective functions and further optimize the entire network via a feed-forward manner. Moreover, for the generator in the second phase, we adopt a deep residual architecture, which also can eliminate the perceptual discontinuity on the border of the missing region. Experimental results on several public datasets demonstrate qualitatively and quantitatively that our model performs better than the state-of-the-art algorithms and can generate both realistic image contents and high-frequency details. Our code will be released soon.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] EIGAN: ENHANCED INPAINTING GENERATIVE ADVERSARIAL NETWORK
    Chen, Feiyu
    Deng, Wei
    Zhang, Chuanfa
    Gu, Kangzheng
    Zhang, Wenqiang
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [2] Image Inpainting using Wasserstein Generative Adversarial Network
    Hua, Peng
    Liu, Xiaohua
    Liu, Ming
    Dong, Liquan
    Hui, Mei
    Zhao, Yuejin
    [J]. OPTICS AND PHOTONICS FOR INFORMATION PROCESSING XII, 2018, 10751
  • [3] Face Image Inpainting Based on Generative Adversarial Network
    Gao, Xinyi
    Minh Nguyen
    Yan, Wei Qi
    [J]. PROCEEDINGS OF THE 2021 36TH INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2021,
  • [4] Fine-grained image inpainting with scale-enhanced generative adversarial network
    Liu, Weirong
    Cao, Chengrui
    Liu, Jie
    Ren, Chenwen
    Wei, Yulin
    Guo, Honglin
    [J]. PATTERN RECOGNITION LETTERS, 2021, 143 : 81 - 87
  • [5] ISRnet: Compressed Image Inpainting Based on Generative Adversarial Network
    Huang, Junjian
    Zheng, Mao
    Li, Zhizhang
    He, Xing
    Wen, Shiping
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024,
  • [6] Semantic face image inpainting based on Generative Adversarial Network
    Zhang, Heshu
    Li, Tao
    [J]. 2020 35TH YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION (YAC), 2020, : 530 - 535
  • [7] Image Inpainting Using Wasserstein Generative Adversarial Imputation Network
    Vasata, Daniel
    Halama, Tomas
    Friedjungova, Magda
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT II, 2021, 12892 : 575 - 586
  • [8] Edge-Guided Generative Adversarial Network for Image Inpainting
    Xu, Shunxin
    Liu, Dong
    Xiong, Zhiwei
    [J]. 2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2017,
  • [9] Face Image Inpainting Algorithm Based on Generative Adversarial Network
    Miao, Yalin
    Jia, Huanhuan
    Liu, Xuemin
    Zhang, Yang
    Zhao, Liyi
    [J]. 2019 6TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND CONTROL ENGINEERING (ICISCE 2019), 2019, : 282 - 286
  • [10] Image inpainting method based on incomplete image samples in generative adversarial network
    Li H.
    Huang H.
    Guo L.
    Li H.
    Chen J.
    Li H.
    [J]. Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2021, 47 (10): : 1949 - 1958