Image inpainting based on deep learning: A review

被引:85
|
作者
Qin, Zhen [1 ]
Zeng, Qingliang [2 ]
Zong, Yixin [3 ]
Xu, Fan [4 ]
机构
[1] Hunan Univ, Sch Design, Changsha, Peoples R China
[2] Wave Grp, Cognit Comp Technol Joint Lab, Beijing, Peoples R China
[3] Chinese Acad Sci, Bur Frontier Sci & Educ, Beijing, Peoples R China
[4] Beijing Inst Control Engn, Beijing, Peoples R China
基金
美国国家科学基金会;
关键词
Computer vision; Image inpainting; Variational autoencoder (VAE); Generative adversarial networks (GAN); INTERPOLATION; REMOVAL;
D O I
10.1016/j.displa.2021.102028
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Image inpainting aims to restore the pixel features of damaged parts in incomplete image and plays a key role in many computer vision tasks. Image inpainting technology based on deep learning is a major current research hotspot. To deeply understand related methods and technologies, this article combs and summarizes the latest research status in this field. Firstly, we summarize inpainting methods of different types of neural network structure based on deep learning, then analyze and study important technical improvement mechanisms. In addition, various algorithms are comprehensively reviewed from the aspects of model network structure and restoration methods. And we select some representative image inpainting methods for comparison and analysis. Finally, the current problems of image inpainting are summarized, and the future development trend and research direction are prospected.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Image inpainting based on deep learning: A review
    Zhang, Xiaobo
    Zhai, Donghai
    Li, Tianrui
    Zhou, Yuxin
    Lin, Yang
    [J]. INFORMATION FUSION, 2023, 90 : 74 - 94
  • [2] A Review of Image Inpainting Methods Based on Deep Learning
    Xu, Zishan
    Zhang, Xiaofeng
    Chen, Wei
    Yao, Minda
    Liu, Jueting
    Xu, Tingting
    Wang, Zehua
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (20):
  • [3] Review of Deep Learning-Based Image Inpainting Techniques
    Yang, Jing
    Ruhaiyem, Nur Intan Raihana
    [J]. IEEE Access, 2024, 12 : 138441 - 138482
  • [4] A Survey of Face Image Inpainting Based on Deep Learning
    Su, Shiqi
    Yang, Miao
    He, Libo
    Shao, Xiaofeng
    Zuo, Yuxuan
    Qiang, Zhenping
    [J]. CLOUD COMPUTING, CLOUDCOMP 2021, 2022, 430 : 72 - 87
  • [5] Deep learning for image inpainting: A survey
    Xiang, Hanyu
    Zou, Qin
    Nawaz, Muhammad Ali
    Huang, Xianfeng
    Zhang, Fan
    Yu, Hongkai
    [J]. PATTERN RECOGNITION, 2023, 134
  • [6] Deep Learning-Based Image and Video Inpainting: A Survey
    Quan, Weize
    Chen, Jiaxi
    Liu, Yanli
    Yan, Dong-Ming
    Wonka, Peter
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (07) : 2367 - 2400
  • [7] Deep learning-based image inpainting with structure map
    Bo, Dezhi
    Ma, Ran
    Wang, Keke
    Su, Min
    An, Ping
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (03)
  • [8] Image Inpainting Methods Based on Deep Neural Networks: A Review
    Li, Yue-Long
    Gao, Yun
    Yan, Jia-Liang
    Zou, Bai-Han
    Wang, Jian-Ming
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2021, 44 (11): : 2295 - 2316
  • [9] A Joint Loss based Deep Learning Model for Enhanced Image Inpainting
    Yu, Haowen
    Chen, Liming
    [J]. 2022 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2022, : 481 - 486
  • [10] A deep learning approach to patch-based image inpainting forensics
    Zhu, Xinshan
    Qian, Yongjun
    Zhao, Xianfeng
    Sun, Biao
    Sun, Ya
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 67 : 90 - 99