Degression receptive field network for image inpainting

被引:0
|
作者
Meng, Jiahao [1 ]
Liu, Weirong [1 ]
Shi, Changhong [1 ]
Li, Zhijun [1 ]
Liu, Chaorong [1 ]
机构
[1] Lanzhou Univ Technol, Coll Elect & Informat Engn, Lanzhou 730050, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Generative adversarial networks; Degression receptive field; Coarse to fine inpainting network; Object removal and image editing; Deep learning;
D O I
10.1016/j.engappai.2024.131158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-stage image inpainting methods from coarse-to-fine have achieved satisfactory inpainting results in recent years. However, an in-depth analysis of multi-stage inpainting networks reveals that simply increasing complexity of refined network may lead to degradation problems. The paper proposes a degression receptive field network (DRFNet) via multi-head attention mechanism and U-shaped network with different receptive fields to address above phenomenon that existing image inpainting methods have detail blur and artifacts due to insufficient constraints. Initially, DRFNet innovatively takes receptive field as a perspective and consists of five sub-networks with decreasing receptive fields. Secondly, an easy-to-use TransConv module is designed to overcome the problem of local-pixel influence in convolution. Experiments show that comprehensive optimal rate of DRFNet on L1 error, Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Measure (SSIM), Fr(SIC)chet Inception Distance (FID), and Learned Perceptual Image Patch Similarity (LPIPS) is more than 82.86% on all three benchmark datasets, which achieves state-of-the-art results. Moreover, real-world experiments demonstrate the potential of DRFNet for object removal and image editing.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] RNON: image inpainting via repair network and optimization network
    Chen, Yuantao
    Xia, Runlong
    Zou, Ke
    Yang, Kai
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (09) : 2945 - 2961
  • [32] RNON: image inpainting via repair network and optimization network
    Yuantao Chen
    Runlong Xia
    Ke Zou
    Kai Yang
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 2945 - 2961
  • [33] Infrared and Visible Image Fusion via Multiscale Receptive Field Amplification Fusion Network
    Ji, Chuanming
    Zhou, Wujie
    Lei, Jingsheng
    Ye, Lv
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 493 - 497
  • [34] Dual residual and large receptive field network for lightweight image super-resolution
    Pan, Lulu
    Li, Guo
    Xu, Ke
    Lv, Yanheng
    Zhang, Wenbo
    Li, Lingxiao
    Lei, Le
    NEUROCOMPUTING, 2024, 600
  • [35] Image Inpainting using Wasserstein Generative Adversarial Network
    Hua, Peng
    Liu, Xiaohua
    Liu, Ming
    Dong, Liquan
    Hui, Mei
    Zhao, Yuejin
    OPTICS AND PHOTONICS FOR INFORMATION PROCESSING XII, 2018, 10751
  • [36] Art Image Inpainting With Style-Guided Dual-Branch Inpainting Network
    Wang, Quan
    Wang, Zichi
    Zhang, Xinpeng
    Feng, Guorui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8026 - 8037
  • [37] Multi-scale attention network for image inpainting
    Qin, Jia
    Bai, Huihui
    Zhao, Yao
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 204
  • [38] Image Inpainting with a Three-Stage Generative Network
    Shao X.
    Ye H.
    Yang B.
    Cao F.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2022, 35 (12): : 1047 - 1063
  • [39] LRGAN: A computational lightweight image inpainting neural network
    Liao N.
    Zhang X.
    Peng C.
    Fan H.
    Zhongguo Kexue Jishu Kexue/Scientia Sinica Technologica, 2022, 52 (03): : 447 - 457
  • [40] PEPSI : Fast Image Inpainting with Parallel Decoding Network
    Sagong, Min-cheol
    Shin, Yong-goo
    Kim, Seung-wook
    Park, Seung
    Ko, Sung-jea
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11352 - 11360