Degression receptive field network for image inpainting

被引:0
|
作者
Meng, Jiahao [1 ]
Liu, Weirong [1 ]
Shi, Changhong [1 ]
Li, Zhijun [1 ]
Liu, Chaorong [1 ]
机构
[1] Lanzhou Univ Technol, Coll Elect & Informat Engn, Lanzhou 730050, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Generative adversarial networks; Degression receptive field; Coarse to fine inpainting network; Object removal and image editing; Deep learning;
D O I
10.1016/j.engappai.2024.131158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-stage image inpainting methods from coarse-to-fine have achieved satisfactory inpainting results in recent years. However, an in-depth analysis of multi-stage inpainting networks reveals that simply increasing complexity of refined network may lead to degradation problems. The paper proposes a degression receptive field network (DRFNet) via multi-head attention mechanism and U-shaped network with different receptive fields to address above phenomenon that existing image inpainting methods have detail blur and artifacts due to insufficient constraints. Initially, DRFNet innovatively takes receptive field as a perspective and consists of five sub-networks with decreasing receptive fields. Secondly, an easy-to-use TransConv module is designed to overcome the problem of local-pixel influence in convolution. Experiments show that comprehensive optimal rate of DRFNet on L1 error, Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Measure (SSIM), Fr(SIC)chet Inception Distance (FID), and Learned Perceptual Image Patch Similarity (LPIPS) is more than 82.86% on all three benchmark datasets, which achieves state-of-the-art results. Moreover, real-world experiments demonstrate the potential of DRFNet for object removal and image editing.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Dense Feature Interaction Network for Image Inpainting Localization
    Yao, Ye
    Han, Tingfeng
    Jia, Shan
    Lyu, Siwei
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2025, 20 : 1636 - 1648
  • [42] Enhanced Wavelet Scattering Network for Image Inpainting Detection
    Barglazan, Adrian-Alin
    Brad, Remus
    COMPUTATION, 2024, 12 (11)
  • [43] Image Inpainting via Enhanced Generative Adversarial Network
    Wang, Qiang
    Fan, Huijie
    2021 27TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2021,
  • [44] FASNet: Feature Aggregation and Sharing Network for Image Inpainting
    Phutke, Shruti S.
    Murala, Subrahmanyam
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 1664 - 1668
  • [45] Digital image inpainting based on Markov random field
    Yasuda, M.
    Ohkubo, J.
    Tanaka, K.
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE FOR MODELLING, CONTROL & AUTOMATION JOINTLY WITH INTERNATIONAL CONFERENCE ON INTELLIGENT AGENTS, WEB TECHNOLOGIES & INTERNET COMMERCE, VOL 2, PROCEEDINGS, 2006, : 747 - +
  • [46] Face Image Inpainting Based on Generative Adversarial Network
    Gao, Xinyi
    Minh Nguyen
    Yan, Wei Qi
    PROCEEDINGS OF THE 2021 36TH INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2021,
  • [47] A two-stage enhancement network with optimized effective receptive field for speckle image reconstruction
    Linli Xu
    Peixian Liang
    Jing Han
    Lianfa Bai
    Danny Z. Chen
    Multimedia Tools and Applications, 2023, 82 : 19923 - 19943
  • [48] Image Inpainting Based on Hidden Markov Random Field
    Liu, Hongxi
    Sun, Junxi
    Sun, Hongbin
    Lin, Haibo
    PROCEEDINGS OF 2016 IEEE 13TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP 2016), 2016, : 697 - 701
  • [49] Receptive Field-Based All-Optical Spiking Neural Network for Image Processing
    Chen, Taiyi
    Huang, Yu
    Zhou, Pei
    Mu, Penghua
    Xiang, Shuiying
    Chizhevsky, V. N.
    Li, Nianqiang
    IEEE JOURNAL OF QUANTUM ELECTRONICS, 2024, 60 (01)
  • [50] RF-Net: An End-to-End Image Matching Network based on Receptive Field
    Shen, Xuelun
    Wang, Cheng
    Li, Xin
    Yu, Zenglei
    Li, Jonathan
    Wen, Chenglu
    Cheng, Ming
    He, Zijian
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 8124 - 8132