Degression receptive field network for image inpainting

被引:0
|
作者
Meng, Jiahao [1 ]
Liu, Weirong [1 ]
Shi, Changhong [1 ]
Li, Zhijun [1 ]
Liu, Chaorong [1 ]
机构
[1] Lanzhou Univ Technol, Coll Elect & Informat Engn, Lanzhou 730050, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Generative adversarial networks; Degression receptive field; Coarse to fine inpainting network; Object removal and image editing; Deep learning;
D O I
10.1016/j.engappai.2024.131158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-stage image inpainting methods from coarse-to-fine have achieved satisfactory inpainting results in recent years. However, an in-depth analysis of multi-stage inpainting networks reveals that simply increasing complexity of refined network may lead to degradation problems. The paper proposes a degression receptive field network (DRFNet) via multi-head attention mechanism and U-shaped network with different receptive fields to address above phenomenon that existing image inpainting methods have detail blur and artifacts due to insufficient constraints. Initially, DRFNet innovatively takes receptive field as a perspective and consists of five sub-networks with decreasing receptive fields. Secondly, an easy-to-use TransConv module is designed to overcome the problem of local-pixel influence in convolution. Experiments show that comprehensive optimal rate of DRFNet on L1 error, Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Measure (SSIM), Fr(SIC)chet Inception Distance (FID), and Learned Perceptual Image Patch Similarity (LPIPS) is more than 82.86% on all three benchmark datasets, which achieves state-of-the-art results. Moreover, real-world experiments demonstrate the potential of DRFNet for object removal and image editing.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Wide Receptive Field and Channel Attention Network for JPEG Compressed Image Deblurring
    Lee, Donghyeon
    Lee, Chulhee
    Kim, Taesung
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 304 - 313
  • [22] PEPSI: Fast and Lightweight Network for Image Inpainting
    Shin, Yong-Goo
    Sagong, Min-Cheol
    Yeo, Yoon-Jae
    Kim, Seung-Wook
    Ko, Sung-Jea
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (01) : 252 - 265
  • [23] Semantic Residual Pyramid Network for Image Inpainting
    Luo, Haiyin
    Zheng, Yuhui
    INFORMATION, 2022, 13 (02)
  • [24] Parallel adaptive guidance network for image inpainting
    Jiang, Jinyang
    Dong, Xiucheng
    Li, Tao
    Zhang, Fan
    Qian, Hongjiang
    Chen, Guifang
    APPLIED INTELLIGENCE, 2023, 53 (01) : 1162 - 1179
  • [25] Image inpainting with aggregated convolution progressive network
    Li, Yang
    Zhai, Jia
    Lu, Wen
    Guo, Haipeng
    Wen, Jiazheng
    Liu, Huanyu
    Li, Junbao
    IET IMAGE PROCESSING, 2025, 19 (01)
  • [26] Parallel adaptive guidance network for image inpainting
    Jinyang Jiang
    Xiucheng Dong
    Tao Li
    Fan Zhang
    Hongjiang Qian
    Guifang Chen
    Applied Intelligence, 2023, 53 : 1162 - 1179
  • [27] Learning Contextual Transformer Network for Image Inpainting
    Deng, Ye
    Hui, Siqi
    Zhou, Sanping
    Meng, Deyu
    Wang, Jinjun
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2529 - 2538
  • [28] Local and global mixture network for image inpainting
    Woo, Seunggyun
    Ko, Keunsoo
    Kim, Chang-Su
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 104
  • [29] Raindrop Removal With Light Field Image Using Image Inpainting
    Yang, Tao
    Chang, Xiaofei
    Su, Hang
    Crombez, Nathan
    Ruichek, Yassine
    Krajnik, Tomas
    Yan, Zhi
    IEEE ACCESS, 2020, 8 : 58416 - 58426
  • [30] Understanding the Influence of Receptive Field and Network Complexity in Neural Network-Guided TEM Image Analysis
    Sytwu, Katherine
    Groschner, Catherine
    Scott, Mary C.
    MICROSCOPY AND MICROANALYSIS, 2022, 28 (06) : 1896 - 1904