Degression receptive field network for image inpainting

被引:0
|
作者
Meng, Jiahao [1 ]
Liu, Weirong [1 ]
Shi, Changhong [1 ]
Li, Zhijun [1 ]
Liu, Chaorong [1 ]
机构
[1] Lanzhou Univ Technol, Coll Elect & Informat Engn, Lanzhou 730050, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Generative adversarial networks; Degression receptive field; Coarse to fine inpainting network; Object removal and image editing; Deep learning;
D O I
10.1016/j.engappai.2024.131158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-stage image inpainting methods from coarse-to-fine have achieved satisfactory inpainting results in recent years. However, an in-depth analysis of multi-stage inpainting networks reveals that simply increasing complexity of refined network may lead to degradation problems. The paper proposes a degression receptive field network (DRFNet) via multi-head attention mechanism and U-shaped network with different receptive fields to address above phenomenon that existing image inpainting methods have detail blur and artifacts due to insufficient constraints. Initially, DRFNet innovatively takes receptive field as a perspective and consists of five sub-networks with decreasing receptive fields. Secondly, an easy-to-use TransConv module is designed to overcome the problem of local-pixel influence in convolution. Experiments show that comprehensive optimal rate of DRFNet on L1 error, Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Measure (SSIM), Fr(SIC)chet Inception Distance (FID), and Learned Perceptual Image Patch Similarity (LPIPS) is more than 82.86% on all three benchmark datasets, which achieves state-of-the-art results. Moreover, real-world experiments demonstrate the potential of DRFNet for object removal and image editing.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Degression receptive field network for image inpainting
    Meng, Jiahao
    Liu, Weirong
    Shi, Changhong
    Li, Zhijun
    Liu, Chaorong
    Engineering Applications of Artificial Intelligence, 2024, 138
  • [2] Diverse Receptive Field Based Adversarial Concurrent Encoder Network for Image Inpainting
    Phutke, Shruti S.
    Murala, Subrahmanyam
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 1873 - 1877
  • [3] Multi-receptive Field Aggregation Network for single image deraining
    Liang, Songliang
    Meng, Xiaozhe
    Su, Zhuo
    Zhou, Fan
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 84
  • [4] DRFnet: Dynamic receptive field network for object detection and image recognition
    Tan, Minjie
    Yuan, Xinyang
    Liang, Binbin
    Han, Songchen
    FRONTIERS IN NEUROROBOTICS, 2023, 16
  • [5] Cascading Blend Network for Image Inpainting
    Jin, Yiting
    Wu, Jie
    Wang, Wanliang
    Yan, Yidong
    Jiang, Jiawei
    Zheng, Jianwei
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (01)
  • [6] Image Inpainting with Contrastive Relation Network
    Zhou, Xiaoqiang
    Li, Junjie
    Wang, Zilei
    He, Ran
    Tan, Tieniu
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 4420 - 4427
  • [7] IMAGE INPAINTING USING PARALLEL NETWORK
    Deng, Ye
    Wang, Jinjun
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 1088 - 1092
  • [8] Context Adaptive Network for Image Inpainting
    Deng, Ye
    Hui, Siqi
    Zhou, Sanping
    Huang, Wenli
    Wang, Jinjun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 6332 - 6345
  • [9] Hourglass Attention Network for Image Inpainting
    Deng, Ye
    Hui, Siqi
    Meng, Rongye
    Zhou, Sanping
    Wang, Jinjun
    COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 : 483 - 501
  • [10] Image inpainting using a neural network
    Gapon, Nikolay
    Ponamorenko, Mikola
    Pismenskova, Marina
    Tokareva, Olga
    XIII INTERNATIONAL SCIENTIFIC-TECHNICAL CONFERENCE DYNAMIC OF TECHNICAL SYSTEMS (DTS-2017), 2017, 132