Generative Image Inpainting with Residual Attention Learning

被引:0
|
作者
Wan, Fang [1 ]
Zhu, Yuesheng [1 ]
Cai, Zehua [1 ]
机构
[1] Peking Univ, Commun & Informat Secur Lab, Shenzhen Grad Sch, Shenzhen 518055, Peoples R China
关键词
Image inpainting; attention mechanism; deep learning;
D O I
10.1117/12.2573109
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Recent deep learning approaches have shown significant improvements in the challenging task of image inpainting. However, these methods may generate blurry output and distorted textures. In this paper, we propose an efficient end-to-end two-stage network for image inpainting. In the coarse stage, we employ residual dense block (RDB) as well as short and long skip connections to fully leverage and exploit features from all convolutional layers and give a globally rough reconstruction. In the refinement stage, we propose a local and global residual network based on channel and spatial attention block (CSAB) to adaptively weigh both channel-wise and spatial-wise features focusing on more meaningful information, and generate a locally fine-detailed image. Experiments on Paris StreetView and DTD textures demonstrate the effectiveness and efficiency of our method. Results show that our method outperforms the baseline techniques quantitatively and qualitatively.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Generative Image Inpainting With Attention Propagation
    Cao, Cheng-Rui
    Liu, Wei-Rong
    Shi, Chang-Hong
    Zhang, Hao-Chen
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (05): : 1343 - 1352
  • [2] Generative Image Inpainting with Contextual Attention
    Yu, Jiahui
    Lin, Zhe
    Yang, Jimei
    Shen, Xiaohui
    Lu, Xin
    Huang, Thomas S.
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 5505 - 5514
  • [3] Deep Generative Model for Image Inpainting With Local Binary Pattern Learning and Spatial Attention
    Wu, Haiwei
    Zhou, Jiantao
    Li, Yuanman
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 4016 - 4027
  • [4] Generative Image Inpainting Based on Wavelet Transform Attention Model
    Wang, Chen
    Wang, Jin
    Zhu, Qing
    Yin, Baocai
    [J]. 2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2020,
  • [5] Image Inpainting Using Channel Attention and Hierarchical Residual Networks
    Yang H.
    Yu Y.
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2021, 33 (05): : 671 - 681
  • [6] Learning Prior Feature and Attention Enhanced Image Inpainting
    Cao, Chenjie
    Dong, Qiaole
    Fu, Yanwei
    [J]. COMPUTER VISION - ECCV 2022, PT XV, 2022, 13675 : 306 - 322
  • [7] Image Inpainting via Residual Attention Fusion and Gated Information Distillation
    Yu Y.
    He P.
    Xu C.
    [J]. Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2022, 50 (12): : 49 - 59
  • [8] Collaborative Contrastive Learning-Based Generative Model for Image Inpainting
    Du, Yongqiang
    Liu, Haoran
    Chen, Songnan
    [J]. IEEE ACCESS, 2022, 10 : 106641 - 106654
  • [9] ITrans: generative image inpainting with transformers
    Wei Miao
    Lijun Wang
    Huchuan Lu
    Kaining Huang
    Xinchu Shi
    Bocong Liu
    [J]. Multimedia Systems, 2024, 30
  • [10] ITrans: generative image inpainting with transformers
    Miao, Wei
    Wang, Lijun
    Lu, Huchuan
    Huang, Kaining
    Shi, Xinchu
    Liu, Bocong
    [J]. MULTIMEDIA SYSTEMS, 2024, 30 (01)