Generative Image Inpainting with Residual Attention Learning

被引:0
|
作者
Wan, Fang [1 ]
Zhu, Yuesheng [1 ]
Cai, Zehua [1 ]
机构
[1] Peking Univ, Commun & Informat Secur Lab, Shenzhen Grad Sch, Shenzhen 518055, Peoples R China
关键词
Image inpainting; attention mechanism; deep learning;
D O I
10.1117/12.2573109
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Recent deep learning approaches have shown significant improvements in the challenging task of image inpainting. However, these methods may generate blurry output and distorted textures. In this paper, we propose an efficient end-to-end two-stage network for image inpainting. In the coarse stage, we employ residual dense block (RDB) as well as short and long skip connections to fully leverage and exploit features from all convolutional layers and give a globally rough reconstruction. In the refinement stage, we propose a local and global residual network based on channel and spatial attention block (CSAB) to adaptively weigh both channel-wise and spatial-wise features focusing on more meaningful information, and generate a locally fine-detailed image. Experiments on Paris StreetView and DTD textures demonstrate the effectiveness and efficiency of our method. Results show that our method outperforms the baseline techniques quantitatively and qualitatively.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Generative image inpainting with enhanced gated convolution and Transformers
    Wang, Min
    Lu, Wanglong
    Lyu, Jiankai
    Shi, Kaijie
    Zhao, Hanli
    [J]. DISPLAYS, 2022, 75
  • [42] PiiGAN: Generative Adversarial Networks for Pluralistic Image Inpainting
    Cai, Weiwei
    Wei, Zhanguo
    [J]. IEEE ACCESS, 2020, 8 (08): : 48451 - 48463
  • [43] Semantic image inpainting based on Generative Adversarial Networks
    Wu, Chugang
    Xian, Yanhua
    Bai, Junqi
    Jing, Yuancheng
    [J]. 2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTER ENGINEERING (ICAICE 2020), 2020, : 276 - 280
  • [44] Image Inpainting via Enhanced Generative Adversarial Network
    Wang, Qiang
    Fan, Huijie
    [J]. 2021 27TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2021,
  • [45] Face Image Inpainting Based on Generative Adversarial Network
    Gao, Xinyi
    Minh Nguyen
    Yan, Wei Qi
    [J]. PROCEEDINGS OF THE 2021 36TH INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2021,
  • [46] Video inpainting based on residual convolution attention network
    Li De-cai
    Yan Qun
    Yao Jian-min
    Lin Zhi-xian
    Dong Ze-yu
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2022, 37 (01) : 86 - 96
  • [47] Semantic Residual Pyramid Network for Image Inpainting
    Luo, Haiyin
    Zheng, Yuhui
    [J]. INFORMATION, 2022, 13 (02)
  • [48] CTRF-GAN: A Generative Network for Image Inpainting Using CSWin Transformer and Fast Fourier Convolution Residual
    Wu, Hongcheng
    Lin, Guojun
    Lin, Tong
    Zhu, Yanmei
    Wang, Zhisun
    Diao, Haojie
    [J]. IEEE Access, 2024, 12 : 156327 - 156336
  • [49] Image inpainting with contextual attention and partial convolution
    Mohite, Tejaswini Adesh
    Phadke, Gargi S.
    [J]. 2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND SIGNAL PROCESSING (AISP), 2020,
  • [50] Image Inpainting with Learnable Bidirectional Attention Maps
    Xie, Chaohao
    Liu, Shaohui
    Li, Chao
    Cheng, Ming-Ming
    Zuo, Wangmeng
    Liu, Xiao
    Wen, Shilei
    Ding, Errui
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 8857 - 8866