Multi-scale gradient attention guidance and adaptive style fusion for image inpainting

被引:0
|
作者
Zhu, Ye [1 ]
Wang, Chao [1 ]
Geng, Shuze [2 ]
Yu, Yang [1 ]
Hao, Xiaoke [1 ]
机构
[1] Hebei Univ Technol, Tianjin 300401, Peoples R China
[2] Tianjin Univ Technol & Educ, Tianjin 300222, Peoples R China
关键词
Image inpainting; Style transfer; Gradient attention; Multi-scale gradient loss; OBJECT REMOVAL; DIFFUSION;
D O I
10.1016/j.jvcir.2022.103681
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image inpainting aims to fill in the missing regions of damaged images with plausible content. Existing inpainting methods tend to produce ambiguous artifacts and implausible structures. To address the above issues, our method aims to fully utilize the information of known regions to provide style and structural guidance for missing regions. Specifically, the Adaptive Style Fusion (ASF) module reduces artifacts by transferring visual style features from known regions to missing regions. The Gradient Attention Guidance (GAG) module generates accurate structures by aggregating semantic information along gradient boundary regions. In addition, the Multi-scale Attentional Feature Extraction (MAFE) module extracts global contextual information and enhances the representation of image features. The sufficient experimental results on the three datasets demonstrate that our proposed method has superior performance in terms of visual plausibility and structural consistency compared to state-of-the-art inpainting methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Spatially adaptive multi-scale contextual attention for image inpainting
    Xueting Wang
    Yiyan Chen
    Toshihiko Yamasaki
    [J]. Multimedia Tools and Applications, 2022, 81 : 31831 - 31846
  • [2] Spatially adaptive multi-scale contextual attention for image inpainting
    Wang, Xueting
    Chen, Yiyan
    Yamasaki, Toshihiko
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (22) : 31831 - 31846
  • [3] Multi-scale attention network for image inpainting
    Qin, Jia
    Bai, Huihui
    Zhao, Yao
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 204
  • [4] Progressively Multi-Scale Feature Fusion for Image Inpainting
    Wen, Wu
    Li, Tianhao
    Tolba, Amr
    Liu, Ziyi
    Shao, Kai
    [J]. MATHEMATICS, 2023, 11 (24)
  • [5] MRS-Net: an image inpainting algorithm with multi-scale residual attention fusion
    Deng, Hongxia
    Qian, Guanyu
    Luo, Dongsheng
    Lv, Xindong
    Liu, Haoqi
    Li, Haifang
    [J]. APPLIED INTELLIGENCE, 2023, 53 (07) : 7497 - 7511
  • [6] MRS-Net: an image inpainting algorithm with multi-scale residual attention fusion
    Hongxia Deng
    Guanyu Qian
    Dongsheng Luo
    Xindong Lv
    Haoqi Liu
    Haifang Li
    [J]. Applied Intelligence, 2023, 53 : 7497 - 7511
  • [7] MUSICAL: Multi-Scale Image Contextual Attention Learning for Inpainting
    Wang, Ning
    Li, Jingyuan
    Zhang, Lefei
    Du, Bo
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 3748 - 3754
  • [8] Image Inpainting Based Multi-scale Gated Convolution and Attention
    Jiang, Hualiang
    Ma, Xiaohu
    Yang, Dongdong
    Zhao, Jiaxin
    Shen, Yao
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT II, 2022, 13530 : 407 - 418
  • [9] Dunhuang mural inpainting based on reference guidance and multi-scale fusion
    Liu, Zhongmin
    Li, Yaolong
    [J]. IET IMAGE PROCESSING, 2024,
  • [10] Image Inpainting Using Multi-Scale Feature Joint Attention Model
    Lin, Xiao
    Zhou, Yunxiang
    Li, Dazhi
    Huang, Wei
    Sheng, Bin
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (08): : 1260 - 1271