Uncertainty-aware image inpainting with adaptive feedback network

被引:2
|
作者
Ma, Xin [1 ]
Zhou, Xiaoqiang [3 ,4 ]
Huang, Huaibo [3 ]
Jia, Gengyun [2 ]
Wang, Yaohui [5 ]
Chen, Xinyuan [5 ]
Chen, Cunjian [1 ]
机构
[1] Monash Univ, Clayton, Australia
[2] Nanjing Univ Posts & Telecommun, Sch Commun & Informat Engn, Nanjing, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Nanjing, Peoples R China
[4] Univ Sci & Technol China, Hefei, Peoples R China
[5] Shanghai Artificial Intelligence Lab, Shanghai, Peoples R China
基金
国家重点研发计划;
关键词
Image inpainting; Uncertainty estimation; Feedback mechanism;
D O I
10.1016/j.eswa.2023.121148
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While most image inpainting methods perform well on small image defects, they still struggle to deliver satisfactory results on large holes due to insufficient image guidance. To address this challenge, this paper proposes an uncertainty-aware adaptive feedback network (U2AFN), which incorporates an adaptive feedback mechanism to refine inpainting regions progressively. U2AFN predicts both an uncertainty map and an inpainting result simultaneously. During each iteration, the adaptive integration feedback block utilizes inpainting pixels with low uncertainty to guide the subsequent learning iteration. This process leads to a gradual reduction in uncertainty and produces more reliable inpainting outcomes. Our approach is extensively evaluated and compared on multiple datasets, demonstrating its superior performance over existing methods. The code is available at: https://codeocean.com/capsule/1901983/tree.
引用
收藏
页数:8
相关论文
共 50 条
  • [31] Three-Dimensional-Consistent Scene Inpainting via Uncertainty-Aware Neural Radiance Field
    Wang, Meng
    Yu, Qinkang
    Liu, Haipeng
    ELECTRONICS, 2024, 13 (02)
  • [32] Uncertainty-Aware Source-Free Adaptive Image Super-Resolution with Wavelet Augmentation Transformer
    Ai, Yuang
    Zhou, Xiaoqiang
    Huang, Huaibo
    Zhang, Lei
    He, Ran
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 8142 - 8152
  • [33] Parallel adaptive guidance network for image inpainting
    Jiang, Jinyang
    Dong, Xiucheng
    Li, Tao
    Zhang, Fan
    Qian, Hongjiang
    Chen, Guifang
    APPLIED INTELLIGENCE, 2023, 53 (01) : 1162 - 1179
  • [34] Uncertainty-Aware Sequence Labeling
    Ye, Jiacheng
    Zhou, Xiang
    Zheng, Xiaoqing
    Gui, Tao
    Zhang, Qi
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2022, 30 : 1775 - 1788
  • [35] Uncertainty-Aware Denoising Network for Artifact Removal in EEG Signals
    Jin, Xiyuan
    Wang, Jing
    Liu, Lei
    Lin, Youfang
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 4470 - 4480
  • [36] Trustworthy Mechanical Fault Diagnosis Using Uncertainty-aware Network
    Shao, Haidong
    Xiao, Yiming
    Deng, Qianwang
    Ren, Yingying
    Han, Te
    Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2024, 60 (12): : 194 - 206
  • [37] Fast Road Segmentation via Uncertainty-aware Symmetric Network
    Chang, Yicong
    Xue, Feng
    Sheng, Fei
    Liang, Wenteng
    Ming, Anlong
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022, 2022, : 11124 - 11130
  • [38] Uncertainty-Aware Multidimensional Scaling
    Hagele D.
    Krake T.
    Weiskopf D.
    IEEE Transactions on Visualization and Computer Graphics, 2023, 29 (01) : 23 - 32
  • [39] Parallel adaptive guidance network for image inpainting
    Jinyang Jiang
    Xiucheng Dong
    Tao Li
    Fan Zhang
    Hongjiang Qian
    Guifang Chen
    Applied Intelligence, 2023, 53 : 1162 - 1179
  • [40] UDNet: Uncertainty-aware deep network for salient object detection
    Fang, Yuming
    Zhang, Haiyan
    Yan, Jiebin
    Jiang, Wenhui
    Liu, Yang
    PATTERN RECOGNITION, 2023, 134