Uncertainty-aware image inpainting with adaptive feedback network

被引:2
|
作者
Ma, Xin [1 ]
Zhou, Xiaoqiang [3 ,4 ]
Huang, Huaibo [3 ]
Jia, Gengyun [2 ]
Wang, Yaohui [5 ]
Chen, Xinyuan [5 ]
Chen, Cunjian [1 ]
机构
[1] Monash Univ, Clayton, Australia
[2] Nanjing Univ Posts & Telecommun, Sch Commun & Informat Engn, Nanjing, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Nanjing, Peoples R China
[4] Univ Sci & Technol China, Hefei, Peoples R China
[5] Shanghai Artificial Intelligence Lab, Shanghai, Peoples R China
基金
国家重点研发计划;
关键词
Image inpainting; Uncertainty estimation; Feedback mechanism;
D O I
10.1016/j.eswa.2023.121148
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While most image inpainting methods perform well on small image defects, they still struggle to deliver satisfactory results on large holes due to insufficient image guidance. To address this challenge, this paper proposes an uncertainty-aware adaptive feedback network (U2AFN), which incorporates an adaptive feedback mechanism to refine inpainting regions progressively. U2AFN predicts both an uncertainty map and an inpainting result simultaneously. During each iteration, the adaptive integration feedback block utilizes inpainting pixels with low uncertainty to guide the subsequent learning iteration. This process leads to a gradual reduction in uncertainty and produces more reliable inpainting outcomes. Our approach is extensively evaluated and compared on multiple datasets, demonstrating its superior performance over existing methods. The code is available at: https://codeocean.com/capsule/1901983/tree.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Uncertainty-Aware Semantic Guidance and Estimation for Image Inpainting
    Liao, Liang
    Xiao, Jing
    Wang, Zheng
    Lin, Chia-Wen
    Satoh, Shin'ichi
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2021, 15 (02) : 310 - 323
  • [2] Uncertainty-Aware Image Captioning
    Fei, Zhengcong
    Fan, Mingyuan
    Zhu, Li
    Huang, Junshi
    Wei, Xiaoming
    Wei, Xiaolin
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 614 - 622
  • [3] Deep Adaptive Pansharpening via Uncertainty-Aware Image Fusion
    Zheng, Kaiwen
    Huang, Jie
    Zhou, Man
    Hong, Danfeng
    Zhao, Feng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [4] Uncertainty-aware network alignment
    Zhou, Fan
    Li, Ce
    Wen, Zijing
    Zhong, Ting
    Trajcevski, Goce
    Khokhar, Ashfaq
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2021, 36 (12) : 7895 - 7924
  • [5] Uncertainty-Aware Hierarchical Aggregation Network for Medical Image Segmentation
    Zhou, Tao
    Zhou, Yi
    Li, Guangyu
    Chen, Geng
    Shen, Jianbing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 7440 - 7453
  • [6] Uncertainty-aware Simulation of Adaptive Systems
    Jezequel, Jean-Marc
    Vallecillo, Antonio
    ACM TRANSACTIONS ON MODELING AND COMPUTER SIMULATION, 2023, 33 (03):
  • [7] Uncertainty-aware GAN with Adaptive Loss for Robust MRI Image Enhancement
    Upadhyay, Uddeshya
    Sudarshan, Viswanath P.
    Awate, Suyash P.
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 3248 - 3257
  • [8] Uncertainty-Aware RGBD Image Segmentation
    Yu, Chengxiao
    Wang, Xin
    Wang, Junqiu
    Zha, Hongbin
    2017 IEEE INTERNATIONAL CONFERENCE ON CYBORG AND BIONIC SYSTEMS (CBS), 2017, : 97 - 102
  • [9] Uncertainty-Aware Sparse Transformer Network for Single-Image Deraindrop
    Fu, Bo
    Jiang, Yunyun
    Wang, Di
    Gao, Jiaxin
    Wang, Cong
    Li, Ximing
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [10] Uncertainty-aware Cascade Network for Ultrasound Image Segmentation with Ambiguous Boundary
    Xie, Yanting
    Liao, Hongen
    Zhang, Daoqiang
    Chen, Fang
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT IV, 2022, 13434 : 268 - 278