Uncertainty-aware image inpainting with adaptive feedback network

被引:2
|
作者
Ma, Xin [1 ]
Zhou, Xiaoqiang [3 ,4 ]
Huang, Huaibo [3 ]
Jia, Gengyun [2 ]
Wang, Yaohui [5 ]
Chen, Xinyuan [5 ]
Chen, Cunjian [1 ]
机构
[1] Monash Univ, Clayton, Australia
[2] Nanjing Univ Posts & Telecommun, Sch Commun & Informat Engn, Nanjing, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Nanjing, Peoples R China
[4] Univ Sci & Technol China, Hefei, Peoples R China
[5] Shanghai Artificial Intelligence Lab, Shanghai, Peoples R China
基金
国家重点研发计划;
关键词
Image inpainting; Uncertainty estimation; Feedback mechanism;
D O I
10.1016/j.eswa.2023.121148
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While most image inpainting methods perform well on small image defects, they still struggle to deliver satisfactory results on large holes due to insufficient image guidance. To address this challenge, this paper proposes an uncertainty-aware adaptive feedback network (U2AFN), which incorporates an adaptive feedback mechanism to refine inpainting regions progressively. U2AFN predicts both an uncertainty map and an inpainting result simultaneously. During each iteration, the adaptive integration feedback block utilizes inpainting pixels with low uncertainty to guide the subsequent learning iteration. This process leads to a gradual reduction in uncertainty and produces more reliable inpainting outcomes. Our approach is extensively evaluated and compared on multiple datasets, demonstrating its superior performance over existing methods. The code is available at: https://codeocean.com/capsule/1901983/tree.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Context Adaptive Network for Image Inpainting
    Deng, Ye
    Hui, Siqi
    Zhou, Sanping
    Huang, Wenli
    Wang, Jinjun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 6332 - 6345
  • [22] Adaptive Tracking Control With Uncertainty-Aware and State-Dependent Feedback Action Blending for Robot Manipulators
    Wu, Xuwei
    Kirner, Annika
    Garofalo, Gianluca
    Ott, Christian
    Kotyczka, Paul
    Dietrich, Alexander
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) : 12307 - 12314
  • [23] Uncertainty-Aware Active Domain Adaptive Salient Object Detection
    Li, Guanbin
    Chen, Zhuohua
    Mao, Mingzhi
    Lin, Liang
    Fang, Chaowei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 5510 - 5524
  • [24] Uncertainty-Aware Robust Adaptive Video Streaming with Bayesian Neural Network and Model Predictive Control
    Kan, Nuowen
    Li, Chenglin
    Yang, Caiyi
    Dai, Wenrui
    Zou, Junni
    Xiong, Hongkai
    PROCEEDINGS OF THE 31ST ACM WORKSHOP ON NETWORK AND OPERATING SYSTEMS SUPPORT FOR DIGITAL AUDIO AND VIDEO (NOSSDAV '21), 2021, : 18 - 24
  • [25] Uncertainty-Aware Label Rectification for Domain Adaptive Mitochondria Segmentation
    Wu, Siqi
    Chen, Chang
    Xiong, Zhiwei
    Chen, Xuejin
    Sun, Xiaoyan
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT III, 2021, 12903 : 191 - 200
  • [26] A Continual Learning Framework for Uncertainty-Aware Interactive Image Segmentation
    Zheng, Ervine
    Yu, Qi
    Li, Rui
    Shi, Pengcheng
    Haake, Anne
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 6030 - 6038
  • [27] Uncertainty-Aware Unsupervised Image Deblurring with Deep Residual Prior
    Tang, Xiaole
    Zhao, Xile
    Liu, Jun
    Wang, Jianli
    Miao, Yuchun
    Zeng, Tieyong
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 9883 - 9892
  • [28] Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild
    Zhang, Weixia
    Ma, Kede
    Zhai, Guangtao
    Yang, Xiaokang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3474 - 3486
  • [29] An Uncertainty-Aware Visual System for Image Pre-Processing
    Gillmann, Christina
    Arbelaez, Pablo
    Tiberio Hernandez, Jose
    Hagen, Hans
    Wischgoll, Thomas
    JOURNAL OF IMAGING, 2018, 4 (09):
  • [30] Uncertainty-Aware Adaptive Multiscale U-Net for Low-Contrast Cardiac Image Segmentation
    Sagar, A. S. M. Sharifuzzaman
    Islam, Muhammad Zubair
    Tanveer, Jawad
    Kim, Hyung Seok
    APPLIED SCIENCES-BASEL, 2025, 15 (04):