Uncertainty-aware image inpainting with adaptive feedback network

被引:2
|
作者
Ma, Xin [1 ]
Zhou, Xiaoqiang [3 ,4 ]
Huang, Huaibo [3 ]
Jia, Gengyun [2 ]
Wang, Yaohui [5 ]
Chen, Xinyuan [5 ]
Chen, Cunjian [1 ]
机构
[1] Monash Univ, Clayton, Australia
[2] Nanjing Univ Posts & Telecommun, Sch Commun & Informat Engn, Nanjing, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Nanjing, Peoples R China
[4] Univ Sci & Technol China, Hefei, Peoples R China
[5] Shanghai Artificial Intelligence Lab, Shanghai, Peoples R China
基金
国家重点研发计划;
关键词
Image inpainting; Uncertainty estimation; Feedback mechanism;
D O I
10.1016/j.eswa.2023.121148
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While most image inpainting methods perform well on small image defects, they still struggle to deliver satisfactory results on large holes due to insufficient image guidance. To address this challenge, this paper proposes an uncertainty-aware adaptive feedback network (U2AFN), which incorporates an adaptive feedback mechanism to refine inpainting regions progressively. U2AFN predicts both an uncertainty map and an inpainting result simultaneously. During each iteration, the adaptive integration feedback block utilizes inpainting pixels with low uncertainty to guide the subsequent learning iteration. This process leads to a gradual reduction in uncertainty and produces more reliable inpainting outcomes. Our approach is extensively evaluated and compared on multiple datasets, demonstrating its superior performance over existing methods. The code is available at: https://codeocean.com/capsule/1901983/tree.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] Precision Vehicle Pose Estimation with Uncertainty-aware Neural Network
    Nowak, Tomasz
    Skrzypczynski, Piotr
    WALKING ROBOTS INTO REAL WORLD, CLAWAR 2024 CONFERENCE, VOL 1, 2024, 1114 : 22 - 33
  • [42] Uncertainty-Aware Anticipation of Activities
    Abu Farha, Yazan
    Gall, Juergen
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 1197 - 1204
  • [43] Uncertainty-aware circuit optimization
    Bai, XL
    Visweswariah, C
    Strenski, PN
    Hathaway, DJ
    39TH DESIGN AUTOMATION CONFERENCE, PROCEEDINGS 2002, 2002, : 58 - 63
  • [44] Uncertainty-Aware Panoptic Segmentation
    Sirohi, Kshitij
    Marvi, Sajad
    Buescher, Daniel
    Burgard, Wolfram
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (05): : 2629 - 2636
  • [45] Uncertainty-aware Ramachandran Plots
    Maack, Robin G. C.
    Hagen, Hans
    Gillmann, Christina
    2019 IEEE PACIFIC VISUALIZATION SYMPOSIUM (PACIFICVIS 2019), 2019, : 227 - 231
  • [46] Uncertainty-Aware Policy Optimization: A Robust, Adaptive Trust Region Approach
    Queeney, James
    Paschalidis, Ioannis Ch
    Cassandras, Christos G.
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 9377 - 9385
  • [47] Uncertainty-aware Situational Understanding
    Tomsett, Richard
    Kaplan, Lance
    Cerutti, Federico
    Sullivan, Paul
    Vente, Daniel
    Vilamala, Marc Roig
    Kimmig, Angelika
    Preece, Alun
    Sensoy, Murat
    ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR MULTI-DOMAIN OPERATIONS APPLICATIONS, 2019, 11006
  • [48] Uncertainty-aware Pseudo Label Refinery for Domain Adaptive Semantic Segmentation
    Wang, Yuxi
    Peng, Junran
    Zhang, Zhaoxiang
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9072 - 9081
  • [49] Uncertainty-Aware Source-Free Domain Adaptive Semantic Segmentation
    Lu, Zhihe
    Li, Da
    Song, Yi-Zhe
    Xiang, Tao
    Hospedales, Timothy M. M.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 4664 - 4676
  • [50] Learning Adaptive Probabilistic Models for Uncertainty-Aware Air Pollution Prediction
    Wu, Zhiyuan
    Liu, Ning
    Li, Guodong
    Liu, Xinyu
    Wang, Yue
    Zhang, Lin
    IEEE ACCESS, 2023, 11 : 24971 - 24985