Deep Variational Inference Network for Single Image Reflection Removal

被引:1
|
作者
Zhang, Ya-Nan [1 ,2 ]
Li, Qiufu [1 ,2 ]
Shen, Linlin [1 ,2 ]
He, Ailian [3 ]
Wu, Song [4 ]
机构
[1] Shenzhen Univ, Coll Comp Sci & Software Engn, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Peoples R China
[2] Shenzhen Univ, Natl Engn Lab Big Data Syst Comp Technol, Shenzhen 518060, Peoples R China
[3] Tencent Mus Entertainment, Shenzhen 518000, Peoples R China
[4] Shenzhen Univ, South China Hosp, Dept Urol, Shenzhen, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Bayes methods; Training; Deep learning; Superresolution; Rain; Generators; Deep network; interpretability; single image reflection removal; variational inference; SEPARATION;
D O I
10.1109/TETCI.2024.3359063
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Reflection removal from an image with undesirable reflections is a challenging and ill-posed problem in low-level vision. In recent years, several deep learning approaches have been proposed to tackle the task of single image reflection removal (SIRR). These methods, however, do not fully utilize the fundamental image priors of reflection and lack interpretability. In this paper, we propose a deep variational inference reflection removal (VIRR) method for the SIRR problem, which has good interpretability and good generalization ability. Based on the proposed VIRR method, the posterior distributions of the latent transmission and reflection images can be estimated jointly through variational inference, using deep neural networks. Furthermore, the proposed network framework can be trained by the supervision of data-driven priors for the transmission image and reflection image, which is produced by the variational lower bound objective of marginal data likelihood. Our proposed method outperforms previous state-of-the-art approaches on four benchmark datasets, as demonstrated by extensive subjective and objective evaluations.
引用
收藏
页码:1910 / 1921
页数:12
相关论文
共 50 条
  • [1] Content and Gradient Model-driven Deep Network for Single Image Reflection Removal
    Zhang, Ya-Nan
    Shen, Linlin
    Li, Qiufu
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6802 - 6812
  • [2] Hue Guidance Network for Single Image Reflection Removal
    Zhu Y.
    Fu X.
    Zhang Z.
    Liu A.
    Xiong Z.
    Zha Z.
    [J]. IEEE Trans. Neural Networks Learn. Sys., 2024, 10 (13701-13712): : 1 - 12
  • [3] A Generic Deep Architecture for Single Image Reflection Removal and Image Smoothing
    Fan, Qingnan
    Yang, Jiaolong
    Hua, Gang
    Chen, Baoquan
    Wipf, David
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 3258 - 3267
  • [4] Single Image Reflection Removal via Deep Feature Contrast
    Liu L.
    [J]. International Journal of Circuits, Systems and Signal Processing, 2022, 16 : 311 - 320
  • [5] LEDNet: Deep Network for Single Image Haze Removal
    Dudhane, Akshay
    Murala, Subrahmanyam
    Dhall, Abhinav
    [J]. ELEVENTH INDIAN CONFERENCE ON COMPUTER VISION, GRAPHICS AND IMAGE PROCESSING (ICVGIP 2018), 2018,
  • [6] Single Image Reflection Removal for Privacy Protection using Deep CNN
    Takahashi, Tomohiro
    Uruma, Kazunori
    Kobayashi, Keita
    [J]. 2020 IEEE 63RD INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2020, : 1028 - 1031
  • [7] Single-Image Reflection Removal Using Deep Learning: A Systematic Review
    Amanlou, Ali
    Suratgar, Amir Abolfazl
    Tavoosi, Jafar
    Mohammadzadeh, Ardashir
    Mosavi, Amir
    [J]. IEEE ACCESS, 2022, 10 : 29937 - 29953
  • [8] Seeing Deeply and Bidirectionally: A Deep Learning Approach for Single Image Reflection Removal
    Yang, Jie
    Gong, Dong
    Liu, Lingqiao
    Shi, Qinfeng
    [J]. COMPUTER VISION - ECCV 2018, PT III, 2018, 11207 : 675 - 691
  • [9] Multistage Curvature-Guided Network for Progressive Single Image Reflection Removal
    Song, Binbin
    Zhou, Jiantao
    Wu, Haiwei
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) : 6515 - 6529
  • [10] Single Image Reflection Removal Exploiting Misaligned Training Data and Network Enhancements
    Wei, Kaixuan
    Yang, Jiaolong
    Fu, Ying
    Wipf, David
    Huang, Hua
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 8170 - 8179