Deep Variational Inference Network for Single Image Reflection Removal

被引:1
|
作者
Zhang, Ya-Nan [1 ,2 ]
Li, Qiufu [1 ,2 ]
Shen, Linlin [1 ,2 ]
He, Ailian [3 ]
Wu, Song [4 ]
机构
[1] Shenzhen Univ, Coll Comp Sci & Software Engn, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Peoples R China
[2] Shenzhen Univ, Natl Engn Lab Big Data Syst Comp Technol, Shenzhen 518060, Peoples R China
[3] Tencent Mus Entertainment, Shenzhen 518000, Peoples R China
[4] Shenzhen Univ, South China Hosp, Dept Urol, Shenzhen, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Bayes methods; Training; Deep learning; Superresolution; Rain; Generators; Deep network; interpretability; single image reflection removal; variational inference; SEPARATION;
D O I
10.1109/TETCI.2024.3359063
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Reflection removal from an image with undesirable reflections is a challenging and ill-posed problem in low-level vision. In recent years, several deep learning approaches have been proposed to tackle the task of single image reflection removal (SIRR). These methods, however, do not fully utilize the fundamental image priors of reflection and lack interpretability. In this paper, we propose a deep variational inference reflection removal (VIRR) method for the SIRR problem, which has good interpretability and good generalization ability. Based on the proposed VIRR method, the posterior distributions of the latent transmission and reflection images can be estimated jointly through variational inference, using deep neural networks. Furthermore, the proposed network framework can be trained by the supervision of data-driven priors for the transmission image and reflection image, which is produced by the variational lower bound objective of marginal data likelihood. Our proposed method outperforms previous state-of-the-art approaches on four benchmark datasets, as demonstrated by extensive subjective and objective evaluations.
引用
收藏
页码:1910 / 1921
页数:12
相关论文
共 50 条
  • [31] Single-Image Fence Removal Using Deep Convolutional Neural Network
    Matsui, Takuro
    Ikehara, Masaaki
    [J]. IEEE ACCESS, 2020, 8 : 38846 - 38854
  • [32] Reflection Intensity Guided Single Image Reflection Removal and Transmission Recovery
    He, Lingzhi
    Li, Feng
    Cong, Runmin
    Zhao, Yao
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 5026 - 5039
  • [33] Deep Variational Network Toward Blind Image Restoration
    Yue Z.
    Yong H.
    Zhao Q.
    Zhang L.
    Meng D.
    Wong K.K.
    [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, 46 (11) : 1 - 16
  • [34] Location-aware Single Image Reflection Removal
    Dong, Zheng
    Xu, Ke
    Yang, Yin
    Bao, Hujun
    Xu, Weiwei
    Lau, Rynson W. H.
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4997 - 5006
  • [35] Single Image Reflection Removal through Cascaded Refinement
    Li, Chao
    Yang, Yixiao
    He, Kun
    Lin, Stephen
    Hopcroft, John E.
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3562 - 3571
  • [36] Benchmarking Single-Image Reflection Removal Algorithms
    Wan, Renjie
    Shi, Boxin
    Li, Haoliang
    Hong, Yuchen
    Duan, Ling-Yu
    Kot, Alex C.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 1424 - 1441
  • [37] Benchmarking Single-Image Reflection Removal Algorithms
    Wan, Renjie
    Shi, Boxin
    Duan, Ling-Yu
    Tan, Ah-Hwee
    Kot, Alex C.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 3942 - 3950
  • [38] FIPHN: Feature-Integrated Patch-Hierarchical Network for Single Image Reflection Removal
    Wang, Wei
    Yu, Dongyu
    Li, Yue
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 685 - 691
  • [39] DLT-Net: deep learning transmittance network for single image haze removal
    Li, Bin
    Zhao, Jingjuan
    Fu, Hui
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2020, 14 (06) : 1245 - 1253
  • [40] DLT-Net: deep learning transmittance network for single image haze removal
    Bin Li
    Jingjuan Zhao
    Hui Fu
    [J]. Signal, Image and Video Processing, 2020, 14 : 1245 - 1253