Multispectral illumination estimation using deep unrolling network

被引:15
|
作者
Li, Yuqi [1 ]
Fu, Qiang [1 ]
Heidrich, Wolfgang [1 ]
机构
[1] King Abdullah Univ Sci & Technol, Thuwal, Saudi Arabia
关键词
D O I
10.1109/ICCV48922.2021.00267
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper examines the problem of illumination spectra estimation in multispectral images. We cast the problem into a constrained matrix factorization problem and present a method for both single-global and multiple illumination estimation in which a deep unrolling network is constructed from the alternating direction method of multipliers(ADMM) optimization for solving the matrix factorization problem. To alleviate the lack of multispectral training data, we build a large multispectral reflectance image dataset for generating synthesized data and use them for training and evaluating our model. The results of simulations and real experiments demonstrate that the proposed method is able to outperform state-of-the-art spectral illumination estimation methods, and that it generalizes well to a wide variety of scenes and spectra.
引用
收藏
页码:2652 / 2661
页数:10
相关论文
共 50 条
  • [1] Deep Shutter Unrolling Network
    Liu, Peidong
    Cui, Zhaopeng
    Larsson, Viktor
    Pollefeys, Marc
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5940 - 5948
  • [2] DSNet: Deep Shadow Network for Illumination Estimation
    Xiong, Yuan
    Chen, Hongrui
    Wang, Jingru
    Zhu, Zhe
    Zhou, Zhong
    [J]. 2021 IEEE VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2021, : 179 - 187
  • [3] Deep Separable Convolution Neural Network for Illumination Estimation
    Wang, Minquan
    Shang, Zhaowei
    [J]. PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE (ICAART), VOL 2, 2019, : 879 - 886
  • [4] Deep Unrolling for Anomaly Detection in Network Flows
    Schynol, Lukas
    Pesavento, Marius
    [J]. 2023 IEEE 9TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING, CAMSAP, 2023, : 61 - 65
  • [5] Cocktail Glass Network: Fast Depth Estimation Using Channel to Space Unrolling
    Yu, Jung-Jae
    Ko, Jong-Gook
    Kim, Junmo
    [J]. IEEE ACCESS, 2021, 9 : 114680 - 114689
  • [6] A Self-Supervised Spaceborne Multispectral and Hyperspectral Image Fusion Unrolling Network
    Zhu, Zengliang
    Wang, Xinyu
    Li, Guanzhong
    Zhong, Yanfei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [7] Underexposed Photo Enhancement using Deep Illumination Estimation
    Wang, Ruixing
    Zhang, Qing
    Fu, Chi-Wing
    Shen, Xiaoyong
    Zheng, Wei-Shi
    Jia, Jiaya
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 6842 - 6850
  • [8] DEEP UNROLLING SHRINKAGE NETWORK FOR DYNAMIC MR IMAGING
    Zhang, Yinghao
    Li, Xiaodi
    Li, Weihang
    Hu, Yue
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1145 - 1149
  • [9] Image reconstruction of multispectral sparse sampling photoacoustic tomography based on deep algorithm unrolling
    Ge, Jia
    Mo, Zongxin
    Zhang, Shuangyang
    Zhang, Xiaoming
    Zhong, Yutian
    Liang, Zhaoyong
    Hu, Chaobin
    Chen, Wufan
    Qi, Li
    [J]. PHOTOACOUSTICS, 2024, 38
  • [10] Multispectral imaging using multiplexed illumination
    Park, Jong-Il
    Lee, Moon-Hyun
    Grossberg, Michael D.
    Nayar, Shree K.
    [J]. 2007 IEEE 11TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS 1-6, 2007, : 2049 - +