A Convolutional Neural Network for Pixelwise Illuminant Recovery in Colour and Spectral Images

被引:0
|
作者
Robles-Kelly, Antonio [1 ,2 ]
Wei, Ran [2 ]
机构
[1] Deakin Univ, Sch Inf Tech, Waurn Ponds, Vic 3216, Australia
[2] Data61 CSIRO, Black Mt Labs, Canberra, ACT 2601, Australia
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Here, we present a pixelwise illuminant recovery method for both, trichromatic and multi or hyperspectral images which employs a convolutional neural nettwork. The network used here is based upon the simple, yet effective architecture employed by the CIFAR10-quick net[1]. The network is trained using a loss function which employs the angular difference between the target illuminant and the estimated one as the data term. The loss used here also includes a regularisation term which encourages smoothness in the spectral domain. Moreover, the network takes, at input, a tensor which is constructed making use of an image patch at different scales. This allows the network to predict the illuminant per-pixel using locally supported multiscale information. We illustrate the utility of our method for both, colour and hyperspectal illuminant recovery and compare our results against other techniques elsewhere in literature.
引用
收藏
页码:109 / 114
页数:6
相关论文
共 50 条
  • [1] Spectral reflectance recovery using convolutional neural network
    Xiong, Yifan
    Wu, Guangyuan
    Li, Xiaozhou
    Niu, Shijun
    Han, Xiaomeng
    [J]. INTERNATIONAL CONFERENCE ON OPTOELECTRONIC MATERIALS AND DEVICES (ICOMD 2021), 2022, 12164
  • [2] A Spiking Neural Network for Illuminant-invariant Colour Discrimination
    Ratnasingam, Sivalogeswaran
    Robles-Kelly, Antonio
    [J]. 2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [3] Convolutional neural network for spectral–spatial classification of hyperspectral images
    Hongmin Gao
    Yao Yang
    Chenming Li
    Xiaoke Zhang
    Jia Zhao
    Dan Yao
    [J]. Neural Computing and Applications, 2019, 31 : 8997 - 9012
  • [4] AUDIO CODING BASED ON SPECTRAL RECOVERY BY CONVOLUTIONAL NEURAL NETWORK
    Shin, Seong-Hyeon
    Beack, Seung Kwon
    Lee, Taejin
    Park, Hochong
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 725 - 729
  • [5] Convolutional neural network for spectral-spatial classification of hyperspectral images
    Gao, Hongmin
    Yang, Yao
    Li, Chenming
    Zhang, Xiaoke
    Zhao, Jia
    Yao, Dan
    [J]. NEURAL COMPUTING & APPLICATIONS, 2019, 31 (12): : 8997 - 9012
  • [6] Classification of hyperspectral images based on a convolutional neural network and spectral sensitivity
    Ye, Cheng-ming
    Liu, Xin
    Xu, Hong
    Ren, Shi-cong
    Li, Yao
    Li, Jonathan
    [J]. JOURNAL OF ZHEJIANG UNIVERSITY-SCIENCE A, 2020, 21 (03): : 240 - 248
  • [7] Reconstructing Spectral Images from RGB-Images using a Convolutional Neural Network
    Stiebel, Tarek
    Koppers, Simon
    Seltsam, Philipp
    Merhof, Dorit
    [J]. PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 1061 - 1066
  • [8] SPECTRAL DOMAIN CONVOLUTIONAL NEURAL NETWORK
    Guan, Bochen
    Zhang, Jinnian
    Sethares, William A.
    Kijowski, Richard
    Liu, Fang
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2795 - 2799
  • [9] A convolutional neural network to classify American Sign Language fingerspelling from depth and colour images
    Ameen, Salem
    Vadera, Sunil
    [J]. EXPERT SYSTEMS, 2017, 34 (03)
  • [10] Spectral Classification of a Set of Hyperspectral Images using the Convolutional Neural Network, in a Single Training
    Zbakh, Abdelali
    Mdaghri, Zoubida Alaoui
    Benyoussef, Abdelillah
    El Kenz, Abdellah
    El Yadari, Mourad
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (06) : 245 - 250