Super-Resolution for Hyperspectral and Multispectral Image Fusion Accounting for Seasonal Spectral Variability

被引:76
|
作者
Borsoi, Ricardo Augusto [1 ,2 ]
Imbiriba, Tales [1 ,3 ]
Moreira Bermudez, Jose Carlos [1 ,4 ]
机构
[1] Fed Univ Santa Catarina DEE UFSC, Dept Elect Engn, BR-88040900 Florianopolis, SC, Brazil
[2] Univ Cote dAzur, Lagrange Lab, F-06108 Nice, France
[3] Northeastern Univ, ECE Dept, Boston, MA 02115 USA
[4] Catholic Univ Pelotas UCPel, Grad Program Elect Engn & Comp, BR-96015560 Pelotas, Brazil
关键词
Hyperspectral data; multispectral data; end-member variability; seasonal variability; super-resolution; image fusion; SPATIAL REGULARIZATION; LANDSAT DATA; REFLECTANCE; ALGORITHM; MS;
D O I
10.1109/TIP.2019.2928895
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image fusion combines data from different heterogeneous sources to obtain more precise information about an underlying scene. Hyperspectral-multispectral (HS-MS) image fusion is currently attracting great interest in remote sensing since it allows the generation of high spatial resolution HS images and circumventing the main limitation of this imaging modality. Existing HS-MS fusion algorithms, however, neglect the spectral variability often existing between images acquired at different time instants. This time difference causes variations in spectral signatures of the underlying constituent materials due to the different acquisition and seasonal conditions. This paper introduces a novel HS-MS image fusion strategy that combines an unmixing-based formulation with an explicit parametric model for typical spectral variability between the two images. Simulations with synthetic and real data show that the proposed strategy leads to a significant performance improvement under spectral variability and state-of-the-art performance otherwise.
引用
收藏
页码:116 / 127
页数:12
相关论文
共 50 条
  • [1] Bayesian Hyperspectral Image Super-Resolution in the Presence of Spectral Variability
    Ye, Fei
    Wu, Zebin
    Xu, Yang
    Liu, Hongyi
    Wei, Zhihui
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] IMAGE FUSION FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Irmak, Hasan
    Akar, Gozde Bozdagi
    Yuksel, Seniha Esen
    [J]. 2018 9TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2018,
  • [3] Advances and prospects in hyperspectral and multispectral remote sensing image super-resolution fusion
    Zhang, Bing
    Gao, Lianru
    Li, Jiaxin
    Hong, Danfeng
    Zheng, Ke
    [J]. Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2023, 52 (07): : 1074 - 1089
  • [4] HYPERSPECTRAL IMAGE SUPER-RESOLUTION VIA ADJACENT SPECTRAL FUSION STRATEGY
    Li, Qiang
    Wang, Qi
    Li, Xuelong
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1645 - 1649
  • [5] Hyperspectral Image Super-Resolution Based on Spatial and Spectral Correlation Fusion
    Yi, Chen
    Zhao, Yong-Qiang
    Chan, Jonathan Cheung-Wai
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (07): : 4165 - 4177
  • [6] Hyperspectral Super-resolution Accounting for Spectral Variability: Coupled Tensor LL1-Based Recovery and Blind Unmixing of the Unknown Super-resolution Image*
    Prevost, Clemence
    Borsoi, Ricardo A.
    Usevich, Konstantin
    Brie, David
    Bermudez, Jose C. M.
    Richard, Cedric
    [J]. SIAM JOURNAL ON IMAGING SCIENCES, 2022, 15 (01): : 110 - 138
  • [7] DEEP RESIDUAL NETWORK OF SPECTRAL AND SPATIAL FUSION FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Han, Xian-Hua
    Chen, Yen-Wei
    [J]. 2019 IEEE FIFTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2019), 2019, : 266 - 270
  • [8] Group Shuffle and Spectral-Spatial Fusion for Hyperspectral Image Super-Resolution
    Wang, Xinya
    Cheng, Yingsong
    Mei, Xiaoguang
    Jiang, Junjun
    Ma, Jiayi
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2022, 8 : 1223 - 1236
  • [9] Exploring the Spectral Prior for Hyperspectral Image Super-Resolution
    Hu, Qian
    Wang, Xinya
    Jiang, Junjun
    Zhang, Xiao-Ping
    Ma, Jiayi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 5260 - 5272
  • [10] Deep Intra Fusion for Hyperspectral Image Super-Resolution
    Hu, Jing
    Chen, Huilin
    Zhao, Minghua
    Li, Yunsong
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 2663 - 2666