Multispectral Image Super-Resolution Using Structure-Guided RGB Image Fusion

被引:1
|
作者
Pan, Zhi-Wei [1 ]
Shen, Hui-Liang [1 ]
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Multispectral imaging; Super-resolution; Directional total variation; Image reconstruction; Image fusion;
D O I
10.1007/978-3-030-03398-9_14
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to hardware limitation, multispectral imaging device usually cannot achieve high spatial resolution. To address the issue, this paper proposes a multispectral image super-resolution algorithm by fusing the low-resolution multispectral image and the high-resolution RGB image. The fusion is formulated as an optimization problem according to the linear image degradation models. Meanwhile, the fusion is guided by the edge structure of RGB image via the directional total variation regularizer. Then the fusion problem is solved by the alternating direction method of multipliers algorithm through iteration. The subproblems in each iterative step is simple and can be solved in closed-form. The effectiveness of the proposed algorithm is evaluated on both public datasets and our image set. Experimental results validate that the algorithm outperforms the state-of-the-arts in terms of both reconstruction accuracy and computational efficiency.
引用
收藏
页码:155 / 167
页数:13
相关论文
共 50 条
  • [1] Multispectral Image Super-Resolution via RGB Image Fusion and Radiometric Calibration
    Pan, Zhi-Wei
    Shen, Hui-Liang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (04) : 1783 - 1797
  • [2] Multispectral image data fusion using POCS and super-resolution
    Aguena, MLS
    Mascarenhas, NDA
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2006, 102 (02) : 178 - 187
  • [3] Hyperspectral Image Super-Resolution with RGB Image Super-Resolution as an Auxiliary Task
    Li, Ke
    Dai, Dengxin
    van Gool, Luc
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 4039 - 4048
  • [4] Multispectral image fusion using super-resolution conditional generative adversarial networks
    Zhang, Junhao
    Shamsolmoali, Pourya
    Zhang, Pengpeng
    Feng, Deying
    Yang, Jie
    JOURNAL OF APPLIED REMOTE SENSING, 2018, 13 (02)
  • [5] Hyperspectral Image Super-Resolution With a Mosaic RGB Image
    Fu, Ying
    Zheng, Yinqiang
    Huang, Hua
    Sato, Imari
    Sato, Yoichi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (11) : 5539 - 5552
  • [6] IMAGE FUSION FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Irmak, Hasan
    Akar, Gozde Bozdagi
    Yuksel, Seniha Esen
    2018 9TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2018,
  • [7] Multi-modal Image Fusion for Multispectral Super-resolution in Microscopy
    Dey, Neel
    Li, Shijie
    Bermond, Katharina
    Heintzmann, Rainer
    Curcio, Christine A.
    Ach, Thomas
    Gerig, Guido
    MEDICAL IMAGING 2019: IMAGE PROCESSING, 2019, 10949
  • [8] RGB-guided hyperspectral image super-resolution with deep progressive learning
    Zhang, Tao
    Fu, Ying
    Huang, Liwei
    Li, Siyuan
    You, Shaodi
    Yan, Chenggang
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2024, 9 (03) : 679 - 694
  • [9] Super-Resolution for Hyperspectral and Multispectral Image Fusion Accounting for Seasonal Spectral Variability
    Borsoi, Ricardo Augusto
    Imbiriba, Tales
    Moreira Bermudez, Jose Carlos
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 116 - 127
  • [10] Advances and prospects in hyperspectral and multispectral remote sensing image super-resolution fusion
    Zhang B.
    Gao L.
    Li J.
    Hong D.
    Zheng K.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2023, 52 (07): : 1074 - 1089