HYPERSPECTRAL AND MULTISPECTRAL IMAGE FUSION BASED ON DEEP ATTENTION NETWORK

被引:17
|
作者
Yang, Qing [1 ]
Xu, Yang [1 ]
Wu, Zebin [1 ]
Wei, Zhihui [1 ]
机构
[1] Nanjing Univ Sci & Technol, Nanjing, Jiangsu, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Hyperspectral image; multi-spectral image; image fusion; spatial attention; deep learning;
D O I
10.1109/whispers.2019.8920825
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hyperspectral (HS) images have rich spectral information and can provide attribute information. High spatial resolution images, such as multispectral (MS) images and panchromatic (PAN) images, can provide fine geometric features. Thus, the fusion of the two images can achieve information complementarity and increase the accuracy and reliability of information. In this paper, we propose a hyperspectral and multispectral image fusion method based on deep attention network. Our model consists of two parts. One is the fusion network, which is used to fuse images. The other part is the spatial attention network, which is used to extract tiny textures and enhance the spatial structure. Experimental results compared with some state-of-the-art methods illustrate that our method is outstanding in both visual and numerical results.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] HyperNet: A deep network for hyperspectral, multispectral, and panchromatic image fusion
    Li, Kun
    Zhang, Wei
    Yu, Dian
    Tian, Xin
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 188 : 30 - 44
  • [2] Unsupervised Deep Tensor Network for Hyperspectral-Multispectral Image Fusion
    Yang, Jingxiang
    Xiao, Liang
    Zhao, Yong-Qiang
    Chan, Jonathan Cheung-Wai
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) : 13017 - 13031
  • [3] Stereo Cross-Attention Network for Unregistered Hyperspectral and Multispectral Image Fusion
    Guo, Yujuan
    Fu, Xiyou
    Xu, Meng
    Jia, Sen
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [4] Self-supervised Hyperspectral and Multispectral Image Fusion in Deep Neural Network
    Gao, Jianhao
    Li, Jie
    Yuan, Qiangqiang
    He, Jiang
    Su, Xin
    [J]. IMAGE AND GRAPHICS (ICIG 2021), PT III, 2021, 12890 : 425 - 436
  • [5] MHF-Net: An Interpretable Deep Network for Multispectral and Hyperspectral Image Fusion
    Xie, Qi
    Zhou, Minghao
    Zhao, Qian
    Xu, Zongben
    Meng, Deyu
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (03) : 1457 - 1473
  • [6] ReLAP-Net: Residual Learning and Attention Based Parallel Network for Hyperspectral and Multispectral Image Fusion br
    Agrawal, Aditya
    Kundu, Souraja
    Ahmad, Touseef
    Bhatt, Manish
    [J]. PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2024, 90 (07): : 395 - 403
  • [7] Hyperspectral and Multispectral Image Fusion by Deep Neural Network in a Self-Supervised Manner
    Gao, Jianhao
    Li, Jie
    Jiang, Menghui
    [J]. REMOTE SENSING, 2021, 13 (16)
  • [8] Deep Unfolding Network Enhanced by Transformer Priors for Unregistered Hyperspectral and Multispectral Image Fusion
    Fang, Jian
    Yang, Jingxiang
    Khader, Abdolraheem
    Xiao, Liang
    [J]. IEEE Transactions on Geoscience and Remote Sensing, 2024, 62
  • [9] Interpretable Model-Driven Deep Network for Hyperspectral, Multispectral, and Panchromatic Image Fusion
    Tian, Xin
    Li, Kun
    Zhang, Wei
    Wang, Zhongyuan
    Ma, Jiayi
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 35 (10) : 1 - 14
  • [10] Variational Regularization Network With Attentive Deep Prior for Hyperspectral-Multispectral Image Fusion
    Yang, Jingxiang
    Xiao, Liang
    Zhao, Yong-Qiang
    Chan, Jonathan Cheung-Wai
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60