Hyperspectral Image Super-Resolution Based on Multiscale Mixed Attention Network Fusion

被引:47
|
作者
Hu, Jianwen [1 ,2 ]
Tang, Yuan [1 ,2 ]
Liu, Yaoting [1 ,2 ]
Fan, Shaosheng [1 ,2 ]
机构
[1] Changsha Univ Sci & Technol, Sch Elect & Informat Engn, Changsha 410114, Peoples R China
[2] Changsha Univ Sci & Technol, Key Lab Elect Power Robot Hunan Prov, Changsha 410114, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Superresolution; Convolution; Spatial resolution; Hyperspectral imaging; Image reconstruction; Feature extraction; Hyperspectral image (HSI); image super-resolution (SR); mixed attention; mutual learning;
D O I
10.1109/LGRS.2021.3124974
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral images (HSIs) contain rich spectral information and have great application value. However, due to various hardware limitations, the spatial resolution of HSIs acquired by the sensor is low. HSI super-resolution (SR) attracts much attention to improve spatial quality. In this letter, a single HSI SR method based on network fusion is proposed. Our method includes the SR network part and fusion part. In the SR network part, we construct 3-D multiscale mixed attention networks (3-D-MSMANs) by cascading 3-D multiscale mixed attention block (3-D-MSMAB) to restore high-resolution HSIs. 3-D-MSMAB consists of the 3-D Res2net module and the mixed attention module. 3-D Res2net module is a simple and effective multiscale method. The mixed attention module is proposed by combining the first- and second-order statistics of features. In addition, we use the mutual learning loss between 3-D-MSMAN so that they can learn from each other. In the fusion part, the fusion module is designed to merge the output of each 3-D-MSMAN. Our method can achieve good results in both simulated and real SR experiments. Code is available at https://github.com/LYT-max/Mixed-Attention-for-HSI-SR.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Hyperspectral image super-resolution based on attention ConvBiLSTM network
    Lu, Xiaochen
    Liu, Xiaohui
    Zhang, Lei
    Jia, Fengde
    Yang, Yunlong
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (13) : 5059 - 5074
  • [2] Image Super-Resolution Network Based on Feature Fusion Attention
    Zou, Changjun
    Ye, Lintao
    [J]. JOURNAL OF SENSORS, 2022, 2022
  • [3] Feature Fusion Attention Network for Image Super-resolution
    Zhou, Deng-Wen
    Ma, Lu-Yao
    Tian, Jin-Yue
    Sun, Xiu-Xiu
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (09): : 2233 - 2241
  • [4] A Diffusion Model-Assisted Multiscale Spectral Attention Network for Hyperspectral Image Super-Resolution
    He, Kaiqi
    Cai, Yiheng
    Peng, Shengjun
    Tan, Meiling
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 8612 - 8625
  • [5] Lightweight image super-resolution with multiscale residual attention network
    Xiao, Cunjun
    Dong, Hui
    Li, Haibin
    Li, Yaqian
    Zhang, Wenming
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (04)
  • [6] IMAGE FUSION FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Irmak, Hasan
    Akar, Gozde Bozdagi
    Yuksel, Seniha Esen
    [J]. 2018 9TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2018,
  • [7] Fusformer: A Transformer-Based Fusion Network for Hyperspectral Image Super-Resolution
    Hu, Jin-Fan
    Huang, Ting-Zhu
    Deng, Liang-Jian
    Dou, Hong-Xia
    Hong, Danfeng
    Vivone, Gemine
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [8] PYRAMID FUSION ATTENTION NETWORK FOR SINGLE IMAGE SUPER-RESOLUTION
    He, Hao
    Du, Zongcai
    Li, Wenfeng
    Tang, Jie
    Wu, Gangshan
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2165 - 2169
  • [9] Structured Fusion Attention Network for Image Super-Resolution Reconstruction
    Dai, Yaonan
    Yu, Jiuyang
    Hu, Tianhao
    Lu, Yang
    Zheng, Xiaotao
    [J]. IEEE ACCESS, 2022, 10 : 31896 - 31906
  • [10] Structured Fusion Attention Network for Image Super-Resolution Reconstruction
    Dai, Yaonan
    Yu, Jiuyang
    Hu, Tianhao
    Lu, Yang
    Zheng, Xiaotao
    [J]. IEEE Access, 2022, 10 : 31896 - 31906