A Diffusion Model-Assisted Multiscale Spectral Attention Network for Hyperspectral Image Super-Resolution

被引:1
|
作者
He, Kaiqi [1 ]
Cai, Yiheng [1 ]
Peng, Shengjun [1 ]
Tan, Meiling [1 ]
机构
[1] Beijing Univ Technol, Dept Informat Sci, Beijing 100124, Peoples R China
关键词
Convolutional super-resolution network; diffusion model; image fusion; super-resolution hyperspectral image (HSI); FUSION; REPRESENTATION; RESOLUTION;
D O I
10.1109/JSTARS.2024.3386702
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hyperspectral images (HSIs) can reflect the spectral characteristics of objects in multiple bands, which can be used in various tasks, including classification, material detection and identification, and geological exploration. However, due to hardware limitations, spatial data have commonly been partially discarded to obtain more spectral information. Therefore, the enhancement of spatial resolution is often contemplated through the application of super-resolution algorithms. In view of this, this study proposes a diffusion model-assisted multiscale spectral attention network (DMSANet) to increase the HSI resolution in the spatial dimension while preserving spectral information as much as possible. For the first time, a diffusion model is combined with deep networks to solve the HSI super-resolution problem, which enhances the spatial texture details of the output image using a layer-by-layer super-resolution mechanism of Markov chains. In addition, a multiscale attention block that can integrate multiple receptive fields to extract spectral features of HSIs is designed, which enhances spectral information details. Extensive evaluations and comparisons on three benchmark datasets demonstrate that the proposed DMSANet can achieve superior performance compared with the existing methods.
引用
收藏
页码:8612 / 8625
页数:14
相关论文
共 50 条
  • [1] Hyperspectral Image Super-Resolution Based on Multiscale Mixed Attention Network Fusion
    Hu, Jianwen
    Tang, Yuan
    Liu, Yaoting
    Fan, Shaosheng
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [2] A Spectral Diffusion Prior for Unsupervised Hyperspectral Image Super-Resolution
    Liu, Jianjun
    Wu, Zebin
    Xiao, Liang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [3] Lightweight image super-resolution with multiscale residual attention network
    Xiao, Cunjun
    Dong, Hui
    Li, Haibin
    Li, Yaqian
    Zhang, Wenming
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (04)
  • [4] Hyperspectral image super-resolution based on attention ConvBiLSTM network
    Lu, Xiaochen
    Liu, Xiaohui
    Zhang, Lei
    Jia, Fengde
    Yang, Yunlong
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (13) : 5059 - 5074
  • [5] Hyperspectral image super-resolution with spectral-spatial network
    Jia, Jinrang
    Ji, Luyan
    Zhao, Yongchao
    Geng, Xiurui
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2018, 39 (22) : 7806 - 7829
  • [6] A Spectral Grouping and Attention-Driven Residual Dense Network for Hyperspectral Image Super-Resolution
    Liu, Denghong
    Li, Jie
    Yuan, Qiangqiang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (09): : 7711 - 7725
  • [7] Deep Residual Attention Network for Spectral Image Super-Resolution
    Shi, Zhan
    Chen, Chang
    Xiong, Zhiwei
    Liu, Dong
    Zha, Zheng-Jun
    Wu, Feng
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 214 - 229
  • [8] A novel spatial and spectral transformer network for hyperspectral image super-resolution
    Wu, Huapeng
    Xu, Hui
    Zhan, Tianming
    [J]. MULTIMEDIA SYSTEMS, 2024, 30 (03)
  • [9] Spectral-Spatial MLP Network for Hyperspectral Image Super-Resolution
    Yao, Yunze
    Hu, Jianwen
    Liu, Yaoting
    Zhao, Yushan
    [J]. REMOTE SENSING, 2023, 15 (12)
  • [10] Multilevel Progressive Network With Nonlocal Channel Attention for Hyperspectral Image Super-Resolution
    Hu, Jianwen
    Liu, Yaoting
    Kang, Xudong
    Fan, Shaosheng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60