Adversarial Spectral Super-Resolution for Multispectral Imagery Using Spatial Spectral Feature Attention Module

被引:1
|
作者
Liu, Ziyu [1 ]
Zhu, Han [1 ]
Chen, Zhenzhong [1 ,2 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Hubei Luojia Lab, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金;
关键词
Hyperspectral imaging; Spatial resolution; Image reconstruction; Superresolution; Sensors; Correlation; Cameras; Adversarial learning; attention mechanism; hyperspectral imagery; spectral super-resolution (SSR); HYPERSPECTRAL DATA; EO-1; HYPERION; SPARSE; NETWORK;
D O I
10.1109/JSTARS.2023.3238853
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Acquiring high-quality hyperspectral imagery with high spatial and spectral resolution plays an important role in remote sensing. Due to the limited capacity of sensors, providing high spatial and spectral resolution is still a challenging issue. Spectral super-resolution (SSR) increases the spectral dimensionality of multispectral images to achieve resolution enhancement. In this article, we propose a spectral resolution enhancement method based on the generative adversarial network framework without introducing additional spectral responses prior. In order to adaptively rescale informative features for capturing interdependencies in the spectral and spatial dimensions, a spatial spectral feature attention module is introduced. The proposed method jointly exploits spatio-spectral distribution in the hyperspectral manifold to increase spectral resolution while maintaining spatial content consistency. Experiments are conducted on both synthetic Landsat 8 and Sentinel-2 radiance data and real coregistered advanced land image and Hyperion (MS and HS) images, which indicates the superiority of the proposed method compared to other state-of-the-art methods.
引用
收藏
页码:1550 / 1562
页数:13
相关论文
共 50 条
  • [21] Spatial Super-Resolution in Code Aperture Spectral Imaging
    Arguello, Henry
    Rueda, Hoover F.
    Arce, Gonzalo R.
    COMPRESSIVE SENSING, 2012, 8365
  • [22] Hyperspectral Image Super-Resolution Based on Spatial-Spectral Feature Extraction Network
    Li Yanshan
    Chen Shifu
    Luo Wenhan
    Zhou Li
    Xie Weixin
    CHINESE JOURNAL OF ELECTRONICS, 2023, 32 (03) : 415 - 428
  • [23] Hyperspectral Image Super-Resolution Based on Spatial-Spectral Feature Extraction Network
    LI Yanshan
    CHEN Shifu
    LUO Wenhan
    ZHOU Li
    XIE Weixin
    ChineseJournalofElectronics, 2023, 32 (03) : 415 - 428
  • [24] LEARNING SPECTRAL AND SPATIAL FEATURES BASED ON GENERATIVE ADVERSARIAL NETWORK FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Jiang, Ruituo
    Li, Xu
    Gao, Ang
    Li, Lixin
    Meng, Hongying
    Yue, Shigang
    Zhang, Lei
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 3161 - 3164
  • [25] Spectral Clustering Super-Resolution Imaging Based on Multispectral Camera Array
    Huang, Feng
    Chen, Yating
    Wang, Xuesong
    Wang, Shu
    Wu, Xianyu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1257 - 1271
  • [26] HYBRID TRANSFORMER ARCHITECTURE FOR SPECTRAL SUPER-RESOLUTION RECONSTRUCTION OF MULTISPECTRAL IMAGES
    Zhao, Genping
    He, Yudan
    Wang, Zhuowei
    Wu, Heng
    2024 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2024), 2024, : 9468 - 9471
  • [27] Super-Resolution of Sentinel-2 Images Using a Spectral Attention Mechanism
    Zabalza, Maialen
    Bernardini, Angela
    REMOTE SENSING, 2022, 14 (12)
  • [28] Super-Resolution for Overhead Imagery Using DenseNets and Adversarial Learning
    Bosch, Marc
    Clifford, Christopher M.
    Rodriguez, Pedro A.
    2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, : 1414 - 1422
  • [29] A Cascaded Spectral-Spatial CNN Model for Super-Resolution River Mapping With MODIS Imagery
    Yin, Zhixiang
    Ling, Feng
    Li, Xinyan
    Cai, Xiaobin
    Chi, Hong
    Li, Xiaodong
    Wang, Lihui
    Zhang, Yihang
    Du, Yun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [30] Deep Residual Attention Network for Spectral Image Super-Resolution
    Shi, Zhan
    Chen, Chang
    Xiong, Zhiwei
    Liu, Dong
    Zha, Zheng-Jun
    Wu, Feng
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 214 - 229