PCCN-MSS: Parallel Convolutional Classification Network Combined Multi-Spatial Scale and Spectral Features for UAV-Borne Hyperspectral With High Spatial Resolution Imagery

被引:3
|
作者
Jiang, Linhuan [1 ,2 ]
Zhang, Zhen [1 ,2 ]
Tang, Bo-Hui [1 ,2 ,3 ]
Huang, Lehao [1 ,2 ]
Zhang, Bingru [1 ,2 ]
机构
[1] Kunming Univ Sci & Technol, Fac Land Resource Engn, Kunming 650093, Peoples R China
[2] Yunnan Prov Dept Educ, Key Lab Plateau Remote Sensing, Kunming 650093, Peoples R China
[3] Chinese Acad Sci, Inst Geog Sci & Nat Resources Res, State Key Lab Resources & Environm Informat Syst, Beijing 100101, Peoples R China
关键词
Feature extraction; Convolutional neural networks; Hyperspectral imaging; Data mining; Computational modeling; Autonomous aerial vehicles; Convolution; Feature pyramid networks (FPNs); image classification; parallel convolutional classification network; spectral attention (SA); unmanned aerial vehicle (UAV)-borne hyperspectral imagery; ATTENTION NETWORK; FUSION;
D O I
10.1109/JSTARS.2024.3370632
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hyperspectral remote sensing images with high spatial resolution (H-2 imagery) have an abundant spatial-spectral information, holding tremendous potential for remote sensing fine-grained monitoring and classification. However, challenges such as high spatial heterogeneity, severe intra-class spectral variability, and poor signal-to-noise ratio especially in unmanned aerial vehicle (UAV) hyperspectral imagery constrain and hinder the performance of fine-grained classification. Convolutional neural network (CNN) emerges as a formidable and excellent tool for image mining and feature extraction, offering effective utility for land cover classification. In this article, a parallel convolutional classification network model based on multimodal filters [including independent component analysis (ICA)-two-dimensional (2-D)-FPN and spectral attention (SA)-3-D-CNN branching structures] PCCN-MSS is proposed for precise H-2 imagery classification. The ICA-2-D-FPN branch integrates ICA into 2-D-CNN to extract the multispatial scale and spectral information of H-2 imagery by feature pyramid networks, meanwhile, the SA-3-D-CNN branch is designed to extract the spatial and spectral information by combining SA mechanism and 3-D-CNN. Taking hyperspectral imagery of UAVs containing vegetation and artifactual material ground as an example, the proposed PCCN-MSS model achieves an overall accuracy of 78.18%, which outperforms by 9.58% to the compared methods. The proposed PCCN-MSS method can mitigate the classification issues of severe salt-and-pepper noise and inaccurate boundary, delivering more satisfactory classification results with robust classification performance and remarkable advantages for H-2 imagery.
引用
收藏
页码:6529 / 6543
页数:15
相关论文
共 50 条
  • [1] SPNet: Spectral Patching End-to-End Classification Network for UAV-Borne Hyperspectral Imagery With High Spatial and Spectral Resolutions
    Hu, Xin
    Zhong, Yanfei
    Wang, Xinyu
    Luo, Chang
    Zhao, Ji
    Lei, Lei
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] Spatial-Spectral Fusion Based on Conditional Random Fields for the Fine Classification of Crops in UAV-Borne Hyperspectral Remote Sensing Imagery
    Wei, Lifei
    Yu, Ming
    Zhong, Yanfei
    Zhao, Ji
    Liang, Yajing
    Hu, Xin
    REMOTE SENSING, 2019, 11 (07)
  • [3] Spectral-Spatial Classification of Hyperspectral Imagery Based on Deep Convolutional Network
    Zhang, Haokui
    Li, Ying
    2016 INTERNATIONAL CONFERENCE ON ORANGE TECHNOLOGIES (ICOT), 2018, : 44 - 47
  • [4] WHAT KIND OF SPATIAL AND SPECTRAL RESOLUTION OF UAV-BORNE HYPERSPECTRAL IMAGE IS REQUIRED FOR PRECISE CROP CLASSIFICATION WHEN USING DEEP LEARNING
    Yang, Bin
    Hu, Shunshi
    2022 12TH WORKSHOP ON HYPERSPECTRAL IMAGING AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2022,
  • [5] Comparison of Spectral-Spatial Classification for Urban Hyperspectral Imagery with High Resolution
    Yang, He
    Ma, Ben
    Du, Qian
    Zhang, Liangpei
    2009 JOINT URBAN REMOTE SENSING EVENT, VOLS 1-3, 2009, : 808 - +
  • [6] Precise Crop Classification Using Spectral-Spatial-Location Fusion Based on Conditional Random Fields for UAV-Borne Hyperspectral Remote Sensing Imagery
    Wei, Lifei
    Yu, Ming
    Liang, Yajing
    Yuan, Ziran
    Huang, Can
    Li, Rong
    Yu, Yiwei
    REMOTE SENSING, 2019, 11 (17)
  • [7] Deep 3D convolutional network combined with spatial-spectral features for hyperspectral image classification
    Liu B.
    Yu X.
    Zhang P.
    Tan X.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2019, 48 (01): : 53 - 63
  • [8] Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network
    Li, Ying
    Zhang, Haokui
    Shen, Qiang
    REMOTE SENSING, 2017, 9 (01)
  • [9] Semi-supervised ELM combined with spectral-spatial features for hyperspectral imagery classification
    Fu Q.
    Yu X.
    Zhang P.
    Wei X.
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2017, 45 (07): : 89 - 93and121
  • [10] Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network
    Zhang, Haokui
    Li, Ying
    Zhang, Yuzhu
    Shen, Qiang
    REMOTE SENSING LETTERS, 2017, 8 (05) : 438 - 447