A Multi-branch Feature Fusion Model Based on Convolutional Neural Network for Hyperspectral Remote Sensing Image Classification

被引:0
|
作者
Zhang, Jinli [1 ,2 ]
Chen, Ziqiang [1 ,3 ]
Ji, Yuanfa [1 ,2 ]
Sun, Xiyan [1 ,2 ,4 ]
Bai, Yang [1 ,2 ]
机构
[1] Guilin Univ Elect Technol, Informat & Commun Sch, Guilin 541004, Peoples R China
[2] Guilin Univ Elect Technol, Guangxi Key Lab Precis Nav Technol & Applicat, Guilin 541004, Peoples R China
[3] Guilin Univ Elect Technol, Guangxi Key Lab Wireless Wideband Commun & Signal, Guilin 541004, Peoples R China
[4] GUET Nanning E Tech Res Inst Co Ltd, Nanning 530031, Peoples R China
关键词
Hyperspectral image classification; convolutional neural network (CNN); multi-branch network; feature fusion;
D O I
10.14569/IJACSA.2023.0140617
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Hyperspectral image classification constitutes a pivotal research domain in the realm of remote sensing image processing. In the past few years, convolutional neural networks (CNNs) with advanced feature extraction capabilities have demonstrated remarkable performance in hyperspectral image classification. However, the challenges faced by classification methods are compounded by the difficulties of "dimensional disaster" and limited sample distinctiveness in hyperspectral images. Despite existing efforts to extract spectral spatial information, low classification accuracy remains a persistent issue. Therefore, this paper proposes a multi-branch feature fusion model classification method based on convolutional neural networks to fully extract more effective and adequate high-level semantic features. The proposed classification model first undergoes PCA dimensionality reduction, followed by a multi-branch network composed of three-dimensional and two-dimensional convolutions. Convolutional kernels of varying scales are utilized for multi-feature extraction. Among them, the 3D convolution not only adapts to the cube of hyperspectral data but also fully exploits the spectral-spatial information, while the 2D convolution learns deeper spatial information. The experimental results of the proposed model on three datasets demonstrate its superior performance over traditional classification models, enabling it to accomplish the task of hyperspectral image classification more effectively.
引用
收藏
页码:147 / 156
页数:10
相关论文
共 50 条
  • [21] Deep fusion of hyperspectral images and multi-source remote sensing data for classification with convolutional neural network
    结合深度学习的高光谱与多源遥感数据融合分类
    [J]. Li, Shanshan (lishanshan@aircas.ac.cn), 1600, (25): : 1489 - 1502
  • [22] Edge protection filtering and convolutional neural network for hyperspectral remote sensing image classification
    Lv, Huanhuan
    Wang, Zhuolu
    Zhang, Hui
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2022, 122
  • [23] Remote Sensing Image Fusion with Convolutional Neural Network
    Zhong J.
    Yang B.
    Huang G.
    Zhong F.
    Chen Z.
    [J]. Sensing and Imaging, 2016, 17 (1):
  • [24] Abnormal behavior detection algorithm based on multi-branch convolutional fusion neural network
    Zheng Xu
    Yuanyao Lu
    [J]. Multimedia Tools and Applications, 2023, 82 : 22723 - 22740
  • [25] Adaptive Multi-Feature Fusion Graph Convolutional Network for Hyperspectral Image Classification
    Liu, Jie
    Guan, Renxiang
    Li, Zihao
    Zhang, Jiaxuan
    Hu, Yaowen
    Wang, Xueyong
    [J]. REMOTE SENSING, 2023, 15 (23)
  • [26] Abnormal behavior detection algorithm based on multi-branch convolutional fusion neural network
    Xu, Zheng
    Lu, Yuanyao
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (15) : 22723 - 22740
  • [27] A Multi-Feature Fusion Model Based on Denoising Convolutional Neural Network and Attention Mechanism for Image Classification
    Zhang, Jingsi
    Yu, Xiaosheng
    Lei, Xiaoliang
    Wu, Chengdong
    [J]. INTERNATIONAL JOURNAL OF SWARM INTELLIGENCE RESEARCH, 2023, 14 (02)
  • [28] Multiscale Feature Aggregation Capsule Neural Network for Hyperspectral Remote Sensing Image Classification
    Lei, Runmin
    Zhang, Chunju
    Zhang, Xueying
    Huang, Jianwei
    Li, Zhenxuan
    Liu, Wencong
    Cui, Hao
    [J]. REMOTE SENSING, 2022, 14 (07)
  • [29] A Modularized Architecture of Multi-Branch Convolutional Neural Network for Image Captioning
    He, Shan
    Lu, Yuanyao
    [J]. ELECTRONICS, 2019, 8 (12)
  • [30] Multilayer Feature Fusion With Weight Adjustment Based on a Convolutional Neural Network for Remote Sensing Scene Classification
    Ma, Chenhui
    Mu, Xiaodong
    Lin, Renpu
    Wang, Shuyang
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (02) : 241 - 245