Multi-branch fusion network for hyperspectral image classification

被引:38
|
作者
Gao, Hongmin [1 ]
Yang, Yao [1 ]
Lei, Sheng [2 ]
Li, Chenming [1 ]
Zhou, Hui [1 ]
Qu, Xiaoyu [1 ]
机构
[1] Hohai Univ, Coll Comp & Informat, Nanjing 211100, Jiangsu, Peoples R China
[2] Jiangxi Prov Inst Water Sci, Nanchang 330029, Jiangxi, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金; 美国国家科学基金会;
关键词
Hyperspectral remote sensing image classification; Convolutional neural network; Multi-branch fusion network; Small sample size problem; Class imbalance; SPECTRAL-SPATIAL CLASSIFICATION; SVM;
D O I
10.1016/j.knosys.2019.01.020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hyperspectral remote sensing image (HSI) has the characteristics of large data volume and high spectral resolution. It contains abundant spectral information and has tremendous applicable value. Convolutional neural network (CNN) has been successfully applied to HSI classification. However, the limited labeled samples of the HSI make the existing CNN based HSI classification methods generally be plagued by small sample size problem and class imbalance, which cause great challenges for HSI classification. This work proposes a novel CNN architecture for HSI classification. The proposed CNN is a multi-branch fusion network, which is formed by merging multiple branches on an ordinary CNN. It can effectively extract features of HSIs. In addition, the 1 x 1 convolutional layer is introduced into the branches to reduce the number of parameters and then improve the classification efficiency. Furthermore, the L2 regularization is introduced into this work to improve the generalization performance of the proposed model under small sample set. Experimental results on three benchmark hyperspectral images demonstrate that the proposed CNN can provide excellent classification performance under small training set. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:11 / 25
页数:15
相关论文
共 50 条
  • [1] A Multi-branch Feature Fusion Model Based on Convolutional Neural Network for Hyperspectral Remote Sensing Image Classification
    Zhang, Jinli
    Chen, Ziqiang
    Ji, Yuanfa
    Sun, Xiyan
    Bai, Yang
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (06) : 147 - 156
  • [2] Pruning Multi-Scale Multi-Branch Network for Small-Sample Hyperspectral Image Classification
    Bai, Yu
    Xu, Meng
    Zhang, Lili
    Liu, Yuxuan
    [J]. ELECTRONICS, 2023, 12 (03)
  • [3] Improving Hyperspectral Image Classification with Compact Multi-Branch Deep Learning
    Islam, Md. Rashedul
    Islam, Md. Touhid
    Uddin, Md Palash
    Ulhaq, Anwaar
    [J]. REMOTE SENSING, 2024, 16 (12)
  • [4] Multi-branch Aggregate Convolutional Neural Network for Image Classification
    Fan, Rui
    Jiang, Pinqun
    Zeng, Shangyou
    Li, Peng
    [J]. SERVICE-ORIENTED COMPUTING, ICSOC 2018, 2019, 11434 : 102 - 112
  • [5] Hyperspectral image classification using multi-branch-multi-scale residual fusion network
    Cai, Yiheng
    Xie, Jin
    Lang, Shinan
    Yang, Jingxian
    Liu, Dan
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2021, 15 (02)
  • [6] Remote Sensing Image Scene Classification Based on Deep Multi-branch Feature Fusion Network
    Zhang Tong
    Zheng En-rang
    Shen Jun-ge
    Gao An-tong
    [J]. ACTA PHOTONICA SINICA, 2020, 49 (05)
  • [7] Progressive multi-branch embedding fusion network for underwater image enhancement
    Sun, Kaichuan
    Meng, Fei
    Tian, Yubo
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 87
  • [8] Progressive multi-branch embedding fusion network for underwater image enhancement
    Sun, Kaichuan
    Meng, Fei
    Tian, Yubo
    [J]. Journal of Visual Communication and Image Representation, 2022, 87
  • [9] Multi-Branch Hybrid Network Based on Adaptive Selection of Spatial-Spectral Kernel for Hyperspectral Image Classification
    Wang, Cailing
    Fu, He
    Wang, Hongwei
    [J]. IEEE ACCESS, 2023, 11 : 80503 - 80517
  • [10] A Novel Multi-Branch Channel Expansion Network for Garbage Image Classification
    Shi, Cuiping
    Xia, Ruiyang
    Wang, Liguo
    [J]. IEEE ACCESS, 2020, 8 : 154436 - 154452