MHFNet: An Improved HGR Multimodal Network for Informative Correlation Fusion in Remote Sensing Image Classification

被引:0
|
作者
Zhang, Hongkang [1 ]
Huang, Shao-Lun [1 ]
Kuruoglu, Ercan Engin [1 ]
机构
[1] Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
基金
国家重点研发计划;
关键词
Feature extraction; Convolutional neural networks; Remote sensing; Correlation; Laser radar; Data models; Synthetic aperture radar; Data sparsity; HGR maximal correlation; multimodal fusion; remote sensing image classification; LIDAR;
D O I
10.1109/JSTARS.2024.3448430
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the realm of urban development, the precise classification and identification of land types are crucial for improving land use efficiency. This article proposes a land recognition and classification method based on data sparsity and improved Soft Hirschfeld-Gebelein-R & eacute;nyi (Soft-HGR) under multimodal conditions. First, a sparse information processing module is designed to enhance information accuracy and quickly obtain data sample features. Then, to solve the problem of information independence in single mode and lack of fusion in multimodal mode, an improved SoftHGR module is developed. This module incorporates covariance and trace constraints, enhances machine learning efficiency by stabilizing output and addressing dimensionality and variance issues in HGR, and speeds up land classification by cross-fusing multimodal features to deepen the understanding of diverse information interconnections. Based on this, a multimodal MI-SoftHGR fusion network is constructed, which can achieve cross-correlation sharing and collaborative extraction of feature information, thereby realizing accurate remote sensing image recognition and classification under multimodal conditions. Finally, empirical evaluations were conducted on Berlin, Augsburg, and MUUFL datasets, and the proposed method was compared with state-of-the-art algorithms. The results fully validate the efficacy and significant superiority of the proposed method.
引用
收藏
页码:15052 / 15066
页数:15
相关论文
共 50 条
  • [1] HGR Correlation Pooling Fusion Framework for Recognition and Classification in Multimodal Remote Sensing Data
    Zhang, Hongkang
    Huang, Shao-Lun
    Kuruoglu, Ercan Engin
    [J]. REMOTE SENSING, 2024, 16 (10)
  • [2] Multimodal Fusion Transformer for Remote Sensing Image Classification
    Roy, Swalpa Kumar
    Deria, Ankur
    Hong, Danfeng
    Rasti, Behnood
    Plaza, Antonio
    Chanussot, Jocelyn
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [3] IFF-Net: Irregular Feature Fusion Network for Multimodal Remote Sensing Image Classification
    Wang, Huiqing
    Wang, Huajun
    Wu, Linfeng
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (12):
  • [4] A multimodal hyper-fusion transformer for remote sensing image classification
    Ma, Mengru
    Ma, Wenping
    Jiao, Licheng
    Liu, Xu
    Li, Lingling
    Feng, Zhixi
    Liu, Fang
    Yang, Shuyuan
    [J]. INFORMATION FUSION, 2023, 96 : 66 - 79
  • [5] Scale Adaptive Fusion Network for Multimodal Remote Sensing Data Classification
    Liu, Xiaomin
    Yu, Mengjun
    Qiao, Zhenzhuang
    Wang, Haoyu
    Xing, Changda
    [J]. Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (09): : 3693 - 3702
  • [6] Improved convolutional neural network in remote sensing image classification
    Binghui Xu
    [J]. Neural Computing and Applications, 2021, 33 : 8169 - 8180
  • [7] Improved convolutional neural network in remote sensing image classification
    Xu, Binghui
    [J]. NEURAL COMPUTING & APPLICATIONS, 2021, 33 (14): : 8169 - 8180
  • [8] An improved neural network algorithm for remote sensing image classification
    [J]. Zhao, Liang, 2020, North Atlantic University Union NAUN (14):
  • [9] Heterogeneous feature learning network for multimodal remote sensing image collaborative classification
    Yu, Xuchu
    Xue, Zhixiang
    Yang, Guopeng
    Yu, Anzhu
    Liu, Bing
    Hu, Qingfeng
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (15) : 4983 - 5007
  • [10] Adaptive Multiscale Deep Fusion Residual Network for Remote Sensing Image Classification
    Li, Ge
    Li, Lingling
    Zhu, Hao
    Liu, Xu
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (11): : 8506 - 8521