Convolution-augmented transformer network for hyperspectral image subspace clustering

被引:3
|
作者
Zhang, Zhongbiao [1 ]
Wang, Huajun [1 ]
Liu, Shujun [1 ]
Chen, Jiaxin [2 ]
Zhang, Zhongyu [1 ]
Wang, Sen [3 ]
机构
[1] Chengdu Univ Technol, Key Lab Earth Explorat & Informat Tech, Minist Educ, Chengdu 610059, Peoples R China
[2] Chengdu Univ Technol, Coll Comp Sci & Cyber Secur, Chengdu 610059, Peoples R China
[3] Tongji Univ, Coll Elect & Informat Engn, Shanghai 201804, Peoples R China
关键词
Conformer; Hyperspectral image clustering; Attention; Subspace clustering; Deep subspace clustering; CLASSIFICATION; SEGMENTATION; ROBUST;
D O I
10.1007/s12145-023-01031-6
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With the widespread and successful application of hyperspectral imaging, the task of classifying hyperspectral images has become a meaningful endeavor. This paper introduces a new approach to clustering hyperspectral images called CTNSC, which incorporates an attention mechanism to improve performance. In comparison to many current convolution-based methods for deep subspace clustering, our approach incorporates an attention mechanism to effectively capture the extensive spatial relationships that exist between objects in hyperspectral images. We combine convolution and attention through the use of Conformer blocks, enabling the network to simultaneously capture both local and global features of objects. As a result, our network can identify a more optimal deep affinity matrix, which can be utilized for spectral clustering to achieve better clustering results. We conducted experiments on three real-world datasets, and the results showed that CTNSC achieved excellent clustering performance compared to many commonly used clustering methods.
引用
收藏
页码:2439 / 2453
页数:15
相关论文
共 50 条
  • [1] Convolution-augmented transformer network for hyperspectral image subspace clustering
    Zhongbiao Zhang
    Huajun Wang
    Shujun Liu
    Jiaxin Chen
    Zhongyu Zhang
    Sen Wang
    [J]. Earth Science Informatics, 2023, 16 : 2439 - 2453
  • [2] Correction to: Convolution-augmented transformer network for hyperspectral image subspace clustering
    Zhongbiao Zhang
    Huajun Wang
    Shujun Liu
    Jiaxin Chen
    Zhongyu Zhang
    Sen Wang
    [J]. Earth Science Informatics, 2023, 16 : 2455 - 2455
  • [3] Convolution-augmented transformer network for hyperspectral image subspace clustering (Jul, 10.1007/s12145-023-01031-6, 2023)
    Zhang, Zhongbiao
    Wang, Huajun
    Liu, Shujun
    Chen, Jiaxin
    Zhang, Zhongyu
    Wang, Sen
    [J]. EARTH SCIENCE INFORMATICS, 2023, 16 (3) : 2455 - 2455
  • [4] Conformer: Convolution-augmented Transformer for Speech Recognition
    Gulati, Anmol
    Qin, James
    Chiu, Chung-Cheng
    Parmar, Niki
    Zhang, Yu
    Yu, Jiahui
    Han, Wei
    Wang, Shibo
    Zhang, Zhengdong
    Wu, Yonghui
    Pang, Ruoming
    [J]. INTERSPEECH 2020, 2020, : 5036 - 5040
  • [5] Graph Regularized Residual Subspace Clustering Network for hyperspectral image clustering
    Cai, Yaoming
    Zeng, Meng
    Cai, Zhihua
    Liu, Xiaobo
    Zhang, Zijia
    [J]. INFORMATION SCIENCES, 2021, 578 : 85 - 101
  • [6] Convolution Transformer Fusion Splicing Network for Hyperspectral Image Classification
    Zhao, Feng
    Li, Shijie
    Zhang, Junjie
    Liu, Hanqiang
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [7] Convolution Transformer Fusion Splicing Network for Hyperspectral Image Classification
    Zhao, Feng
    Li, Shijie
    Zhang, Junjie
    Liu, Hanqiang
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [8] An End-to-end Oxford Nanopore Basecaller Using Convolution-augmented Transformer
    Lv, Xuan
    Chen, Zhiguang
    Lu, Yutong
    Yang, Yuedong
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 337 - 342
  • [9] Transmission Line Fault Classification Using Conformer Convolution-Augmented Transformer Model
    Lee, Meng-Yun
    Huang, Yu-Shan
    Chang, Chia-Jui
    Yang, Jia-Yu
    Liu, Chih-Wen
    Lin, Tzu-Chiao
    Lin, Yen-Bor
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (10):
  • [10] Silent Speech Interface With Vocal Speaker Assistance Based on Convolution-Augmented Transformer
    Li, Huiyan
    Liang, Yihao
    Gao, Han
    Liu, Li
    Wang, You
    Chen, Daqi
    Luo, Zhiyuan
    Li, Guang
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72