Hyperspectral Image Classification Based on Class-Incremental Learning with Knowledge Distillation

被引:11
|
作者
Xu, Meng [1 ]
Zhao, Yuanyuan [2 ]
Liang, Yajun [3 ]
Ma, Xiaorui [2 ]
机构
[1] China Acad Space Technol, Beijjng 100098, Peoples R China
[2] Dalian Univ Technol, Sch Informat Sci & Technol, Dalian 116024, Peoples R China
[3] Space Star Technol Co Ltd, Chengdu 610100, Peoples R China
基金
中国国家自然科学基金;
关键词
hyperspectral image; classification; class-incremental learning; SPECTRAL-SPATIAL CLASSIFICATION; CONVOLUTIONAL NEURAL-NETWORK; SUPERPIXEL;
D O I
10.3390/rs14112556
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
By virtue of its large-covered spatial information and high-resolution spectral information, hyperspectral images make lots of mapping-based fine-grained remote sensing applications possible. However, due to the inconsistency of land-cover types between different images, most hyperspectral image classification methods keep their effectiveness by training on every image and saving all classification models and training samples, which limits the promotion of related remote sensing tasks. To deal with the aforementioned issues, this paper proposes a hyperspectral image classification method based on class-incremental learning to learn new land-cover types without forgetting the old ones, which enables the classification method to classify all land-cover types with one final model. Specially, when learning new classes, a knowledge distillation strategy is designed to recall the information of old classes by transferring knowledge to the newly trained network, and a linear correction layer is proposed to relax the heavy bias towards the new class by reapportioning information between different classes. Additionally, the proposed method introduces a channel attention mechanism to effectively utilize spatial-spectral information by a recalibration strategy. Experimental results on the three widely used hyperspectral images demonstrate that the proposed method can identify both new and old land-cover types with high accuracy, which proves the proposed method is more practical in large-coverage remote sensing tasks.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] CLASS-INCREMENTAL LEARNING FOR REMOTE SENSING IMAGES BASED ON KNOWLEDGE DISTILLATION
    Song, Jingduo
    Jia, Hecheng
    Xu, Feng
    [J]. IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 5026 - 5028
  • [2] Online Class-Incremental Learning in Image Classification Based on Attention
    Du, Baoyu
    Wei, Zhonghe
    Cheng, Jinyong
    Lv, Guohua
    Dai, Xiaoyu
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT VII, 2024, 14431 : 487 - 499
  • [3] Class-Incremental Learning by Knowledge Distillation with Adaptive Feature Consolidation
    Kang, Minsoo
    Park, Jaeyoo
    Han, Bohyung
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 16050 - 16059
  • [4] Memory Efficient Class-Incremental Learning for Image Classification
    Zhao, Hanbin
    Wang, Hui
    Fu, Yongjian
    Wu, Fei
    Li, Xi
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (10) : 5966 - 5977
  • [5] Class-Incremental Learning on Video-Based Action Recognition by Distillation of Various Knowledge
    Maraghi, Vali Ollah
    Faez, Karim
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [6] Class-Incremental Learning: Survey and Performance Evaluation on Image Classification
    Masana, Marc
    Liu, Xialei
    Twardowski, Bartlomiej
    Menta, Mikel
    Bagdanov, Andrew D.
    van de Weijer, Joost
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 5513 - 5533
  • [7] Class-Incremental Learning of Plant and Disease Detection: Growing Branches with Knowledge Distillation
    Page-Fortin, Mathieu
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 593 - 603
  • [8] Few-Shot Class-Incremental Learning via Relation Knowledge Distillation
    Dong, Songlin
    Hong, Xiaopeng
    Tao, Xiaoyu
    Chang, Xinyuan
    Wei, Xing
    Gong, Yihong
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 1255 - 1263
  • [9] Class incremental learning with analytic learning for hyperspectral image classification
    Zhuang, Huiping
    Yan, Yue
    He, Run
    Zeng, Ziqian
    [J]. Journal of the Franklin Institute, 2024, 361 (18)
  • [10] Class-Incremental Exemplar Compression for Class-Incremental Learning
    Luo, Zilin
    Liu, Yaoyao
    Schiele, Bernt
    Sun, Qianru
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 11371 - 11380