A Lightweight Graph Neural Network Algorithm for Action Recognition Based on Self-Distillation

被引:1
|
作者
Feng, Miao [1 ]
Meunier, Jean [1 ]
机构
[1] Univ Montreal, Dept Comp Sci & Operat Res, Montreal, PQ H3C 3J7, Canada
关键词
human action recognition; graph neural networks; skeleton graph; self-distillation; model compression;
D O I
10.3390/a16120552
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recognizing human actions can help in numerous ways, such as health monitoring, intelligent surveillance, virtual reality and human-computer interaction. A quick and accurate detection algorithm is required for daily real-time detection. This paper first proposes to generate a lightweight graph neural network by self-distillation for human action recognition tasks. The lightweight graph neural network was evaluated on the NTU-RGB+D dataset. The results demonstrate that, with competitive accuracy, the heavyweight graph neural network can be compressed by up to 80%. Furthermore, the learned representations have denser clusters, estimated by the Davies-Bouldin index, the Dunn index and silhouette coefficients. The ideal input data and algorithm capacity are also discussed.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Balanced self-distillation for long-tailed recognition
    Ren, Ning
    Li, Xiaosong
    Wu, Yanxia
    Fu, Yan
    KNOWLEDGE-BASED SYSTEMS, 2024, 290
  • [22] A Transformer-Based Model With Self-Distillation for Multimodal Emotion Recognition in Conversations
    Ma, Hui
    Wang, Jian
    Lin, Hongfei
    Zhang, Bo
    Zhang, Yijia
    Xu, Bo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 776 - 788
  • [23] Enhanced Adjacency Matrix-Based Lightweight Graph Convolution Network for Action Recognition
    Zhang, Daqing
    Deng, Hongmin
    Zhi, Yong
    SENSORS, 2023, 23 (14)
  • [24] Self-Distillation: Towards Efficient and Compact Neural Networks
    Zhang, Linfeng
    Bao, Chenglong
    Ma, Kaisheng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (08) : 4388 - 4403
  • [25] Graph Convolutional Neural Network Gesture Recognition Based on Pooling Algorithm
    Chen, Hong
    Qi, Baoqiang
    Zhao, Hongdong
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2022, 31 (15)
  • [26] Unbiased scene graph generation using the self-distillation method
    Sun, Bo
    Hao, Zhuo
    Yu, Lejun
    He, Jun
    VISUAL COMPUTER, 2024, 40 (04): : 2381 - 2390
  • [27] Knowledge distillation based lightweight domain adversarial neural network for electroencephalogram-based emotion recognition
    Wang, Zhe
    Wang, Yongxiong
    Tang, Yiheng
    Pan, Zhiqun
    Zhang, Jiapeng
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 95
  • [28] Finger Vein Recognition Algorithm Based on Lightweight Deep Convolutional Neural Network
    Shen, Jiaquan
    Liu, Ningzhong
    Xu, Chenglu
    Sun, Han
    Xiao, Yushun
    Li, Deguang
    Zhang, Yongxin
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [29] A Lightweight Method for Graph Neural Networks Based on Knowledge Distillation and Graph Contrastive Learning
    Wang, Yong
    Yang, Shuqun
    APPLIED SCIENCES-BASEL, 2024, 14 (11):
  • [30] Cloud Recognition Based on Lightweight Neural Network
    Zhang, Liang
    Jia, Kebin
    Liu, Pengyu
    Fang, Chunyao
    2020 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2020, : 1033 - 1042