Action Recognition Based on Multi-Level Topological Channel Attention of Human Skeleton

被引:3
|
作者
Hu, Kai [1 ,2 ]
Shen, Chaowen [1 ]
Wang, Tianyan [1 ]
Shen, Shuai [1 ]
Cai, Chengxue [1 ]
Huang, Huaming [3 ]
Xia, Min [1 ,2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Automat, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, CICAEET, Nanjing 210044, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Dept Phys Educ, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
skeleton action recognition; temporal modeling; prior knowledge; ENSEMBLE; NETWORK;
D O I
10.3390/s23249738
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In action recognition, obtaining skeleton data from human poses is valuable. This process can help eliminate negative effects of environmental noise, including changes in background and lighting conditions. Although GCN can learn unique action features, it fails to fully utilize the prior knowledge of human body structure and the coordination relations between limbs. To address these issues, this paper proposes a Multi-level Topological Channel Attention Network algorithm: Firstly, the Multi-level Topology and Channel Attention Module incorporates prior knowledge of human body structure using a coarse-to-fine approach, effectively extracting action features. Secondly, the Coordination Module utilizes contralateral and ipsilateral coordinated movements in human kinematics. Lastly, the Multi-scale Global Spatio-temporal Attention Module captures spatiotemporal features of different granularities and incorporates a causal convolution block and masked temporal attention to prevent non-causal relationships. This method achieved accuracy rates of 91.9% (Xsub), 96.3% (Xview), 88.5% (Xsub), and 90.3% (Xset) on NTU-RGB+D 60 and NTU-RGB+D 120, respectively.
引用
收藏
页数:26
相关论文
共 50 条
  • [41] Multi-level Motion Attention for Human Motion Prediction
    Mao, Wei
    Liu, Miaomiao
    Salzmann, Mathieu
    Li, Hongdong
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (09) : 2513 - 2535
  • [42] Human Action Recognition with Multi-Level Granularity and Pair-wise Hyper GCN
    Alsarhan, Tamam
    Ali, Syed Sadaf
    Alsarhan, Ayoub
    Ganapathi, Iyyakutti Iyappan
    Werghi, Naoufel
    2024 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, FG 2024, 2024,
  • [43] Multi-level Motion Attention for Human Motion Prediction
    Wei Mao
    Miaomiao Liu
    Mathieu Salzmann
    Hongdong Li
    International Journal of Computer Vision, 2021, 129 : 2513 - 2535
  • [44] Attention-Based Generative Graph Convolutional Network for Skeleton-Based Human Action Recognition
    Yang, Kai
    Ding, Xiaolu
    Chen, Wai
    ICVIP 2019: PROCEEDINGS OF 2019 3RD INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING, 2019, : 1 - 6
  • [45] Attention-based generative graph convolutional network for skeleton-based human action recognition
    Yang, Kai
    Ding, Xiaolu
    Chen, Wai
    ACM International Conference Proceeding Series, 2019, : 1 - 6
  • [46] Context-Aware Cross-Attention for Skeleton-Based Human Action Recognition
    Fan, Yanbo
    Weng, Shuchen
    Zhang, Yong
    Shi, Boxin
    Zhang, Yi
    IEEE ACCESS, 2020, 8 (08): : 15280 - 15290
  • [47] An Attention-Aware Model for Human Action Recognition on Tree-Based Skeleton Sequences
    Ding, Runwei
    Liu, Chang
    Liu, Hong
    SOCIAL ROBOTICS, ICSR 2018, 2018, 11357 : 569 - 579
  • [48] MULTI-LEVEL BASED PEDESTRIAN ATTRIBUTE RECOGNITION
    Yan, Hua-Rui
    Zhan, Jin-Yu
    Li, Fan
    Zhang, Ting
    Li, Na
    Li, Zu-Ning
    2019 16TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICWAMTIP), 2019, : 166 - 169
  • [49] Multi-Level Temporal Dilated Dense Prediction for Action Recognition
    Wang, Jinpeng
    Lin, Yiqi
    Zhang, Manlin
    Gao, Yuan
    Ma, Andy J.
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 2553 - 2566
  • [50] MLENet: Multi-Level Extraction Network for video action recognition
    Wang, Fan
    Li, Xinke
    Xiong, Han
    Mo, Haofan
    Li, Yongming
    PATTERN RECOGNITION, 2024, 154