View-independent representation with frame interpolation method for skeleton-based human action recognition

被引:0
|
作者
Yingguo Jiang
Jun Xu
Tong Zhang
机构
[1] South China University of Technology,School of Computer Science and Engineering
[2] Unit 95269 of the People’s Liberation Army,undefined
关键词
Action recognition; View-independent representation; Frame interpolation; Transfer CNN; Self-attention mechanism;
D O I
暂无
中图分类号
学科分类号
摘要
Human action recognition is an important branch of computer vision science. It is a challenging task based on skeletal data because of joints’ complex spatiotemporal information. In this work, we propose a method for action recognition, which consists of three parts: view-independent representation, frame interpolation, and combined model. First, the action sequence becomes view-independent representations independent of the view. Second, when judgment conditions are met, differentiated frame interpolations are used to expand the temporal dimensional information. Then, a combined model is adopted to extract these representation features and classify actions. Experimental results on two multi-view benchmark datasets Northwestern-UCLA and NTU RGB+D demonstrate the effectiveness of our complete method. Although using only one type of action feature and a simple architecture combined model, our complete method still outperforms most of the referential state-of-the-art methods and has strong robustness.
引用
收藏
页码:2625 / 2636
页数:11
相关论文
共 50 条
  • [1] View-independent representation with frame interpolation method for skeleton-based human action recognition
    Jiang, Yingguo
    Xu, Jun
    Zhang, Tong
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2020, 11 (12) : 2625 - 2636
  • [2] Enhanced view-independent representation method for skeleton-based human action recognition
    Jiang Y.
    Lu L.
    Xu J.
    [J]. International Journal of Information and Communication Technology, 2021, 19 (02) : 201 - 218
  • [3] View-Independent Human Action Recognition based on a Stereo Camera
    Roh, Myung-Cheol
    Shin, Ho-Keun
    Lee, Seong-Whan
    [J]. PROCEEDINGS OF THE 2009 CHINESE CONFERENCE ON PATTERN RECOGNITION AND THE FIRST CJK JOINT WORKSHOP ON PATTERN RECOGNITION, VOLS 1 AND 2, 2009, : 832 - 836
  • [4] InfoGCN: Representation Learning for Human Skeleton-based Action Recognition
    Chi, Hyung-gun
    Ha, Myoung Hoon
    Chi, Seunggeun
    Lee, Sang Wan
    Huang, Qixing
    Ramani, Karthik
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 20154 - 20164
  • [5] Adaptive Spatiotemporal Representation Learning for Skeleton-Based Human Action Recognition
    Yu, Jiahui
    Gao, Hongwei
    Chen, Yongquan
    Zhou, Dalin
    Liu, Jinguo
    Ju, Zhaojie
    [J]. IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (04) : 1654 - 1665
  • [6] Bootstrapped Representation Learning for Skeleton-Based Action Recognition
    Moliner, Olivier
    Huang, Sangxia
    Astrom, Kalle
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 4153 - 4163
  • [7] View-independent human action recognition by action hypersphere in nonlinear subspace
    Zhang, Jian
    Zhuang, Yueting
    [J]. ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2007, 2007, 4810 : 108 - 117
  • [8] Skeleton MixFormer: Multivariate Topology Representation for Skeleton-based Action Recognition
    Xin, Wentian
    Miao, Qiguang
    Liu, Yi
    Liu, Ruyi
    Pun, Chi-Man
    Shi, Cheng
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 2211 - 2220
  • [9] VIEW-INDEPENDENT HUMAN ACTION RECOGNITION BASED ON MULTI-VIEW ACTION IMAGES AND DISCRIMINANT LEARNING
    Iosifidis, Alexandros
    Tefas, Anastasios
    Pitas, Ioannis
    [J]. 2013 IEEE 11TH IVMSP WORKSHOP: 3D IMAGE/VIDEO TECHNOLOGIES AND APPLICATIONS (IVMSP 2013), 2013,
  • [10] A High Invariance Motion Representation for Skeleton-Based Action Recognition
    Guo, Songrui
    Pan, Huawei
    Tan, Guanghua
    Chen, Lin
    Gao, Chunming
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2016, 30 (08)