Deep Learning-Based Action Recognition Using 3D Skeleton Joints Information

被引:15
|
作者
Tasnim, Nusrat [1 ]
Islam, Md. Mahbubul [1 ]
Baek, Joong-Hwan [1 ]
机构
[1] Korea Aerosp Univ, Dept Elect & Informat Engn, Goyang 10540, South Korea
关键词
3D skeleton data; action recognition; deep learning; pre-processing;
D O I
10.3390/inventions5030049
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Human action recognition has turned into one of the most attractive and demanding fields of research in computer vision and pattern recognition for facilitating easy, smart, and comfortable ways of human-machine interaction. With the witnessing of massive improvements to research in recent years, several methods have been suggested for the discrimination of different types of human actions using color, depth, inertial, and skeleton information. Despite having several action identification methods using different modalities, classifying human actions using skeleton joints information in 3-dimensional space is still a challenging problem. In this paper, we conceive an efficacious method for action recognition using 3D skeleton data. First, large-scale 3D skeleton joints information was analyzed and accomplished some meaningful pre-processing. Then, a simple straight-forward deep convolutional neural network (DCNN) was designed for the classification of the desired actions in order to evaluate the effectiveness and embonpoint of the proposed system. We also conducted prior DCNN models such as ResNet18 and MobileNetV2, which outperform existing systems using human skeleton joints information.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 50 条
  • [1] Deep learning-based action recognition with 3D skeleton: A survey
    Xing, Yuling
    Zhu, Jia
    [J]. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2021, 6 (01) : 80 - 92
  • [2] Arm-hand Action Recognition Based on 3D Skeleton Joints
    Rui, Ling
    Ma, Shi-wei
    Wen, Jia-rui
    Liu, Li-na
    [J]. INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION (ICCA 2016), 2016, : 326 - 332
  • [3] A Survey on 3D Skeleton-Based Action Recognition Using Learning Method
    Ren, Bin
    Liu, Mengyuan
    Ding, Runwei
    Liu, Hong
    [J]. CYBORG AND BIONIC SYSTEMS, 2024, 5
  • [4] Deep learning-based multi-view 3D-human action recognition using skeleton and depth data
    Sampat Kumar Ghosh
    Rashmi M
    Biju R Mohan
    Ram Mohana Reddy Guddeti
    [J]. Multimedia Tools and Applications, 2023, 82 : 19829 - 19851
  • [5] Deep learning-based multi-view 3D-human action recognition using skeleton and depth data
    Ghosh, Sampat Kumar
    Rashmi, M.
    Mohan, Biju R.
    Guddeti, Ram Mohana Reddy
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (13) : 19829 - 19851
  • [6] Geometric Deep Learning on Skeleton Sequences for 2D/3D Action Recognition
    Friji, Rasha
    Drira, Hassen
    Chaieb, Faten
    [J]. PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 5: VISAPP, 2020, : 196 - 204
  • [7] Learning Clip Representations for Skeleton-Based 3D Action Recognition
    Ke, Qiuhong
    Bennamoun, Mohammed
    An, Senjian
    Sohel, Ferdous
    Boussaid, Farid
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (06) : 2842 - 2855
  • [8] Spatiotemporal representation of 3D skeleton joints-based action recognition using modified spherical harmonics
    Salih, Al Alwani Adnan
    Youssef, Chahir
    [J]. PATTERN RECOGNITION LETTERS, 2016, 83 : 32 - 41
  • [9] Key frame and skeleton extraction for deep learning-based human action recognition
    Hai-Hong Phan
    Trung Tin Nguyen
    Ngo Huu Phuc
    Nguyen Huu Nhan
    Do Minh Hieu
    Cao Truong Tran
    Bao Ngoc Vi
    [J]. 2021 RIVF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION TECHNOLOGIES (RIVF 2021), 2021, : 180 - 185
  • [10] Skeleton Image Representation for 3D Action Recognition based on Tree Structure and Reference Joints
    Caetano, Carlos
    Bremond, Francois
    Schwartz, William Robson
    [J]. 2019 32ND SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2019, : 16 - 23