Action recognition using interrelationships of 3D joints and frames based on angle sine relation and distance features using interrelationships

被引:19
|
作者
Islam, M. Shujah [1 ]
Bakhat, Khush [2 ]
Khan, Rashid [1 ]
Iqbal, Mansoor [1 ]
Islam, M. Mattah [3 ]
Ye, Zhongfu [1 ]
机构
[1] Univ Sci & Technol China, Hefei, Peoples R China
[2] Air Univ, Islamabad, Pakistan
[3] Natl Univ Comp & Emerging Sci, Islamabad, Pakistan
关键词
Human action recognition; ASD-R; Joint's point interrelationships; Frame-frame interrelationships; SVM; REPRESENTATION;
D O I
10.1007/s10489-020-02176-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human action recognition is still an uncertain computer vision problem, which could be solved by a robust action descriptor. As a solution, we proposed an action recognition descriptor using only the 3D skeleton joint's points to perform this unsettle task. Joint's point interrelationships and frame-frame interrelationships are presented, which is a solution backbone to achieve human action recognition. Here, many joints are related to each other, and frames depend on different frames while performing any action sequence. Joints point spatial information calculates using angle, joint's sine relation, and distance features, whereas joints point temporal information estimates from frame-frame relations. Experiments are performed over four publicly available databases, i.e., MSR Daily Activity 3D Dataset, UTD Multimodal Human Action Dataset, KARD- Kinect Activity Recognition Dataset, and SBU Kinect Interaction Dataset, and proved that proposed descriptor outperforms as a comparison to state-of-the-art approaches on entire four datasets. Angle, Sine relation, and Distance features are extracted using interrelationships of joints and frames (ASD-R). It is all achieved due to accurately detecting spatial and temporal information of the Joint's points. Moreover, the Support Vector Machine classifier supports the proposed descriptor to identify the right classification precisely.
引用
收藏
页码:6001 / 6013
页数:13
相关论文
共 50 条
  • [41] A Survey on 3D Skeleton-Based Action Recognition Using Learning Method
    Ren, Bin
    Liu, Mengyuan
    Ding, Runwei
    Liu, Hong
    CYBORG AND BIONIC SYSTEMS, 2024, 5
  • [42] Action Recognition Based on Features Fusion and 3D Convolutional Neural Networks
    Liu, Lulu
    Hu, Fangyu
    Zhou, Jiahui
    PROCEEDINGS OF 2016 9TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 1, 2016, : 178 - 181
  • [43] Action Recognition from 3D Skeleton Sequences using Deep Networks on Lie Group Features
    Rhif, Manel
    Wannous, Hazem
    Farah, Imed Riadh
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 3427 - 3432
  • [44] Ear recognition in 3D using 2D curvilinear features
    Ganapathi, Iyyakutti Iyappan
    Prakash, Surya
    Dave, Ishan Rajendra
    Joshi, Piyush
    Ali, Syed Sadaf
    Shrivastava, Akhilesh Mohan
    IET BIOMETRICS, 2018, 7 (06) : 519 - 529
  • [45] Extracting The Shape Content of 3D Objects using Angle and Distance Histograms
    Altintoprak, Sadik
    Saykol, Ediz
    2019 11TH INTERNATIONAL CONFERENCE ON ELECTRICAL AND ELECTRONICS ENGINEERING (ELECO 2019), 2019, : 557 - 564
  • [46] Face recognition using SIFT features under 3D meshes
    Cheng Zhang
    Yu-zhang Gu
    Ke-li Hu
    Ying-guan Wang
    Journal of Central South University, 2015, 22 : 1817 - 1825
  • [47] Improving Hand Gesture Recognition Using 3D Combined Features
    Elmezain, Mahmoud
    Al-Hamadi, Ayoub
    Michaelis, Bernd
    2009 SECOND INTERNATIONAL CONFERENCE ON MACHINE VISION, PROCEEDINGS, ( ICMV 2009), 2009, : 128 - 132
  • [48] 3D object recognition using scale-invariant features
    Jeonghun Lim
    Kunwoo Lee
    The Visual Computer, 2019, 35 : 71 - 84
  • [49] Robust 3D Face Recognition using Learn Correlative Features
    Ming, Yue
    Ruan, Qiuqi
    Wang, Xueqiao
    Mu, Meiru
    2010 IEEE 10TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS (ICSP2010), VOLS I-III, 2010, : 1382 - 1385
  • [50] 3D object recognition using scale-invariant features
    Lim, Jeonghun
    Lee, Kunwoo
    VISUAL COMPUTER, 2019, 35 (01): : 71 - 84