Action recognition using interrelationships of 3D joints and frames based on angle sine relation and distance features using interrelationships

被引:19
|
作者
Islam, M. Shujah [1 ]
Bakhat, Khush [2 ]
Khan, Rashid [1 ]
Iqbal, Mansoor [1 ]
Islam, M. Mattah [3 ]
Ye, Zhongfu [1 ]
机构
[1] Univ Sci & Technol China, Hefei, Peoples R China
[2] Air Univ, Islamabad, Pakistan
[3] Natl Univ Comp & Emerging Sci, Islamabad, Pakistan
关键词
Human action recognition; ASD-R; Joint's point interrelationships; Frame-frame interrelationships; SVM; REPRESENTATION;
D O I
10.1007/s10489-020-02176-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human action recognition is still an uncertain computer vision problem, which could be solved by a robust action descriptor. As a solution, we proposed an action recognition descriptor using only the 3D skeleton joint's points to perform this unsettle task. Joint's point interrelationships and frame-frame interrelationships are presented, which is a solution backbone to achieve human action recognition. Here, many joints are related to each other, and frames depend on different frames while performing any action sequence. Joints point spatial information calculates using angle, joint's sine relation, and distance features, whereas joints point temporal information estimates from frame-frame relations. Experiments are performed over four publicly available databases, i.e., MSR Daily Activity 3D Dataset, UTD Multimodal Human Action Dataset, KARD- Kinect Activity Recognition Dataset, and SBU Kinect Interaction Dataset, and proved that proposed descriptor outperforms as a comparison to state-of-the-art approaches on entire four datasets. Angle, Sine relation, and Distance features are extracted using interrelationships of joints and frames (ASD-R). It is all achieved due to accurately detecting spatial and temporal information of the Joint's points. Moreover, the Support Vector Machine classifier supports the proposed descriptor to identify the right classification precisely.
引用
收藏
页码:6001 / 6013
页数:13
相关论文
共 50 条
  • [31] Human Action Recognition Using 3D Zernike Moments
    Arik, Okay
    Bingol, A. Semih
    2014 11TH INTERNATIONAL MULTI-CONFERENCE ON SYSTEMS, SIGNALS & DEVICES (SSD), 2014,
  • [32] Aggressive action recognition using 3D CNN architectures
    Saveliev, Anton
    Uzdiaev, Mikhail
    Dmitrii, Malov
    12TH INTERNATIONAL CONFERENCE ON THE DEVELOPMENTS IN ESYSTEMS ENGINEERING (DESE 2019), 2019, : 890 - 895
  • [33] 3D Human Action Recognition Using Model Segmentation
    Yoon, Sang Min
    Kuijper, Arjan
    IMAGE ANALYSIS AND RECOGNITION, PT I, PROCEEDINGS, 2010, 6111 : 189 - +
  • [34] Localization and recognition of human action in 3D using transformers
    Jiankai Sun
    Linjiang Huang
    Hongsong Wang
    Chuanyang Zheng
    Jianing Qiu
    Md Tauhidul Islam
    Enze Xie
    Bolei Zhou
    Lei Xing
    Arjun Chandrasekaran
    Michael J. Black
    Communications Engineering, 3 (1):
  • [35] 3D GLOH Features for Human Action Recognition
    Abdulmunem, Ashwan
    Lai, Yu-Kun
    Sun, Xianfang
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 805 - 810
  • [36] Human Action Recognition Using 3D Reconstruction Data
    Papadopoulos, Georgios Th
    Daras, Petros
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (08) : 1807 - 1823
  • [37] 3D CNNs on Distance Matrices for Human Action Recognition
    Hernandez Ruiz, Alejandro
    Porzi, Lorenzo
    Bulo, Samuel Rota
    Moreno-Noguer, Francesc
    PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, : 1087 - 1095
  • [38] CNN based 3D Facial Expression Recognition Using Masking and Landmark Features
    Yang, Huiyuan
    Yin, Lijun
    2017 SEVENTH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII), 2017, : 556 - 560
  • [39] 3D Shape Context and Distance Transform for Action Recognition
    Grundmann, Matthias
    Meier, Franziska
    Essa, Irfan
    19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 725 - 728
  • [40] 3D face recognition algorithm based on discriminant analysis using composite features
    Sun, Yan-Feng
    Wang, Jun
    Yin, Bao-Cai
    Beijing Gongye Daxue Xuebao / Journal of Beijing University of Technology, 2010, 36 (01): : 98 - 103