Action recognition using interrelationships of 3D joints and frames based on angle sine relation and distance features using interrelationships

被引:19
|
作者
Islam, M. Shujah [1 ]
Bakhat, Khush [2 ]
Khan, Rashid [1 ]
Iqbal, Mansoor [1 ]
Islam, M. Mattah [3 ]
Ye, Zhongfu [1 ]
机构
[1] Univ Sci & Technol China, Hefei, Peoples R China
[2] Air Univ, Islamabad, Pakistan
[3] Natl Univ Comp & Emerging Sci, Islamabad, Pakistan
关键词
Human action recognition; ASD-R; Joint's point interrelationships; Frame-frame interrelationships; SVM; REPRESENTATION;
D O I
10.1007/s10489-020-02176-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human action recognition is still an uncertain computer vision problem, which could be solved by a robust action descriptor. As a solution, we proposed an action recognition descriptor using only the 3D skeleton joint's points to perform this unsettle task. Joint's point interrelationships and frame-frame interrelationships are presented, which is a solution backbone to achieve human action recognition. Here, many joints are related to each other, and frames depend on different frames while performing any action sequence. Joints point spatial information calculates using angle, joint's sine relation, and distance features, whereas joints point temporal information estimates from frame-frame relations. Experiments are performed over four publicly available databases, i.e., MSR Daily Activity 3D Dataset, UTD Multimodal Human Action Dataset, KARD- Kinect Activity Recognition Dataset, and SBU Kinect Interaction Dataset, and proved that proposed descriptor outperforms as a comparison to state-of-the-art approaches on entire four datasets. Angle, Sine relation, and Distance features are extracted using interrelationships of joints and frames (ASD-R). It is all achieved due to accurately detecting spatial and temporal information of the Joint's points. Moreover, the Support Vector Machine classifier supports the proposed descriptor to identify the right classification precisely.
引用
收藏
页码:6001 / 6013
页数:13
相关论文
共 50 条
  • [1] Action recognition using interrelationships of 3D joints and frames based on angle sine relation and distance features using interrelationships
    M. Shujah Islam
    Khush Bakhat
    Rashid Khan
    Mansoor Iqbal
    M. Mattah Islam
    Zhongfu Ye
    Applied Intelligence, 2021, 51 : 6001 - 6013
  • [2] Spatio-Temporal Features in Action Recognition Using 3D Skeletal Joints
    Trascau, Mihai
    Nan, Mihai
    Florea, Adina Magda
    SENSORS, 2019, 19 (02)
  • [3] Action Recognition Using Local Joints Structure and Histograms of 3D Joints
    Liang, Yan
    Lu, Wanxuan
    Liang, Wei
    Wang, Yucheng
    2014 TENTH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS), 2014, : 185 - 188
  • [4] Fusing Spatiotemporal Features and Joints for 3D Action Recognition
    Zhu, Yu
    Chen, Wenbin
    Guo, Guodong
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2013, : 486 - 491
  • [5] Deep Learning-Based Action Recognition Using 3D Skeleton Joints Information
    Tasnim, Nusrat
    Islam, Md. Mahbubul
    Baek, Joong-Hwan
    INVENTIONS, 2020, 5 (03) : 1 - 15
  • [6] A 3D Facial Expression Recognition System Based On SVM Classifier Using Distance Based Features
    Soylemez, Omer Famk
    Ergen, Burhan
    Soylemez, Nesrin Hark
    2017 25TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2017,
  • [7] 3D Facial Expression Recognition using Distance Features and LBP Features based on automatically detected keypoints
    Sheng, Nan
    Cai, Yiheng
    Zhan, Changfei
    Qiu, Changyan
    Cui, Yize
    Gao, Xurong
    2016 9TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2016), 2016, : 396 - 401
  • [8] View Invariant Human Action Recognition Using 3D Geometric Features
    Zhao, Qingsong
    Sun, Shijie
    Ji, Xiaopeng
    Wang, Lei
    Cheng, Jun
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT IV, 2019, 11743 : 564 - 575
  • [9] 3D Action Recognition Based on Limb Angle Model
    Du, Jing
    Chen, Dongfang
    2014 4TH IEEE INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST), 2014, : 304 - 307
  • [10] Spatiotemporal representation of 3D skeleton joints-based action recognition using modified spherical harmonics
    Salih, Al Alwani Adnan
    Youssef, Chahir
    PATTERN RECOGNITION LETTERS, 2016, 83 : 32 - 41