Human action recognition using fusion of features for unconstrained video sequences

被引:40
|
作者
Patel, Chirag I. [1 ]
Garg, Sanjay [1 ]
Zaveri, Tanish [2 ]
Banerjee, Asim [3 ]
Patel, Ripal [4 ]
机构
[1] Nirma Univ, Inst Technol, Comp Sci & Engn, Ahmadabad, Gujarat, India
[2] Nirma Univ, Inst Technol, Elect & Commun Engn, Ahmadabad, Gujarat, India
[3] DA IICT, Gandhinagar, India
[4] BVM Engn Coll, Vallabh Vidyanagar, Gujarat, India
关键词
Human action recognition; Histogram of oriented gradient (HOG); Local binary pattern (LBP); Artificial neural network; Support vector machine; Multiple kernel learning; Decision combination neural network (DCNN); Choquet's fuzzy integral (CFI); Decison template;
D O I
10.1016/j.compeleceng.2016.06.004
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Effective modeling of the human action using different features is a critical task for human action recognition; hence, the fusion of features concept has been used in our proposed work. By fusing several modalities, features, or classifier decision scores, we present six different fusion models inspired by the early fusion schemes, late fusion schemes, and intermediate fusion schemes. In the first two models, we have utilized early fusion technique. The third and fourth models exploit intermediate fusion techniques. In the fourth model, we confront a kernel-based fusion scheme, which takes advantage of kernel basis of classifiers i.e. Support Vector Machine (SVM). In the fifth and sixth models, we have demonstrated late fusion techniques. The performance of all models is evaluated with ASLAN and UCF11 benchmark dataset of action videos. We obtained significant improvements with the proposed fusion schemes relative to the usual fusion schemes relative state-of-the-art methods. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:284 / 301
页数:18
相关论文
共 50 条
  • [1] Histogram of Oriented Gradient-Based Fusion of Features for Human Action Recognition in Action Video Sequences
    Patel, Chirag I.
    Labana, Dileep
    Pandya, Sharnil
    Modi, Kirit
    Ghayvat, Hemant
    Awais, Muhammad
    [J]. SENSORS, 2020, 20 (24) : 1 - 33
  • [2] Human action recognition using fusion of multiview and deep features: an application to video surveillance
    Muhammad Attique Khan
    Kashif Javed
    Sajid Ali Khan
    Tanzila Saba
    Usman Habib
    Junaid Ali Khan
    Aaqif Afzaal Abbasi
    [J]. Multimedia Tools and Applications, 2024, 83 : 14885 - 14911
  • [3] Human action recognition using fusion of multiview and deep features: an application to video surveillance
    Khan, Muhammad Attique
    Javed, Kashif
    Khan, Sajid Ali
    Saba, Tanzila
    Habib, Usman
    Khan, Junaid Ali
    Abbasi, Aaqif Afzaal
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (05) : 14885 - 14911
  • [4] Human Action Recognition in Video Sequence using Logistic Regression by Features Fusion Approach based on CNN Features
    Ahmad, Tariq
    Wu, Jinsong
    Khan, Imran
    Rahim, Asif
    Khan, Amjad
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (11) : 18 - 25
  • [5] Human Action Recognition in Video by Fusion of Structural and Spatio-temporal Features
    Borzeshi, Ehsan Zare
    Concha, Oscar Perez
    Piccardi, Massimo
    [J]. STRUCTURAL, SYNTACTIC, AND STATISTICAL PATTERN RECOGNITION, 2012, 7626 : 474 - 482
  • [6] Human Action Recognition in Video Sequences Using Deep Belief Networks
    Abdellaoui, Mehrez
    Douik, Ali
    [J]. TRAITEMENT DU SIGNAL, 2020, 37 (01) : 37 - 44
  • [7] Fusion of Face and Gait for Human Recognition in Video Sequences
    Hou, Xiaohui
    Liu, Zhijing
    [J]. 2009 INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND COMPUTER SCIENCE, VOL 1, PROCEEDINGS, 2009, : 577 - 580
  • [8] Human Action Recognition Based on Fusion Features
    Yang, Shiqiang
    Yang, Jiangtao
    Li, Fei
    Fan, Guohao
    Li, Dexin
    [J]. CYBER SECURITY INTELLIGENCE AND ANALYTICS, 2020, 928 : 569 - 579
  • [9] Human Body Articulation for Action Recognition in Video Sequences
    Thi, Tuan Hue
    Lu, Sijun
    Zhang, Jian
    Cheng, Li
    Wang, Li
    [J]. AVSS: 2009 6TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE, 2009, : 92 - +
  • [10] Human action recognition using multi-view image sequences features
    Ahmad, Mohiuddin
    Lee, Seong-Whan
    [J]. PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION - PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE, 2006, : 523 - +