Human action recognition using fusion of features for unconstrained video sequences

被引:40
|
作者
Patel, Chirag I. [1 ]
Garg, Sanjay [1 ]
Zaveri, Tanish [2 ]
Banerjee, Asim [3 ]
Patel, Ripal [4 ]
机构
[1] Nirma Univ, Inst Technol, Comp Sci & Engn, Ahmadabad, Gujarat, India
[2] Nirma Univ, Inst Technol, Elect & Commun Engn, Ahmadabad, Gujarat, India
[3] DA IICT, Gandhinagar, India
[4] BVM Engn Coll, Vallabh Vidyanagar, Gujarat, India
关键词
Human action recognition; Histogram of oriented gradient (HOG); Local binary pattern (LBP); Artificial neural network; Support vector machine; Multiple kernel learning; Decision combination neural network (DCNN); Choquet's fuzzy integral (CFI); Decison template;
D O I
10.1016/j.compeleceng.2016.06.004
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Effective modeling of the human action using different features is a critical task for human action recognition; hence, the fusion of features concept has been used in our proposed work. By fusing several modalities, features, or classifier decision scores, we present six different fusion models inspired by the early fusion schemes, late fusion schemes, and intermediate fusion schemes. In the first two models, we have utilized early fusion technique. The third and fourth models exploit intermediate fusion techniques. In the fourth model, we confront a kernel-based fusion scheme, which takes advantage of kernel basis of classifiers i.e. Support Vector Machine (SVM). In the fifth and sixth models, we have demonstrated late fusion techniques. The performance of all models is evaluated with ASLAN and UCF11 benchmark dataset of action videos. We obtained significant improvements with the proposed fusion schemes relative to the usual fusion schemes relative state-of-the-art methods. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:284 / 301
页数:18
相关论文
共 50 条
  • [41] DMMs-Based Multiple Features Fusion for Human Action Recognition
    Bulbul, Mohammad Farhad
    Jiang, Yunsheng
    Ma, Jinwen
    [J]. INTERNATIONAL JOURNAL OF MULTIMEDIA DATA ENGINEERING & MANAGEMENT, 2015, 6 (04): : 23 - 39
  • [42] Feature Fusion of Deep Spatial Features and Handcrafted Spatiotemporal Features for Human Action Recognition
    Uddin, Md Azher
    Lee, Young-Koo
    [J]. SENSORS, 2019, 19 (07)
  • [43] Spatiotemporal Fusion Networks for Video Action Recognition
    Liu, Zheng
    Hu, Haifeng
    Zhang, Junxuan
    [J]. NEURAL PROCESSING LETTERS, 2019, 50 (02) : 1877 - 1890
  • [44] Spatiotemporal Fusion Networks for Video Action Recognition
    Zheng Liu
    Haifeng Hu
    Junxuan Zhang
    [J]. Neural Processing Letters, 2019, 50 : 1877 - 1890
  • [45] Deep Fusion Module for Video Action Recognition
    Li, Yunyao
    Zheng, Zihao
    Zhou, Mingliang
    Yang, Guangchao
    Wei, Xuekai
    Pu, Huayan
    Luo, Jun
    [J]. JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2024, 33 (14)
  • [46] Multilevel features cascade fusion network for infrared video human behavior recognition
    Han, Huiyan
    Ouyang, Nannan
    Kuang, Xinhe
    Wang, Song
    Xiong, Fengguang
    [J]. Displays, 2025, 87
  • [47] Human Action Recognition Using Spatial and Temporal Sequences Alignment
    Li, Yandi
    Zhao, Zhihao
    [J]. SECOND INTERNATIONAL CONFERENCE ON OPTICS AND IMAGE PROCESSING (ICOIP 2022), 2022, 12328
  • [48] Style of Action based Individual Recognition in Video Sequences
    Pratheepan, Y.
    Prasad, G.
    Condell, J. V.
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), VOLS 1-6, 2008, : 1236 - 1241
  • [49] Human Action Recognition from Video Sequences by Enforcing Tri-view Constraints
    Wang, Yang
    Wu, Lin
    Huang, Xiaodi
    Lin, Xuemin
    [J]. COMPUTER JOURNAL, 2012, 55 (09): : 1030 - 1040
  • [50] Fusion of Skeleton and RGB Features for RGB-D Human Action Recognition
    Weiyao, Xu
    Muqing, Wu
    Min, Zhao
    Ting, Xia
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (17) : 19157 - 19164