Action recognition algorithm based on multi-scale and multi-branch features

被引:0
|
作者
Zhang Lei [1 ,2 ]
Han Guang-Liang [1 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
action recognition; multi-scale features; multi-branch features; feature fusion; CONVOLUTION; HISTOGRAMS;
D O I
10.37188/CJLCD.2022-0176
中图分类号
O7 [晶体学];
学科分类号
0702 ; 070205 ; 0703 ; 080501 ;
摘要
Aiming at the problems of insufficient feature extraction,incompleteness and low recognition accuracy in action recognition based on human skeleton sequence,a action recognition model based on multi -branch feature and multi-scale spatio-temporal feature is proposed in this paper. Firstly,the original data are enhanced by the combination of various algorithms. Secondly,the multi-branch feature input form is improved to multi-branch fusion feature information,which is input into the network,respectively. After a certain depth of network modules,it is fused together. Then,a multi-scale spatio-temporal convolution module is constructed as the basic module of the network to extract multi-scale spatio-temporal features. Finally,the overall network model is constructed to output action categories. The experimental results show that the recognition accuracy on Cross-subject and Cross-view of NTU RGB-D 60 data set is 89. 6% and 95. 1%,and the recognition accuracy on Cross-subject and Cross-setup of NTU RGB-D 120 data set is 84. 1% and 86. 0%,respectively. Compared with other algorithms,the more diversified and multi-scale action features are extracted,and the recognition accuracy of action categories is improved to a certain extent.
引用
收藏
页码:1614 / 1625
页数:12
相关论文
共 25 条
  • [1] Skeleton Image Representation for 3D Action Recognition based on Tree Structure and Reference Joints
    Caetano, Carlos
    Bremond, Francois
    Schwartz, William Robson
    [J]. 2019 32ND SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2019, : 16 - 23
  • [2] Histograms of oriented gradients for human detection
    Dalal, N
    Triggs, B
    [J]. 2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, : 886 - 893
  • [3] Human detection using oriented histograms of flow and appearance
    Dalal, Navneet
    Triggs, Bill
    Schmid, Cordelia
    [J]. COMPUTER VISION - ECCV 2006, PT 2, PROCEEDINGS, 2006, 3952 : 428 - 441
  • [4] Du Y, 2015, PROCEEDINGS 3RD IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION ACPR 2015, P579, DOI 10.1109/ACPR.2015.7486569
  • [5] Heng Wang, 2011, 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), P3169, DOI 10.1109/CVPR.2011.5995407
  • [6] Interpretable 3D Human Action Analysis with Temporal Convolutional Networks
    Kim, Tae Soo
    Reiter, Austin
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1623 - 1631
  • [7] Li C, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P786
  • [8] Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognition
    Li, Maosen
    Chen, Siheng
    Chen, Xu
    Zhang, Ya
    Wang, Yanfeng
    Tian, Qi
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3590 - 3598
  • [9] Campus violence action recognition based on lightweight graph convolution network
    Li Qi
    Deng Yao-hui
    Wang Jiao
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2022, 37 (04) : 530 - 538
  • [10] Li Qing-hui, 2018, Optics and Precision Engineering, V26, P2584, DOI 10.3788/OPE.20182610.2584