Campus violence action recognition based on lightweight graph convolution network

被引:2
|
作者
Li Qi [1 ]
Deng Yao-hui [2 ]
Wang Jiao [2 ]
机构
[1] Shaanxi Univ Sci & Technol, Sch Elect Informat & Artificial Intelligence, Xian 710021, Peoples R China
[2] Shaanxi Univ Sci & Technol, Sch Elect & Control Engn, Xian 710021, Peoples R China
关键词
campus violence action recognition; graph convolution network; information flow data fusion; spatio-temporal attention module;
D O I
10.37188/CJLCD.2021-0229
中图分类号
O7 [晶体学];
学科分类号
0702 ; 070205 ; 0703 ; 080501 ;
摘要
Aiming at the problem of low recognition speed and recognition rate of convolution neural network and graph convolution network in campus violence recognition, this paper proposes a lightweight graph convolution network combined with multi-information flow data fusion and spatio-temporal attention mechanism. The human skeleton is taken as the research object. Firstly, the multi-information flow data related to joint points and skeleton are fused to improve the operation speed by reducing the number of net work parameters. Secondly, the spatio-temporal attention module based on nonlocal operation is constructed to focus on the most action discriminant nodes, and the recognition accuracy is improved by reducing redundant information. Then, the spatio-temporal feature extraction module is constructed to obtain the spatio-temporal correlation information of the concerned nodes. Finally, action recognition is realized by Softmax layer. The experimental results show that the recognition accuracy of boxing, kicking, falling, pushing, earlighting and kneeling in campus security scene is 94. 5%, 97. 0% 98. 5% 95. 0%, 94. 5% and 95. 5%, respectively, and the maximum recognition speed is 20. 6 fps. Compared with the two benchmark networks on UCF101 dataset, the recognition speed and accuracy are improved, which verifies the universality of the method for other actions. Therefore, it can meet the real-time and reliability requirements of typical campus violence identification.
引用
收藏
页码:530 / 538
页数:9
相关论文
共 15 条
  • [1] CAI Q, 2020, SURVEY HUMAN ACTION, V47, P85
  • [2] [曹毅 Cao Yi], 2020, [华中科技大学学报. 自然科学版, Journal of Huazhong University of Science and Technology. Nature Science], V48, P5
  • [3] Hu T., 2020, PUBLIC COMMUNICATION, V12, P130
  • [4] Large-scale Video Classification with Convolutional Neural Networks
    Karpathy, Andrej
    Toderici, George
    Shetty, Sanketh
    Leung, Thomas
    Sukthankar, Rahul
    Fei-Fei, Li
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 1725 - 1732
  • [5] [孔玮 Kong Wei], 2021, [控制与决策, Control and Decision], V36, P1537
  • [6] Tower Crane remote wireless monitoring system based on Modbus/TCP protocol
    Li, Bo
    Chen, Geng
    Wang, Le
    Hao, Zhe
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE) AND IEEE/IFIP INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (EUC), VOL 2, 2017, : 187 - 190
  • [7] [李鹏飞 Li Pengfei], 2014, [液晶与显示, Chinese Journal of Liquid Crystals and Displays], V29, P417
  • [8] Face detection algorithm based on skin color location
    Lin Guo-jun
    Yang Ming-zhong
    Chen Ming-ju
    Xie Mei
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2019, 34 (01) : 70 - 73
  • [9] WANG J Z, 2021, COMPUTER ENG, V47, P1
  • [10] Yan SJ, 2018, AAAI CONF ARTIF INTE, P7444