Building Indoor Dangerous Behavior Recognition Based on LSTM-GCN with Attention Mechanism

被引:2
|
作者
Zhao, Qingyue [1 ]
Gu, Qiaoyu [2 ]
Gao, Zhijun [3 ]
Shao, Shipian [1 ]
Zhang, Xinyuan [1 ]
机构
[1] Shenyang Jianzhu Univ, Sch Management, Shenyang 110168, Peoples R China
[2] North Univ China, Sch Informat & Commun Engn, Taiyuan 030051, Peoples R China
[3] Shenyang Jianzhu Univ, Sch Informat & Control Engn, Shenyang 110168, Peoples R China
来源
关键词
Human skeleton; building indoor dangerous behaviors recognition; graph convolution network; long short term memory network; attention mechanism;
D O I
10.32604/cmes.2023.027500
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Building indoor dangerous behavior recognition is a specific application in the field of abnormal human recogni-tion. A human dangerous behavior recognition method based on LSTM-GCN with attention mechanism (GLA) model was proposed aiming at the problem that the existing human skeleton-based action recognition methods cannot fully extract the temporal and spatial features. The network connects GCN and LSTM network in series, and inputs the skeleton sequence extracted by GCN that contains spatial information into the LSTM layer for time sequence feature extraction, which fully excavates the temporal and spatial features of the skeleton sequence. Finally, an attention layer is designed to enhance the features of key bone points, and Softmax is used to classify and identify dangerous behaviors. The dangerous behavior datasets are derived from NTU-RGB+D and Kinetics data sets. Experimental results show that the proposed method can effectively identify some dangerous behaviors in the building, and its accuracy is higher than those of other similar methods.
引用
收藏
页码:1773 / 1788
页数:16
相关论文
共 50 条
  • [1] Research on GCN-LSTM Emotion Recognition Algorithm with Attention Mechanism based on EEG
    Chang, Lina
    Li, Qi
    Yan, Xurong
    PROCEEDINGS OF 2024 4TH INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND INTELLIGENT COMPUTING, BIC 2024, 2024, : 170 - 174
  • [2] A Shortcut Enhanced LSTM-GCN Network for Multi-Sensor Based Human Motion Tracking
    Li, Xiaoyu
    Ye, Chaoxiang
    Huang, Binhua
    Zhou, Zhenning
    Su, Yuanzhe
    Ma, Yue
    Yi, Zhengkun
    Wu, Xinyu
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2023, 21 (04) : 1 - 10
  • [3] SLAFusion: Attention fusion based on SAX and LSTM for dangerous driving behavior detection
    Liu, Jia
    Huang, Wei
    Li, Hao
    Ji, Shenggong
    Du, Yajun
    Li, Tianrui
    INFORMATION SCIENCES, 2023, 640
  • [4] LSTM-GCN based multidimensional parameter relationship analysis and prediction framework for system level experimental bench
    Yang, Linjun
    Miao, Zhuang
    Li, Tong
    Tan, Sichao
    Wang, Bo
    Li, Dongyang
    Liu, Yongchao
    Wei, Hengyuan
    Li, Jiajun
    Li, Jiangkuan
    Wen, Jiming
    Xu, Zhao
    Tian, Ruifeng
    Annals of Nuclear Energy, 2025, 210
  • [5] Attention Mechanism and LSTM Network for Fingerprint-Based Indoor Location System
    Wu, Zhen
    Hu, Peng
    Liu, Shuangyue
    Pang, Tao
    SENSORS, 2024, 24 (05)
  • [6] An attention mechanism based convolutional LSTM network for video action recognition
    Ge, Hongwei
    Yan, Zehang
    Yu, Wenhao
    Sun, Liang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (14) : 20533 - 20556
  • [7] Object tactile character recognition model based on attention mechanism LSTM
    Xu, Zhe
    Chen, Muxin
    Liu, Chunfang
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 7095 - 7100
  • [8] An attention mechanism based convolutional LSTM network for video action recognition
    Hongwei Ge
    Zehang Yan
    Wenhao Yu
    Liang Sun
    Multimedia Tools and Applications, 2019, 78 : 20533 - 20556
  • [9] Dangerous Driving Behavior Detection with Attention Mechanism
    Wang, Kun
    Chen, Xianqiao
    Gao, Rui
    ICVIP 2019: PROCEEDINGS OF 2019 3RD INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING, 2019, : 57 - 62
  • [10] Human Behavior Analysis Based on Attention Mechanism and LSTM Neural Network
    Hao, Ziqiang
    Liu, Meng
    Wang, Zhongyuan
    Zhan, Weida
    PROCEEDINGS OF 2019 IEEE 9TH INTERNATIONAL CONFERENCE ON ELECTRONICS INFORMATION AND EMERGENCY COMMUNICATION (ICEIEC 2019), 2019, : 346 - 349