Human Activity Recognition Using Self-Powered Sensors Based on Multilayer Bidirectional Long Short-Term Memory Networks

被引:8
|
作者
Su, Jian [1 ]
Liao, Zhenlong [1 ]
Sheng, Zhengguo [2 ]
Liu, Alex X. [3 ]
Singh, Dilbag [4 ]
Lee, Heung-No [4 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Jiangsu, Peoples R China
[2] Univ Sussex, Dept Engn & Design, Brighton BN1 9RH, England
[3] Ant Financial Serv Grp, Hangzhou 310000, Peoples R China
[4] Gwangju Inst Sci & Technol, Sch Elect Engn & Comp Sci, Gwangju 61005, South Korea
基金
新加坡国家研究基金会;
关键词
Bidirectional long short-term memory (BLSTM); channel state information (CSI); deep learning; human activity recognition (HAR); self-powered sensors; Wi-Fi; SEGMENTATION; MODEL;
D O I
10.1109/JSEN.2022.3195274
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Sensor-based human activity recognition (HAR) requires the acquisition of channel state information (CSI) data with time series based on sensors to predict human behavior. Many existing approaches are based on wearable sensors and cameras, which increases the burden and privacy issues for patients. Self-powered sensors are capable of noncontact collection of time series data generated by human activity while ensuring their own stable operation. In this article, we propose a deep-learning-based framework for contactless real-time activity detection of humans using self-powered sensors, which is called multilayer bidirectional long short-term memory (MBLSTM). The collected Wi-Fi CSI data are fed into our proposed network model, which is then used to learn representative features of both sides from the original continuous CSI measurements. The attention model is used to assign differentweights to the learned features, and finally, activity recognition is performed. Experimental results showthat our proposedmethod achievesan accuracy ofmore than 96% for the recognition of six activities in multiple rounds of testing, outperforming other benchmark methods used for comparison.
引用
收藏
页码:20633 / 20641
页数:9
相关论文
共 50 条
  • [41] Human activity recognition using improved complete ensemble EMD with adaptive noise and long short-term memory neural networks
    Altuve, Miguel
    Lizarazo, Paula
    Villamizar, Javier
    [J]. BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2020, 40 (03) : 901 - 909
  • [42] Centralized tracking and bidirectional long short-term memory for abnormal behaviour recognition
    Andersson, Maria
    [J]. COUNTERTERRORISM, CRIME FIGHTING, FORENSICS, AND SURVEILLANCE TECHNOLOGIES VI, 2022, 12275
  • [43] Applying Deep Bidirectional Long Short-Term Memory to Mandarin Tone Recognition
    Yang, Longfei
    Xie, Yanlu
    Zhang, Jinsong
    [J]. PROCEEDINGS OF 2018 14TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2018, : 1124 - 1127
  • [44] Surface EMG Pattern Recognition Using Long Short-Term Memory Combined with Multilayer Perceptron
    He, Yunan
    Fukuda, Osamu
    Bu, Nan
    Okumura, Hiroshi
    Yamaguchi, Nobuhiko
    [J]. 2018 40TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2018, : 5636 - 5639
  • [45] Ground target classification using mmWave radar with bidirectional long short-term memory networks
    Gunes, Oytun
    Ege, Mert
    Morgul, Omer
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (04)
  • [46] Speaker Change Detection in Broadcast TV using Bidirectional Long Short-Term Memory Networks
    Yin, Ruiqing
    Bredin, Herve
    Barras, Claude
    [J]. 18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 3827 - 3831
  • [47] A Novel Word Spotting Algorithm Using Bidirectional Long Short-Term Memory Neural Networks
    Frinken, Volkmar
    Fischer, Andreas
    Bunke, Horst
    [J]. ARTIFICIAL NEURAL NETWORKS IN PATTERN RECOGNITION, PROCEEDINGS, 2010, 5998 : 185 - 196
  • [48] Sleep Stage Classification using Convolutional Neural Networks and Bidirectional Long Short-Term Memory
    Yulita, Intan Nurma
    Fanany, Mohamad Ivan
    Arymurthy, Aniati Murni
    [J]. 2017 INTERNATIONAL CONFERENCE ON ADVANCED COMPUTER SCIENCE AND INFORMATION SYSTEMS (ICACSIS), 2017, : 303 - 307
  • [49] Enhanced Deep Hierarchical Long Short-Term Memory and Bidirectional Long Short-Term Memory for Tamil Emotional Speech Recognition using Data Augmentation and Spatial Features
    Fernandes, Bennilo
    Mannepalli, Kasiprasad
    [J]. PERTANIKA JOURNAL OF SCIENCE AND TECHNOLOGY, 2021, 29 (04): : 2967 - 2992
  • [50] Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks
    Wang J.
    Wang Y.
    Yao L.
    [J]. Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2021, 38 (03): : 447 - 454