Human Activity Recognition Using Self-Powered Sensors Based on Multilayer Bidirectional Long Short-Term Memory Networks

被引:8
|
作者
Su, Jian [1 ]
Liao, Zhenlong [1 ]
Sheng, Zhengguo [2 ]
Liu, Alex X. [3 ]
Singh, Dilbag [4 ]
Lee, Heung-No [4 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Jiangsu, Peoples R China
[2] Univ Sussex, Dept Engn & Design, Brighton BN1 9RH, England
[3] Ant Financial Serv Grp, Hangzhou 310000, Peoples R China
[4] Gwangju Inst Sci & Technol, Sch Elect Engn & Comp Sci, Gwangju 61005, South Korea
基金
新加坡国家研究基金会;
关键词
Bidirectional long short-term memory (BLSTM); channel state information (CSI); deep learning; human activity recognition (HAR); self-powered sensors; Wi-Fi; SEGMENTATION; MODEL;
D O I
10.1109/JSEN.2022.3195274
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Sensor-based human activity recognition (HAR) requires the acquisition of channel state information (CSI) data with time series based on sensors to predict human behavior. Many existing approaches are based on wearable sensors and cameras, which increases the burden and privacy issues for patients. Self-powered sensors are capable of noncontact collection of time series data generated by human activity while ensuring their own stable operation. In this article, we propose a deep-learning-based framework for contactless real-time activity detection of humans using self-powered sensors, which is called multilayer bidirectional long short-term memory (MBLSTM). The collected Wi-Fi CSI data are fed into our proposed network model, which is then used to learn representative features of both sides from the original continuous CSI measurements. The attention model is used to assign differentweights to the learned features, and finally, activity recognition is performed. Experimental results showthat our proposedmethod achievesan accuracy ofmore than 96% for the recognition of six activities in multiple rounds of testing, outperforming other benchmark methods used for comparison.
引用
收藏
页码:20633 / 20641
页数:9
相关论文
共 50 条
  • [21] Time Series-based Spoof Speech Detection Using Long Short-term Memory and Bidirectional Long Short-term Memory
    Mirza, Arsalan R.
    Al-Talabani, Abdulbasit K.
    [J]. ARO-THE SCIENTIFIC JOURNAL OF KOYA UNIVERSITY, 2024, 12 (02): : 119 - 129
  • [22] Real-Time Human Activity Generation using Bidirectional Long Short Term Memory Networks
    Aswal, Vivek
    Sreeram, Vmeet
    Kuchik, Aishwarya
    Ahuja, Simran
    Patel, Himali
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL SYSTEMS (ICICCS 2020), 2020, : 775 - 780
  • [23] Attention-based bidirectional-long short-term memory for abnormal human activity detection
    Manoj Kumar
    Anoop Kumar Patel
    Mantosh Biswas
    S. Shitharth
    [J]. Scientific Reports, 13
  • [24] VOICE CONVERSION USING DEEP BIDIRECTIONAL LONG SHORT-TERM MEMORY BASED RECURRENT NEURAL NETWORKS
    Sun, Lifa
    Kang, Shiyin
    Li, Kun
    Meng, Helen
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 4869 - 4873
  • [25] Attention-based bidirectional-long short-term memory for abnormal human activity detection
    Kumar, Manoj
    Patel, Anoop Kumar
    Biswas, Mantosh
    Shitharth, S.
    [J]. SCIENTIFIC REPORTS, 2023, 13 (01)
  • [26] Convolutional Neural Networks and Long Short-Term Memory for skeleton-based human activity and hand gesture recognition
    Nunez, Juan C.
    Cabido, Raul
    Pantrigo, Juan J.
    Montemayor, Antonio S.
    Velez, Jose F.
    [J]. PATTERN RECOGNITION, 2018, 76 : 80 - 94
  • [27] Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification
    Zhou, Peng
    Shi, Wei
    Tian, Jun
    Qi, Zhenyu
    Li, Bingchen
    Hao, Hongwei
    Xu, Bo
    [J]. PROCEEDINGS OF THE 54TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2016), VOL 2, 2016, : 207 - 212
  • [28] Gesture Recognition Using Wearable Sensors With Bi-Long Short-Term Memory Convolutional Neural Networks
    Nguyen-Trong, Khanh
    Vu, Hoai Nam
    Trung, Ngon Nguyen
    Pham, Cuong
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (13) : 15065 - 15079
  • [29] Automatic Recognition of Workers' Motions in Highway Construction by Using Motion Sensors and Long Short-Term Memory Networks
    Kim, Kinam
    Cho, Yong K.
    [J]. JOURNAL OF CONSTRUCTION ENGINEERING AND MANAGEMENT, 2021, 147 (03)
  • [30] Adapted Long Short-Term Memory (LSTM) for Concurrent Human Activity Recognition
    Thapa, Keshav
    Mi, Zubaer Md. Abdhulla
    Sung-Hyun, Yang
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 69 (02): : 1653 - 1670