Human Activity Recognition Using Self-Powered Sensors Based on Multilayer Bidirectional Long Short-Term Memory Networks

被引:8
|
作者
Su, Jian [1 ]
Liao, Zhenlong [1 ]
Sheng, Zhengguo [2 ]
Liu, Alex X. [3 ]
Singh, Dilbag [4 ]
Lee, Heung-No [4 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Jiangsu, Peoples R China
[2] Univ Sussex, Dept Engn & Design, Brighton BN1 9RH, England
[3] Ant Financial Serv Grp, Hangzhou 310000, Peoples R China
[4] Gwangju Inst Sci & Technol, Sch Elect Engn & Comp Sci, Gwangju 61005, South Korea
基金
新加坡国家研究基金会;
关键词
Bidirectional long short-term memory (BLSTM); channel state information (CSI); deep learning; human activity recognition (HAR); self-powered sensors; Wi-Fi; SEGMENTATION; MODEL;
D O I
10.1109/JSEN.2022.3195274
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Sensor-based human activity recognition (HAR) requires the acquisition of channel state information (CSI) data with time series based on sensors to predict human behavior. Many existing approaches are based on wearable sensors and cameras, which increases the burden and privacy issues for patients. Self-powered sensors are capable of noncontact collection of time series data generated by human activity while ensuring their own stable operation. In this article, we propose a deep-learning-based framework for contactless real-time activity detection of humans using self-powered sensors, which is called multilayer bidirectional long short-term memory (MBLSTM). The collected Wi-Fi CSI data are fed into our proposed network model, which is then used to learn representative features of both sides from the original continuous CSI measurements. The attention model is used to assign differentweights to the learned features, and finally, activity recognition is performed. Experimental results showthat our proposedmethod achievesan accuracy ofmore than 96% for the recognition of six activities in multiple rounds of testing, outperforming other benchmark methods used for comparison.
引用
收藏
页码:20633 / 20641
页数:9
相关论文
共 50 条
  • [1] Recognition of ships based on vector sensor and bidirectional long short-term memory networks
    Li, Sichun
    Yang, Shuyu
    Liang, Jinghan
    [J]. APPLIED ACOUSTICS, 2020, 164
  • [2] Multicolumn Bidirectional Long Short-Term Memory for Mobile Devices-Based Human Activity Recognition
    Tao, Dapeng
    Wen, Yonggang
    Hong, Richang
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2016, 3 (06): : 1124 - 1134
  • [3] HUMAN ACTIVITY RECOGNITION USING LONG SHORT-TERM MEMORY NETWORK
    Warunsin, Kulwarun
    Promjiraprawat, Kamphol
    Chitsobhuk, Orachat
    [J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2023, 19 (03): : 973 - 990
  • [4] Fuzzy Feature Representation with Bidirectional Long Short-Term Memory for Human Activity Modelling and Recognition
    Mohmed, Gadelhag
    Adama, David Ada
    Lotfi, Ahmad
    [J]. ADVANCES IN COMPUTATIONAL INTELLIGENCE SYSTEMS (UKCI 2019), 2020, 1043 : 15 - 26
  • [5] Kannada Named Entity Recognition and Classification using Bidirectional Long Short-Term Memory Networks
    Sathyanarayanan, Dinesh
    Ashok, Ashwin
    Mishra, Debanik
    Chimalamarri, Santwana
    Sitaram, Dinkar
    [J]. 2018 3RD INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, COMMUNICATION, COMPUTER, AND OPTIMIZATION TECHNIQUES (ICEECCOT - 2018), 2018, : 65 - 71
  • [6] Attention Mechanism-Based Bidirectional Long Short-Term Memory for Cycling Activity Recognition Using Smartphones
    Nguyen, Van Sy
    Kim, Hyunseok
    Suh, Dongjun
    [J]. IEEE ACCESS, 2023, 11 : 136206 - 136218
  • [7] Efficient Human Activity Recognition System Using Long Short-Term Memory
    Almusawi, Athraa
    Ali, Ali H.
    [J]. ADVANCES ON INTELLIGENT INFORMATICS AND COMPUTING: HEALTH INFORMATICS, INTELLIGENT SYSTEMS, DATA SCIENCE AND SMART COMPUTING, 2022, 127 : 73 - 83
  • [8] A novel approach to on-line handwriting recognition based on bidirectional long short-term memory networks
    Liwicki, Marcus
    Graves, Alex
    Bunke, Horst
    Schmidhuber, Juergyen
    [J]. ICDAR 2007: NINTH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION, VOLS I AND II, PROCEEDINGS, 2007, : 367 - +
  • [9] BIDIRECTIONAL QUATERNION LONG SHORT-TERM MEMORY RECURRENT NEURAL NETWORKS FOR SPEECH RECOGNITION
    Parcollet, Titouan
    Morchid, Mohamed
    Linares, Georges
    De Mori, Renato
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 8519 - 8523
  • [10] A sentiment analysis method based on bidirectional long short-term memory networks
    Zhang, Haifei
    Xu, Jian
    Lei, Liting
    Qiu Jianlin
    Alshalabi, Riyad
    [J]. APPLIED MATHEMATICS AND NONLINEAR SCIENCES, 2023, 8 (01) : 55 - 68