MM-Wave Radar-Based Recognition of Multiple Hand Gestures Using Long Short-Term Memory (LSTM) Neural Network

被引:5
|
作者
Grobelny, Piotr [1 ]
Narbudowicz, Adam [1 ,2 ]
机构
[1] Wroclaw Univ Sci & Technol, Dept Telecommun & Teleinformat, PL-50370 Wroclaw, Poland
[2] Univ Dublin, Trinity Coll Dublin, CONNECT Ctr, Dublin D02 PN40, Ireland
基金
爱尔兰科学基金会;
关键词
radar; MM-wave radar; FMCW radar; hand-gesture recognition; machine learning; neural network; recurrent neural network; SYSTEM;
D O I
10.3390/electronics11050787
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The paper proposes a simple machine learning solution for hand-gesture classification, based on processed MM-wave radar signal. It investigates the classification up to 12 different intuitive and ergonomic gestures, which are intended to serve as a contactless user interface. The system is based on AWR1642 boost Frequency-Modulated Continuous-Wave (FMCW) radar, which allows capturing standardized data to support the scalability of the proposed solution. More than 4000 samples were collected from 4 different people, with all signatures extracted from the radar hardware available in open-access database accompanying the publication. Collected data were processed and used to train Long short-term memory (LSTM) and artificial recurrent neural network (RNN) architecture. The work studies the impact of different input parameters, the number of hidden layers, and the number of neurons in those layers. The proposed LSTM network allows for classification of different gestures, with the total accuracy ranging from 94.4% to 100% depending on use-case scenario, with a relatively small architecture of only 2 hidden layers with 32 neurons in each. The solution is also tested with additional data recorded from subjects not involved in the original training set, resulting in an accuracy drop of no more than 2.24%. This demonstrates that the proposed solution is robust and scalable, allowing quick and reliable creation of larger databases of gestures to expand the use of machine learning with radar technologies.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Recognition of Natural Hand Gestures Using Bkilrectional Long Short-Term Memory Model
    Kim, A-Ram
    Rhee, Sang-Yong
    [J]. INTERNATIONAL JOURNAL OF FUZZY LOGIC AND INTELLIGENT SYSTEMS, 2018, 18 (04) : 326 - 332
  • [2] Improving Radar-Based Rainfall Forecasts by Long Short-Term Memory Network in Urban Basins
    Nguyen, Duc Hai
    Kim, Jeong-Bae
    Bae, Deg-Hyo
    [J]. WATER, 2021, 13 (06)
  • [3] Well performance prediction based on Long Short-Term Memory (LSTM) neural network
    Huang, Ruijie
    Wei, Chenji
    Wang, Baohua
    Yang, Jian
    Xu, Xin
    Wu, Suwei
    Huang, Suqi
    [J]. JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2022, 208
  • [4] Persian Phoneme Recognition using Long Short-Term Memory Neural Network
    Daneshvar, Mohammad
    Veisi, Hadi
    [J]. 2016 EIGHTH INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE TECHNOLOGY (IKT), 2016, : 111 - 115
  • [5] Multiple Sequence Behavior Recognition on Humanoid Robot using Long Short-Term Memory (LSTM)
    How, Dickson Neoh Tze
    Sahari, Khairul Salleh Mohamed
    Hu Yuhuang
    Kiong, Loo Chu
    [J]. 2014 IEEE INTERNATIONAL SYMPOSIUM ON ROBOTICS AND MANUFACTURING AUTOMATION (ROMA), 2014, : 109 - 114
  • [7] Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network
    Sherstinsky, Alex
    [J]. arXiv, 2018,
  • [8] Application of Long Short-Term Memory (LSTM) Neural Network for Flood Forecasting
    Le, Xuan-Hien
    Hung Viet Ho
    Lee, Giha
    Jung, Sungho
    [J]. WATER, 2019, 11 (07)
  • [9] Very Short-term Prediction of Weather Radar-Based Rainfall Distribution and Intensity Over the Korean Peninsula Using Convolutional Long Short-Term Memory Network
    Yeonjun Kim
    Sungwook Hong
    [J]. Asia-Pacific Journal of Atmospheric Sciences, 2022, 58 : 489 - 506
  • [10] Very Short-term Prediction of Weather Radar-Based Rainfall Distribution and Intensity Over the Korean Peninsula Using Convolutional Long Short-Term Memory Network
    Kim, Yeonjun
    Hong, Sungwook
    [J]. ASIA-PACIFIC JOURNAL OF ATMOSPHERIC SCIENCES, 2022, 58 (04) : 489 - 506