Hand-Gesture Recognition Using Two-Antenna Doppler Radar With Deep Convolutional Neural Networks

被引:185
|
作者
Skaria, Sruthy [1 ]
Al-Hourani, Akram [1 ]
Lech, Margaret [1 ]
Evans, Robin J. [2 ]
机构
[1] RMIT Univ, Sch Engn, Melbourne, Vic 3000, Australia
[2] Univ Melbourne, Dept Elect & Elect Engn, Melbourne, Vic 3010, Australia
关键词
Radar sensors; deep convolutional neural networks; radar signal processing; hand-gesture recognition; Doppler radar; multi-antenna radar; millimeter-wave radar; CLASSIFICATION;
D O I
10.1109/JSEN.2019.2892073
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Low cost consumer radar integrated circuits combined with recent advances in machine learning have opened up a range of new possibilities in smart sensing. In this paper, we use a miniature radar sensor to capture Doppler signatures of 14 different hand gestures and train a deep convolutional neural network (DCNN) to classify these captured gestures. We utilize two receiving antennas of a continuous-wave Doppler radar capable of producing the in-phase and quadrature components of the heat signals. We map these two heat signals into three input channels of a DCNN as two spectrograms and an angle of arrival matrix. The classification results of the proposed architecture show a gesture classification accuracy exceeding 95% and a very low confusion between different gestures. This is almost 10% improvement over the single-channel Doppler methods reported in the literature.
引用
收藏
页码:3041 / 3048
页数:8
相关论文
共 50 条
  • [31] Hand Gesture Recognition with Convolutional Neural Networks for the Multimodal UAV Control
    Ma, Yuntao
    Liu, Yuxuan
    Fin, Ruiyang
    Yuan, Xingyang
    Sekha, Raza
    Wilson, Samuel
    Vaidyanathan, Ravi
    2017 WORKSHOP ON RESEARCH, EDUCATION AND DEVELOPMENT OF UNMANNED AERIAL SYSTEMS (RED-UAS), 2017, : 198 - 203
  • [32] Application of FMCW Radar for the Recongnition of Hand Gesture Using Time Series Convolutional Neural Networks
    Liu, Desheng
    Meng, Hongfu
    2020 INTERNATIONAL CONFERENCE ON MICROWAVE AND MILLIMETER WAVE TECHNOLOGY (ICMMT 2020 ONLINE), 2020,
  • [33] Static Hand Gesture Recognition for American Sign Language using Deep Convolutional Neural Network
    Das, Prangon
    Ahmed, Tanvir
    Ali, Md Firoj
    2020 IEEE REGION 10 SYMPOSIUM (TENSYMP) - TECHNOLOGY FOR IMPACTFUL SUSTAINABLE DEVELOPMENT, 2020, : 762 - 765
  • [34] Hand-gesture recognition using computer-vision techniques
    Rios-Soria, David J.
    Schaeffer, Satu E.
    Garza-Villarreal, Sara E.
    WSCG 2013, COMMUNICATION PAPERS PROCEEDINGS, 2013, : 1 - 8
  • [35] Classification of micro-Doppler radar hand-gesture signatures by means of Chebyshev moments
    Pallotta, Luca
    Cauli, Michela
    Clemente, Carmine
    Fioranelli, Francesco
    Giunta, Gaetano
    Farina, Alfonso
    2021 IEEE 8TH INTERNATIONAL WORKSHOP ON METROLOGY FOR AEROSPACE (IEEE METROAEROSPACE), 2021, : 182 - 187
  • [36] Hand Gesture Recognition Using a Radar Echo I-Q Plot and a Convolutional Neural Network
    Sakamoto, Takuya
    Gao, Xiaomeng
    Yavari, Ehsan
    Rahman, Ashikur
    Boric-Lubecke, Olga
    Lubecke, Victor M.
    IEEE SENSORS LETTERS, 2018, 2 (03)
  • [37] Gait Recognition using FMCW Radar and Temporal Convolutional Deep Neural Networks
    Addabbo, Pia
    Bernardi, Mario Luca
    Biondi, Filippo
    Cimitile, Marta
    Clemente, Carmine
    Orlando, Danilo
    2020 IEEE 7TH INTERNATIONAL WORKSHOP ON METROLOGY FOR AEROSPACE (METROAEROSPACE), 2020, : 171 - 175
  • [38] Gesture Recognition with a Low Power FMCW Radar and a Deep Convolutional Neural Network
    Dekker, B.
    Jacobs, S.
    Kossen, A. S.
    Kruithof, M. C.
    Huizing, A. G.
    Geurts, M.
    2017 EUROPEAN RADAR CONFERENCE (EURAD), 2017, : 163 - 166
  • [39] Recognition of Holoscopic 3D Video Hand Gesture Using Convolutional Neural Networks
    Alnaim, Norah
    Abbod, Maysam
    Swash, Rafiq
    TECHNOLOGIES, 2020, 8 (02)
  • [40] Demo: Efficient Convolutional Neural Network for FMCW Radar Based Hand Gesture Recognition
    Cai, Xiaodong
    Ma, Jingyi
    Liu, Wei
    Han, Hemin
    Ma, Lili
    UBICOMP/ISWC'19 ADJUNCT: PROCEEDINGS OF THE 2019 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2019 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2019, : 17 - 20