Hand-Gesture Recognition Using Two-Antenna Doppler Radar With Deep Convolutional Neural Networks

被引:185
|
作者
Skaria, Sruthy [1 ]
Al-Hourani, Akram [1 ]
Lech, Margaret [1 ]
Evans, Robin J. [2 ]
机构
[1] RMIT Univ, Sch Engn, Melbourne, Vic 3000, Australia
[2] Univ Melbourne, Dept Elect & Elect Engn, Melbourne, Vic 3010, Australia
关键词
Radar sensors; deep convolutional neural networks; radar signal processing; hand-gesture recognition; Doppler radar; multi-antenna radar; millimeter-wave radar; CLASSIFICATION;
D O I
10.1109/JSEN.2019.2892073
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Low cost consumer radar integrated circuits combined with recent advances in machine learning have opened up a range of new possibilities in smart sensing. In this paper, we use a miniature radar sensor to capture Doppler signatures of 14 different hand gestures and train a deep convolutional neural network (DCNN) to classify these captured gestures. We utilize two receiving antennas of a continuous-wave Doppler radar capable of producing the in-phase and quadrature components of the heat signals. We map these two heat signals into three input channels of a DCNN as two spectrograms and an angle of arrival matrix. The classification results of the proposed architecture show a gesture classification accuracy exceeding 95% and a very low confusion between different gestures. This is almost 10% improvement over the single-channel Doppler methods reported in the literature.
引用
收藏
页码:3041 / 3048
页数:8
相关论文
共 50 条
  • [1] Doppler-Radar Based Hand Gesture Recognition System Using Convolutional Neural Networks
    Zhang, Jiajun
    Tao, Jinkun
    Shi, Zhiguo
    COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2019, 463 : 1096 - 1113
  • [2] Hand Gesture Recognition Using Deep Convolutional Neural Networks
    Strezoski, Gjorgji
    Stojanovski, Dario
    Dimitrovski, Ivica
    Madjarov, Gjorgji
    ICT INNOVATIONS 2016: COGNITIVE FUNCTIONS AND NEXT GENERATION ICT SYSTEMS, 2018, 665 : 49 - 58
  • [3] Application of Doppler Radar for the Recognition of Hand Gestures Using Optimized Deep Convolutional Neural Networks
    Kim, Youngwook
    Toomajian, Brian
    2017 11TH EUROPEAN CONFERENCE ON ANTENNAS AND PROPAGATION (EUCAP), 2017, : 1258 - 1260
  • [4] Hand Gesture Recognition using Convolutional Neural Networks
    Lan, Shengchang
    He, Zonglong
    Chen, Weichu
    Chen, Lijia
    2018 USNC-URSI RADIO SCIENCE MEETING (JOINT WITH AP-S SYMPOSIUM), 2018, : 147 - 148
  • [5] Gesture recognition of radar micro doppler signatures using separable convolutional neural networks
    Helen Victoria A.
    Maragatham G.
    Materials Today: Proceedings, 2023, 80 : 1961 - 1964
  • [6] Hand Gesture Recognition via Radar Sensors and Convolutional Neural Networks
    Franceschini, S.
    Ambrosanio, M.
    Vitale, S.
    Baselice, F.
    Gifuni, A.
    Grassini, G.
    Pascazio, V
    2020 IEEE RADAR CONFERENCE (RADARCONF20), 2020,
  • [7] Hand-Gesture Recognition System by using Microwave Doppler Sensors
    Kaneda, Shigeo
    Kubota, Yusuke
    Kurokawa, Tomohito
    Furuhata, Takeshi
    IEEE 39TH ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE WORKSHOPS (COMPSAC 2015), VOL 3, 2015, : 211 - 216
  • [8] Hand Gesture Recognition in Video Sequences Using Deep Convolutional and Recurrent Neural Networks
    Obaid, Falah
    Babadi, Amin
    Yoosofan, Ahmad
    APPLIED COMPUTER SYSTEMS, 2020, 25 (01) : 57 - 61
  • [9] Hand Gesture Recognition Using a Dual Axis Millimeter-Wave Interferometric-Doppler Radar and Convolutional Neural Networks
    Klinefelter, Eric
    Nanzer, Jeffrey A.
    2021 18TH EUROPEAN RADAR CONFERENCE (EURAD), 2021, : 297 - 300
  • [10] Deep-Learning Methods for Hand-Gesture Recognition Using Ultra-Wideband Radar
    Skaria, Sruthy
    Al-Hourani, Akram
    Evans, Robin J.
    IEEE ACCESS, 2020, 8 : 203580 - 203590