Hand-Gesture Recognition Using Two-Antenna Doppler Radar With Deep Convolutional Neural Networks

被引:185
|
作者
Skaria, Sruthy [1 ]
Al-Hourani, Akram [1 ]
Lech, Margaret [1 ]
Evans, Robin J. [2 ]
机构
[1] RMIT Univ, Sch Engn, Melbourne, Vic 3000, Australia
[2] Univ Melbourne, Dept Elect & Elect Engn, Melbourne, Vic 3010, Australia
关键词
Radar sensors; deep convolutional neural networks; radar signal processing; hand-gesture recognition; Doppler radar; multi-antenna radar; millimeter-wave radar; CLASSIFICATION;
D O I
10.1109/JSEN.2019.2892073
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Low cost consumer radar integrated circuits combined with recent advances in machine learning have opened up a range of new possibilities in smart sensing. In this paper, we use a miniature radar sensor to capture Doppler signatures of 14 different hand gestures and train a deep convolutional neural network (DCNN) to classify these captured gestures. We utilize two receiving antennas of a continuous-wave Doppler radar capable of producing the in-phase and quadrature components of the heat signals. We map these two heat signals into three input channels of a DCNN as two spectrograms and an angle of arrival matrix. The classification results of the proposed architecture show a gesture classification accuracy exceeding 95% and a very low confusion between different gestures. This is almost 10% improvement over the single-channel Doppler methods reported in the literature.
引用
收藏
页码:3041 / 3048
页数:8
相关论文
共 50 条
  • [41] Hand Gesture Detection with Convolutional Neural Networks
    Alashhab, Samer
    Gallego, Antonio-Javier
    Angel Lozano, Miguel
    DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE, 2019, 800 : 45 - 52
  • [42] Two-Stream Convolutional Neural Networks with Natural Light and Depth Images for Hand Gesture Recognition
    Yan, Mciyang
    Li, Yuan
    2019 12TH ASIAN CONTROL CONFERENCE (ASCC), 2019, : 1519 - 1524
  • [43] HAND GESTURE RECOGNITION USING MEDIA PIPE AND CONVOLUTIONAL NEURAL NETWORK
    Adepu, Anjaiah
    Gade, Lakshmi Manaswini
    Bavikadi, Sindhuja
    Madide, Hemanth
    INTERNATIONAL JOURNAL OF EARLY CHILDHOOD SPECIAL EDUCATION, 2022, 14 (05) : 1341 - 1351
  • [44] Visual Static Hand Gesture Recognition Using Convolutional Neural Network
    Eid, Ahmed
    Schwenker, Friedhelm
    ALGORITHMS, 2023, 16 (08)
  • [45] Sign Language Gesture Recognition using Doppler Radar and Deep Learning
    Kulhandjian, Hovannes
    Sharma, Prakshi
    Kulhandjian, Michel
    D'Amours, Claude
    2019 IEEE GLOBECOM WORKSHOPS (GC WKSHPS), 2019,
  • [46] Deep Neural Networks vs Bag of Features for Hand Gesture Recognition
    Mirsu, Radu
    Simion, Georgiana
    Caleanu, Catlin Daniel
    Ursulescu, Oana
    Calimanu, Ioana Pop
    2019 42ND INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS AND SIGNAL PROCESSING (TSP), 2019, : 369 - 372
  • [47] Vision Transformer with Convolutional Encoder-Decoder for Hand Gesture Recognition using 24-GHz Doppler Radar
    Kehelella, Kavinda
    Leelarathne, Gayangana
    Marasinghe, Dhanuka
    Kariyawasam, Nisal
    Ariyarathna, Viduneth
    Madanayake, Arjuna
    Rodrigo, Ranga
    Edussooriya, Chamira U. S.
    IEEE SENSORS LETTERS, 2022, 6 (10)
  • [48] CONVOLUTIONAL NEURAL NETWORK ARCHITECTURE FOR HAND GESTURE RECOGNITION
    Pinzon Arenas, Javier Orlando
    Useche Murillo, Paula Catalina
    Jimenez Moreno, Robinson
    PROCEEDINGS OF THE 2017 IEEE XXIV INTERNATIONAL CONFERENCE ON ELECTRONICS, ELECTRICAL ENGINEERING AND COMPUTING (INTERCON), 2017,
  • [49] Enhancement of Hand Gesture Recognition Using Convolutional Neural Networks Integrating a Combination of an Autoencoder Network and PCA
    Bousbai, Khalil
    Merah, Mostefa
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36 (10)
  • [50] A New Method for Traffic Participant Recognition Using Doppler Radar Signature and Convolutional Neural Networks
    Slesicki, Blazej
    Slesicka, Anna
    SENSORS, 2024, 24 (12)