Analysis of Edge-Optimized Deep Learning Classifiers for Radar-Based Gesture Recognition

被引:12
|
作者
Chmurski, Mateusz [1 ,2 ]
Zubert, Mariusz [2 ]
Bierzynski, Kay [1 ]
Santra, Avik [1 ]
机构
[1] Infineon Technol AG, D-85579 Neubiberg, Germany
[2] Lodz Univ Technol, Dept Microelect & Comp Sci, PL-90924 Lodz, Poland
基金
欧盟地平线“2020”;
关键词
Optimization; Deep learning; Training; Sensors; Topology; Gesture recognition; Data models; Accelerator; data augmentation; edge computing; FMCW; gesture recognition; neural networks; DNNs; optimization; radar; intel NCS2;
D O I
10.1109/ACCESS.2021.3081353
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The increasing significance of technology in daily lives led to the need for the development of convenient methods of human-computer interaction (HCI). Given that the existing HCI approaches exhibit various limitations, hand gesture recognition-based HCI may serve as a more intuitive mode of human-machine interaction in many situations. In addition, the system has to be deployable on low-power devices for applicability in broadly defined Internet of Things (IoT) and smart home solutions. Recent advances exhibit the potential of deep learning models for gesture classification, whereas they are still limited to high-performance hardware. Embedded neural network accelerators are constrained in terms of available memory, central processing unit (CPU) clock speed, graphics processing unit (GPU) performance, and a number of supported operations. The aforementioned problems are addressed in this paper by namely two approaches - simplifying the signal processing pipeline to avoid recurrent structures and efficient topological design. This paper employs an intuitive scheme allowing for the generation of the data in the compressed form from the sequence of range-Doppler images (RDI). Thus, it allows for the design of a neural classifier avoiding the usage of recurrent layers. The proposed framework has been optimized for Intel(R) Neural Compute Stick 2 (Intel(R) NCS 2), at the same time achieving promising classification accuracy of 97.57%. To confirm the robustness of the proposed algorithm, five independent persons have been involved in the algorithm testing process.
引用
收藏
页码:74406 / 74421
页数:16
相关论文
共 50 条
  • [1] Radar-Based Gesture Recognition Using a Variational Autoencoder With Deep Statistical Metric Learning
    Stadelmayer, Thomas
    Santra, Avik
    Weigel, Robert
    Lurz, Fabian
    [J]. IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES, 2022, 70 (11) : 5051 - 5062
  • [2] On Edge Human Action Recognition Using Radar-Based Sensing and Deep Learning
    Gianoglio, Christian
    Mohanna, Ammar
    Rizik, Ali
    Moroney, Laurence
    Valle, Maurizio
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (03) : 4160 - 4172
  • [3] Learning on Multistatic Simulation Data for Radar-Based Automotive Gesture Recognition
    Kern, Nicolai
    Aguilar, Julian
    Grebner, Timo
    Meinecke, Benedikt
    Waldschmidt, Christian
    [J]. IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES, 2022, 70 (11) : 5039 - 5050
  • [4] Facilitating Radar-Based Gesture Recognition With Self-Supervised Learning
    Sheng, Zhiyao
    Xu, Huatao
    Zhang, Qian
    Wang, Dong
    [J]. 2022 19TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING (SECON), 2022, : 154 - 162
  • [5] Highly-Optimized Radar-Based Gesture Recognition System with Depthwise Expansion Module
    Chmurski, Mateusz
    Mauro, Gianfranco
    Santra, Avik
    Zubert, Mariusz
    Dagasan, Goekberk
    [J]. SENSORS, 2021, 21 (21)
  • [6] Low personality-sensitive feature learning for radar-based gesture recognition
    Wang, Liying
    Cui, Zongyong
    Pi, Yiming
    Cao, Changjie
    Cao, Zongjie
    [J]. NEUROCOMPUTING, 2022, 493 : 373 - 384
  • [7] Learning With Sharing: An Edge-Optimized Incremental Learning Method for Deep Neural Networks
    Hussain, Muhammad Awais
    Huang, Shih-An
    Tsai, Tsung-Han
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2023, 11 (02) : 461 - 473
  • [8] Lightweight Deep Learning Model in Mobile-Edge Computing for Radar-Based Human Activity Recognition
    Zhu, Jianping
    Lou, Xin
    Ye, Wenbin
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (15) : 12350 - 12359
  • [9] Few-Shot User-Definable Radar-Based Hand Gesture Recognition at the Edge
    Mauro, Gianfranco
    Chmurski, Mateusz
    Servadei, Lorenzo
    Pegalajar-Cuellar, Manuel
    Morales-Santos, Diego P.
    [J]. IEEE ACCESS, 2022, 10 : 29741 - 29759
  • [10] Lightweight Online Semisupervised Learning for Ultrasonic Radar-Based Dynamic Hand Gesture Recognition
    Kang, Pixi
    Li, Xiangyu
    [J]. IEEE SENSORS JOURNAL, 2023, 23 (03) : 2707 - 2717