High-precision Gesture Recognition Based on DenseNet and Convolutional Block Attention Module

被引：0
|
作者：
Zhao Y. [1 ]
Song Y. [1 ]
Wu H. [1 ]
He S. [1 ]
Liu P. [2 ]
Wu L. [1 ]
机构：
[1] School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin
[2] China Aerospace Science & Industry Corporation, 8511 company, Nanjing
来源：
Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology | 2024年 / 46卷 / 03期
基金：
中国国家自然科学基金;
关键词：
Convolutional Block Attention Module(CBAM); Convolutional Neural Network(CNN); Gesture recognition; Millimeter wave radar;
D O I：
10.11999/JEIT230165
中图分类号：
学科分类号：
摘要：
Non-contact gesture recognition is a new type of human-computer interaction method with broad application prospects. It can be used in Augmented Reality (AR)/Virtual Reality (VR), smart homes, smart medical, etc., and has recently become a research hotspot. Motivated by the need for more precise micro-motion gesture recognition using mm-wave radar in recent years, a novel micro-motion gesture recognition method based on MIMO millimeter wave radar is proposed in this paper. The MilliMeter Wave CAScaded (MMWCAS) radar cascaded with four AWR1243 radar boards is used to collect gesture echoes. Time-frequency analysis is performed on gesture echoes, and the hand target is detected based on the Range-Doppler (RD) map and 3D point cloud. Through data pre-processing, the Range-Time Map (RTM), Doppler-Time Map (DTM), Azimuth-Time Map (ATM) and Elevation-Time Map (ETM) of the gestures are extracted to more comprehensively characterize the motion of the hand gesture. The mixed Feature-Time Maps (FTM) are formed and adopted for the recognition of 12 types of micro-motion gestures. An innovative gesture recognition network based on DenseNet and Convolutional Block Attention Module (CBAM) is designed, and the mixed FTM is used as the input of the network. Experimental results show that the recognition accuracy reaches 99.03%, achieving high-accuracy gesture recognition. It is discovered that the network focuses on the first half of the gesture movement, which improves the recognition accuracy. © 2024 Science Press. All rights reserved.
引用
收藏
页码：967 / 976
页数：9
相关论文
共 30 条
  • [1] VERDADERO M S, MARTINEZ-OJEDA C O, CRUZ J C D., Hand gesture recognition system as an alternative interface for remote controlled home appliances[C], The 10th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management, pp. 1-5, (2018)
  • [2] WISENER W J, RODRIGUEZ J D, OVANDO A, Et al., A top-view hand gesture recognition system for IoT applications[C], The 5th International Conference on Smart Systems and Inventive Technology, pp. 430-434, (2023)
  • [3] KIM K M, CHOI J I., Passengers’ gesture recognition model in self-driving vehicles: Gesture recognition model of the passengers’ obstruction of the vision of the driver[C], The 4th International Conference on Computer and Communication Systems, pp. 239-242, (2019)
  • [4] NOORUDDIN N, DEMBANI R, MAITLO N., HGR: Hand-gesture-recognition based text input method for AR/VR wearable devices[C], 2020 IEEE International Conference on Systems, Man, and Cybernetics, pp. 744-751, (2020)
  • [5] LIU Zhenyu, LIU Haoming, MA Chongrun, A robust hand gesture sensing and recognition based on dual-flow fusion with FMCW radar, IEEE Geoscience and Remote Sensing Letters, 19, (2022)
  • [6] ZHANG Wenjin, WANG Jiacun, Fangping LAN, Dynamic hand gesture recognition based on short-term sampling neural networks[J], IEEE/CAA Journal of Automatica Sinica, 8, 1, pp. 110-120, (2021)
  • [7] LEON D G, GROLI J, YEDURI S R, Et al., Video hand gestures recognition using depth camera and lightweight CNN[J], IEEE Sensors Journal, 22, 14, pp. 14610-14619, (2022)
  • [8] LIEN J, GILLIAN N, KARAGOZLER M E, Et al., Soli: Ubiquitous gesture sensing with millimeter wave radar, ACM Transactions on Graphics, 35, 4, (2016)
  • [9] WANG Saiwen, SONG Jie, LIEN J, Et al., Interacting with soli: Exploring fine-grained dynamic gesture recognition in the radio-frequency spectrum[C], The 29th Annual Symposium on User Interface Software and Technology, pp. 851-860, (2016)
  • [10] SHEN Xiangyu, ZHENG Haifeng, FENG Xinxin, Et al., ML-HGR-Net: A meta-learning network for FMCW radar based hand gesture recognition[J], IEEE Sensors Journal, 22, 11, pp. 10808-10817, (2022)
123