Dynamic gesture recognition method based on convolutional neural network

被引:0
|
作者
Xu, Xiaoyu [1 ]
Deng, Lizhen [1 ]
Meng, Qingmin [1 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Telecommun & Informat Engn, Nanjing 210003, Peoples R China
关键词
human-computer interaction; gesture recognition; skin segmentation; inter-frame difference; convolutional ceural networks;
D O I
10.1109/iThings/GreenCom/CPSCom/SmartData.2019.00085
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
A method for identifying dynamic gestures is studied for the problem of low recognition accuracy under the rotation angle in gesture recognition of human-computer interaction. The methodology of the design is summarized in four processes. Firstly, the inter-frame difference method is used to extract the gesture key frame. Secondly, Hue Saturation Value (HSV) color space model is used to achieve gestures positioning. Thirdly, gesture key frame and final gesture frame are stitched together. In the final process, training and testing data using convolutional neural network model. The experimental results show that the recognition accuracy of the proposed five kinds of gesture models can reach 92% The method can better realize the recognition of the gesture under the rotation angle.
引用
收藏
页码:389 / 394
页数:6
相关论文
共 50 条
  • [1] A Recognition Method of Misjudgment Gesture Based on Convolutional Neural Network
    Sun, Kaiyun
    Feng, Zhiquan
    Ai, Changsheng
    Li, Yingjun
    Wei, Jun
    Yang, Xiaohui
    Guo, Xiaopei
    [J]. 2017 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION (ICVRV 2017), 2017, : 272 - 273
  • [2] Gesture Recognition based on Deep Convolutional Neural Network
    Jayanthi, P.
    Bhama, Ponsy R. K. Sathia
    [J]. 2018 10TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (ICOAC), 2018, : 367 - 372
  • [3] Dynamic Hand Gesture Recognition via Electromyographic Signal Based on Convolutional Neural Network
    Song, Shouan
    Yang, Lei
    Wu, Man
    Liu, Yanhong
    Yu, Hongnian
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 876 - 881
  • [4] Gesture Recognition Based on Depth Information and Convolutional Neural Network
    Jiang, Du
    Li, Gongfa
    Jiang, Guozhang
    Chen, Disi
    Ju, Zhaojie
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 4041 - 4046
  • [5] An Approach for Gesture Recognition Based on a Lightweight Convolutional Neural Network
    Ravinder, M.
    Malik, Kiran
    Hassaballah, M.
    Tariq, Usman
    Javed, Kashif
    Ghoneimy, Mohamed
    [J]. INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2023, 32 (03)
  • [6] Radar Gesture Recognition Based on Lightweight Convolutional Neural Network
    Dong, Yaoyao
    Qu, Wei
    Wang, Pengda
    Jiang, Haohao
    Gao, Tianhao
    Shu, Yanhe
    [J]. SEVENTH ASIA PACIFIC CONFERENCE ON OPTICS MANUFACTURE (APCOM 2021), 2022, 12166
  • [7] Gesture recognition based on improved VGGNET convolutional neural network
    Yang Zhiqi
    [J]. PROCEEDINGS OF 2020 IEEE 5TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2020), 2020, : 1736 - 1739
  • [8] Dynamic Hand Gesture Recognition Based on 3D Convolutional Neural Network Models
    Zhang, Wenjin
    Wang, Jiacun
    [J]. PROCEEDINGS OF THE 2019 IEEE 16TH INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL (ICNSC 2019), 2019, : 224 - 229
  • [9] Dynamic gesture recognition based on 2D convolutional neural network and feature fusion
    Yu, Jimin
    Qin, Maowei
    Zhou, Shangbo
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [10] Dynamic gesture recognition based on 2D convolutional neural network and feature fusion
    Jimin Yu
    Maowei Qin
    Shangbo Zhou
    [J]. Scientific Reports, 12