Gesture recognition of graph convolutional neural network based on spatial domain

被引:0
|
作者
Hong Chen
Hongdong Zhao
Baoqiang Qi
Shuai Zhang
Zhanghong Yu
机构
[1] Hebei University of Technology,School of Electronic and Information Engineering
[2] Hebei Normal University of Science and Technology,School of Mathematics and Information Technology
[3] Qinhuangdao Institute of Technology,Department of Information Engineering
来源
关键词
Graph convolutional neural network; Gesture recognition; Graph-SAGE model; Cascade classifier;
D O I
暂无
中图分类号
学科分类号
摘要
With the iterative update of computer technology, the penetration of computer and other Internet technologies in human–computer interaction systems has become more and more extensive, and the human–computer interaction methods have quietly undergone huge changes. Gesture recognition has gradually become a hot spot in the field of human–computer interaction now, which has a wide range of application prospects and research value. The color segmentation experiment shows that the skin color of the gesture in the YCrCg space has better clustering properties than in the YCrCb space. In the preprocessing of gesture images, an improved Otsu method is proposed to improve the real-time performance to realize the threshold segmentation of the human hand; then the morphological processing is carried out, and the median filter method is used to achieve image denoising to improve image quality. A gesture recognition algorithm is designed: First, use Graph-SAGE to recognize the graph-structured data of the gesture, and then use the Adaboost algorithm to combine the two strong classifiers of the random forest and the support vector machine into a cascade classifier through the cascade structure. The output information of Graph-SAGE is classified and the meaning of the gesture is analyzed. On the test set, the average detection accuracy of the algorithm is 91.70%, the recall rate is 94.23%, and the average detection time per frame is 330 ms.
引用
收藏
页码:2157 / 2167
页数:10
相关论文
共 50 条
  • [1] Gesture recognition of graph convolutional neural network based on spatial domain
    Chen, Hong
    Zhao, Hongdong
    Qi, Baoqiang
    Zhang, Shuai
    Yu, Zhanghong
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (03): : 2157 - 2167
  • [2] Graph Convolutional Neural Network Gesture Recognition Based on Pooling Algorithm
    Chen, Hong
    Qi, Baoqiang
    Zhao, Hongdong
    [J]. JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2022, 31 (15)
  • [3] Spatial-Temporal Graph Neural Network based Hand Gesture Recognition
    Yuan, Guan
    Bing, Rui
    Liu, Xiao
    Dai, Wei
    Zhang, Yan-Mei
    Cai, Zhuo
    [J]. Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (04): : 921 - 931
  • [4] Gesture Recognition based on Deep Convolutional Neural Network
    Jayanthi, P.
    Bhama, Ponsy R. K. Sathia
    [J]. 2018 10TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (ICOAC), 2018, : 367 - 372
  • [5] Convolutional neural network with spatial pyramid pooling for hand gesture recognition
    Tan, Yong Soon
    Lim, Kian Ming
    Tee, Connie
    Lee, Chin Poo
    Low, Cheng Yaw
    [J]. NEURAL COMPUTING & APPLICATIONS, 2021, 33 (10): : 5339 - 5351
  • [6] Convolutional neural network with spatial pyramid pooling for hand gesture recognition
    Yong Soon Tan
    Kian Ming Lim
    Connie Tee
    Chin Poo Lee
    Cheng Yaw Low
    [J]. Neural Computing and Applications, 2021, 33 : 5339 - 5351
  • [7] Gesture Recognition Based on Depth Information and Convolutional Neural Network
    Jiang, Du
    Li, Gongfa
    Jiang, Guozhang
    Chen, Disi
    Ju, Zhaojie
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 4041 - 4046
  • [8] An Approach for Gesture Recognition Based on a Lightweight Convolutional Neural Network
    Ravinder, M.
    Malik, Kiran
    Hassaballah, M.
    Tariq, Usman
    Javed, Kashif
    Ghoneimy, Mohamed
    [J]. INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2023, 32 (03)
  • [9] Dynamic gesture recognition method based on convolutional neural network
    Xu, Xiaoyu
    Deng, Lizhen
    Meng, Qingmin
    [J]. 2019 INTERNATIONAL CONFERENCE ON INTERNET OF THINGS (ITHINGS) AND IEEE GREEN COMPUTING AND COMMUNICATIONS (GREENCOM) AND IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING (CPSCOM) AND IEEE SMART DATA (SMARTDATA), 2019, : 389 - 394
  • [10] Gesture recognition based on improved VGGNET convolutional neural network
    Yang Zhiqi
    [J]. PROCEEDINGS OF 2020 IEEE 5TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2020), 2020, : 1736 - 1739