A novel feature fusion technique for robust hand gesture recognition

被引:1
|
作者
Balmik, Archana [1 ]
Sunanda [1 ]
Nandy, Anup [1 ]
机构
[1] Natl Inst Technol Rourkela, Dept Comp Sci & Engn, Machine Intelligence & Biomot Lab, Rourkela, India
关键词
Hand detection; Hand gesture recognition; Feature extraction; Feature fusion; AlexNet;
D O I
10.1007/s11042-024-18173-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Gesture recognition has emerged as a crucial field of research due to its wide range of applications, such as human-computer interaction, sign language interpretation, and virtual reality. In this research work, a robust framework for hand gesture recognition is developed. The publicly available dataset, i.e., the Multi-Modal Hand Gesture dataset, is used. To achieve effective classification of hand gestures, a series of preprocessing techniques are employed to enhance the image quality. The Haar wavelet transform (HWT) and Local Binary Pattern (LBP) techniques are utilized for feature fusion, extracting both global and local texture information. This fusion of features maximizes the discriminative power of the classification model. In addition, the original AlexNet model architecture is modified, now referred to as the AlexNet-11 Layer model, by incorporating additional layers that effectively learn the patterns and fused features. As a result, the proposed approach achieves a remarkable accuracy of 97.38%, outperforming the state-of-the-art methods, which achieved accuracies of 96.5%, 96% and 82%. This significant improvement showcases the effectiveness of the proposed approach in advancing the field of gesture recognition and image classification.
引用
收藏
页码:65815 / 65831
页数:17
相关论文
共 50 条
  • [1] Hand gesture recognition based on attentive feature fusion
    Yu, Bin
    Luo, Zhiming
    Wu, Huangbin
    Li, Shaozi
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (22):
  • [2] Hand Gesture Recognition Based on Multi Feature Fusion
    Yang, Hongling
    Xuan, Shibin
    Mo, Yuanbin
    [J]. ADVANCES IN SWARM INTELLIGENCE, ICSI 2018, PT II, 2018, 10942 : 389 - 398
  • [3] RPFNET: COMPLEMENTARY FEATURE FUSION FOR HAND GESTURE RECOGNITION
    Kim, Do Yeon
    Kim, Dae Ha
    Song, Byung Cheol
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 986 - 990
  • [4] Fast and robust dynamic hand gesture recognition via key frames extraction and feature fusion
    Tang, Hao
    Liu, Hong
    Xiao, Wei
    Sebe, Nicu
    [J]. NEUROCOMPUTING, 2019, 331 : 424 - 433
  • [5] Feature Fusion of sEMG and Ultrasound Signals in Hand Gesture Recognition
    Zeng, Jia
    Zhou, Yu
    Yang, Yicheng
    Wang, Jiaole
    Liu, Honghai
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 3911 - 3916
  • [6] A novel concatenate feature fusion RCNN architecture for sEMG-based hand gesture recognition
    Xu, Pufan
    Li, Fei
    Wang, Haipeng
    [J]. PLOS ONE, 2022, 17 (01):
  • [7] Feature Fusion Based Hand Gesture Recognition Method for Automotive Interfaces
    XU Qianyi
    QIN Guihe
    SUN Minghui
    YAN Jie
    JIANG Huiming
    ZHANG Zhonghan
    [J]. Chinese Journal of Electronics, 2020, 29 (06) : 1153 - 1164
  • [8] Deep Feature Extraction and Multi-feature Fusion for Similar Hand Gesture Recognition
    Xie, Cunhuang
    Yu, Li
    Wang, Shengwei
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP), 2018,
  • [9] Fusion of Inertial and Depth Sensor Data for Robust Hand Gesture Recognition
    Liu, Kui
    Chen, Chen
    Jafari, Roozbeh
    Kehtarnavaz, Nasser
    [J]. IEEE SENSORS JOURNAL, 2014, 14 (06) : 1898 - 1903
  • [10] Robust human gesture recognition by leveraging multi-scale feature fusion
    Deng, Minwei
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 83