A novel feature fusion technique for robust hand gesture recognition

被引:1
|
作者
Balmik, Archana [1 ]
Sunanda [1 ]
Nandy, Anup [1 ]
机构
[1] Natl Inst Technol Rourkela, Dept Comp Sci & Engn, Machine Intelligence & Biomot Lab, Rourkela, India
关键词
Hand detection; Hand gesture recognition; Feature extraction; Feature fusion; AlexNet;
D O I
10.1007/s11042-024-18173-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Gesture recognition has emerged as a crucial field of research due to its wide range of applications, such as human-computer interaction, sign language interpretation, and virtual reality. In this research work, a robust framework for hand gesture recognition is developed. The publicly available dataset, i.e., the Multi-Modal Hand Gesture dataset, is used. To achieve effective classification of hand gestures, a series of preprocessing techniques are employed to enhance the image quality. The Haar wavelet transform (HWT) and Local Binary Pattern (LBP) techniques are utilized for feature fusion, extracting both global and local texture information. This fusion of features maximizes the discriminative power of the classification model. In addition, the original AlexNet model architecture is modified, now referred to as the AlexNet-11 Layer model, by incorporating additional layers that effectively learn the patterns and fused features. As a result, the proposed approach achieves a remarkable accuracy of 97.38%, outperforming the state-of-the-art methods, which achieved accuracies of 96.5%, 96% and 82%. This significant improvement showcases the effectiveness of the proposed approach in advancing the field of gesture recognition and image classification.
引用
收藏
页码:65815 / 65831
页数:17
相关论文
共 50 条
  • [31] Continuous, Robust Hand Gesture Recognition for Embedded Devices
    Satya, Ujwal Bachiraju Venkata
    Peddigari, Venkat R.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS-ASIA (ICCE-ASIA), 2017, : 117 - 120
  • [32] Fusion of kinematic and physiological sensors for hand gesture recognition
    Wang, Aiguo
    Liu, Huancheng
    Zheng, Chundi
    Chen, Huihui
    Chang, Chih-Yung
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (26) : 68013 - 68040
  • [33] Static Hand Gesture Recognition Based on Fusion of Moments
    Chatterjee, Subhamoy
    Ghosh, Dipak Kumar
    Ari, Samit
    [J]. INTELLIGENT COMPUTING, COMMUNICATION AND DEVICES, 2015, 309 : 429 - 434
  • [34] Applying a Novel Feature Set Fusion Technique to Facial Recognition
    Devlin, Paul
    Halom, Matt
    Ahmad, Ishfaq
    [J]. 2019 2ND INTERNATIONAL CONFERENCE ON DATA INTELLIGENCE AND SECURITY (ICDIS 2019), 2019, : 76 - 81
  • [35] ISL Gesture Recognition Using Multiple Feature Fusion
    Bora, Riya
    Bisht, Ankita
    Saini, Aradhya
    Gupta, Tanu
    Mittal, Ankush
    [J]. 2017 2ND IEEE INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, SIGNAL PROCESSING AND NETWORKING (WISPNET), 2017, : 196 - 199
  • [36] Gesture recognition with feature fusion using FMCW radar
    Chen, Tianyang
    Dong, Xichao
    Chen, Yaowen
    [J]. SEVENTH ASIA PACIFIC CONFERENCE ON OPTICS MANUFACTURE (APCOM 2021), 2022, 12166
  • [37] Gesture recognition based on multilevel multimodal feature fusion
    Tian, Jinrong
    Cheng, Wentao
    Sun, Ying
    Li, Gongfa
    Jiang, Du
    Jiang, Guozhang
    Tao, Bo
    Zhao, Haoyi
    Chen, Disi
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 38 (03) : 2539 - 2550
  • [38] Novel Segmentation Algorithm for Hand Gesture Recognition
    Dhruva, N.
    Rupanagudi, Sudhir Rao
    Sachin, S. K.
    Sthuthi, B.
    Pavithra, R.
    Raghavendra
    [J]. 2013 IEEE INTERNATIONAL MULTI CONFERENCE ON AUTOMATION, COMPUTING, COMMUNICATION, CONTROL AND COMPRESSED SENSING (IMAC4S), 2013, : 383 - 388
  • [39] Gesture Recognition and Multi-modal Fusion on a New Hand Gesture Dataset
    Schak, Monika
    Gepperth, Alexander
    [J]. PATTERN RECOGNITION APPLICATIONS AND METHODS, ICPRAM 2021, ICPRAM 2022, 2023, 13822 : 76 - 97
  • [40] Hand gesture recognition using two-level speed normalization, feature selection and classifier fusion
    Singha, Joyeeta
    Laskar, Rabul Hussain
    [J]. MULTIMEDIA SYSTEMS, 2017, 23 (04) : 499 - 514