Vision-based Hand Gesture Recognition for Indian Sign Language Using Convolution Neural Network

被引：15
|
作者：
Gangrade, Jayesh [1 ,2 ]
Bharti, Jyoti [3 ]
机构：
[1] IES Indore, Maunala Azad Natl Inst Technol Bhopal, Indore, India
[2] IES Indore, IPS Acad, Indore, India
[3] Maunala Azad Natl Inst Technol, Dept Comp Sci & Engn, Bhopal, India
来源：
IETE JOURNAL OF RESEARCH | 2023年 / 69卷 / 02期
关键词：
Convolution neural network (CNN); Hard of hearing (HoH); Indian sign language (ISL); Microsoft Kinect sensor;
D O I：
10.1080/03772063.2020.1838342
中图分类号：
TM [电工技术]; TN [电子技术、通信技术];
学科分类号：
0808 ; 0809 ;
摘要：
Hearing-impaired people can interact with other people through sign language. The proposed system tears down the communication barrier between Hard of hearing (HoH) community and those who do not know their sign language. In this paper, we have developed an algorithm to detect and segment the hand region from a depth image using the Microsoft Kinect sensor. The proposed algorithm works well in the cluttered environment, e.g. skin color background and hand overlaps the face. Convolution Neural networks (CNN) are applied to automatically construct features from Indian sign language (ISL) signs. These features are invariant to rotation and scaling. The proposed system recognizes gestures accurately up to 99.3%.
引用
收藏
页码：723 / 732
页数：10
相关论文
共 50 条
  • [21] On an algorithm for Vision-based hand gesture recognition
    Dipak Kumar Ghosh
    Samit Ari
    [J]. Signal, Image and Video Processing, 2016, 10 : 655 - 662
  • [22] VISION BASED MULTI-FEATURE HAND GESTURE RECOGNITION FOR INDIAN SIGN LANGUAGE MANUAL SIGNS
    Kharate, Gajanan K.
    Ghotkar, Archana S.
    [J]. INTERNATIONAL JOURNAL ON SMART SENSING AND INTELLIGENT SYSTEMS, 2016, 9 (01) : 123 - 145
  • [23] Wide Residual Network for Vision-based Static Hand Gesture Recognition
    Tan, Yong Soon
    Lim, Kian Ming
    Lee, Chin Poo
    [J]. IAENG International Journal of Computer Science, 2021, 48 (04):
  • [24] Visual Hand Gesture Recognition with Convolution Neural Network
    Han, Mengmeng
    Chen, Jiajun
    Li, Ling
    Chang, Yuchun
    [J]. 2016 17TH IEEE/ACIS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ARTIFICIAL INTELLIGENCE, NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING (SNPD), 2016, : 287 - 291
  • [25] Static Hand Gesture Recognition for American Sign Language using Deep Convolutional Neural Network
    Das, Prangon
    Ahmed, Tanvir
    Ali, Md Firoj
    [J]. 2020 IEEE REGION 10 SYMPOSIUM (TENSYMP) - TECHNOLOGY FOR IMPACTFUL SUSTAINABLE DEVELOPMENT, 2020, : 762 - 765
  • [26] Sign to Speech Convolutional Neural Network-Based Filipino Sign Language Hand Gesture Recognition System
    Jarabese, Mark Benedict D.
    Marzan, Charlie S.
    Boado, Jenelyn Q.
    Lopez, Rushaine Rica Mae F.
    Ofiana, Lady Grace B.
    Pilarca, Kenneth John P.
    [J]. 2021 INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE AND INTELLIGENT CONTROLS (ISCSIC 2021), 2021, : 147 - 153
  • [27] Static and Dynamic Hand Gesture Recognition for Indian Sign Language
    Susitha, A.
    Geetha, N.
    Suhirtha, R.
    Swetha, A.
    [J]. MACHINE LEARNING AND BIG DATA ANALYTICS (PROCEEDINGS OF INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND BIG DATA ANALYTICS (ICMLBDA) 2021), 2022, 256 : 48 - 66
  • [28] Hand Gesture Classification for Sign Language Using Artificial Neural Network
    Rahagiyanto, Angga
    Basuki, Achmad
    Sigit, Riyanto
    Anwar, Aditiya
    Zikky, Moh
    [J]. 2017 21ST INTERNATIONAL COMPUTER SCIENCE AND ENGINEERING CONFERENCE (ICSEC 2017), 2017, : 205 - 209
  • [29] Recent methods in vision-based hand gesture recognition
    Badi H.
    [J]. Badi, Haitham (haitham@siswa.um.edu.my), 1600, Springer Science and Business Media Deutschland GmbH (01): : 77 - 87
  • [30] Survey on vision-based dynamic hand gesture recognition
    Tripathi, Reena
    Verma, Bindu
    [J]. VISUAL COMPUTER, 2024, 40 (09): : 6171 - 6199
12345