Study of Convolutional Neural Network in Recognizing Static American Sign Language

被引:0
|
作者
Bin, Lee Yi [1 ]
Huann, Goh Yeh [1 ]
Yun, Lum Kin [1 ]
机构
[1] Tunku Abdul Rahman Univ Coll, Fac Engn & Technol, Dept Mech Engn, Kuala Lumpur, Malaysia
关键词
Convolutional Neural Network; American Sign Language; Machine Learning; Computer Vision;
D O I
10.1109/icsipa45851.2019.8977767
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sign language is a form of communication language to connect a deaf-mute person to the world. It involves the uses of hand gestures and body movement in order to express an idea. Nevertheless, general publics are mostly not educated to comprehend the sign language. For this reason, there is a need to have a translator to facilitate the communication. This paper would like to present a Convolutional Neural Network (CNN) model for predicting American Sign Language. There are 4800 images were captured to train and validate the proposed model. 95% recognition accuracy was attained in experiment, which shows robust performance in recognition 24 static American Sign Language pattern. The successful development of this model can be served as the basis to develop a more complicated sign language translator.
引用
收藏
页码:41 / 45
页数:5
相关论文
共 50 条
  • [21] Bengali Sign Language Recognition Using Deep Convolutional Neural Network
    Hossen, M. A.
    Govindaiah, Arun
    Sultana, Sadia
    Bhuiyan, Alauddin
    2018 JOINT 7TH INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS & VISION (ICIEV) AND 2018 2ND INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR), 2018, : 369 - 373
  • [22] A wearable system for sign language recognition enabled by a convolutional neural network
    Liu, Yuxuan
    Jiang, Xijun
    Yu, Xingge
    Ye, Huaidong
    Ma, Chao
    Wang, Wanyi
    Hu, Youfan
    NANO ENERGY, 2023, 116
  • [23] Ethiopian sign language recognition using deep convolutional neural network
    Bekalu Tadele Abeje
    Ayodeji Olalekan Salau
    Abreham Debasu Mengistu
    Nigus Kefyalew Tamiru
    Multimedia Tools and Applications, 2022, 81 : 29027 - 29043
  • [24] Sign Language Learning System with Image Sampling and Convolutional Neural Network
    Ji, Yangho
    Kim, Sunmok
    Lee, Ki-Baek
    2017 FIRST IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING (IRC), 2017, : 371 - 375
  • [25] Ethiopian sign language recognition using deep convolutional neural network
    Abeje, Bekalu Tadele
    Salau, Ayodeji Olalekan
    Mengistu, Abreham Debasu
    Tamiru, Nigus Kefyalew
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (20) : 29027 - 29043
  • [26] A Modern Approach for Sign Language Interpretation Using Convolutional Neural Network
    Paul, Pias
    Bhuiya, Moh. Anwar-Ul-Azim
    Ullah, Md. Ayat
    Saqib, Molla Nazmus
    Mohammed, Nabeel
    Momen, Sifat
    PRICAI 2019: TRENDS IN ARTIFICIAL INTELLIGENCE, PT III, 2019, 11672 : 431 - 444
  • [27] Sign Language Numeral Gestures Recognition Using Convolutional Neural Network
    Gruber, Ivan
    Ryumin, Dmitry
    Hruz, Marek
    Karpov, Alexey
    INTERACTIVE COLLABORATIVE ROBOTICS, ICR 2018, 2018, 11097 : 70 - 77
  • [28] Sign Language Gesture to Speech Conversion Using Convolutional Neural Network
    Tope, Shreya
    Gomkar, Sadnyani
    Rathkanthiwar, Pukhraj
    Ganguli, Aayushi
    Selokar, Pradip R.
    INTERNATIONAL JOURNAL OF NEXT-GENERATION COMPUTING, 2023, 14 (01): : 24 - 29
  • [29] Sign Language Recognition Using Modified Convolutional Neural Network Model
    Suharjito
    Gunawan, Herman
    Thiracitta, Narada
    Nugroho, Ariadi
    2018 INDONESIAN ASSOCIATION FOR PATTERN RECOGNITION INTERNATIONAL CONFERENCE (INAPR), 2018, : 1 - 5
  • [30] Arabic and American Sign Languages Alphabet Recognition by Convolutional Neural Network
    Alshomrani, Shroog
    Aljoudi, Lina
    Arif, Muhammad
    ADVANCES IN SCIENCE AND TECHNOLOGY-RESEARCH JOURNAL, 2021, 15 (04) : 136 - 148