Enhancing Communication Accessibility: A Deep Learning Approach to Gesture Recognition for the Deaf and Mute Community

被引:0
|
作者
Kandula, Ashok Reddy [1 ]
Ramachandran, Priya Darshini [1 ]
Tummalapalli, Nikhitha [1 ]
Tirukkovalluri, Krishna Priya [1 ]
Kothapalli, Kavya [1 ]
机构
[1] Seshadri Rao Gudlavalleru Engn Coll, Dept AI & DS, Gudlavalleru, India
关键词
Recurrent Neural Network; long short-term memory; OpenCV; Media pipe; Rectified Linear Unit; SoftMax; Adam Optimizer; Gesture Classification;
D O I
10.1109/ICPCSN62568.2024.00142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Though human communication is crucial, individuals with physical obstacles like deafness and naivety frequently find it challenging to communicate effectively. Utilizing sign language can be a primitive component of communication among this group. This paper suggests a creative approach to closing the communication hole by engaging the comprehension of sign dialect without the prerequisite for people to memorize it. Tallying flag recording on webcams gives a successful and straightforward means of collecting data. These hand advancements are meticulously recorded and utilized as the primitive for planning and testing models. The credibility of pushing for inclusivity exists, as does the potential for making more effective communication channels that cater to assorted social classes. Sign tongue isn't a burdensome errand due to the effortlessness of this procedure, which makes communication less demanding. Through this unused approach, social instinct will progress through predominant communication, frequent understanding, and support among particular levels of society. In this way, this movement has the potential to begin noteworthy updates in interpersonal associations, develop inclusivity, and address existing boundaries for fruitful communication. This research work attempted it more than once and were attained a better accuracy of 90%.
引用
收藏
页码:842 / 849
页数:8
相关论文
共 50 条
  • [41] An Efficient Hand Gesture Recognition System Using Deep Learning
    Deepa, R.
    Sandhya, M. K.
    INTELLIGENT COMPUTING, INFORMATION AND CONTROL SYSTEMS, ICICCS 2019, 2020, 1039 : 514 - 521
  • [42] Deep Learning for Gesture Recognition based on Surface EMG Data
    Fukano, Kaichi
    Iiazawa, Kazuma
    Soeda, Takuto
    Shirai, Aya
    Capi, Genci
    2021 INTERNATIONAL CONFERENCE ON ADVANCED MECHATRONIC SYSTEMS (ICAMECHS), 2021, : 41 - 45
  • [43] Deep Learning with Attention on Hand Gesture Recognition Based on sEMG
    Zhao, Huanjun
    Zheng, Bin
    Wang, Le
    2022 PROGNOSTICS AND HEALTH MANAGEMENT CONFERENCE, PHM-LONDON 2022, 2022, : 316 - 320
  • [44] Intersected EMG Heatmaps and Deep Learning Based Gesture Recognition
    Ke, Weijie
    Xing, Yannan
    Di Caterina, Gaetano
    Petropoulakis, Lykourgos
    Soraghan, John
    ICMLC 2020: 2020 12TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING, 2018, : 73 - 78
  • [45] EMG based Hand Gesture Recognition using Deep Learning
    Ozdemir, Mehmet Akif
    Kisa, Deniz Hande
    Guren, Onan
    Onan, Aytug
    Akan, Aydin
    2020 MEDICAL TECHNOLOGIES CONGRESS (TIPTEKNO), 2020,
  • [46] A fully connected deep learning approach to upper limb gesture recognition in a secure FES rehabilitation environment
    Liu, Qi
    Wu, Xueyan
    Jiang, Yinghang
    Liu, Xiaodong
    Zhang, Yonghong
    Xu, Xiaolong
    Qi, Lianyong
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2021, 36 (05) : 2387 - 2411
  • [47] Hand Gesture Communication using Deep Learning based on Relevance Theory
    Dou, Wen Bang
    Chin, Wei Hong
    Kubota, Naoyuki
    2020 JOINT 11TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS AND 21ST INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (SCIS-ISIS), 2020, : 132 - 136
  • [48] Deep Learning Based Hand Gesture Recognition and UAV Flight Controls
    Bin Hu
    Jiacun Wang
    International Journal of Automation and Computing, 2020, 17 (01) : 17 - 29
  • [49] Deep Learning Based Hand Gesture Recognition and UAV Flight Controls
    Hu, Bin
    Wang, Jiacun
    INTERNATIONAL JOURNAL OF AUTOMATION AND COMPUTING, 2020, 17 (01) : 17 - 29
  • [50] Deep learning in vision-based static hand gesture recognition
    Oyebade K. Oyedotun
    Adnan Khashman
    Neural Computing and Applications, 2017, 28 : 3941 - 3951