Automated Gesture Recognition using Deep Learning Model for Visually Challenged People

被引:0
|
作者
Rosi, A. [1 ]
Rose, Remya S. [2 ]
Murugan, C. Arul [3 ]
Balamurugan, E. [4 ]
Priya, M. Sangeetha [5 ]
Lalitha, K. S. [6 ]
机构
[1] Vel Tech Rangarajan Dr Sagunthala R&D Inst Sci &, Dept ECE, Chennai, Tamil Nadu, India
[2] RMD Engn Coll, Dept Artificial Intelligence & Machine Learning, Chennai, Tamil Nadu, India
[3] Karpagam Coll Engn, Dept Elect & Telecommun Engn, Coimbatore, Tamil Nadu, India
[4] Bannari Amman Inst Technol, Dept Artificial Intelligence & Machine Learning, Sathyamangalam, Tamil Nadu, India
[5] Saveetha Engn Coll, Dept Comp Sci & Engn, Chennai, Tamil Nadu, India
[6] Vinayaka Missions Homoeopath Med Coll & Hosp, Dept Psychiat, Salem, Tamilnadu, India
关键词
Gesture recognition; Convolutional Neural Network; Hand gestures; Facial features; Haar Cascade classifiers; LBPH recognizer;
D O I
10.1109/ACCAI61061.2024.10602059
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Individuals with visual impairments face challenges in engaging in tasks involving surroundings, social interactions, and technologies. Moreover, individuals are experiencing challenges in being self-reliant and secure in their everyday activities. The blind people may precisely sense and react to emotions with recognition. The current application needs the integration of face and facial expression detection. Technologies seem far more sophisticated than they were in the past. It is possible to identify the communication of a deaf and visually challenged individual by recording their speech and comparing it to existing datasets, therefore determining their intentions.This research presents a system for recognizing hand gestures and faces using animated pictures and techniques. The hand gesture method identifies skin color and hand convex deformities, while the face recognition system utilizes Haar Cascade Classifiers and LBPH recognizer for identification and authentication. OpenCV is used for execution.The study achieved an accuracy rate of 96.3% in identifying hand gestures and facial features. The system is automated and operates on an artificial intelligence server.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Automated Voice Assistance for Visually Impaired People Using Deep Learning
    Preetha, J.
    Ganthimathi, M.
    Kamaleshwaran, K.
    [J]. JOURNAL OF ALGEBRAIC STATISTICS, 2022, 13 (02) : 250 - 258
  • [2] Hand Gesture Recognition system for physically challenged people using IoT
    Nair, Rajit
    Singh, Dileep Kumar
    Ashu
    Yadav, Shivam
    Bakshi, Sourabh
    [J]. 2020 6TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING AND COMMUNICATION SYSTEMS (ICACCS), 2020, : 671 - 675
  • [3] Deep Learning-Based Object Detection, Face Recognition, and Tracking Support Model for Visually Challenged
    Gupta, Manu
    Asthana, Akanksha
    Ali, Mir Amjad
    [J]. SMART TRENDS IN COMPUTING AND COMMUNICATIONS, VOL 4, SMARTCOM 2024, 2024, 948 : 173 - 185
  • [4] Automated Hand Gesture Recognition using a Deep Convolutional Neural Network model
    Dhall, Ishika
    Vashisth, Shubham
    Aggarwal, Garima
    [J]. PROCEEDINGS OF THE CONFLUENCE 2020: 10TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING, 2020, : 811 - 816
  • [5] Deep Learning Driven Arabic Text to Speech Synthesizer for Visually Challenged People
    Alnfiai, Mrim M.
    Almalki, Nabil
    Al-Wesabi, Fahd N.
    Alduhayyem, Mesfer
    Hilal, Anwer Mustafa
    Hamza, Manar Ahmed
    [J]. INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 36 (03): : 2639 - 2652
  • [6] Hand Gesture Recognition Using Deep Learning
    Hussain, Soeb
    Saxena, Rupal
    Han, Xie
    Khan, Jameel Ahmed
    Shin, Hyunchul
    [J]. PROCEEDINGS INTERNATIONAL SOC DESIGN CONFERENCE 2017 (ISOCC 2017), 2017, : 48 - 49
  • [7] An Automated Wheelchair for Physically Challenged People Using Hand Gesture and Mobile App
    Razy, Md Farhan
    Anis, Sabah Shahnoor
    Touhid, Md Touhiduzzaman
    Uddin, Jia
    [J]. INTELLIGENT HUMAN COMPUTER INTERACTION, IHCI 2020, PT II, 2021, 12616 : 135 - 144
  • [8] Face Gesture Recognition Using Deep-Learning Models
    Espinel, Andrés
    Pérez, Noel
    Riofrío, Daniel
    Benítez, Diego
    Moyano, Ricardo Flores
    [J]. 2021 IEEE Colombian Conference on Applications of Computational Intelligence, ColCACI 2021 - Proceedings, 2021,
  • [9] An Efficient Hand Gesture Recognition System Using Deep Learning
    Deepa, R.
    Sandhya, M. K.
    [J]. INTELLIGENT COMPUTING, INFORMATION AND CONTROL SYSTEMS, ICICCS 2019, 2020, 1039 : 514 - 521
  • [10] Face Gesture Recognition Using Deep-Learning Models
    Espinel, Andres
    Perez, Noel
    Riofrio, Daniel
    Benitez, Diego
    Flores Moyano, Ricardo
    [J]. 2021 IEEE COLOMBIAN CONFERENCE ON APPLICATIONS OF COMPUTATIONAL INTELLIGENCE - COLCACI, 2021,