Automated Voice Assistance for Visually Impaired People Using Deep Learning

被引:0
|
作者
Preetha, J. [1 ]
Ganthimathi, M. [1 ]
Kamaleshwaran, K. [1 ]
机构
[1] Muthayammal Engn Coll, Dept Comp Sci & Engn, Namakkal, Tamil Nadu, India
关键词
object classification; Automate the vision process; Single-Shot Detector Model; pyttsx3; GTTS;
D O I
暂无
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Vision loss in the elderly is a major health problem. In past years, the main choice of visually impaired people is a spectacular glasses. Today's assistive technology tools include not only better magnifying devices, but also advanced computing software, applications, and other use cases that use facial recognition, artificial intelligence, and other technologies to visibly improve the lives of the visually impaired. In these modern days, many developments have been madeto improve the quality of life of the visually impaired. These people face many challenges in performing their daily tasks, including discovering themselves in an unfamiliar environmental circumstance. They cannot distinguish the objects around them and cannot accurately perceive the objects that around them most of the time. Keeping this in mind, With the advancement in the deep learning frameworks like computer vision techniques assist the visually impaired. In this paper, our goal is to providing the automated way that the people can get the knowledge of the facing objects in realtime by voice feedback. And also they get the position of the objects in front of them. We adopted the Mobilenet SingleShot Detector, a deep learning multi-label detection model for classifying theobjects. Besides, the model determines the position of object in the frame and finally generates an audio signal as output to notify the visually-impaired people. This system provides a novel way of assisting visually challenged people.
引用
收藏
页码:250 / 258
页数:9
相关论文
共 50 条
  • [1] An Intelligent Voice Assistance System for Visually Impaired using Deep Learning
    Varghese, Renju Rachel
    Jacob, Pramod Mathew
    Shaji, Midhun
    Abhijith, R.
    John, Emil Saji
    Philip, Sebin Beebi
    [J]. 2022 INTERNATIONAL CONFERENCE ON DECISION AID SCIENCES AND APPLICATIONS (DASA), 2022, : 449 - 453
  • [2] Obstacle Detection System for Navigation Assistance of Visually Impaired People Based on Deep Learning Techniques
    Said, Yahia
    Atri, Mohamed
    Albahar, Marwan Ali
    Ben Atitallah, Ahmed
    Alsariera, Yazan Ahmad
    [J]. SENSORS, 2023, 23 (11)
  • [3] Voicemoji: Emoji Entry Using Voice for Visually Impaired People
    Zhang, Mingrui Ray
    Wang, Ruolin
    Xu, Xuhai
    Li, Qisheng
    Sharif, Ather
    Wobbrock, Jacob O.
    [J]. CHI '21: PROCEEDINGS OF THE 2021 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2021,
  • [4] Automated Gesture Recognition using Deep Learning Model for Visually Challenged People
    Rosi, A.
    Rose, Remya S.
    Murugan, C. Arul
    Balamurugan, E.
    Priya, M. Sangeetha
    Lalitha, K. S.
    [J]. 2024 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATION AND APPLIED INFORMATICS, ACCAI 2024, 2024,
  • [5] Visually Impaired People Positioning Assistance System Using Artificial Intelligence
    Lima, Rui
    Barreto, Luis
    Amaral, Antonio
    Paiva, Sara
    [J]. IEEE SENSORS JOURNAL, 2023, 23 (07) : 7758 - 7765
  • [6] A Navigation Device with Voice for Visually Impaired People
    Nehal, S. K.
    Obheroi, Rajat Kumar
    Anand, Ajay
    Rana, Haneet
    [J]. INTELLIGENT COMMUNICATION, CONTROL AND DEVICES, ICICCD 2017, 2018, 624 : 1369 - 1380
  • [7] Assistive Navigation Using Deep Reinforcement Learning Guiding Robot With UWB/Voice Beacons and Semantic Feedbacks for Blind and Visually Impaired People
    Lu, Chen-Lung
    Liu, Zi-Yan
    Huang, Jui-Te
    Huang, Ching-, I
    Wang, Bo-Hui
    Chen, Yi
    Wu, Nien-Hsin
    Wang, Hsueh-Cheng
    Giarre, Laura
    Kuo, Pei-Yi
    [J]. FRONTIERS IN ROBOTICS AND AI, 2021, 8
  • [8] Smart Electronic Cane for the Assistance of Visually Impaired People
    Salat, Sidratul
    Habib, Mohammad Ashfak
    [J]. 2019 5TH IEEE INTERNATIONAL WIE CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (WIECON-ECE 2019), 2019,
  • [9] IoT based Smart Assistance for Visually Impaired People
    Singh, Himanshu
    Kumar, Harsh
    Sabarivelan, S.
    Kumar, Amit
    Rai, Prakhar
    Sitharthan, R.
    [J]. 2023 9TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENERGY SYSTEMS, ICEES, 2023, : 118 - 122
  • [10] Mental Health Evaluation and Assistance for Visually Impaired People
    Pandey, Kavita
    Pandey, Dhiraj
    [J]. EAI ENDORSED TRANSACTIONS ON SCALABLE INFORMATION SYSTEMS, 2023, 10 (04): : 1 - 9