Automated Voice Assistance for Visually Impaired People Using Deep Learning

被引:0
|
作者
Preetha, J. [1 ]
Ganthimathi, M. [1 ]
Kamaleshwaran, K. [1 ]
机构
[1] Muthayammal Engn Coll, Dept Comp Sci & Engn, Namakkal, Tamil Nadu, India
关键词
object classification; Automate the vision process; Single-Shot Detector Model; pyttsx3; GTTS;
D O I
暂无
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Vision loss in the elderly is a major health problem. In past years, the main choice of visually impaired people is a spectacular glasses. Today's assistive technology tools include not only better magnifying devices, but also advanced computing software, applications, and other use cases that use facial recognition, artificial intelligence, and other technologies to visibly improve the lives of the visually impaired. In these modern days, many developments have been madeto improve the quality of life of the visually impaired. These people face many challenges in performing their daily tasks, including discovering themselves in an unfamiliar environmental circumstance. They cannot distinguish the objects around them and cannot accurately perceive the objects that around them most of the time. Keeping this in mind, With the advancement in the deep learning frameworks like computer vision techniques assist the visually impaired. In this paper, our goal is to providing the automated way that the people can get the knowledge of the facing objects in realtime by voice feedback. And also they get the position of the objects in front of them. We adopted the Mobilenet SingleShot Detector, a deep learning multi-label detection model for classifying theobjects. Besides, the model determines the position of object in the frame and finally generates an audio signal as output to notify the visually-impaired people. This system provides a novel way of assisting visually challenged people.
引用
收藏
页码:250 / 258
页数:9
相关论文
共 50 条
  • [31] Study for acceptance on new navigation assistance by visually impaired people
    Paajala, Iikka J.
    Keranen, Niina
    2015 9TH INTERNATIONAL SYMPOSIUM ON MEDICAL INFORMATION AND COMMUNICATION TECHNOLOGY (ISMICT), 2015, : 64 - 67
  • [32] Deep Learning-Based Positioning of Visually Impaired People in Indoor Environments
    Mahida, Payal
    Shahrestani, Seyed
    Cheung, Hon
    SENSORS, 2020, 20 (21) : 1 - 18
  • [33] A Deep Learning Based Wearable Medicines Recognition System for Visually Impaired People
    Chang, Wan-Jung
    Yu, Yue-Xun
    Chen, Jhen-Hao
    Zhang, Zhi-Yao
    Ko, Sung-Jie
    Yang, Tsung-Han
    Hsu, Chia-Hao
    Chen, Liang-Bi
    Chen, Ming-Che
    2019 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2019), 2019, : 207 - 208
  • [34] Generation of photorealistic tactile maps for visually impaired people through deep learning
    Fillieres-Riveau, Gauthier
    Favreau, Jean-Marie
    Barra, Vincent
    Touya, Guillaume
    REVUE INTERNATIONALE DE GEOMATIQUE, 2020, 30 (1-2): : 105 - 126
  • [35] iSeePlus : A cost effective smart assistance archetype based on deep learning model for visually impaired
    Virmani, Deepali
    Gupta, Charu
    Bamdev, Pakhi
    Jain, Prateek
    JOURNAL OF INFORMATION & OPTIMIZATION SCIENCES, 2020, 41 (07): : 1741 - 1756
  • [36] A Cost-Effective Voice Controlled Electronic Braille for Independent Learning of Visually Impaired People
    Adnan, Md Ehtesham
    Alam, Mir Md Nur E.
    Monira, Jannatul Ferdousi Sirajum
    Islam, Mohammad Rezaul
    2020 IEEE REGION 10 SYMPOSIUM (TENSYMP) - TECHNOLOGY FOR IMPACTFUL SUSTAINABLE DEVELOPMENT, 2020, : 1317 - 1320
  • [37] Visually Impaired People Learning Virtual Textures Through Multimodal Feedback Combining Vibrotactile and Voice
    Chen, Dapeng
    Ding, Yi
    Wu, Hao
    Jia, Qi
    Zeng, Hong
    Wei, Lina
    Hua, Chengcheng
    Liu, Jia
    Song, Aiguo
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2025, 33 : 453 - 465
  • [38] AUTOMATED GESTURE RECOGNITION USING ARTIFICIAL RABBITS OPTIMIZATION WITH DEEP LEARNING FOR ASSISTING VISUALLY CHALLENGED PEOPLE
    Marzouk, Radwa
    Aldehim, Ghadah
    Al-Hagery, Mohammed abdullah
    Hilal, Anwer mustafa
    Alneil, Amani a.
    FRACTALS-COMPLEX GEOMETRY PATTERNS AND SCALING IN NATURE AND SOCIETY, 2024,
  • [39] Assistance For Visually Impaired Using Finger-Tip Text Reader Using Machine Learning
    Kowshik, S.
    Gautam, V. R.
    Suganthi, K.
    2019 11TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (ICOAC 2019), 2019, : 7 - 12
  • [40] DIRECTORY ASSISTANCE FOR THE VISUALLY IMPAIRED
    COLANGELO, RD
    COLBERT, MA
    MCKEEMAN, JC
    PROCEEDINGS : THE TWENTY-FIRST SOUTHEASTERN SYMPOSIUM ON SYSTEM THEORY, 1989, : 564 - 566