Automated Voice Assistance for Visually Impaired People Using Deep Learning

被引:0
|
作者
Preetha, J. [1 ]
Ganthimathi, M. [1 ]
Kamaleshwaran, K. [1 ]
机构
[1] Muthayammal Engn Coll, Dept Comp Sci & Engn, Namakkal, Tamil Nadu, India
关键词
object classification; Automate the vision process; Single-Shot Detector Model; pyttsx3; GTTS;
D O I
暂无
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Vision loss in the elderly is a major health problem. In past years, the main choice of visually impaired people is a spectacular glasses. Today's assistive technology tools include not only better magnifying devices, but also advanced computing software, applications, and other use cases that use facial recognition, artificial intelligence, and other technologies to visibly improve the lives of the visually impaired. In these modern days, many developments have been madeto improve the quality of life of the visually impaired. These people face many challenges in performing their daily tasks, including discovering themselves in an unfamiliar environmental circumstance. They cannot distinguish the objects around them and cannot accurately perceive the objects that around them most of the time. Keeping this in mind, With the advancement in the deep learning frameworks like computer vision techniques assist the visually impaired. In this paper, our goal is to providing the automated way that the people can get the knowledge of the facing objects in realtime by voice feedback. And also they get the position of the objects in front of them. We adopted the Mobilenet SingleShot Detector, a deep learning multi-label detection model for classifying theobjects. Besides, the model determines the position of object in the frame and finally generates an audio signal as output to notify the visually-impaired people. This system provides a novel way of assisting visually challenged people.
引用
收藏
页码:250 / 258
页数:9
相关论文
共 50 条
  • [41] Identification of Visually Impaired Person with Deep Learning
    Fujisawa, Shoichiro
    Mandai, Ranmaru
    Kurozumi, Ryota
    Ito, Shin-ichi
    Sato, Katsuya
    INTELLIGENT HUMAN SYSTEMS INTEGRATION, IHSI 2018, 2018, 722 : 601 - 607
  • [42] Enhancing Education and Interaction for the Visually Impaired Using Deep Learning and IoT
    Dash, Sanjit Kumar
    Biswal, Rudra Madhav
    Misra, Aisurya
    Swain, Rajesh
    Ray, Saswat
    Mishra, Jibitesh
    INTERNATIONAL JOURNAL OF MOBILE HUMAN COMPUTER INTERACTION, 2021, 13 (01) : 1 - 16
  • [43] Object detection and recognition: using deep learning to assist the visually impaired
    Bhandari, Abinash
    Prasad, P. W. C.
    Alsadoon, Abeer
    Maag, Angelika
    DISABILITY AND REHABILITATION-ASSISTIVE TECHNOLOGY, 2021, 16 (03) : 280 - 288
  • [44] Deep learning for detecting visually impaired cataracts using fundus images
    Xie, He
    Li, Zhongwen
    Wu, Chengchao
    Zhao, Yitian
    Lin, Chengmin
    Wang, Zhouqian
    Wang, Chenxi
    Gu, Qinyi
    Wang, Minye
    Zheng, Qinxiang
    Jiang, Jiewei
    Chen, Wei
    FRONTIERS IN CELL AND DEVELOPMENTAL BIOLOGY, 2023, 11
  • [45] Smart Glass System Using Deep Learning for the Blind and Visually Impaired
    Mukhiddinov, Mukhriddin
    Cho, Jinsoo
    ELECTRONICS, 2021, 10 (22)
  • [46] Design and Evaluation of Vibrating Footwear for Navigation Assistance to Visually Impaired People
    Xu, Qianli
    Gan, Tian
    Chia, Shue Ching
    Li, Liyuan
    Lim, Joo-Hwee
    Kyaw, Phyoe Kyaw
    2016 IEEE INTERNATIONAL CONFERENCE ON INTERNET OF THINGS (ITHINGS) AND IEEE GREEN COMPUTING AND COMMUNICATIONS (GREENCOM) AND IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING (CPSCOM) AND IEEE SMART DATA (SMARTDATA), 2016, : 305 - 310
  • [47] Publish-Subscribe Architecture for Delivering Assistance to Visually Impaired People
    Rodrigues, Ricardo N.
    Canez, Alexsander V.
    Sinaas, Gisele M.
    Barwaldt, Regina
    IFAC PAPERSONLINE, 2016, 49 (30): : 150 - 155
  • [48] The MAPS: Toward a Novel Mobility Assistance System for Visually Impaired People
    Romeo, Katerine
    Pissaloux, Edwige
    Gay, Simon L.
    Truong, Ngoc-Tan
    Djoussouf, Lilia
    SENSORS, 2022, 22 (09)
  • [49] An Outdoor Navigation Assistance System for Visually Impaired People in Public Transportation
    Martinez-Cruz, Salvador
    Morales-Hernandez, Luis A.
    Perez-Soto, Gerardo, I
    Benitez-Rangel, Juan P.
    Camarillo-Gomez, Karla A.
    IEEE ACCESS, 2021, 9 : 130767 - 130777
  • [50] Moving Assistance for Visually Impaired People by Laser Profile and Haptic Alert
    Rodriguez-Quinonez, Julio Cesar
    Medina-Madrazo, Leonardo Daniel
    Castro-Toscano, Moises Jesus
    Flores-Fuentes, Wendy
    Sergiyenko, Oleg
    Hernandez-Balbuena, Daniel
    Trujillo-Hernandez, Gabriel
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73