Indoor objects detection and recognition for an ICT mobility assistance of visually impaired people

被引:35
|
作者
Afif, Mouna [1 ]
Ayachi, Riadh [1 ]
Pissaloux, Edwige [2 ,3 ]
Said, Yahia [1 ,4 ]
Atri, Mohamed [5 ]
机构
[1] Univ Monastir, Fac Sci Monastir, Lab Elect & Microelect EuE, Monastir, Tunisia
[2] Univ Rouen Normandy Rouen, LITIS Lab, Rouen, France
[3] Univ Rouen Normandy Rouen, CNRS FR 3638, Rouen, France
[4] Northern Border Univ, Coll Engn, Elect Engn Dept, Ar Ar, Saudi Arabia
[5] King Khalid Univ, Coll Comp Sci, Abha, Saudi Arabia
关键词
Indoor object detection and recognition; Deep convolutional neural networks (DCNN); Visually impaired people (VIP) mobility; Indoor navigation;
D O I
10.1007/s11042-020-09662-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Indoor object detection in real scene presents a challenging computer vision task; it is also a key component of an ICT autonomous displacement assistance of Visually Impaired People (VIP). To handle this challenge, a DCNN (Deep Convolutional Neural Networks) for indoor object detection and a new indoor dataset are proposed. The novel DCNN design is based on a pre-trained DCNN called YOLO v3. In order to train and test the proposed DCNN, a new dataset for indoor objects was created. The images of the new dataset present large variety of objects, of indoor illuminations and of indoor architectural structures potentially unsafe for a VIP independent mobility. The dataset contains about 8000 images and presents 16 indoor object categories. Experimental results prove the high performance of the proposed indoor object detection as its recognition rate (a mean average precision) is 73,19%.
引用
收藏
页码:31645 / 31662
页数:18
相关论文
共 50 条
  • [41] Obstacle Detection Techniques for Navigational Assistance of the Visually Impaired
    Amin, Navya
    Borschbach, Markus
    2014 13TH INTERNATIONAL CONFERENCE ON CONTROL AUTOMATION ROBOTICS & VISION (ICARCV), 2014, : 1941 - 1944
  • [42] Mobility Aid in Urban Scenarios for Visually Impaired People
    Fanucci, Luca
    Giusti, David
    Iacopetti, Fabrizio
    Leporini, Barbara
    Roncella, Roberto
    Santoro, Carmen
    Scebba, Andrea
    ASSISTIVE TECHNOLOGY FROM ADAPTED EQUIPMENT TO INCLUSIVE ENVIRONMENTS, 2009, 25 : 64 - +
  • [43] A wearable system for mobility improvement of visually impaired people
    Sylvain Cardin
    Daniel Thalmann
    Frédéric Vexo
    The Visual Computer, 2007, 23 : 109 - 118
  • [44] An AIoT-Based Assistance System for Visually Impaired People
    Li, Jiawen
    Xie, Lianglu
    Chen, Zhe
    Shi, Liang
    Chen, Rongjun
    Ren, Yongqi
    Wang, Leijun
    Lu, Xu
    ELECTRONICS, 2023, 12 (18)
  • [45] An Implementation of an Intelligent Assistance System for Visually Impaired/Blind People
    Chen, Liang-Bi
    Su, Jian-Ping
    Chen, Ming-Che
    Chang, Wan-Jung
    Yang, Ching-Hsiang
    Sie, Cheng-You
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2019,
  • [46] Personal Shopping Assistance and Navigator System for Visually Impaired People
    Chippendale, Paul
    Tomaselli, Valeria
    D'Alto, Viviana
    Urlini, Giulio
    Modena, Carla Maria
    Messelodi, Stefano
    Strano, Sebastiano Mauro
    Alce, Gunter
    Hermodsson, Klas
    Razafimahazo, Mathieu
    Michel, Thibaud
    Farinella, Giovanni Maria
    COMPUTER VISION - ECCV 2014 WORKSHOPS, PT III, 2015, 8927 : 375 - 390
  • [47] A wearable system for mobility improvement of visually impaired people
    Cardin, Sylvain
    Thalmann, Daniel
    Vexo, Frederic
    VISUAL COMPUTER, 2007, 23 (02): : 109 - 118
  • [48] The Electromagnetic Technology for Safe Mobility of Visually Impaired People
    Cerri, G.
    De Leo, A.
    Di Mattia, V.
    Manfredi, G.
    Primiani, V. Mariani
    Petrini, V.
    Pieralisi, M.
    Russo, P.
    Scalise, L.
    2014 22ND MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2014, : 164 - 168
  • [49] An Electromagnetic Device for Autonomous Mobility of Visually Impaired People
    Di Mattia, V.
    Russo, P.
    De Leo, A.
    Primiani, V. Mariani
    Petrini, V.
    Cerri, G.
    Scalise, L.
    2014 44TH EUROPEAN MICROWAVE CONFERENCE (EUMC), 2014, : 472 - 475
  • [50] Intelligent Assistance System for Visually Impaired/Blind People (ISVB)
    Ghatwary, Noha
    Abouzeina, Ahmed
    Kantoush, Ahmed
    Eltawil, Bahaa
    Ramadan, Mohamed
    Yasser, Mohamed
    2022 5TH INTERNATIONAL CONFERENCE ON COMMUNICATIONS, SIGNAL PROCESSING, AND THEIR APPLICATIONS (ICCSPA), 2022,