Indoor objects detection and recognition for an ICT mobility assistance of visually impaired people

被引:35
|
作者
Afif, Mouna [1 ]
Ayachi, Riadh [1 ]
Pissaloux, Edwige [2 ,3 ]
Said, Yahia [1 ,4 ]
Atri, Mohamed [5 ]
机构
[1] Univ Monastir, Fac Sci Monastir, Lab Elect & Microelect EuE, Monastir, Tunisia
[2] Univ Rouen Normandy Rouen, LITIS Lab, Rouen, France
[3] Univ Rouen Normandy Rouen, CNRS FR 3638, Rouen, France
[4] Northern Border Univ, Coll Engn, Elect Engn Dept, Ar Ar, Saudi Arabia
[5] King Khalid Univ, Coll Comp Sci, Abha, Saudi Arabia
关键词
Indoor object detection and recognition; Deep convolutional neural networks (DCNN); Visually impaired people (VIP) mobility; Indoor navigation;
D O I
10.1007/s11042-020-09662-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Indoor object detection in real scene presents a challenging computer vision task; it is also a key component of an ICT autonomous displacement assistance of Visually Impaired People (VIP). To handle this challenge, a DCNN (Deep Convolutional Neural Networks) for indoor object detection and a new indoor dataset are proposed. The novel DCNN design is based on a pre-trained DCNN called YOLO v3. In order to train and test the proposed DCNN, a new dataset for indoor objects was created. The images of the new dataset present large variety of objects, of indoor illuminations and of indoor architectural structures potentially unsafe for a VIP independent mobility. The dataset contains about 8000 images and presents 16 indoor object categories. Experimental results prove the high performance of the proposed indoor object detection as its recognition rate (a mean average precision) is 73,19%.
引用
收藏
页码:31645 / 31662
页数:18
相关论文
共 50 条
  • [31] Utilization of auditory perceptions of sounds and silent objects for orientation and mobility by visually-impaired people
    Miura, Takahiro
    Ebihara, Yuka
    Sakajiri, Masatsugu
    Ifukube, Tohru
    2011 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2011, : 1080 - 1087
  • [32] An Indoor and Outdoor Navigation System for Visually Impaired People
    Croce, Daniele
    Giarre, Laura
    Pascucci, Federica
    Tinnirello, Ilenia
    Galioto, Giovanni Ettore
    Garlisi, Domenico
    Lo Valvo, Alice
    IEEE ACCESS, 2019, 7 : 170406 - 170418
  • [33] Indoor Positioning for Visually Impaired People Based on Smartphones
    Moder, Thomas
    Hafner, Petra
    Wieser, Manfred
    COMPUTERS HELPING PEOPLE WITH SPECIAL NEEDS, ICCHP 2014, PT I, 2014, 8547 : 441 - 444
  • [34] Signage Recognition Framework for Visually Impaired People
    Foong, Oi-Mean
    Razali, Nurul Safwanah Bt Mohd
    COMPUTER COMMUNICATION AND MANAGEMENT, 2011, 5 : 488 - 492
  • [35] A Color Recognition System for the Visually Impaired People
    Samara, Mohammed
    AlSadah, Jihad
    Driche, Mohamed
    Osais, Yahya
    2017 4TH IEEE INTERNATIONAL CONFERENCE ON ENGINEERING TECHNOLOGIES AND APPLIED SCIENCES (ICETAS), 2017,
  • [36] IMAGE RECOGNITION FOR VISUALLY IMPAIRED PEOPLE BY SOUND
    Krishnan, K. Gopala
    Porkodi, C. M.
    Kanimozhi, K.
    2013 INTERNATIONAL CONFERENCE ON COMMUNICATIONS AND SIGNAL PROCESSING (ICCSP), 2013, : 943 - 946
  • [37] INSIDe: Image recognition tool aimed at helping visually impaired people contextualize indoor environments
    Fank, Elias
    Bevilacqua, Fernando
    Duarte, Denio
    Scapinello, Alesson
    REVISTA BRASILEIRA DE COMPUTACAO APLICADA, 2019, 11 (03): : 59 - 71
  • [38] Scene text detection and recognition system for visually impaired people in real world
    Fei, Lei
    Wang, Kaiwei
    Lin, Shufei
    Yang, Kailun
    Cheng, Ruiqi
    Chen, Hao
    TARGET AND BACKGROUND SIGNATURES IV, 2018, 10794
  • [39] A PRIMARY TRAVELLING ASSISTANT SYSTEM OF BUS DETECTION AND RECOGNITION FOR VISUALLY IMPAIRED PEOPLE
    Pan, Hangrong
    Yi, Chucai
    Tian, Yingli
    ELECTRONIC PROCEEDINGS OF THE 2013 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2013,
  • [40] Face Recognition and Spoofing Detection System Adapted To Visually-Impaired People
    Fernandez, A.
    Carus, J. L.
    Usamentiaga, R.
    Casado, R.
    IEEE LATIN AMERICA TRANSACTIONS, 2016, 14 (02) : 913 - 921