Indoor objects detection and recognition for an ICT mobility assistance of visually impaired people

被引:35
|
作者
Afif, Mouna [1 ]
Ayachi, Riadh [1 ]
Pissaloux, Edwige [2 ,3 ]
Said, Yahia [1 ,4 ]
Atri, Mohamed [5 ]
机构
[1] Univ Monastir, Fac Sci Monastir, Lab Elect & Microelect EuE, Monastir, Tunisia
[2] Univ Rouen Normandy Rouen, LITIS Lab, Rouen, France
[3] Univ Rouen Normandy Rouen, CNRS FR 3638, Rouen, France
[4] Northern Border Univ, Coll Engn, Elect Engn Dept, Ar Ar, Saudi Arabia
[5] King Khalid Univ, Coll Comp Sci, Abha, Saudi Arabia
关键词
Indoor object detection and recognition; Deep convolutional neural networks (DCNN); Visually impaired people (VIP) mobility; Indoor navigation;
D O I
10.1007/s11042-020-09662-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Indoor object detection in real scene presents a challenging computer vision task; it is also a key component of an ICT autonomous displacement assistance of Visually Impaired People (VIP). To handle this challenge, a DCNN (Deep Convolutional Neural Networks) for indoor object detection and a new indoor dataset are proposed. The novel DCNN design is based on a pre-trained DCNN called YOLO v3. In order to train and test the proposed DCNN, a new dataset for indoor objects was created. The images of the new dataset present large variety of objects, of indoor illuminations and of indoor architectural structures potentially unsafe for a VIP independent mobility. The dataset contains about 8000 images and presents 16 indoor object categories. Experimental results prove the high performance of the proposed indoor object detection as its recognition rate (a mean average precision) is 73,19%.
引用
收藏
页码:31645 / 31662
页数:18
相关论文
共 50 条
  • [1] Indoor objects detection and recognition for an ICT mobility assistance of visually impaired people
    Mouna Afif
    Riadh Ayachi
    Edwige Pissaloux
    Yahia Said
    Mohamed Atri
    Multimedia Tools and Applications, 2020, 79 : 31645 - 31662
  • [2] Identifying Indoor Objects Using Neutrosophic Reasoning for Mobility Assisting Visually Impaired People
    Darwish, Saad M. M.
    Salah, Mohamed A. A.
    Elzoghabi, Adel A. A.
    APPLIED SCIENCES-BASEL, 2023, 13 (04):
  • [3] Range-IT: Detection and Multimodal Presentation of Indoor Objects for Visually Impaired People
    Zeng, Limin
    Weber, Gerhard
    Ravyse, Ilse
    Simros, Markus
    van Erp, Jan
    Mioch, Tina
    Conradie, Peter
    Saldien, Jelle
    PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON HUMAN-COMPUTER INTERACTION WITH MOBILE DEVICES AND SERVICES (MOBILEHCI '17), 2017,
  • [4] Mobile indoor navigation assistance for mobility impaired people
    Blattner, Andreas
    Vasilev, Yavor
    Harriehausen-Muehlbauer, Bettina
    6TH INTERNATIONAL CONFERENCE ON APPLIED HUMAN FACTORS AND ERGONOMICS (AHFE 2015) AND THE AFFILIATED CONFERENCES, AHFE 2015, 2015, 3 : 51 - 58
  • [5] pseudoEye - Mobility Assistance for Visually Impaired Using Image Recognition
    Sareeka, A. G.
    Kirthika, K.
    Gowthame, M. R.
    Sucharitha, V.
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON INVENTIVE SYSTEMS AND CONTROL (ICISC 2018), 2018, : 174 - 178
  • [6] Visually impaired mobility and ICT supports
    Pissaloux, Edwige E.
    2013 SIGNAL PROCESSING: ALGORITHMS, ARCHITECTURES, ARRANGEMENTS, AND APPLICATIONS (SPA), 2013, : 19 - 19
  • [7] The MAPS: Toward a Novel Mobility Assistance System for Visually Impaired People
    Romeo, Katerine
    Pissaloux, Edwige
    Gay, Simon L.
    Truong, Ngoc-Tan
    Djoussouf, Lilia
    SENSORS, 2022, 22 (09)
  • [8] A Survey of 17 Indoor Travel Assistance Systems for Blind and Visually Impaired People
    Wang, Jie
    Liu, Erwu
    Geng, Yuanzhe
    Qu, Xinyu
    Wang, Rui
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2022, 52 (01) : 134 - 148
  • [9] Indoor assistance for visually impaired people using a RGB-D camera
    Vlaminck, Michiel
    Hiep Quang Luong
    Hoang Van Nam
    Hai Vu
    Veelaert, Peter
    Philips, Wilfried
    2016 IEEE SOUTHWEST SYMPOSIUM ON IMAGE ANALYSIS AND INTERPRETATION (SSIAI), 2016, : 161 - 164
  • [10] Indoor Navigation Assistance System for Visually Impaired People using Multimodal Technologies
    Trung-Kien Dao
    Thanh-Hai Tran
    Thi-Lan Le
    Hai Vu
    Viet-Tung Nguyen
    Dang-Khoa Mac
    Ngoc-Diep Do
    Thanh-Thuy Pham
    2016 14TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV), 2016,