Substituting depth for intensity and real-time phosphene rendering: Visual navigation under low vision conditions

被引:0
|
作者
Lieby, Paulette [1 ,2 ]
Barnes, Nick [1 ,2 ]
McCarthy, Chris [1 ,2 ]
Liu, Nianjun [1 ,2 ]
Dennett, Hugh [3 ]
Walker, Janine G. [4 ]
Botea, Viorica [1 ]
Scott, Adele F. [1 ]
机构
[1] NICTA Canberra Res Lab, Tower A,7 London Circuit,Locked Bag 8001, Canberra, ACT 2601, Australia
[2] Australian Natl Univ, Coll Engn & Comp Sci, Canberra, ACT 2601, Australia
[3] Australian Natl Univ, Dept Psychol, Canberra, ACT, Australia
[4] Australian Natl Univ, Ctr Mental Hlth Res, Canberra, ACT, Australia
关键词
MOBILITY PERFORMANCE;
D O I
暂无
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Navigation and way finding including obstacle avoidance is difficult when visual perception is limited to low resolution, such as is currently available on a bionic eye. Depth visualisation may be a suitable alternative. Such an approach can be evaluated using simulated phosphenes with a wearable mobile virtual reality kit. In this paper, we present two novel approaches: (i) an implementation of depth visualisation; and, (ii) novel methods for rapid rendering of simulated phosphenes with an empirical comparison between them. Our new software-based method for simulated phosphene rendering shows large speed improvements, facilitating the display in real-time of a large number of phosphenes with size and brightness dependent on pixel intensity, and with customised output dynamic range. Further, we describe the protocol, navigation environment and system used for visual navigation experiments to evaluate the use of depth on low resolution simulations of a bionic eye perceptual experience. Results for these experiments show that a depth-based representation is effective for navigation, and shows significant advantages over intensity-based approaches when overhanging obstacles are present. The results of the experiments were reported in [1], [2].
引用
收藏
页码:8017 / 8020
页数:4
相关论文
共 50 条
  • [1] Depth images: Representations and real-time rendering
    Verlani, Pooja
    Goswami, Aditi
    Narayanan, P. J.
    Dwivedi, Shekhar
    Penta, Sashi Kumar
    [J]. THIRD INTERNATIONAL SYMPOSIUM ON 3D DATA PROCESSING, VISUALIZATION, AND TRANSMISSION, PROCEEDINGS, 2007, : 962 - 969
  • [2] Polyhedral visual hulls for real-time rendering
    Matusik, W
    Buehler, C
    McMillan, L
    [J]. RENDERING TECHNIQUES 2001, 2001, : 115 - +
  • [3] Real-time Depth of Field Rendering with Bokeh Effect
    Hu, Min-Chun
    Tseng, Yi-Ning
    Wu, Ja-Ling
    Kuo, Chih-Hsuan
    Hsiao, Yi-Mao
    Hua, Kai-Lung
    [J]. 2013 IEEE 17TH INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS (ISCE), 2013, : 99 - +
  • [4] Real-Time Depth-of-Field Rendering for Shadow
    Hu, Yingsong
    Mao, Jiayi
    Li, Dan
    Chen, Yuzhong
    [J]. 2017 4TH INTERNATIONAL CONFERENCE ON SYSTEMS AND INFORMATICS (ICSAI), 2017, : 1383 - 1387
  • [5] Commodity real-time stereo vision for navigation
    Bromley, SP
    Zelek, JS
    Dony, RD
    [J]. 1ST CANADIAN CONFERENCE ON COMPUTER AND ROBOT VISION, PROCEEDINGS, 2004, : 424 - 431
  • [6] Real-time rendering of ray scattering effect under the conditions of rain and fog
    State Key Laboratory of CAD and CG, Zhejiang University, Hangzhou 310027, China
    不详
    不详
    不详
    [J]. Ruan Jian Xue Bao, 2006, SUPPL. (126-137):
  • [7] YaQ: An Architecture for Real-Time Navigation and Rendering of Varied Crowds
    Maim, Jonathan
    Yersin, Barbara
    Thalmann, Daniel
    Pettre, Julien
    [J]. IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2009, 29 (04) : 44 - 53
  • [8] GPU based real-time rendering of spherical depth image
    Zhu, Jian
    Wu, En-Hua
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2009, 32 (02): : 231 - 240
  • [9] Real-time Depth-Image-Based Rendering on GPU
    Sun, Zengzeng
    Jung, Cheolkon
    [J]. 2015 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY, 2015, : 324 - 328
  • [10] Real-Time Simulation of Phosphene Images Evoked by Electrical Stimulation of the Visual Cortex
    Fehervari, Tamas
    Matsuoka, Masaru
    Okuno, Hirotsugu
    Yagi, Tetsuya
    [J]. NEURAL INFORMATION PROCESSING: THEORY AND ALGORITHMS, PT I, 2010, 6443 : 171 - 178