Mental Rotation of Digitally-Rendered Haptic Objects by the Visually-Impaired

被引:6
|
作者
Tivadar, Ruxandra, I [1 ,2 ,3 ,4 ]
Chappaz, Cedrick [5 ]
Anaflous, Fatima [3 ,4 ]
Roche, Jean [3 ,4 ]
Murray, Micah M. [1 ,2 ,3 ,4 ,6 ,7 ]
机构
[1] Univ Hosp Ctr, Dept Radiol, LINE Lab Invest Neurophysiol, Lausanne, Switzerland
[2] Univ Lausanne, Lausanne, Switzerland
[3] Univ Lausanne, Dept Ophthalmol, Lausanne, Switzerland
[4] Fdn Asile des Aveugles, Lausanne, Switzerland
[5] Hap2u, St Martin Dheres, France
[6] Ctr Biomed Imaging CIBM, Sensory Perceptual & Cognit Neurosci Sect, Lausanne, Switzerland
[7] Vanderbilt Univ, Dept Hearing & Speech Sci, 221 Kirkland Hall, Nashville, TN 37235 USA
基金
瑞士国家科学基金会;
关键词
blind; low vision; sensory substitution; mental rotation; haptics; digital technology; TACTILE SPATIAL ACUITY; CROSS-MODAL PLASTICITY; BLIND PERSONS; AUDITORY SUBSTITUTION; FRICTION REDUCTION; CONGENITALLY BLIND; REPRESENTATION; STIMULATION; VISION; MEMORY;
D O I
10.3389/fnins.2020.00197
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
In the event of visual impairment or blindness, information from other intact senses can be used as substitutes to retrain (and in extremis replace) visual functions. Abilities including reading, mental representation of objects and spatial navigation can be performed using tactile information. Current technologies can convey a restricted library of stimuli, either because they depend on real objects or renderings with low resolution layouts. Digital haptic technologies can overcome such limitations. The applicability of this technology was previously demonstrated in sighted participants. Here, we reasoned that visually-impaired and blind participants can create mental representations of letters presented haptically in normal and mirror-reversed form without the use of any visual information, and mentally manipulate such representations. Visually-impaired and blind volunteers were blindfolded and trained on the haptic tablet with two letters (either L and P or F and G). During testing, they haptically explored on any trial one of the four letters presented at 0 degrees, 90 degrees, 180 degrees, or 270 degrees rotation from upright and indicated if the letter was either in a normal or mirror-reversed form. Rotation angle impacted performance; greater deviation from 0 degrees resulted in greater impairment for trained and untrained normal letters, consistent with mental rotation of these haptically-rendered objects. Performance was also generally less accurate with mirror-reversed stimuli, which was not affected by rotation angle. Our findings demonstrate, for the first time, the suitability of a digital haptic technology in the blind and visually-impaired. Classic devices remain limited in their accessibility and in the flexibility of their applications. We show that mental representations can be generated and manipulated using digital haptic technology. This technology may thus offer an innovative solution to the mitigation of impairments in the visually-impaired, and to the training of skills dependent on mental representations and their spatial manipulation.
引用
收藏
页数:11
相关论文
共 15 条
  • [1] Mental Rotation of Digitally-Rendered Haptic Objects
    Tivadar, Ruxandra I.
    Rouillard, Tom
    Chappaz, Cedrick
    Knebel, Jean-Francois
    Turoman, Nora
    Anaflous, Fatima
    Roche, Jean
    Matusz, Pawel J.
    Murray, Micah M.
    [J]. FRONTIERS IN INTEGRATIVE NEUROSCIENCE, 2019, 13
  • [2] MENTAL ROTATION OF A TACTILE LAYOUT BY YOUNG VISUALLY-IMPAIRED CHILDREN
    UNGAR, S
    BLADES, M
    SPENCER, C
    [J]. PERCEPTION, 1995, 24 (08) : 891 - 900
  • [3] A Haptic Knob as an Innovative User Interface for Visually-Impaired
    Mengoni, Maura
    Cavalieri, Lorenzo
    Raponi, Damiano
    [J]. UNIVERSAL ACCESS IN HUMAN-COMPUTER INTERACTION: ACCESS TO INTERACTION, PT II, 2015, 9176 : 127 - 138
  • [4] VISUALLY-IMPAIRED CHILDREN AND HAPTIC INTELLIGENCE-TEST SCORES - INTELLIGENCE-TEST FOR VISUALLY-IMPAIRED CHILDREN (ITVIC)
    DEKKER, R
    [J]. DEVELOPMENTAL MEDICINE AND CHILD NEUROLOGY, 1993, 35 (06): : 478 - 489
  • [5] Vibratory Haptic Feedback Assistive Device for Visually-Impaired Drivers
    Wi, Daehan
    Sodemann, Angela
    Chicci, Riley
    [J]. 2017 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTED, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI), 2017,
  • [6] Haptic Wearable System to Assist Visually-Impaired People in Obstacle Detection
    Leporini, Barbara
    Rosellini, Michele
    Forgione, Nicola
    [J]. PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2022, 2022, : 269 - 272
  • [7] BAYLEY MENTAL SCALE OF INFANT DEVELOPMENT AND VISUALLY-IMPAIRED CHILDREN
    LEGUIRE, LE
    FELLOWS, RR
    BIER, G
    [J]. JOURNAL OF VISUAL IMPAIRMENT & BLINDNESS, 1990, 84 (08) : 400 - 404
  • [8] A Wearable Haptic Guidance System Based on Skin Stretch around the Waist for Visually-Impaired Runners
    Kayhan, Oguz
    Samur, Evren
    [J]. 2022 IEEE HAPTICS SYMPOSIUM (HAPTICS), 2022,
  • [9] Utilization of auditory perceptions of sounds and silent objects for orientation and mobility by visually-impaired people
    Miura, Takahiro
    Ebihara, Yuka
    Sakajiri, Masatsugu
    Ifukube, Tohru
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2011, : 1080 - 1087
  • [10] REPRESENTATION OF HAPTIC OBJECTS DURING MENTAL ROTATION IN CONGENITAL BLINDNESS
    Guclu, Burak
    Celik, Serkan
    Ilci, Civan
    [J]. PERCEPTUAL AND MOTOR SKILLS, 2014, 118 (02) : 587 - 607