A Low-Cost Multi-Modal Auditory-Visual-Tactile Framework for Remote Touch

被引:10
|
作者
Sanfilippo, Filippo [1 ,2 ]
Pacchierotti, Claudio [3 ]
机构
[1] Univ Agder UiA, Dept Engn Sci, Jon Lilletuns Vei 9, N-4879 Grimstad, Norway
[2] Oslo Metropolitan Univ OsloMet, Dept Mech Elect & Chem Engn, POB 4 St Olays Plass, N-0130 Oslo, Norway
[3] Univ Rennes, CNRS, Inria, IRISA, Campus Univ Beaulieu, F-35042 Rennes, France
关键词
Wearable Haptics; Human-Computer Interaction; Multimodality;
D O I
10.1109/ICICT50521.2020.00040
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Haptic technology for human augmentation provides gains in ability for different applications, whether the aim is to enhance "disabilities" to "abilities", or "abilities" to "super-abilities". Commercially-available devices are generally expensive and tailored to specific applications and hardware. To give researchers a haptic feedback system that is economical, customisable, and fast to fabricate, our group developed a low-cost immersive haptic, audio, and visual experience built by using off-the-shelf (COTS) components. It is composed of a vibrotactile glove, a Leap Motion sensor, and an head-mounted display, integrated together to provide compelling immersive sensations. This paper proposes a higher technology readiness level (TRL) for the system to make it modular and reliable. To demonstrate its potential, we present two human subject studies in Virtual Reality. They evaluate the capability of the system in providing (i) guidance during simulated drone operations, and (ii) contact haptic feedback during virtual objects interaction. Results prove that the proposed haptic-enabled framework improves the performance and illusion of presence.
引用
收藏
页码:213 / 218
页数:6
相关论文
共 50 条
  • [21] Human visual system inspired multi-modal medical image fusion framework
    Bhatnagar, Gaurav
    Wu, Q. M. Jonathan
    Liu, Zheng
    EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (05) : 1708 - 1720
  • [22] Designing an accessible low-cost interactive multi-touch surface
    Cristina Manresa-Yee
    Ramon Mas
    Universal Access in the Information Society, 2016, 15 : 419 - 429
  • [23] Low-cost malleable surfaces with multi-touch pressure sensitivity
    Smith, J. David
    Graham, T. C. Nicholas
    Holman, David
    Borchers, Jan
    SECOND ANNUAL IEEE INTERNATIONAL WORKSHOP ON HORIZONTAL INTERACTIVE HUMAN-COMPUTER SYSTEMS, PROCEEDINGS, 2007, : 205 - +
  • [24] Designing an accessible low-cost interactive multi-touch surface
    Manresa-Yee, Cristina
    Mas, Ramon
    UNIVERSAL ACCESS IN THE INFORMATION SOCIETY, 2016, 15 (03) : 419 - 429
  • [25] Multi-modal Remote Sensing Image Classification for Low Sample Size Data
    He, Qi
    Lee, Yao
    Huang, Dongmei
    He, Shengqi
    Song, Wei
    Du, Yanling
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [26] A low-cost multi-modal medical imaging system with fringe projection profilometry and 3D freehand ultrasound
    Meza, Jhacson
    Simarra, Pedro
    Contreras-Ojeda, Sara
    Romero, Lenny A.
    Contreras-Ortiz, Sonia H.
    Ardmbula Cosio, Fernando
    Marrugo, Andres G.
    15TH INTERNATIONAL SYMPOSIUM ON MEDICAL INFORMATION PROCESSING AND ANALYSIS, 2020, 11330
  • [27] A Light Visual Mapping and Navigation Framework for Low-Cost Robots
    Bazeille, Stephane
    Battesti, Emmanuel
    Filliat, David
    JOURNAL OF INTELLIGENT SYSTEMS, 2015, 24 (04) : 505 - 524
  • [28] VISUAL ATTITUDE ESTIMATION FOR LOW-COST PERSONAL REMOTE SENSING SYSTEMS
    Fromm, Tobias
    Di, Long
    Chen, YangQuan
    Voos, Holger
    PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2011, VOL 3, PTS A AND B, 2012, : 901 - 908
  • [29] A LOW-RANK TENSOR BAYESIAN FILTER FRAMEWORK FOR MULTI-MODAL ANALYSIS
    Yang, Wenbin
    Wang, Zijia
    Ni, Jiacheng
    Chen, Qiang
    Jia, Zhen
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 3738 - 3742
  • [30] Network model of predictive coding based on reservoir computing for multi-modal processing of visual and auditory signals
    Yonemura, Yoshihiro
    Katori, Yuichi
    IEICE NONLINEAR THEORY AND ITS APPLICATIONS, 2021, 12 (02): : 143 - 156