A Low-Cost Multi-Modal Auditory-Visual-Tactile Framework for Remote Touch

被引:10
|
作者
Sanfilippo, Filippo [1 ,2 ]
Pacchierotti, Claudio [3 ]
机构
[1] Univ Agder UiA, Dept Engn Sci, Jon Lilletuns Vei 9, N-4879 Grimstad, Norway
[2] Oslo Metropolitan Univ OsloMet, Dept Mech Elect & Chem Engn, POB 4 St Olays Plass, N-0130 Oslo, Norway
[3] Univ Rennes, CNRS, Inria, IRISA, Campus Univ Beaulieu, F-35042 Rennes, France
关键词
Wearable Haptics; Human-Computer Interaction; Multimodality;
D O I
10.1109/ICICT50521.2020.00040
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Haptic technology for human augmentation provides gains in ability for different applications, whether the aim is to enhance "disabilities" to "abilities", or "abilities" to "super-abilities". Commercially-available devices are generally expensive and tailored to specific applications and hardware. To give researchers a haptic feedback system that is economical, customisable, and fast to fabricate, our group developed a low-cost immersive haptic, audio, and visual experience built by using off-the-shelf (COTS) components. It is composed of a vibrotactile glove, a Leap Motion sensor, and an head-mounted display, integrated together to provide compelling immersive sensations. This paper proposes a higher technology readiness level (TRL) for the system to make it modular and reliable. To demonstrate its potential, we present two human subject studies in Virtual Reality. They evaluate the capability of the system in providing (i) guidance during simulated drone operations, and (ii) contact haptic feedback during virtual objects interaction. Results prove that the proposed haptic-enabled framework improves the performance and illusion of presence.
引用
收藏
页码:213 / 218
页数:6
相关论文
共 50 条
  • [31] A Cloud-Based Visual SLAM Framework for Low-Cost Agents
    Jiao, Jianhao
    Yun, Peng
    Liu, Ming
    COMPUTER VISION SYSTEMS, ICVS 2017, 2017, 10528 : 471 - 484
  • [32] A visual SLAM-based lightweight multi-modal semantic framework for an intelligent substation robot
    Li, Shaohu
    Gu, Jason
    Li, Zhijun
    Li, Shaofeng
    Guo, Bixiang
    Gao, Shangbing
    Zhao, Feng
    Yang, Yuwei
    Li, Guoxin
    Dong, Lanfang
    ROBOTICA, 2024, 42 (07) : 2169 - 2183
  • [33] Multi-modal approach to evaluate adaptive visual stimuli of remote operation system using gaze behavior
    Chew, Jouh Yeong
    Kawamoto, Mitsuru
    Okuma, Takashi
    Yoshida, Eiichi
    Kato, Norihiko
    INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS, 2021, 86
  • [34] Characterizing autonomic response to arousing visual-auditory multi-modal task in Autism Spectrum Disorder (ASD)
    Cavinato, L.
    Cardinaux, A.
    Jain, K.
    Jama, W.
    Kjelgaard, M.
    Sinha, P.
    Barbieri, R.
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 4942 - 4945
  • [35] Auditory noise influences human visual perception of ambiguous information: multi-modal integration during bistable perception
    Woochul Choi
    Se-Bum Paik
    BMC Neuroscience, 16 (Suppl 1)
  • [36] A Multi-Disciplinary Approach to Remote Sensing through Low-Cost UAVs
    Calvario, Gabriela
    Sierra, Basilio
    Alarcon, Teresa E.
    Hernandez, Carmen
    Dalmau, Oscar
    SENSORS, 2017, 17 (06)
  • [37] DigiTac: A DIGIT-TacTip Hybrid Tactile Sensor for Comparing Low-Cost High-Resolution Robot Touch
    Lepora, Nathan F.
    Lin, Yijiong
    Money-Coomes, Ben
    Lloyd, John
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) : 9382 - 9388
  • [38] Design and Implementation of a Low-Cost and Modular Remote Lab Framework: Application to Electronic Sensors
    Benhamouda, Abdallah
    Benmounah, Badreddine
    Baira, Nada
    Kahmous, Sabrina
    TEACHING AND LEARNING IN A DIGITAL WORLD, 2018, 716 : 657 - 664
  • [39] MKGF: A multi-modal knowledge graph based RAG framework to enhance LVLMs for Medical visual question answering
    Wu, Yinan
    Lu, Yuming
    Zhou, Yan
    Ding, Yifan
    Liu, Jingping
    Ruan, Tong
    NEUROCOMPUTING, 2025, 635
  • [40] Low Frequency Vibration Visual Monitoring System Based on Multi-Modal 3DCNN-ConvLSTM
    Alimasi, Alimina
    Liu, Hongchen
    Lyu, Chengang
    SENSORS, 2020, 20 (20) : 1 - 13