A Low-Cost Multi-Modal Auditory-Visual-Tactile Framework for Remote Touch

被引:10
|
作者
Sanfilippo, Filippo [1 ,2 ]
Pacchierotti, Claudio [3 ]
机构
[1] Univ Agder UiA, Dept Engn Sci, Jon Lilletuns Vei 9, N-4879 Grimstad, Norway
[2] Oslo Metropolitan Univ OsloMet, Dept Mech Elect & Chem Engn, POB 4 St Olays Plass, N-0130 Oslo, Norway
[3] Univ Rennes, CNRS, Inria, IRISA, Campus Univ Beaulieu, F-35042 Rennes, France
关键词
Wearable Haptics; Human-Computer Interaction; Multimodality;
D O I
10.1109/ICICT50521.2020.00040
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Haptic technology for human augmentation provides gains in ability for different applications, whether the aim is to enhance "disabilities" to "abilities", or "abilities" to "super-abilities". Commercially-available devices are generally expensive and tailored to specific applications and hardware. To give researchers a haptic feedback system that is economical, customisable, and fast to fabricate, our group developed a low-cost immersive haptic, audio, and visual experience built by using off-the-shelf (COTS) components. It is composed of a vibrotactile glove, a Leap Motion sensor, and an head-mounted display, integrated together to provide compelling immersive sensations. This paper proposes a higher technology readiness level (TRL) for the system to make it modular and reliable. To demonstrate its potential, we present two human subject studies in Virtual Reality. They evaluate the capability of the system in providing (i) guidance during simulated drone operations, and (ii) contact haptic feedback during virtual objects interaction. Results prove that the proposed haptic-enabled framework improves the performance and illusion of presence.
引用
收藏
页码:213 / 218
页数:6
相关论文
共 50 条
  • [41] Low-cost Multi-Channel Analog Sampler and Signal Generator for Remote Laboratories
    Samuelsen, Dag A. H.
    Graven, Olaf H.
    PROCEEDINGS OF 2015 12TH INTERNATIONAL CONFERENCE ON REMOTE ENGINEERING AND VIRTUAL INSTRUMENTATION (REV), 2015, : 100 - 104
  • [42] On Combining Wearable Sensors and Visual SLAM for Remote Controlling of Low-cost Micro Aerial Vehicles
    Martinez-Carranza, Jose
    Marquez, Francisco
    Garcia, Esteban O.
    Munoz-Melendez, Angelica
    Mayol-Cuevas, Walterio
    2015 WORKSHOP ON RESEARCH, EDUCATION AND DEVELOPMENT OF UNMANNED AERIAL SYSTEMS (RED-UAS), 2015, : 232 - 240
  • [43] Multi-modal remote sensing image segmentation based on attention-driven dual-branch encoding framework
    Li, Zhiyang
    Pan, Xuran
    Xu, Kexing
    Yang, Xinqi
    JOURNAL OF APPLIED REMOTE SENSING, 2024, 18 (02)
  • [44] A Low-Cost Multi-Touch Surface Device Supporting Effective Ergonomic Cognitive Training for the Elderly
    Theodoreli, Vasiliki
    Petsatodis, Theodore
    Soldatos, John
    Talantzis, Fotios
    Pnevmatikakis, Aristodemos
    INTERNATIONAL JOURNAL OF AMBIENT COMPUTING AND INTELLIGENCE, 2010, 2 (03) : 50 - 62
  • [45] Unified diffusion-based object detection in multi-modal and low-light remote sensing images
    Sun, Xu
    Yu, Yinhui
    Cheng, Qing
    ELECTRONICS LETTERS, 2024, 60 (22)
  • [46] Multi-Modal Large Language Model Enhanced Pseudo 3D Perception Framework for Visual Commonsense Reasoning
    Zhu, Jian
    Wang, Hanli
    Shi, Miaojing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (11) : 11682 - 11694
  • [47] MM-Reasoner: A Multi-Modal Knowledge-Aware Framework for Knowledge-Based Visual Question Answering
    Khademi, Mahmoud
    Yang, Ziyi
    Frujeri, Felipe Vieira
    Zhu, Chenguang
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 6571 - 6581
  • [48] A LOW-COST VISUAL RADAR-BASED ODOMETRY FRAMEWORK WITH MMWAVE RADAR AND MONOCULAR CAMERA
    Lu, Yang-En
    Tsai, Syun
    Tsai, Meng-Lun
    Chiang, Kai-Wei
    XXIV ISPRS CONGRESS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION I, 2022, 43-B1 : 235 - 240
  • [49] Low and high-level visual feature-based apple detection from multi-modal images
    J. P. Wachs
    H. I. Stern
    T. Burks
    V. Alchanatis
    Precision Agriculture, 2010, 11 : 717 - 735
  • [50] Tactile Gym 2.0: Sim-to-Real Deep Reinforcement Learning for Comparing Low-Cost High-Resolution Robot Touch
    Lin, Yijiong
    Lloyd, John
    Church, Alex
    Lepora, Nathan F.
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) : 10754 - 10761