Active mechanical haptics with high-fidelity perceptions for immersive virtual reality

被引:17
|
作者
Zhang, Zhuang [1 ,2 ]
Xu, Zhenghao [3 ]
Emu, Luoqian [1 ]
Wei, Pingdong [1 ,2 ]
Chen, Sentao [1 ]
Zhai, Zirui [4 ]
Kong, Lingyu [5 ]
Wang, Yong [3 ]
Jiang, Hanqing [1 ,2 ,6 ]
机构
[1] Westlake Univ, Sch Engn, Hangzhou, Peoples R China
[2] Westlake Inst Adv Study, Hangzhou, Peoples R China
[3] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou, Peoples R China
[4] Arizona State Univ, Sch Engn Matter Transport & Energy, Tempe, AZ USA
[5] Intelligent Robot Res Ctr, Zhejiang Lab, Hangzhou, Peoples R China
[6] Westlake Univ, Res Ctr Ind Future, Hangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
ORIGAMI; INTERFACES; ROBOT; TOUCH;
D O I
10.1038/s42256-023-00671-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human-centred mechanical sensory perceptions enable us to immerse ourselves in the physical environment by actively touching or holding objects so that we may feel their existence (that is, ownership) and their fundamental properties (for example, stiffness or hardness). In a virtual environment, the replication of these active perceptions can create authentic haptic experiences, serving as an essential supplement for visual and auditory experiences. We present here a first-person, human-triggered haptic device enabled by curved origami that allows humans to actively experience touching of objects with various stiffness perceptions from soft to hard and from positive to negative ranges. This device represents a substantial shift away from the third-person, machine-triggered and passive haptics currently in use. The device is synchronized with the virtual environment by changing its configuration to adapt various interactions by emulating body-centred physical perceptions, including hardness, softness and sensations of crushing and weightlessness. Quantitative evaluations demonstrate that the active haptic device creates a highly immersive virtual environment, outperforming existing vibration-based passive devices. These concepts and resulting technologies create new opportunities and application potential for a more authentic virtual world. Immersive virtual reality requires artificial sensory perceptions to simulate what we feel and how we interact in the natural environment. Zhang and colleagues present a first-person, human-triggered, active haptic device that allows users to experience mechanical touching with various stiffness perceptions from positive to negative ranges, achieved by the unique benefits of curved origami.
引用
收藏
页码:643 / +
页数:27
相关论文
共 50 条
  • [1] Active mechanical haptics with high-fidelity perceptions for immersive virtual reality
    Zhuang Zhang
    Zhenghao Xu
    Luoqian Emu
    Pingdong Wei
    Sentao Chen
    Zirui Zhai
    Lingyu Kong
    Yong Wang
    Hanqing Jiang
    [J]. Nature Machine Intelligence, 2023, 5 : 643 - 655
  • [2] Passive Haptics and Conversational Avatars for Interacting with Ancient Egypt Remains in High-Fidelity Virtual Reality Experiences
    Cannavo, Alberto
    Pacchiot, Simona
    Ret, Nicola
    Terzoli, Martina
    Spallone, Roberta
    Lamberti, Fabrizio
    [J]. ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE, 2024, 17 (02):
  • [3] High-Fidelity Interaction for Virtual and Augmented Reality
    Whitmire, Eric
    [J]. 25TH 2018 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2018, : 796 - 798
  • [4] Demonstrating High-Precision and High-Fidelity Digital Inking for Virtual Reality
    Romat, Hugo
    Fender, Andreas
    Meier, Manuel
    Holz, Christian
    [J]. 2021 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS (VRW 2021), 2021, : 749 - 750
  • [5] High-fidelity simulation and virtual reality: an evaluation of medical students' experiences
    Macnamara, Alexandra Frances
    Bird, Katie
    Rigby, Alan
    Sathyapalan, Thozhukat
    Hepburn, David
    [J]. BMJ SIMULATION & TECHNOLOGY ENHANCED LEARNING, 2021, 7 (06): : 528 - 535
  • [6] A framework for fidelity evaluation of immersive virtual reality systems
    Hamza A. Al-Jundi
    Emad Y. Tanbour
    [J]. Virtual Reality, 2022, 26 : 1103 - 1122
  • [7] A framework for fidelity evaluation of immersive virtual reality systems
    Al-Jundi, Hamza A.
    Tanbour, Emad Y.
    [J]. VIRTUAL REALITY, 2022, 26 (03) : 1103 - 1122
  • [8] High-fidelity bilateral teleoperation systems and the effect of multimodal haptics
    Tavakoli, Mahdi
    Aziminejad, Arash
    Patel, Rajni V.
    Moallem, Mehrdad
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2007, 37 (06): : 1512 - 1528
  • [9] High-Fidelity Grasping in Virtual Reality using a Glove-based System
    Liu, Hangxin
    Zhang, Zhenliang
    Xie, Xu
    Zhu, Yixin
    Liu, Yue
    Wang, Yongtian
    Zhu, Song-Chun
    [J]. 2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 5180 - 5186
  • [10] Performance Benefits of High-Fidelity Passive Haptic Feedback in Virtual Reality Training
    Franzluebbers, Anton
    Johnsen, Kyle
    [J]. SUI'18: PROCEEDINGS OF THE 2018 SYMPOSIUM ON SPATIAL USER INTERACTION, 2016, : 16 - 24