Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions

被引:291
|
作者
Sun, Zhongda [1 ,2 ,3 ,4 ,5 ]
Zhu, Minglu [1 ,2 ,3 ,5 ]
Shan, Xuechuan [4 ,6 ]
Lee, Chengkuo [1 ,2 ,3 ,4 ,5 ,7 ]
机构
[1] Natl Univ Singapore, Dept Elect & Comp Engn, 4 Engn Dr 3, Singapore 117583, Singapore
[2] Natl Univ Singapore, Ctr Intelligent Sensors, 4 Engn Dr 3, Singapore 117583, Singapore
[3] Natl Univ Singapore, MEMS, 4 Engn Dr 3, Singapore 117583, Singapore
[4] Natl Univ Singapore, Singapore Inst Mfg Technol & Natl Univ Singapore, 4 Engn Dr 3, Singapore 117583, Singapore
[5] Natl Univ Singapore, Suzhou Res Inst NUSRI, Suzhou Ind Pk, Suzhou 215123, Peoples R China
[6] ASTAR, Singapore Inst Mfg Technol, Printed Intelligent Device Grp, Singapore 637662, Singapore
[7] Natl Univ Singapore, NUS Grad Sch, Integrat Sci & Engn Program ISEP, Singapore 119077, Singapore
关键词
PYROELECTRIC NANOGENERATORS; NANOWIRE HEATER; DEVICES; ROBOT;
D O I
10.1038/s41467-022-32745-8
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Current wearable solutions for Virtual Reality (VR) have limitations of complicated structures and large driven power. Here, the authors report a highly integrated ring consisting of multimodal sensing and feedback units for augmented interactions in metaverse. Advancements of virtual reality technology pave the way for developing wearable devices to enable somatosensory sensation, which can bring more comprehensive perception and feedback in the metaverse-based virtual society. Here, we propose augmented tactile-perception and haptic-feedback rings with multimodal sensing and feedback capabilities. This highly integrated ring consists of triboelectric and pyroelectric sensors for tactile and temperature perception, and vibrators and nichrome heaters for vibro- and thermo-haptic feedback. All these components integrated on the ring can be directly driven by a custom wireless platform of low power consumption for wearable/portable scenarios. With voltage integration processing, high-resolution continuous finger motion tracking is achieved via the triboelectric tactile sensor, which also contributes to superior performance in gesture/object recognition with artificial intelligence analysis. By fusing the multimodal sensing and feedback functions, an interactive metaverse platform with cross-space perception capability is successfully achieved, giving people a face-to-face like immersive virtual social experience.
引用
收藏
页数:13
相关论文
共 9 条
  • [1] Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions
    Zhongda Sun
    Minglu Zhu
    Xuechuan Shan
    Chengkuo Lee
    Nature Communications, 13
  • [2] HAPTIC-FEEDBACK RING ENABLED HUMAN-MACHINE INTERFACE (HMI) AIMING AT IMMERSIVE VIRTUAL REALITY EXPERIENCE
    Sun, Zhongda
    Zhu, Minglu
    Chen, Zhaocong
    Shan, Xuechuan
    Lee, Chengkuo
    2021 21ST INTERNATIONAL CONFERENCE ON SOLID-STATE SENSORS, ACTUATORS AND MICROSYSTEMS (TRANSDUCERS), 2021, : 333 - 336
  • [3] Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications
    Zhu, Minglu
    Sun, Zhongda
    Zhang, Zixuan
    Shi, Qiongfeng
    He, Tianyiyi
    Liu, Huicong
    Chen, Tao
    Lee, Chengkuo
    SCIENCE ADVANCES, 2020, 6 (19)
  • [4] On-Skin Stimulation Devices for Haptic Feedback and Human-Machine Interfaces
    Guo, Wei
    Hu, Yijia
    Yin, Zhouping
    Wu, Hao
    ADVANCED MATERIALS TECHNOLOGIES, 2022, 7 (02)
  • [5] Interactive Haptic System with Multimodal Tactile Sensing and Hydraulic Feedback for Realistic Human-Machine Interaction
    Jeong, Jingu
    Kang, Mingyu
    Song, Youngsup
    Pyo, Soonjae
    ADVANCED INTELLIGENT SYSTEMS, 2024,
  • [6] Programmable and Ultrasensitive Haptic Interfaces Enabling Closed-Loop Human-Machine Interactions
    Lin, Wansheng
    Wei, Chao
    Yu, Shifan
    Chen, Zihan
    Zhang, Cuirong
    Guo, Ziquan
    Liao, Qingliang
    Wang, Shuli
    Lin, Maohua
    Zheng, Yuanjin
    Liao, Xinqin
    Chen, Zhong
    ADVANCED FUNCTIONAL MATERIALS, 2023, 33 (47)
  • [7] Wireless, Wrist-Worn Ultraconformal Neuromuscular Interfaces for Thumb-Controlled Immersive Human-Machine Interactions
    Wang, Chengjun
    Hong, Weijie
    Deng, Yidong
    Lan, Lingyi
    Zhang, Shun
    Ping, Jianfeng
    Ying, Yibin
    Yu, Cunjiang
    Luo, Jikui
    Chen, Weiqiu
    Chen, Zuobing
    Song, Jizhou
    ADVANCED FUNCTIONAL MATERIALS, 2025,
  • [8] Skin-integrated stretchable actuators toward skin-compatible haptic feedback and closed-loop human-machine interactions
    Chen, Si
    Chen, Yanjun
    Yang, Ji
    Han, Teng
    Yao, Shanshan
    NPJ FLEXIBLE ELECTRONICS, 2023, 7 (01)
  • [9] Skin-integrated stretchable actuators toward skin-compatible haptic feedback and closed-loop human-machine interactions
    Si Chen
    Yanjun Chen
    Ji Yang
    Teng Han
    Shanshan Yao
    npj Flexible Electronics, 7