Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications

被引:477
|
作者
Zhu, Minglu [1 ,2 ,3 ,4 ]
Sun, Zhongda [1 ,2 ,3 ]
Zhang, Zixuan [1 ,2 ,3 ]
Shi, Qiongfeng [1 ,2 ,3 ]
He, Tianyiyi [1 ,2 ,3 ,4 ]
Liu, Huicong [5 ]
Chen, Tao [5 ]
Lee, Chengkuo [1 ,2 ,3 ,4 ,6 ]
机构
[1] Natl Univ Singapore, Dept Elect & Comp Engn, 4 Engn Dr 3, Singapore 117576, Singapore
[2] Natl Univ Singapore, Ctr Intelligent Sensors & MEMS CISM, 5 Engn Dr 1, Singapore 117608, Singapore
[3] Hybrid Integrated Flexible Elect Syst HIFES, 5 Engn Dr 1, Singapore 117608, Singapore
[4] Singapore Suzhou Res Inst NUSRI, Natl Univ, Suzhou Ind Pk, Suzhou 215123, Peoples R China
[5] Soochow Univ, Sch Mech & Elect Engn, Jiangsu Prov Key Lab Adv Robot, Suzhou 215123, Peoples R China
[6] Natl Univ Singapore, NUS Grad Sch Integrat Sci & Engn, Singapore 119077, Singapore
关键词
ROBOT; SENSORS; SKIN; PRESSURE; JOINT;
D O I
10.1126/sciadv.aaz8693
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Human-machine interfaces (HMIs) experience increasing requirements for intuitive and effective manipulation. Current commercialized solutions of glove-based HMI are limited by either detectable motions or the huge cost on fabrication, energy, and computing power. We propose the haptic-feedback smart glove with triboelectric-based finger bending sensors, palm sliding sensor, and piezoelectric mechanical stimulators. The detection of multidirectional bending and sliding events is demonstrated in virtual space using the self-generated triboelectric signals for various degrees of freedom on human hand. We also perform haptic mechanical stimulation via piezoelectric chips to realize the augmented HMI. The smart glove achieves object recognition using machine learning technique, with an accuracy of 96%. Through the integrated demonstration of multidimensional manipulation, haptic feedback, and AI-based object recognition, our glove reveals its potential as a promising solution for low-cost and advanced human-machine interaction, which can benefit diversified areas, including entertainment, home healthcare, sports training, and medical industry.
引用
收藏
页数:14
相关论文
共 30 条
  • [1] HAPTIC-FEEDBACK RING ENABLED HUMAN-MACHINE INTERFACE (HMI) AIMING AT IMMERSIVE VIRTUAL REALITY EXPERIENCE
    Sun, Zhongda
    Zhu, Minglu
    Chen, Zhaocong
    Shan, Xuechuan
    Lee, Chengkuo
    [J]. 2021 21ST INTERNATIONAL CONFERENCE ON SOLID-STATE SENSORS, ACTUATORS AND MICROSYSTEMS (TRANSDUCERS), 2021, : 333 - 336
  • [2] Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions
    Zhongda Sun
    Minglu Zhu
    Xuechuan Shan
    Chengkuo Lee
    [J]. Nature Communications, 13
  • [3] Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions
    Sun, Zhongda
    Zhu, Minglu
    Shan, Xuechuan
    Lee, Chengkuo
    [J]. NATURE COMMUNICATIONS, 2022, 13 (01)
  • [4] Platform Supporting Intelligent Human-Machine Interface (HMI) Applications for Smart Machine Tools
    Park, Il-Ha
    Yoon, Joo Sung
    Sohn, Jin Ho
    Lee, Dong Yoon
    [J]. INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING, 2024, 25 (05) : 1073 - 1086
  • [5] Networking physical and virtual entities in CPPS - Augmented reality as a human-machine interface
    Van De Sand, Ron
    Schulz, Sebastian
    Ritzmann, Kay
    Reiff-Stephan, Jorg
    [J]. ATP MAGAZINE, 2018, (09): : 36 - 43
  • [6] SENSORY-GLOVE-BASED HUMAN MACHINE INTERFACE FOR AUGMENTED REALITY (AR) APPLICATIONS
    Zhu, Minglu
    Sun, Zhongda
    Zhang, Zixuan
    Shi, Qiongfeng
    Chen, Tao
    Liu, Huicong
    Lee, Chengkuo
    [J]. 2020 33RD IEEE INTERNATIONAL CONFERENCE ON MICRO ELECTRO MECHANICAL SYSTEMS (MEMS 2020), 2020, : 16 - 19
  • [7] Machine learning-augmented wearable triboelectric human-machine interface in motion identification and virtual reality
    Zhu, Jianxiong
    Ji, Shanling
    Yu, Jiachuan
    Shao, Haoran
    Wen, Haiying
    Zhang, Hui
    Xia, Zhijie
    Zhang, Zhisheng
    Lee, Chengkuo
    [J]. NANO ENERGY, 2022, 103
  • [8] Creating the Future: Augmented Reality, the next Human-Machine Interface
    Abrash, Michael
    [J]. 2021 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM), 2021,
  • [9] Ultrapiano: A Novel Human-Machine Interface Applied to Virtual Reality
    Sagardia, Mikel
    Hertkorn, Katharina
    Gonzalez, David Sierra
    Castellini, Claudio
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2014, : 2089 - 2089
  • [10] Virtual/Mixed/Augmented Reality Laboratory Research for the Study of Augmented Human and Human-Machine Systems
    Helm, Kaj
    Karjalainen, Jaakko
    Kuula, Timo
    Philippon, Nicolas
    [J]. 12TH INTERNATIONAL CONFERENCE ON INTELLIGENT ENVIRONMENTS - IE 2016, 2016, : 163 - 166