Ultra-Robust and Sensitive Flexible Strain Sensor for Real-Time and Wearable Sign Language Translation

被引:33
|
作者
Wu, Xuping [1 ,2 ]
Luo, Xuemei [1 ]
Song, Zhuman [1 ]
Bai, Yaoyao [3 ]
Zhang, Bin [3 ]
Zhang, Guangping [1 ]
机构
[1] Chinese Acad Sci, Inst Met Res, Shenyang Natl Lab Mat Sci, 72 Wenhua Rd, Shenyang 110016, Peoples R China
[2] Univ Sci & Technol China, Sch Mat Sci & Engn, 72 Wenhua Rd, Shenyang 110016, Peoples R China
[3] Northeastern Univ, Sch Mat Sci & Engn, Key Lab Anisotropy & Texture Mat, Minist Educ, 3-11 Wenhua Rd, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
machine learning; robustness; sensitivity; sign languages; strain sensors; CRACK; RECOGNITION; GAUGES;
D O I
10.1002/adfm.202303504
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Flexible strain sensors with high sensitivity and high mechanical robustness are highly desirable for their accurate and long-term reliable service in wearable human-machine interfaces. However, the current application of flexible strain sensors has to face a trade-off between high sensitivity and high mechanical robustness. The most representative examples are micro/nano crack-based sensors and serpentine meander-based sensors. The former one typically shows high sensitivity but limited robustness, while the latter is on the contrary. Herein, ultra-robust and sensitive flexible strain sensors are developed by crack-like pathway customization and ingenious modulation of low/high-resistance regions on a serpentine meander structure. The sensors show high cyclic stability (10 000 cycles), strong tolerance to harsh environments, high gauge factor (>1000) comparable with that of the crack-based sensor, and fast response time (<58 ms). Finally, the sensors are integrated into a wearable sign language translation system, which is wireless, low-cost, and lightweight. Recognition rates of over 98% are demonstrated for the translation of 21 sign languages with the assistance of machine learning. This system facilitates achieving barrier-free communication between signers and nonsigners and offers broad application prospects in gesture interaction.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Development of a Wearable Sensor Glove for Real-Time Sign Language Translation
    Ambar, Radzi
    Salim, Safyzan
    Wahab, Mohd Helmy Abd
    Jamil, Muhammad Mahadi Abdul
    Phing, Tan Ching
    [J]. Annals of Emerging Technologies in Computing, 2023, 7 (05) : 25 - 38
  • [2] Ultra-Robust Real-Time Estimation of Gait Phase
    Shushtari, Mohammad
    Dinovitzer, Hannah
    Weng, Jiacheng
    Arami, Arash
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2022, 30 : 2793 - 2801
  • [3] A Real-Time Automatic Translation of Text to Sign Language
    Sanaullah, Muhammad
    Ahmad, Babar
    Kashif, Muhammad
    Safdar, Tauqeer
    Hassan, Mehdi
    Hasan, Mohd Hilmi
    Aziz, Norshakirah
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 70 (02): : 2471 - 2488
  • [4] A Real-time Portable Sign Language Translation System
    Kau, Lih-Jen
    Su, Wan-Lin
    Yu, Pei-Ju
    Wei, Sin-Jhan
    [J]. 2015 IEEE 58TH INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2015,
  • [5] Mechanically Ultra-Robust, Elastic, Conductive, and Multifunctional Hybrid Hydrogel for a Triboelectric Nanogenerator and Flexible/Wearable Sensor
    Long, Yong
    Wang, Zhuo
    Xu, Fan
    Jiang, Bin
    Xiao, Junfeng
    Yang, Jun
    Wang, Zhong Lin
    Hu, Weiguo
    [J]. SMALL, 2022, 18 (47)
  • [6] Wearable strain sensor for real-time sweat volume monitoring
    Wang, Lirong
    Xu, Tailin
    Fan, Chuan
    Zhang, Xueji
    [J]. ISCIENCE, 2021, 24 (01)
  • [7] Wearable sign language translation system using strain sensors
    Lee, Sangmin
    Jo, Dongbin
    Kim, Kyu-Beom
    Jang, Jaewon
    Park, Wanjun
    [J]. SENSORS AND ACTUATORS A-PHYSICAL, 2021, 331
  • [8] A Real-Time Translation of Arabic Video Contents to Arabic Sign Language
    Maghraby, Ashwag
    Qutub, Safaa
    Alandijani, Afraa
    Alandijani, Huda
    Bakhsh, Linah
    Alharbi, Nuha
    [J]. 2021 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI 2021), 2021, : 1008 - 1013
  • [9] Towards Real-Time Sign Language Recognition and Translation on Edge Devices
    Gan, Shiwei
    Yin, Yafeng
    Jiang, Zhiwei
    Xie, Lei
    Lu, Sanglu
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 4502 - 4512
  • [10] LIVE DEMO: A REAL-TIME PORTABLE SIGN LANGUAGE TRANSLATION SYSTEM
    Kau, Lih-Jen
    Zhuo, Bo-Xun
    [J]. PROCEEDINGS OF 2016 IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE (BIOCAS), 2016, : 134 - 134