A Facial Electromyography Activity Detection Method in Silent Speech Recognition

被引:4
|
作者
Cai, Huihui [1 ,2 ]
Zhang, Yakun [2 ,3 ]
Xie, Liang [2 ,3 ]
Yan, Huijiong [2 ]
Qin, Wei [2 ,3 ]
Yan, Ye [2 ,3 ]
Yin, Erwei [1 ,2 ,3 ]
Xu, Minpeng [1 ]
Ming, Dong [1 ]
机构
[1] Tianjin Univ, Sch Acad Med Engn & Translat Med, Tianjin, Peoples R China
[2] Tianjin Artif Intelligence Innoat Ctr TAIIC, Tianjin, Peoples R China
[3] Acad Mil Sci AMS, Def Innovat Inst, Beijing, Peoples R China
关键词
Silent speech recognition; Spectral subtraction; Backtracking; Activity detection; CNN-BiGRU; EMG;
D O I
10.1109/HPBDIS53214.2021.9658469
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Silent speech recognition (SSR) is a new application of human-computer interaction based on electromyography (EMG), which solves the limitation of acoustic signal dependence. In a low signal-to-noise ratio (SNR) environment, traditional methods cannot accurately segment the EMG active signal. This paper proposes an energy detection method based on spectral subtraction backtracking for detecting EMG active signals to assist silent speech recognition. The experiments are mainly based on energy detection. In addition to the energy detection, the spectral subtraction method is also used to improve the SNR and the accuracy of the endpoint information. Then, the experiments propose a backtracking method to make up for the deficiency of spectral subtraction. Finally, this paper adopts an end-to-end network model, which takes the pre-trained model of CNN as the front end, and the bidirectional gate recurrent unit (Bi-GRU) as the back end for classification. Experimental results show that the proposed activity detection method in this paper is more accurate than others in the low SNR environment.
引用
收藏
页码:246 / 251
页数:6
相关论文
共 50 条
  • [1] Design of a Silent Speech Interface using Facial Gesture Recognition and Electromyography
    Nair, Aishwarya
    Shashikumar, Niranjana
    Vidhya, S.
    Kirthika, S. K.
    16TH INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING, 2017, 61 : 117 - 122
  • [2] Silent Speech Recognition Based on Surface Electromyography
    Ma, Siyuan
    Jin, Dantong
    Zhang, Ming
    Zhang, Bixuan
    Wang, You
    Li, Guang
    Yang, Meng
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 4497 - 4501
  • [3] A STRETCHABLE HIGH-DENSITY ELECTROMYOGRAPHY MEMS SENSOR FOR EFFICIENT SILENT SPEECH RECOGNITION
    Shao, Shuihan
    Jiang, Chunpeng
    Shen, Gencai
    Wang, Yirong
    Zheng, Kunyu
    Zhao, Nan
    Yang, Bin
    Liu, Jingquan
    2024 IEEE 37TH INTERNATIONAL CONFERENCE ON MICRO ELECTRO MECHANICAL SYSTEMS, MEMS, 2024, : 360 - 363
  • [4] A simplified adversarial architecture for cross-subject silent speech recognition using electromyography
    Cui, Qiang
    Zhang, Xingyu
    Zhang, Yakun
    Zheng, Changyan
    Xie, Liang
    Yan, Ye
    Wu, Edmond Q.
    Yin, Erwei
    JOURNAL OF NEURAL ENGINEERING, 2024, 21 (05)
  • [5] Silent Speech Eyewear Interface: Silent Speech Recognition Method using Eyewear with Infrared Distance Sensors
    Yuya, Igarashi
    Kyosuke, Futami
    Kazuya, Murao
    PROCEEDINGS OF THE 2022 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, ISWC 2022, 2022, : 33 - 38
  • [6] Silent Speech Eyewear Interface: Silent Speech Recognition Method using Eyewear with Infrared Distance Sensors
    Igarashi, Yuya
    Futami, Kyosuke
    Murao, Kazuya
    Proceedings - International Symposium on Wearable Computers, ISWC, 2022, : 33 - 38
  • [7] A SPEECH ENHANCEMENT SYSTEM FOR AUTOMOTIVE SPEECH RECOGNITION WITH A HYBRID VOICE ACTIVITY DETECTION METHOD
    Wang, Haikun
    Ye, Zhongfu
    Chen, Jingdong
    2018 16TH INTERNATIONAL WORKSHOP ON ACOUSTIC SIGNAL ENHANCEMENT (IWAENC), 2018, : 456 - 460
  • [8] Towards optimizing electrode configurations for silent speech recognition based on high-density surface electromyography
    Zhu, Mingxing
    Zhang, Haoshi
    Wang, Xiaochen
    Wang, Xin
    Yang, Zijian
    Wang, Cheng
    Samuel, Oluwarotimi Williams
    Chen, Shixiong
    Li, Guanglin
    JOURNAL OF NEURAL ENGINEERING, 2021, 18 (01)
  • [9] Parallel-Inception CNN Approach for Facial sEMG based Silent Speech Recognition
    Wu, Jinghan
    Zhao, Tao
    Zhang, Yakun
    Xie, Liang
    Yan, Ye
    Yin, Erwei
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 554 - 557
  • [10] A NANOFOREST-BASED HUMIDITY SENSOR FOR SILENT SPEECH DETECTION AND RECOGNITION
    Liu, Fengyu
    Chen, Guidong
    Shi, Yizhi
    Shi, Meng
    Zhou, Na
    Huang, Chengjun
    Mao, Haiyang
    2024 IEEE 37TH INTERNATIONAL CONFERENCE ON MICRO ELECTRO MECHANICAL SYSTEMS, MEMS, 2024, : 117 - 120