Investigation on Effect of Speech Imagery EEG Data Augmentation with Actual Speech

被引:0
|
作者
Choi, Jaehoon [1 ]
Kaongoen, Netiwit [1 ]
Jo, Sungho [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Sch Comp, Daejeon, South Korea
关键词
Brain-computer interface (BCI); Speech-imagery; Actual speech; data augmentation; CLASSIFICATION;
D O I
10.1109/BCI53720.2022.9735108
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Speech imagery based brain-computer interfaces (BCI) have been researched as a potentially powerful method to provide communication and control without explicit bodily movements. Compared to other BCI systems, speech imagery based BCIs can employ mental tasks directly related to control tasks, making them more intuitive for use in daily-life. However, training data is difficult to collect in sufficient size and number in terms of time and user comfort; preparation time to wear electroencephalogram (EEG) measurement devices are lengthy and the devices themselves are uncomfortable to use, making it difficult for subjects to undergo long training sessions without feeling fatigued. To overcome this problem, we suggest a novel data augmentation method using actual speech data. Based on the similarity between the tasks imagined speech and actual speech, we augment EEG training data of imagined speech with EEG data of actual speech and show significant improvements for two out of three subjects.
引用
下载
收藏
页数:5
相关论文
共 50 条
  • [1] Investigation of Data Augmentation Techniques for Disordered Speech Recognition
    Geng, Mengzhe
    Xie, Xurong
    Liu, Shansong
    Yu, Jianwei
    Hu, Shoukang
    Liu, Xunying
    Meng, Helen
    INTERSPEECH 2020, 2020, : 696 - 700
  • [2] Data augmentation for speech separation
    Alex, Ashish
    Wang, Lin
    Gastaldo, Paolo
    Cavallaro, Andrea
    SPEECH COMMUNICATION, 2023, 152
  • [3] Linguistic representation of vowels in speech imagery EEG
    Nitta, Tsuneo
    Horikawa, Junsei
    Iribe, Yurie
    Taguchi, Ryo
    Katsurada, Kouichi
    Shinohara, Shuji
    Kawai, Goh
    FRONTIERS IN HUMAN NEUROSCIENCE, 2023, 17
  • [4] Analysis and classification of speech imagery EEG for BCI
    Wang, Li
    Zhang, Xiong
    Zhong, Xuefei
    Zhang, Yu
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2013, 8 (06) : 901 - 908
  • [5] Hypo and Hyperarticulated Speech Data Augmentation for Spontaneous Speech Recognition
    Lee, Sung Joo
    Kang, Byung-Ok
    Chung, Hoon
    Park, Jeon Gue
    Lee, Yun Keun
    2018 26TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2018, : 2080 - 2084
  • [6] A STUDY ON DATA AUGMENTATION OF REVERBERANT SPEECH FOR ROBUST SPEECH RECOGNITION
    Ko, Tom
    Peddinti, Vijayaditya
    Povey, Daniel
    Seltzer, Michael L.
    Khudanpur, Sanjeev
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 5220 - 5224
  • [7] Data Augmentation using Healthy Speech for Dysarthric Speech Recognition
    Vachhani, Bhavik
    Bhat, Chitralekha
    Kopparapu, Sunil Kumar
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 471 - 475
  • [8] Improving Multimodal Speech Recognition by Data Augmentation and Speech Representations
    Oneata, Dan
    Cucu, Horia
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 4578 - 4587
  • [9] IMPORTANTAUG: A DATA AUGMENTATION AGENT FOR SPEECH
    Viet Anh Trinh
    Kavaki, Hassan Salami
    Mandel, Michael, I
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 8592 - 8596
  • [10] EEG based Vowel Classification during Speech Imagery
    Idrees, Basil M.
    Farooq, Omar
    PROCEEDINGS OF THE 10TH INDIACOM - 2016 3RD INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT, 2016, : 1130 - 1134