Investigation on Effect of Speech Imagery EEG Data Augmentation with Actual Speech

被引:0
|
作者
Choi, Jaehoon [1 ]
Kaongoen, Netiwit [1 ]
Jo, Sungho [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Sch Comp, Daejeon, South Korea
关键词
Brain-computer interface (BCI); Speech-imagery; Actual speech; data augmentation; CLASSIFICATION;
D O I
10.1109/BCI53720.2022.9735108
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Speech imagery based brain-computer interfaces (BCI) have been researched as a potentially powerful method to provide communication and control without explicit bodily movements. Compared to other BCI systems, speech imagery based BCIs can employ mental tasks directly related to control tasks, making them more intuitive for use in daily-life. However, training data is difficult to collect in sufficient size and number in terms of time and user comfort; preparation time to wear electroencephalogram (EEG) measurement devices are lengthy and the devices themselves are uncomfortable to use, making it difficult for subjects to undergo long training sessions without feeling fatigued. To overcome this problem, we suggest a novel data augmentation method using actual speech data. Based on the similarity between the tasks imagined speech and actual speech, we augment EEG training data of imagined speech with EEG data of actual speech and show significant improvements for two out of three subjects.
引用
下载
收藏
页数:5
相关论文
共 50 条
  • [41] Analysis of EEG Frequency Components and an Examination of Electrodes Localization during Speech Imagery
    Tsukahara, Akihiko
    Yamada, Masayuki
    Tanaka, Keita
    Uchikawa, Yoshinori
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 4698 - 4702
  • [42] Augmentation Techniques for Adult-Speech to Generate Child-Like Speech Data Samples at Scale
    Yiwere, Mariam Yahayah
    Barcovschi, Andrei
    Jain, Rishabh
    Cucu, Horia
    Corcoran, Peter
    IEEE ACCESS, 2023, 11 : 109066 - 109081
  • [43] Personalized Adversarial Data Augmentation for Dysarthric and Elderly Speech Recognition
    Jin, Zengrui
    Geng, Mengzhe
    Deng, Jiajun
    Wang, Tianzi
    Hu, Shujie
    Li, Guinan
    Liu, Xunying
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 413 - 429
  • [44] Data Augmentation Techniques for Speech Emotion Recognition and Deep Learning
    Antonio Nicolas, Jose
    de Lope, Javier
    Grana, Manuel
    BIO-INSPIRED SYSTEMS AND APPLICATIONS: FROM ROBOTICS TO AMBIENT INTELLIGENCE, PT II, 2022, 13259 : 279 - 288
  • [45] Improving Speech Emotion Recognition With Adversarial Data Augmentation Network
    Yi, Lu
    Mak, Man-Wai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (01) : 172 - 184
  • [46] A Feature Fusion Model with Data Augmentation for Speech Emotion Recognition
    Tu, Zhongwen
    Liu, Bin
    Zhao, Wei
    Yan, Raoxin
    Zou, Yang
    APPLIED SCIENCES-BASEL, 2023, 13 (07):
  • [47] A Data Augmentation Approach for Improving the Performance of Speech Emotion Recognition
    Paraskevopoulou, Georgia
    Spyrou, Evaggelos
    Perantonis, Stavros
    SIGMAP: PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND MULTIMEDIA APPLICATIONS, 2022, : 61 - 69
  • [48] SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
    Park, Daniel S.
    Chan, William
    Zhang, Yu
    Chiu, Chung-Cheng
    Zoph, Barret
    Cubuk, Ekin D.
    Le, Quoc, V
    INTERSPEECH 2019, 2019, : 2613 - 2617
  • [49] SPEECH EMOTION RECOGNITION WITH MULTISCALE AREA ATTENTION AND DATA AUGMENTATION
    Xu, Mingke
    Zhang, Fan
    Cui, Xiaodong
    Zhang, Wei
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6319 - 6323
  • [50] A Survey of the Effects of Data Augmentation for Automatic Speech Recognition Systems
    Manuel Ramirez, Jose
    Montalvo, Ana
    Ramon Calvo, Jose
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS (CIARP 2019), 2019, 11896 : 669 - 678