Investigation on Effect of Speech Imagery EEG Data Augmentation with Actual Speech

被引:0
|
作者
Choi, Jaehoon [1 ]
Kaongoen, Netiwit [1 ]
Jo, Sungho [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Sch Comp, Daejeon, South Korea
关键词
Brain-computer interface (BCI); Speech-imagery; Actual speech; data augmentation; CLASSIFICATION;
D O I
10.1109/BCI53720.2022.9735108
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Speech imagery based brain-computer interfaces (BCI) have been researched as a potentially powerful method to provide communication and control without explicit bodily movements. Compared to other BCI systems, speech imagery based BCIs can employ mental tasks directly related to control tasks, making them more intuitive for use in daily-life. However, training data is difficult to collect in sufficient size and number in terms of time and user comfort; preparation time to wear electroencephalogram (EEG) measurement devices are lengthy and the devices themselves are uncomfortable to use, making it difficult for subjects to undergo long training sessions without feeling fatigued. To overcome this problem, we suggest a novel data augmentation method using actual speech data. Based on the similarity between the tasks imagined speech and actual speech, we augment EEG training data of imagined speech with EEG data of actual speech and show significant improvements for two out of three subjects.
引用
下载
收藏
页数:5
相关论文
共 50 条
  • [31] Data Augmentation using GANs for Speech Emotion Recognition
    Chatziagapi, Aggelina
    Paraskevopoulos, Georgios
    Sgouropoulos, Dimitris
    Pantazopoulos, Georgios
    Nikandrou, Malvina
    Giannakopoulos, Theodoros
    Katsamanis, Athanasios
    Potamianos, Alexandros
    Narayanan, Shrikanth
    INTERSPEECH 2019, 2019, : 171 - 175
  • [32] EEG coherence is modulated by the irrelevant speech effect
    Kopp, F
    Schröger, E
    Lipka, S
    INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2002, 45 (1-2) : 107 - 107
  • [33] VISUAL AND SPEECH IMAGERY
    WEBER, RJ
    BACH, M
    BRITISH JOURNAL OF PSYCHOLOGY, 1969, 60 : 199 - &
  • [34] Refining Synthesized Speech Using Speaker Information and Phone Masking for Data Augmentation of Speech Recognition
    Ueno, Sei
    Lee, Akinobu
    Kawahara, Tatsuya
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 3924 - 3933
  • [35] Effects of imagery ability and speech anxiety on imagery vividness of imaginary of speech scene
    Koizumi, S
    JAPANESE JOURNAL OF PSYCHOLOGY, 1997, 68 (03): : 203 - 208
  • [36] Speech imagery recalibrates speech-perception boundaries
    Mark Scott
    Attention, Perception, & Psychophysics, 2016, 78 : 1496 - 1511
  • [37] Speech imagery recalibrates speech-perception boundaries
    Scott, Mark
    ATTENTION PERCEPTION & PSYCHOPHYSICS, 2016, 78 (05) : 1496 - 1511
  • [38] Data augmentation strategies for EEG-based motor imagery decoding
    George, Olawunmi
    Smith, Roger
    Madiraju, Praveen
    Yahyasoltani, Nasim
    Ahamed, Sheikh Iqbal
    HELIYON, 2022, 8 (08)
  • [39] Neurophysiologically Meaningful Motor Imagery EEG Simulation With Applications to Data Augmentation
    Galvan, Catalina M.
    Spies, Ruben D.
    Milone, Diego H.
    Peterson, Victoria
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 2346 - 2355
  • [40] Inter Comparison of Classification Techniques for Vowel Speech Imagery Using EEG Sensors
    Riaz, Anaum
    Akhtar, Sana
    Iftikhar, Shanza
    Khan, Amir Ali
    Salman, Ahmad
    2014 2ND INTERNATIONAL CONFERENCE ON SYSTEMS AND INFORMATICS (ICSAI), 2014, : 712 - 717