Preliminary study for intonation classification of imagined speech for brain-computer interface applications

被引:0
|
作者
Casso, Isabel [1 ]
Rouillard, Jose [2 ]
Si-Mohammed, Hakim [2 ]
Betrouni, Nacim [3 ]
Cabestaing, Francois [2 ]
Basirat, Anahita [1 ]
机构
[1] Univ Lille, CNRS, UMR 9193, SCALab, F-59000 Lille, France
[2] Univ Lille, CNRS, Cent Lille, UMR 9189,CRIStAL, F-59000 Lille, France
[3] Univ Lille, CHU Lille, INSERM, U1172,Lille Neurosci & Cognit, F-59000 Lille, France
关键词
Intonation; imagined speech; EEG; brain-computer interfaces; prosody;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
In the current study, we focused on decoding speech prosody from EEG. Prosody (i.e., melody and rhythm of speech) is important during communication as it allows to convey emotion and meaning. However, it has received little attention in the field of brain-computer interfaces. To address this issue, we contrasted the production of two syllables, "ba" and "da", produced mentally as an affirmation (e.g., "ba.") or a question (e.g., "ba?") using two different intonations. We focused on spectral features. After classification in the time-frequency domain, we found above chance-level accuracies in specific frequency ranges of the alpha band (7-12 Hz) early on during the production phase. We also obtained above chance-level results on a range of the low-beta band (16-20 Hz) during a late time window. Based on the visual inspection of topographies and the literature, we suggest that the results during the early time window, but not that during the late time window, reflect a genuine difference between imagined affirmation and question production. Future studies should provide more information about neural markers and underlying neuro-cognitive processes to improve the understanding of the imagined intonation production. This would pave the way for the development of speech-based BCI capable of differentiating intonation and prosody in general.
引用
收藏
页码:1238 / 1242
页数:5
相关论文
共 50 条
  • [1] Preliminary study of a brain-computer interface
    Song, YS
    Ryu, CS
    Yoo, DS
    Choi, SS
    Moon, SS
    Sohn, JH
    [J]. WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL 8, PROCEEDINGS: CONCEPTS AND APPLICATIONS OF SYSTEMICS, CYBERNETICS AND INFORMATICS, 1999, : 222 - 225
  • [2] Classification of brain-computer interface data
    AlZoubi, Omar
    Koprinska, Irena
    Calvo, Rafael A.
    [J]. Conferences in Research and Practice in Information Technology Series, 2008, 87 : 123 - 131
  • [3] Brain-Computer Interface: Applications to Speech Decoding and Synthesis to Augment Communication
    Luo, Shiyu
    Rabbani, Qinwan
    Crone, Nathan E.
    [J]. NEUROTHERAPEUTICS, 2022, 19 (01) : 263 - 273
  • [4] Brain-Computer Interface: Applications to Speech Decoding and Synthesis to Augment Communication
    Shiyu Luo
    Qinwan Rabbani
    Nathan E. Crone
    [J]. Neurotherapeutics, 2022, 19 : 263 - 273
  • [5] Development of a ternary hybrid fNIRS-EEG brain-computer interface based on imagined speech
    Sereshkeh, Alborz Rezazadeh
    Yousefi, Rozhin
    Wong, Andrew T.
    Rudzicz, Frank
    Chau, Tom
    [J]. BRAIN-COMPUTER INTERFACES, 2019, 6 (04) : 128 - 140
  • [6] Meaning Based Covert Speech Classification for Brain-Computer Interface Based on Electroencephalography
    Kim, Taekyung
    Lee, Jeyeon
    Choi, Hoseok
    Lee, Hojong
    Kim, In-Young
    Jang, Dong Pyo
    [J]. 2013 6TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2013, : 53 - 56
  • [7] Classification of EEG Signals for Brain-Computer Interface Applications: Performance Comparison
    Ilyas, M. Z.
    Saad, P.
    Ahmad, M. I.
    Ghani, A. R. I.
    [J]. PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON ROBOTICS, AUTOMATION AND SCIENCES (ICORAS 2016), 2016,
  • [8] A Study of EEG Features For Multisubject Brain-computer Interface Classification
    Song, Xiaomu
    Perera, Viraga
    Yoon, Suk-Chung
    [J]. 2014 IEEE SIGNAL PROCESSING IN MEDICINE AND BIOLOGY SYMPOSIUM (SPMB), 2014,
  • [9] Classification of imagined beats for use in a brain computer interface
    de Kruif, Bas J.
    Schaefer, Rebecca
    Desain, Peter
    [J]. 2007 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-16, 2007, : 678 - 681
  • [10] FewShotEEG Learning and Classification for Brain-Computer Interface
    Bharati, Subrato
    Ahmad, M. Omair
    Swamy, M. N. S.
    [J]. 2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,