Decoding of imagined speech electroencephalography neural signals using transfer learning method

被引:4
|
作者
Mahapatra, Nrushingh Charan [1 ,2 ]
Bhuyan, Prachet [2 ]
机构
[1] Intel Technol India Pvt Ltd, Bengaluru 560103, India
[2] Kalinga Inst Ind Technol, Sch Comp Engn, Bhubaneswar 751024, India
来源
JOURNAL OF PHYSICS COMMUNICATIONS | 2023年 / 7卷 / 09期
关键词
brain-computer interface (BCI); deep learning (DL); electroencephalography (EEG); imagined speech; signal processing; transfer learning (TL); EEG; ARTIFACTS;
D O I
10.1088/2399-6528/ad0197
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The use of brain-computer interfaces to produce imagined speech from brain waves has the potential to assist individuals with difficulty producing speech or communicating silently. The decoding of covert speech has been observed to have limited efficacy due to the diverse nature of the associated measured brain waves and the limited number of covert speech databases. As a result, traditional machine learning algorithms for learning and inference are challenging, and one of the real alternatives could be to leverage transfer of learning. The main goals of this research were to create a new deep learning (DL) framework for decoding imagined speech electroencephalography (EEG) signals tasks using transfer learning and to transfer the model learning of the source task of an imagined speech EEG dataset to the model training on the target task of another imagined speech EEG dataset, essentially the cross-task learning transfer of discriminative characteristics of the source task to the target task of imagined speech. The experiment was carried out using two distinct open-access EEG datasets, FEIS and KaraOne, that recorded the imagined speech classes of neural signals from multiple individuals. The target FEIS model and the target KaraOne model for multiclass classification exhibit overall accuracy of 89.01% and 82.35%, respectively, according to the proposed transfer learning. The experiment results indicate that the cross-task deep transfer learning design reliably classifies the imagined speech EEG signals by applying the source task learning to the target task learning. The findings suggest the feasibility of a consistent strategy for classifying multiclass imagined speech with transfer learning, which could thereby open up the possibility of future investigation into cross-task imagined speech classification knowledge usability for generalization of new imagined speech prompts.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Decoding Imagined Speech From EEG Using Transfer Learning
    Panachakel, Jerrin Thomas
    Ganesan, Ramakrishnan Angarai
    IEEE ACCESS, 2021, 9 : 135371 - 135383
  • [2] Multiclass Classification of Imagined Speech Vowels and Words of Electroencephalography Signals Using Deep Learning
    Mahapatra, Nrushingh Charan
    Bhuyan, Prachet
    ADVANCES IN HUMAN-COMPUTER INTERACTION, 2022, 2022
  • [3] Identification of discriminative features for decoding overt and imagined speech using stereotactic electroencephalography
    Meng, Kevin
    Grayden, David B.
    Cook, Mark J.
    Vogrin, Simon
    Goodarzy, Farhad
    2021 9TH IEEE INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2021, : 105 - 110
  • [4] Decoding Speech from Single Trial MEG Signals Using Convolutional Neural Networks and Transfer Learning
    Dash, Debadatta
    Ferrari, Paul
    Heitzman, Daragh
    Wang, Jun
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 5531 - 5535
  • [5] Speech decoding from stereo-electroencephalography (sEEG) signals using advanced deep learning methods
    Wu, Xiaolong
    Wellington, Scott
    Fu, Zhichun
    Zhang, Dingguo
    JOURNAL OF NEURAL ENGINEERING, 2024, 21 (03)
  • [6] Decoding Imagined Speech using Wavelet Features and Deep Neural Networks
    Panachakel, Jerrin Thomas
    Ramakrishnan, A. G.
    Ananthapadmanabha, T., V
    2019 IEEE 16TH INDIA COUNCIL INTERNATIONAL CONFERENCE (IEEE INDICON 2019), 2019,
  • [7] Towards Neural Decoding of Imagined Speech based on Spoken Speech
    Lee, Seo-Hyun
    Lee, Young-Eun
    Kim, Soowon
    Ko, Byung-Kwan
    Lee, Seong-Whan
    2023 11TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE, BCI, 2023,
  • [8] Optimizing Layers Improves CNN Generalization and Transfer Learning for Imagined Speech Decoding from EEG
    Cooney, Ciaran
    Folli, Raffaella
    Coyle, Damien
    2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 1311 - 1316
  • [9] Wavelet-based imagined speech classification using electroencephalography
    Pawar, Dipti
    Dhage, Sudhir
    INTERNATIONAL JOURNAL OF BIOMEDICAL ENGINEERING AND TECHNOLOGY, 2022, 38 (03) : 215 - 224
  • [10] Olfactory Decoding Method Using Neural Spike Signals
    Kyung-jin YOU
    Hyun-chool SHIN
    Journal of Measurement Science and Instrumentation, 2010, 1 (01) : 81 - 85