Decoding of imagined speech electroencephalography neural signals using transfer learning method

被引:4
|
作者
Mahapatra, Nrushingh Charan [1 ,2 ]
Bhuyan, Prachet [2 ]
机构
[1] Intel Technol India Pvt Ltd, Bengaluru 560103, India
[2] Kalinga Inst Ind Technol, Sch Comp Engn, Bhubaneswar 751024, India
来源
JOURNAL OF PHYSICS COMMUNICATIONS | 2023年 / 7卷 / 09期
关键词
brain-computer interface (BCI); deep learning (DL); electroencephalography (EEG); imagined speech; signal processing; transfer learning (TL); EEG; ARTIFACTS;
D O I
10.1088/2399-6528/ad0197
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The use of brain-computer interfaces to produce imagined speech from brain waves has the potential to assist individuals with difficulty producing speech or communicating silently. The decoding of covert speech has been observed to have limited efficacy due to the diverse nature of the associated measured brain waves and the limited number of covert speech databases. As a result, traditional machine learning algorithms for learning and inference are challenging, and one of the real alternatives could be to leverage transfer of learning. The main goals of this research were to create a new deep learning (DL) framework for decoding imagined speech electroencephalography (EEG) signals tasks using transfer learning and to transfer the model learning of the source task of an imagined speech EEG dataset to the model training on the target task of another imagined speech EEG dataset, essentially the cross-task learning transfer of discriminative characteristics of the source task to the target task of imagined speech. The experiment was carried out using two distinct open-access EEG datasets, FEIS and KaraOne, that recorded the imagined speech classes of neural signals from multiple individuals. The target FEIS model and the target KaraOne model for multiclass classification exhibit overall accuracy of 89.01% and 82.35%, respectively, according to the proposed transfer learning. The experiment results indicate that the cross-task deep transfer learning design reliably classifies the imagined speech EEG signals by applying the source task learning to the target task learning. The findings suggest the feasibility of a consistent strategy for classifying multiclass imagined speech with transfer learning, which could thereby open up the possibility of future investigation into cross-task imagined speech classification knowledge usability for generalization of new imagined speech prompts.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Decoding imagined speech from EEG signals using hybrid-scale spatial-temporal dilated convolution network
    Li, Fu
    Chao, Weibing
    Li, Yang
    Fu, Boxun
    Ji, Youshuo
    Wu, Hao
    Shi, Guangming
    JOURNAL OF NEURAL ENGINEERING, 2021, 18 (04)
  • [32] Imagined Speech Classification Using EEG and Deep Learning
    Abdulghani, Mokhles M.
    Walters, Wilbur L.
    Abed, Khalid H.
    BIOENGINEERING-BASEL, 2023, 10 (06):
  • [33] Decoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans
    Pei, Xiaomei
    Barbour, Dennis L.
    Leuthardt, Eric C.
    Schalk, Gerwin
    JOURNAL OF NEURAL ENGINEERING, 2011, 8 (04)
  • [34] Decoding lexical tones and vowels in imagined tonal monosyllables using fNIRS signals
    Guo, Zengzhi
    Chen, Fei
    JOURNAL OF NEURAL ENGINEERING, 2022, 19 (06)
  • [35] Deep manifold learning for the reconstruction of spatiotemporal neural activity in brain cortex using electroencephalography signals
    Wu, Lingyun
    Hu, Zhiwen
    Liu, Jing
    Yu, Haitao
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 102
  • [36] Decoding Knowledge Transfer for Neural Text-to-Speech Training
    Liu, Rui
    Sisman, Berrak
    Gao, Guanglai
    Li, Haizhou
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2022, 30 : 1789 - 1802
  • [37] Neural Decoding of Synergy-Based Hand Movements Using Electroencephalography
    Pei, Dingyi
    Patel, Vrajeshri
    Burns, Martin
    Chandramouli, Rajarathnam
    Vinjamuri, Ramana
    IEEE ACCESS, 2019, 7 : 18155 - 18163
  • [38] An Emotion Recognition Method Using Speech Signals Based on Deep Learning
    Byun, Sung-woo
    Shin, Bo-ra
    Lee, Seok-Pil
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2019, 124 : 181 - 182
  • [39] Neural Decoding of EEG Signals with Machine Learning: A Systematic Review
    Saeidi, Maham
    Karwowski, Waldemar
    Farahani, Farzad V.
    Fiok, Krzysztof
    Taiar, Redha
    Hancock, P. A.
    Al-Juaid, Awad
    BRAIN SCIENCES, 2021, 11 (11)
  • [40] Decoding Speech Using the Timing of Neural Signal Modulation
    Jiang, Werner
    Pailla, Tejaswy
    Dichter, Benjamin
    Chang, Edward F.
    Gilja, Vikash
    2016 38TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2016, : 1532 - 1535