A study of decoding human brain activities from simultaneous data of EEG and fMRI using MVPA

被引:4
|
作者
Zafar, Raheel [1 ]
Kamel, Nidal [2 ]
Naufal, Mohamad [2 ]
Malik, Aamir Saeed [2 ]
Dass, Sarat C. [2 ]
Ahmad, Rana Fayyaz [2 ]
Abdullah, Jafri M. [3 ,4 ]
Reza, Faruque [3 ,4 ]
机构
[1] Natl Univ Modern Languages, Dept Engn, Islamabad, Pakistan
[2] Univ Teknol PETRONAS, CISIR, Perak, Malaysia
[3] Univ Sains Malaysia, Ctr Neurosci Serv & Res, Kota Baharu 16150, Kelantan, Malaysia
[4] Univ Sains Malaysia, Sch Med Sci, Dept Neurosci, Kota Baharu 16150, Kelantan, Malaysia
关键词
EEG; fMRI; Visual decoding; SVM; DWT; NATURAL IMAGES; CLASSIFICATION; PATTERNS; RECONSTRUCTION; OBJECTS;
D O I
10.1007/s13246-018-0656-5
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Neuroscientists have investigated the functionality of the brain in detail and achieved remarkable results but this area still need further research. Functional magnetic resonance imaging (fMRI) is considered as the most reliable and accurate technique to decode the human brain activity, on the other hand electroencephalography (EEG) is a portable and low cost solution in brain research. The purpose of this study is to find whether EEG can be used to decode the brain activity patterns like fMRI. In fMRI, data from a very specific brain region is enough to decode the brain activity patterns due to the quality of data. On the other hand, EEG can measure the rapid changes in neuronal activity patterns due to its higher temporal resolution i.e., in msec. These rapid changes mostly occur in different brain regions. In this study, multivariate pattern analysis (MVPA) is used both for EEG and fMRI data analysis and the information is extracted from distributed activation patterns of the brain. The significant information among different classes is extracted using two sample t test in both data sets. Finally, the classification analysis is done using the support vector machine. A fair comparison of both data sets is done using the same analysis techniques, moreover simultaneously collected data of EEG and fMRI is used for this comparison. The final analysis is done with the data of eight participants; the average result of all conditions are found which is 65.7% for EEG data set and 64.1% for fMRI data set. It concludes that EEG is capable of doing brain decoding with the data from multiple brain regions. In other words, decoding accuracy with EEG MVPA is as good as fMRI MVPA and is above chance level.
引用
收藏
页码:633 / 645
页数:13
相关论文
共 50 条
  • [41] Simultaneous EEG-fMRI during a neurofeedback task, a brain imaging dataset for multimodal data integration
    Lioi, Giulia
    Cury, Claire
    Perronnet, Lorraine
    Mano, Marsel
    Bannier, Elise
    Lecuyer, Anatole
    Barillot, Christian
    SCIENTIFIC DATA, 2020, 7 (01)
  • [42] EXTRACTION AND VISUALIZATION OF FUNCTIONAL BRAIN CONNECTIVITY NETWORKS FROM EEG AND FMRI DATA
    Roerdink, Jos B. T. M.
    ICEM15: 15TH INTERNATIONAL CONFERENCE ON EXPERIMENTAL MECHANICS, 2012,
  • [43] fMRI-EEG study of healthy human brain responses to functional loads
    Boldyreva G.N.
    Zhavoronkova L.A.
    Sharova E.V.
    Buklina S.B.
    Migalev A.S.
    Pyashina D.V.
    Pronin I.N.
    Korniyenko V.N.
    Human Physiology, 2009, 35 (3) : 274 - 284
  • [44] Decoding Brain States From fMRI Signals by Using Unsupervised Domain Adaptation
    Gao, Yufei
    Zhang, Yameng
    Cao, Zhiyuan
    Guo, Xiaojuan
    Zhang, Jiacai
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (06) : 1677 - 1685
  • [45] Different brain reactivity during phasic and tonic REM sleep:: A simultaneous fMRI and EEG study
    Wehrle, R
    Czisch, M
    Wetter, TC
    Kaufmann, C
    Holsboer, F
    Auer, DP
    Pollmächer, T
    PHARMACOPSYCHIATRY, 2003, 36 (05) : 271 - 271
  • [46] Simultaneous EEG thorn fMRI study of brain activity during an emotional Stroop task in individuals in remission from depression
    Fang, Zhuo
    Lynn, Emma
    Huc, Marie
    Fogel, Stuart
    Knott, Verner J.
    Jaworska, Natalia
    CORTEX, 2022, 155 : 237 - 250
  • [47] Combined EEG and fMRI studies of human brain function
    Menon, V
    Crottaz-Herbette, S
    NEUROIMAGING, PT A, 2005, 66 : 291 - +
  • [48] Capturing the musical brain with Lasso: Dynamic decoding of musical features from fMRI data
    Toiviainen, Petri
    Alluri, Vinoo
    Brattico, Elvira
    Wallentin, Mikkel
    Vuust, Peter
    NEUROIMAGE, 2014, 88 : 170 - 180
  • [49] Amplitude of Sensorimotor Mu Rhythm Is Correlated with BOLD from Multiple Brain Regions: A Simultaneous EEG-fMRI Study
    Yin, Siyang
    Liu, Yuelu
    Ding, Mingzhou
    FRONTIERS IN HUMAN NEUROSCIENCE, 2016, 10
  • [50] Gated Transformer for Decoding Human Brain EEG Signals
    Tao, Yunzhe
    Sun, Tao
    Muhamed, Aashiq
    Genc, Sahika
    Jackson, Dylan
    Arsanjani, Ali
    Yaddanapudi, Suri
    Li, Liang
    Kumar, Prachi
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 125 - 130