Categorizing objects from MEG signals using EEGNet

被引:5
|
作者
Shi, Ran [1 ]
Zhao, Yanyu [1 ]
Cao, Zhiyuan [1 ]
Liu, Chunyu [1 ]
Kang, Yi [1 ]
Zhang, Jiacai [1 ,2 ]
机构
[1] Beijing Normal Univ, Sch Artificial Intelligence, Beijing 100875, Peoples R China
[2] Minist Educ, Engn Res Ctr Intelligent Technol & Educ Applicat, Beijing 100875, Peoples R China
关键词
Neural decoding; Magnetoencephalography; Deep learning; Feature fusion; HUMAN BRAIN; PATTERN-ANALYSIS; VISUAL-IMAGERY; CLASSIFICATION; FREQUENCY; STREAM;
D O I
10.1007/s11571-021-09717-7
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Magnetoencephalography (MEG) signals have demonstrated their practical application to reading human minds. Current neural decoding studies have made great progress to build subject-wise decoding models to extract and discriminate the temporal/spatial features in neural signals. In this paper, we used a compact convolutional neural network-EEGNet-to build a common decoder across subjects, which deciphered the categories of objects (faces, tools, animals, and scenes) from MEG data. This study investigated the influence of the spatiotemporal structure of MEG on EEGNet's classification performance. Furthermore, the EEGNet replaced its convolution layers with two sets of parallel convolution structures to extract the spatial and temporal features simultaneously. Our results showed that the organization of MEG data fed into the EEGNet has an effect on EEGNet classification accuracy, and the parallel convolution structures in EEGNet are beneficial to extracting and fusing spatial and temporal MEG features. The classification accuracy demonstrated that the EEGNet succeeds in building the common decoder model across subjects, and outperforms several state-of-the-art feature fusing methods.
引用
收藏
页码:365 / 377
页数:13
相关论文
共 50 条
  • [21] LMA-EEGNet: A Lightweight Multi-Attention Network for Neonatal Seizure Detection Using EEG signals
    Zhou, Weicheng
    Zheng, Wei
    Feng, Youbing
    Li, Xiaolong
    ELECTRONICS, 2024, 13 (12)
  • [22] Autism Detection in Children using Common Spatial Patterns of MEG Signals
    Barik, Kasturi
    Watanabe, Katsumi
    Hirosawa, Tetsu
    Yoshimura, Yuko
    Kikuchi, Mitsuru
    Bhattacharya, Joydeep
    Saha, Goutam
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [23] A new approach to the fusion of EEG and MEG signals using the LCMV beamformer
    Mohseni, Hamid R.
    Kringelbach, Morten L.
    Woolrich, Mark W.
    Aziz, Tipu Z.
    Smith, Penny Probert
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 1202 - 1206
  • [24] Decoding Speech from Single Trial MEG Signals Using Convolutional Neural Networks and Transfer Learning
    Dash, Debadatta
    Ferrari, Paul
    Heitzman, Daragh
    Wang, Jun
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 5531 - 5535
  • [25] Detection of Multiple Salient Objects by Categorizing Regional Features
    Oh, Kang-Han
    Kim, Soo-Hyung
    Kim, Young-Chul
    Lee, Yu-Ra
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2016, 10 (01): : 272 - 287
  • [26] Categorizing natural objects: a comparison of the visual and the haptic modalities
    Gaissert, Nina
    Wallraven, Christian
    EXPERIMENTAL BRAIN RESEARCH, 2012, 216 (01) : 123 - 134
  • [28] Automatic Speech Activity Recognition from MEG Signals Using Seq2Seq Learning
    Dash, Debadatta
    Ferrari, Paul
    Malik, Saleem
    Wang, Jun
    2019 9TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2019, : 340 - 343
  • [29] A robust and practical method to separate periodic signals from MEG data using second order statistics
    Department of Engineering, Gifu University, Yanagido 1-1, Gifu-shi, Gifu-ken, Japan
    BIOSIGNALS - Proc. Int. Conf. Bio-Inspired Syst. Signal Process., (372-377):
  • [30] Categorizing arbitrarily shaped objects based on grasping configurations
    Moussa, Medhat
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2006, 54 (10) : 858 - 863