Visual Decoding of Phrases from Occipital Neuromagnetic Signals

被引:1
|
作者
Dash, Debadatta [1 ,2 ]
Ferrari, Paul [3 ]
Borna, Amir [4 ]
Iivanainen, Joonas [4 ]
Schwindt, Peter D. D. [5 ]
Wang, Jun [1 ]
机构
[1] Univ Texas Austin, Dept Neurol, Dell Med Sch, Austin, TX 78712 USA
[2] Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78712 USA
[3] Spectrum Hlth & Helen DeVos Childrens Hosp, Grand Rapids, MI 49503 USA
[4] Sandia Natl Labs, Phys Based Microsyst Div, Albuquerque, NM 87123 USA
[5] Sandia Natl Labs, Semicond Mat & Device Sci Dept, Albuquerque, NM 87123 USA
基金
美国国家卫生研究院;
关键词
WORD FORM AREA; BRAIN; MAGNETOENCEPHALOGRAPHY; RECOGNITION; SIMILARITY; ACTIVATION; DYNAMICS;
D O I
10.1109/NER49283.2021.9441328
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Orthographic visual perception (reading) is encoded via a widespread dynamic interaction between different language centers of the brain and visual cortex. In this study, we investigated orthographic visual perception decoding with Magnetoencephalography (MEG), where phrases were visually presented to participants. We compared the decoding performance obtained with sensors within the occipital lobe that obtained with sensors covering the whole head. Two naive machine learning classifiers namely support vector machines (SVM) and linear discriminant analysis (LDA) were used. Experimental results indicated that the decoding performance using only occipital sensors is similar to the performance obtained with all sensors within the task period, which were all above chance level. In addition, temporal analysis by taking short-time windows showed that the occipital sensors were more discriminative near onset compared to later time periods, while using the whole head sensor setup at later time periods performed slightly better than occipital sensors. This finding may indicate a sequential order (from visual cortex to other areas beyond occipital lobe) during visual speech perception.
引用
收藏
页码:230 / 233
页数:4
相关论文
共 50 条
  • [31] DECODING VISUAL COVERT SELECTIVE SPATIAL ATTENTION BASED ON MAGNETOENCEPHALOGRAPHY SIGNALS
    Hosseini, Seyyed Abed
    BIOMEDICAL ENGINEERING-APPLICATIONS BASIS COMMUNICATIONS, 2019, 31 (01):
  • [32] Decoding of coherent but not incoherent motion signals in early dorsal visual cortex
    Schwarzkopf, Dietrich Samuel
    Sterzer, Philipp
    Rees, Geraint
    NEUROIMAGE, 2011, 56 (02) : 688 - 698
  • [33] Decoding eye-of-origin signals in and beyond primary visual cortex
    Kaestner, Milena
    Maloney, Ryan T.
    Bloj, Marina
    Harris, Julie M.
    Wade, Alex R.
    PERCEPTION, 2016, 45 : 49 - 49
  • [34] Brain-to-text: decoding spoken phrases from phone representations in the brain
    Herff, Christian
    Heger, Dominic
    de Pesters, Adriana
    Telaar, Dominic
    Brunner, Peter
    Schalk, Gerwin
    Schultz, Tanja
    FRONTIERS IN NEUROSCIENCE, 2015, 9
  • [35] Neuromagnetic signals associated with number comparison task
    Hiwaki, O
    Takae, S
    Hashizume, A
    Kurisu, K
    IEEE TRANSACTIONS ON MAGNETICS, 2002, 38 (05) : 3350 - 3352
  • [36] Have you been here before?: Decoding memory traces for visual scenes from brain signals
    Bles, Mart
    Haynes, John-Dylan
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2008, 43 (3-4) : 624 - 624
  • [37] Decoding Brain Signals from Rapid-Event EEG for Visual Analysis Using Deep Learning
    Rehman, Madiha
    Anwer, Humaira
    Garay, Helena
    Alemany-Iturriaga, Josep
    Diez, Isabel De la Torre
    Siddiqui, Hafeez ur Rehman
    Ullah, Saleem
    SENSORS, 2024, 24 (21)
  • [38] Decoding Color Visual Working Memory from EEG Signals Using Graph Convolutional Neural Networks
    Che, Xiaowei
    Zheng, Yuanjie
    Chen, Xin
    Song, Sutao
    Li, Shouxin
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2022, 32 (02)
  • [39] Decoding the signals
    New Electron, 8 (36):
  • [40] Modification of neuromagnetic cortical signals by thalamic infarctions
    Mäkelä, JP
    Salmelin, R
    Kotila, M
    Salonen, O
    Laaksonen, R
    Hokkanen, L
    Hari, R
    ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1998, 106 (05): : 433 - 443