Visual Decoding of Phrases from Occipital Neuromagnetic Signals

被引:1
|
作者
Dash, Debadatta [1 ,2 ]
Ferrari, Paul [3 ]
Borna, Amir [4 ]
Iivanainen, Joonas [4 ]
Schwindt, Peter D. D. [5 ]
Wang, Jun [1 ]
机构
[1] Univ Texas Austin, Dept Neurol, Dell Med Sch, Austin, TX 78712 USA
[2] Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78712 USA
[3] Spectrum Hlth & Helen DeVos Childrens Hosp, Grand Rapids, MI 49503 USA
[4] Sandia Natl Labs, Phys Based Microsyst Div, Albuquerque, NM 87123 USA
[5] Sandia Natl Labs, Semicond Mat & Device Sci Dept, Albuquerque, NM 87123 USA
基金
美国国家卫生研究院;
关键词
WORD FORM AREA; BRAIN; MAGNETOENCEPHALOGRAPHY; RECOGNITION; SIMILARITY; ACTIVATION; DYNAMICS;
D O I
10.1109/NER49283.2021.9441328
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Orthographic visual perception (reading) is encoded via a widespread dynamic interaction between different language centers of the brain and visual cortex. In this study, we investigated orthographic visual perception decoding with Magnetoencephalography (MEG), where phrases were visually presented to participants. We compared the decoding performance obtained with sensors within the occipital lobe that obtained with sensors covering the whole head. Two naive machine learning classifiers namely support vector machines (SVM) and linear discriminant analysis (LDA) were used. Experimental results indicated that the decoding performance using only occipital sensors is similar to the performance obtained with all sensors within the task period, which were all above chance level. In addition, temporal analysis by taking short-time windows showed that the occipital sensors were more discriminative near onset compared to later time periods, while using the whole head sensor setup at later time periods performed slightly better than occipital sensors. This finding may indicate a sequential order (from visual cortex to other areas beyond occipital lobe) during visual speech perception.
引用
收藏
页码:230 / 233
页数:4
相关论文
共 50 条
  • [1] Decoding Subjective Simultaneity from Neuromagnetic Signals
    Takahashi, Kohske
    Hidaka, Shohei
    Watanabe, Katsumi
    17TH INTERNATIONAL CONFERENCE ON BIOMAGNETISM ADVANCES IN BIOMAGNETISM - BIOMAG2010, 2010, 28 : 191 - +
  • [2] Decoding visual predictions from occipital alpha oscillationsAwareness & Consciousness
    Turner, William
    Blom, Tessel
    Hogendoorn, Hinze
    PERCEPTION, 2022, 51 : 176 - 176
  • [3] Decoding Imagined and Spoken Phrases From Non-invasive Neural (MEG) Signals
    Dash, Debadatta
    Ferrari, Paul
    Wang, Jun
    FRONTIERS IN NEUROSCIENCE, 2020, 14
  • [4] Decoding visual consciousness from human brain signals
    Haynes, John-Dylan
    TRENDS IN COGNITIVE SCIENCES, 2009, 13 (05) : 194 - 202
  • [5] Volumetric imaging of brain activity with spatial-frequency decoding of neuromagnetic signals
    Xiang, Jing
    Korman, Abraham
    Samarasinghe, Kasun M.
    Wang, Xiaopei
    Zhang, Fawen
    Qiao, Hui
    Sun, Bo
    Wang, Fengbin
    Fan, Howard H.
    Thompson, Elizabeth A.
    JOURNAL OF NEUROSCIENCE METHODS, 2015, 239 : 114 - 128
  • [6] Decoding of Visual Attention from LFP Signals of Macaque MT
    Esghaei, Moein
    Daliri, Mohammad Reza
    PLOS ONE, 2014, 9 (06):
  • [7] Decoding visual stimulus in semantic space from electrocorticography signals
    Fukuma, Ryohei
    Yanagisawa, Takufumi
    Nishimoto, Shinji
    Tanaka, Masataka
    Yamamoto, Shota
    Oshino, Satoru
    Kamitani, Yukiyasu
    Kishima, Haruhiko
    2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 102 - 104
  • [8] OCCIPITAL AND INFEROTEMPORAL RESPONSES TO VISUAL SIGNALS IN THE MONKEY
    ASHFORD, JW
    FUSTER, JM
    EXPERIMENTAL NEUROLOGY, 1985, 90 (02) : 444 - 466
  • [9] The role of occipital regions in visual priming and orthographic word decoding
    Samuelsson, SS
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2000, 35 (3-4) : 117 - 117
  • [10] Decoding visual object categories from temporal correlations of ECoG signals
    Majima, Kei
    Matsuo, Takeshi
    Kawasaki, Keisuke
    Kawai, Kensuke
    Saito, Nokihito
    Hasegawa, Isao
    Kamitani, Yukiyasu
    NEUROIMAGE, 2014, 90 : 74 - 83