Visual Decoding of Phrases from Occipital Neuromagnetic Signals

被引:1
|
作者
Dash, Debadatta [1 ,2 ]
Ferrari, Paul [3 ]
Borna, Amir [4 ]
Iivanainen, Joonas [4 ]
Schwindt, Peter D. D. [5 ]
Wang, Jun [1 ]
机构
[1] Univ Texas Austin, Dept Neurol, Dell Med Sch, Austin, TX 78712 USA
[2] Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78712 USA
[3] Spectrum Hlth & Helen DeVos Childrens Hosp, Grand Rapids, MI 49503 USA
[4] Sandia Natl Labs, Phys Based Microsyst Div, Albuquerque, NM 87123 USA
[5] Sandia Natl Labs, Semicond Mat & Device Sci Dept, Albuquerque, NM 87123 USA
基金
美国国家卫生研究院;
关键词
WORD FORM AREA; BRAIN; MAGNETOENCEPHALOGRAPHY; RECOGNITION; SIMILARITY; ACTIVATION; DYNAMICS;
D O I
10.1109/NER49283.2021.9441328
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Orthographic visual perception (reading) is encoded via a widespread dynamic interaction between different language centers of the brain and visual cortex. In this study, we investigated orthographic visual perception decoding with Magnetoencephalography (MEG), where phrases were visually presented to participants. We compared the decoding performance obtained with sensors within the occipital lobe that obtained with sensors covering the whole head. Two naive machine learning classifiers namely support vector machines (SVM) and linear discriminant analysis (LDA) were used. Experimental results indicated that the decoding performance using only occipital sensors is similar to the performance obtained with all sensors within the task period, which were all above chance level. In addition, temporal analysis by taking short-time windows showed that the occipital sensors were more discriminative near onset compared to later time periods, while using the whole head sensor setup at later time periods performed slightly better than occipital sensors. This finding may indicate a sequential order (from visual cortex to other areas beyond occipital lobe) during visual speech perception.
引用
收藏
页码:230 / 233
页数:4
相关论文
共 50 条
  • [21] Evaluation of local field potential signals in decoding of visual attention
    Seif, Zahra
    Daliri, Mohammad Reza
    COGNITIVE NEURODYNAMICS, 2015, 9 (05) : 509 - 522
  • [22] Decoding higher order colour signals in human visual cortex
    Goddard, E.
    Mannion, D. J.
    Mcdonald, J. S.
    Solomon, S. G.
    Clifford, C. W. G.
    PERCEPTION, 2008, 37 : 146 - 146
  • [23] NEUROMAGNETIC CORTICAL SIGNALS IN A PATIENT WITH HYDROCEPHALUS
    MAKELA, JP
    HARI, R
    NEUROREPORT, 1994, 5 (09) : 1125 - 1128
  • [24] Decoding stimulus identity in occipital, parietal and inferotemporal cortices during visual mental imagery
    Ragni, Flavio
    Tucciarelli, Raffaele
    Andersson, Patrik
    Lingnau, Angelika
    CORTEX, 2020, 127 : 371 - 387
  • [25] From sensory signals to perceptual decisions: Decoding the flow of visual information through the human brain
    Haynes, John-Dylan
    PERCEPTION, 2011, 40 (01) : 109 - 110
  • [26] Decoding Speech Evoked Jaw Motion from Non-invasive Neuromagnetic Oscillations
    Dash, Debadatta
    Ferrari, Paul
    Wang, Jun
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [27] Neuromagnetic correlates of visual motion coherence
    Aspell, JE
    Tanskanen, T
    Hurlbert, AC
    EUROPEAN JOURNAL OF NEUROSCIENCE, 2005, 22 (11) : 2937 - 2945
  • [28] Decoding the content of visual short-term memory under distraction in occipital and parietal areas
    Bettencourt, Katherine C.
    Xu, Yaoda
    NATURE NEUROSCIENCE, 2016, 19 (01) : 150 - +
  • [29] A neuromagnetic view of the human visual brain
    Vanni, S.
    PERCEPTION, 1997, 26 : 115 - 115
  • [30] Decoding the content of visual short-term memory under distraction in occipital and parietal areas
    Katherine C Bettencourt
    Yaoda Xu
    Nature Neuroscience, 2016, 19 : 150 - 157