The Spatiotemporal Neural Dynamics of Object Recognition for Natural Images and Line Drawings

被引:6
|
作者
Singer, Johannes J. D. [1 ,2 ]
Cichy, Radoslaw M. [2 ]
Hebart, Martin N. [1 ,3 ]
机构
[1] Max Planck Inst Human Cognit & Brain Sci, Vis & Computat Cognit Grp, D-04103 Leipzig, Germany
[2] Free Univ Berlin, Dept Educ & Psychol, D-14195 Berlin, Germany
[3] Justus Liebig Univ Giessen, Dept Med, D-35390 Giessen, Germany
来源
JOURNAL OF NEUROSCIENCE | 2023年 / 43卷 / 03期
基金
欧洲研究理事会;
关键词
decoding; fMRI; line drawings; MEG; object recognition; representational similarity analysis; TOP-DOWN FACILITATION; CATEGORY INFORMATION; FINE CATEGORIZATION; PICTURE PERCEPTION; VISUAL SCENES; REPRESENTATIONS; FMRI; MEG; NETWORKS; PRIMER;
D O I
10.1523/JNEUROSCI.1546-22.2022
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Drawings offer a simple and efficient way to communicate meaning. While line drawings capture only coarsely how objects look in reality, we still perceive them as resembling real-world objects. Previous work has shown that this perceived similarity is mirrored by shared neural representations for drawings and natural images, which suggests that similar mechanisms underlie the recognition of both. However, other work has proposed that representations of drawings and natural images become similar only after substantial processing has taken place, suggesting distinct mechanisms. To arbitrate between those alternatives, we measured brain responses resolved in space and time using fMRI and MEG, respectively, while human participants (female and male) viewed images of objects depicted as photographs, line drawings, or sketch-like drawings. Using multivariate decoding, we demonstrate that object category information emerged similarly fast and across overlapping regions in occipital, ventral-temporal, and posterior parietal cortex for all types of depiction, yet with smaller effects at higher levels of visual abstraction. In addition, cross-decoding between depiction types revealed strong generalization of object category information from early processing stages on. Finally, by combining fMRI and MEG data using representational similarity analysis, we found that visual information traversed similar processing stages for all types of depiction, yet with an overall stronger representation for photographs. Together, our results demonstrate broad commonalities in the neural dynamics of object recognition across types of depiction, thus providing clear evidence for shared neural mechanisms underlying recognition of natural object images and abstract drawings.
引用
收藏
页码:484 / 500
页数:17
相关论文
共 50 条
  • [41] Spatiotemporal dynamics of natural phenomena
    Mateu, J.
    STOCHASTIC ENVIRONMENTAL RESEARCH AND RISK ASSESSMENT, 2010, 24 (04) : 483 - 485
  • [42] Gabor Feature based Convolutional Neural Network for Object Recognition in Natural Scene
    Hu Yao
    Hu Dan
    Li Chuyi
    Yu Weiyu
    2016 3RD INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND CONTROL ENGINEERING (ICISCE), 2016, : 386 - 390
  • [43] Human Fixations on Line Drawings of Natural Scenes
    Yang, Kaifu
    Jiang, Wenwen
    Li, Yongjie
    PERCEPTION, 2019, 48 : 152 - 152
  • [44] Neural mechanisms of object recognition
    Riesenhuber, M
    Poggio, T
    CURRENT OPINION IN NEUROBIOLOGY, 2002, 12 (02) : 162 - 168
  • [45] Neural Correlates of Subjective Awareness for Natural Scene Categorization of Color Photographs and Line-Drawings
    Fu, Qiufang
    Liu, Yong-Jin
    Dienes, Zoltan
    Wu, Jianhui
    Chen, Wenfeng
    Fu, Xiaolan
    FRONTIERS IN PSYCHOLOGY, 2017, 8
  • [46] A NEURAL NETWORK APPROACH TO THE LABELING OF LINE DRAWINGS
    SALEM, GJ
    YOUNG, TY
    IEEE TRANSACTIONS ON COMPUTERS, 1991, 40 (12) : 1419 - 1424
  • [47] Visual agnosia for line drawings and silhouettes without apparent impairment of real-object recognition: A case report
    Hiraoka, Kotaro
    Suzuki, Kyoko
    Hirayama, Kazumi
    Mori, Etsuro
    BEHAVIOURAL NEUROLOGY, 2009, 21 (3-4) : 187 - 192
  • [48] Object and anatomical feature recognition in surgical video images based on a convolutional neural network
    Yoshiko Bamba
    Shimpei Ogawa
    Michio Itabashi
    Hironari Shindo
    Shingo Kameoka
    Takahiro Okamoto
    Masakazu Yamamoto
    International Journal of Computer Assisted Radiology and Surgery, 2021, 16 : 2045 - 2054
  • [49] Object and anatomical feature recognition in surgical video images based on a convolutional neural network
    Bamba, Yoshiko
    Ogawa, Shimpei
    Itabashi, Michio
    Shindo, Hironari
    Kameoka, Shingo
    Okamoto, Takahiro
    Yamamoto, Masakazu
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2021, 16 (11) : 2045 - 2054
  • [50] Accuracy Evaluation of Automated Object Recognition Using Multispectral Aerial Images and Neural Network
    Mozgovoy, Dmitriy
    Hnatushenko, Volodymyr
    Vasyliev, Volodymyr
    TENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2018), 2018, 10806