The Spatiotemporal Neural Dynamics of Object Recognition for Natural Images and Line Drawings

被引:6
|
作者
Singer, Johannes J. D. [1 ,2 ]
Cichy, Radoslaw M. [2 ]
Hebart, Martin N. [1 ,3 ]
机构
[1] Max Planck Inst Human Cognit & Brain Sci, Vis & Computat Cognit Grp, D-04103 Leipzig, Germany
[2] Free Univ Berlin, Dept Educ & Psychol, D-14195 Berlin, Germany
[3] Justus Liebig Univ Giessen, Dept Med, D-35390 Giessen, Germany
来源
JOURNAL OF NEUROSCIENCE | 2023年 / 43卷 / 03期
基金
欧洲研究理事会;
关键词
decoding; fMRI; line drawings; MEG; object recognition; representational similarity analysis; TOP-DOWN FACILITATION; CATEGORY INFORMATION; FINE CATEGORIZATION; PICTURE PERCEPTION; VISUAL SCENES; REPRESENTATIONS; FMRI; MEG; NETWORKS; PRIMER;
D O I
10.1523/JNEUROSCI.1546-22.2022
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Drawings offer a simple and efficient way to communicate meaning. While line drawings capture only coarsely how objects look in reality, we still perceive them as resembling real-world objects. Previous work has shown that this perceived similarity is mirrored by shared neural representations for drawings and natural images, which suggests that similar mechanisms underlie the recognition of both. However, other work has proposed that representations of drawings and natural images become similar only after substantial processing has taken place, suggesting distinct mechanisms. To arbitrate between those alternatives, we measured brain responses resolved in space and time using fMRI and MEG, respectively, while human participants (female and male) viewed images of objects depicted as photographs, line drawings, or sketch-like drawings. Using multivariate decoding, we demonstrate that object category information emerged similarly fast and across overlapping regions in occipital, ventral-temporal, and posterior parietal cortex for all types of depiction, yet with smaller effects at higher levels of visual abstraction. In addition, cross-decoding between depiction types revealed strong generalization of object category information from early processing stages on. Finally, by combining fMRI and MEG data using representational similarity analysis, we found that visual information traversed similar processing stages for all types of depiction, yet with an overall stronger representation for photographs. Together, our results demonstrate broad commonalities in the neural dynamics of object recognition across types of depiction, thus providing clear evidence for shared neural mechanisms underlying recognition of natural object images and abstract drawings.
引用
收藏
页码:484 / 500
页数:17
相关论文
共 50 条
  • [32] Ontology for the Object Recognition in Images
    Zheng, Bin
    Huang, Lina
    Lu, Xinhai
    MINES 2009: FIRST INTERNATIONAL CONFERENCE ON MULTIMEDIA INFORMATION NETWORKING AND SECURITY, VOL 1, PROCEEDINGS, 2009, : 633 - +
  • [33] Object Recognition in Forward-Looking Sonar Images with Convolutional Neural Networks
    Valdenegro-Toro, Matias
    OCEANS 2016 MTS/IEEE MONTEREY, 2016,
  • [34] Object Recognition in Remote Sensing Images Based on Modified Backpropagation Neural Network
    Raju, Manthena Narasimha
    Natarajan, Kumaran
    Vasamsetty, Chandra Sekhar
    TRAITEMENT DU SIGNAL, 2021, 38 (02) : 451 - 459
  • [35] PICTORIAL STRUCTURES FOR OBJECT RECOGNITION AND PART LABELING IN DRAWINGS
    Sadovnik, Amir
    Chen, Tsuhan
    2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011,
  • [36] A New Approach of Object Recognition in Encrypted Images using Convolutional Neural Network
    Tayari, Zina
    Hnana, Nasreddine
    Zaied, Mourad
    TWELFTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2019), 2020, 11433
  • [37] Using Grayscale Images for Object Recognition with Convolutional-Recursive Neural Network
    Hieu Minh Bui
    Lech, Margaret
    Cheng, Eva
    Neville, Katrina
    Burnett, Ian S.
    2016 IEEE SIXTH INTERNATIONAL CONFERENCE ON COMMUNICATIONS AND ELECTRONICS (ICCE), 2016, : 321 - 325
  • [38] A Character Extraction and Recognition Method for Line Drawings
    Su, Feng
    Cai, Shijie
    PROCEEDINGS OF THE 2009 2ND INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOLS 1-9, 2009, : 2484 - 2488
  • [39] LINE-DRAWINGS SEGMENTATION FOR RECOGNITION AND INTERPRETATION
    BELAID, A
    MASINI, G
    TSI-TECHNIQUE ET SCIENCE INFORMATIQUES, 1982, 1 (02): : 155 - 168
  • [40] Study on line recognition in scanned engineering drawings
    Wang Jin-He
    Zhang Nan
    IMECS 2007: INTERNATIONAL MULTICONFERENCE OF ENGINEERS AND COMPUTER SCIENTISTS, VOLS I AND II, 2007, : 1867 - +