The Spatiotemporal Neural Dynamics of Object Recognition for Natural Images and Line Drawings

被引:6
|
作者
Singer, Johannes J. D. [1 ,2 ]
Cichy, Radoslaw M. [2 ]
Hebart, Martin N. [1 ,3 ]
机构
[1] Max Planck Inst Human Cognit & Brain Sci, Vis & Computat Cognit Grp, D-04103 Leipzig, Germany
[2] Free Univ Berlin, Dept Educ & Psychol, D-14195 Berlin, Germany
[3] Justus Liebig Univ Giessen, Dept Med, D-35390 Giessen, Germany
来源
JOURNAL OF NEUROSCIENCE | 2023年 / 43卷 / 03期
基金
欧洲研究理事会;
关键词
decoding; fMRI; line drawings; MEG; object recognition; representational similarity analysis; TOP-DOWN FACILITATION; CATEGORY INFORMATION; FINE CATEGORIZATION; PICTURE PERCEPTION; VISUAL SCENES; REPRESENTATIONS; FMRI; MEG; NETWORKS; PRIMER;
D O I
10.1523/JNEUROSCI.1546-22.2022
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Drawings offer a simple and efficient way to communicate meaning. While line drawings capture only coarsely how objects look in reality, we still perceive them as resembling real-world objects. Previous work has shown that this perceived similarity is mirrored by shared neural representations for drawings and natural images, which suggests that similar mechanisms underlie the recognition of both. However, other work has proposed that representations of drawings and natural images become similar only after substantial processing has taken place, suggesting distinct mechanisms. To arbitrate between those alternatives, we measured brain responses resolved in space and time using fMRI and MEG, respectively, while human participants (female and male) viewed images of objects depicted as photographs, line drawings, or sketch-like drawings. Using multivariate decoding, we demonstrate that object category information emerged similarly fast and across overlapping regions in occipital, ventral-temporal, and posterior parietal cortex for all types of depiction, yet with smaller effects at higher levels of visual abstraction. In addition, cross-decoding between depiction types revealed strong generalization of object category information from early processing stages on. Finally, by combining fMRI and MEG data using representational similarity analysis, we found that visual information traversed similar processing stages for all types of depiction, yet with an overall stronger representation for photographs. Together, our results demonstrate broad commonalities in the neural dynamics of object recognition across types of depiction, thus providing clear evidence for shared neural mechanisms underlying recognition of natural object images and abstract drawings.
引用
收藏
页码:484 / 500
页数:17
相关论文
共 50 条
  • [21] Thresholding images of line drawings with hysteresis
    Pridmore, TP
    GRAPHICS RECOGNITION: ALGORITHMS AND APPLICATIONS, 2002, 2390 : 310 - 319
  • [22] Unveiling the neural dynamics of conscious perception in rapid object recognition
    Motlagh, Saba Charmi
    Joanisse, Marc
    Wang, Boyu
    Mohsenzadeh, Yalda
    NEUROIMAGE, 2024, 296
  • [23] Visual transients improve object recognition of CNNs in sketches but not in natural images
    Schmittwilken, Lynn
    Kestel, Nico
    Maertens, Marianne
    PERCEPTION, 2022, 51 : 74 - 74
  • [24] A Deep Neural Network on Object Recognition Framework for Submerged Fish Images
    Pulidindi, Sushma
    Kamakshaiah, K.
    Yeruva, Sagar
    ADVANCES IN DATA SCIENCE AND MANAGEMENT, 2020, 37 : 443 - 450
  • [25] Automatic target recognition of ISAR object images based on neural network
    Ning, W
    Chen, WG
    Zhang, XG
    PROCEEDINGS OF 2003 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS & SIGNAL PROCESSING, PROCEEDINGS, VOLS 1 AND 2, 2003, : 373 - 376
  • [26] STUDIES ON OBJECT RECOGNITION FROM DEGRADED IMAGES USING NEURAL NETWORKS
    RAVICHANDRAN, A
    YEGNANARAYANA, B
    NEURAL NETWORKS, 1995, 8 (03) : 481 - 488
  • [27] Object-Scene Convolutional Neural Networks for Event Recognition in Images
    Wang, Limin
    Wang, Zhe
    Du, Wenbin
    Qiao, Yu
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2015,
  • [28] Object recognition using spatiotemporal signatures
    Stone, JV
    VISION RESEARCH, 1998, 38 (07) : 947 - 951
  • [29] PROCESSING THE IDENTITY AND ORIENTATION OF OBJECT LINE DRAWINGS
    MCMULLEN, PA
    JOLICOEUR, P
    BULLETIN OF THE PSYCHONOMIC SOCIETY, 1989, 27 (06) : 523 - 523
  • [30] A place for time: the spatiotemporal structure of neural dynamics during natural audition
    Stephens, Greg J.
    Honey, Christopher J.
    Hasson, Uri
    JOURNAL OF NEUROPHYSIOLOGY, 2013, 110 (09) : 2019 - 2026