Mid-level visual features underlie the high-level categorical organization of the ventral stream

被引:124
|
作者
Long, Bria [1 ,2 ]
Yu, Chen-Ping [1 ,3 ]
Konkle, Talia [1 ]
机构
[1] Harvard Univ, Dept Psychol, 33 Kirkland St, Cambridge, MA 02138 USA
[2] Stanford Univ, Dept Psychol, Stanford, CA 94305 USA
[3] Phiar Technol Inc, Palo Alto, CA 94303 USA
关键词
ventral stream organization; mid-level features; object recognition; fMRI; deep neural networks; FUSIFORM FACE AREA; NEURAL REPRESENTATIONS; CONGENITALLY BLIND; TEMPORAL CORTEX; OBJECT CATEGORY; SHAPE; SELECTIVITY; SIZE; PERCEPTION; SIMILARITY;
D O I
10.1073/pnas.1719616115
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Human object-selective cortex shows a large-scale organization characterized by the high-level properties of both animacy and object size. To what extent are these neural responses explained by primitive perceptual features that distinguish animals from objects and big objects from small objects? To address this question, we used a texture synthesis algorithm to create a class of stimuli-texforms-which preserve some mid-level texture and form information from objects while rendering them unrecognizable. We found that unrecognizable texforms were sufficient to elicit the large-scale organizations of object-selective cortex along the entire ventral pathway. Further, the structure in the neural patterns elicited by texforms was well predicted by curvature features and by intermediate layers of a deep convolutional neural network, supporting the mid-level nature of the representations. These results provide clear evidence that a substantial portion of ventral stream organization can be accounted for by coarse texture and form information without requiring explicit recognition of intact objects.
引用
收藏
页码:E9015 / E9024
页数:10
相关论文
共 50 条
  • [1] Mid-level workers: high-level bungling?
    不详
    [J]. SAMJ SOUTH AFRICAN MEDICAL JOURNAL, 2007, 97 (03): : 148 - 148
  • [2] Mid-level workers: high-level bungling?
    van Niekerk, J. P. de V.
    [J]. SAMJ SOUTH AFRICAN MEDICAL JOURNAL, 2006, 96 (12): : 1209 - +
  • [3] Luminance and color inputs to mid-level and high-level vision
    Jennings, Ben J.
    Martinovic, Jasna
    [J]. JOURNAL OF VISION, 2014, 14 (02): : 1 - 17
  • [4] Learning Mid-Level Features For Recognition
    Boureau, Y-Lan
    Bach, Francis
    LeCun, Yann
    Ponce, Jean
    [J]. 2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 2559 - 2566
  • [5] High-level concept detection based on mid-level semantic information and contextual adaptation
    Mylonas, Phivos
    Spyrou, Evaggelos
    Avrithis, Yannis
    [J]. SECOND INTERNATIONAL WORKSHOP ON SEMANTIC MEDIA ADAPTATION AND PERSONALIZATION, PROCEEDINGS, 2007, : 193 - 198
  • [6] Object shape and surface properties are jointly encoded in mid-level ventral visual cortex
    Pasupathy, Anitha
    Kim, Taekjun
    Popovkina, Dina V.
    [J]. CURRENT OPINION IN NEUROBIOLOGY, 2019, 58 : 199 - 208
  • [7] Unsupervised learning of mid-level visual representations
    Matteucci, Giulio
    Piasini, Eugenio
    Zoccolan, Davide
    [J]. CURRENT OPINION IN NEUROBIOLOGY, 2024, 84
  • [8] Mining Mid-level Features for Image Classification
    Basura Fernando
    Elisa Fromont
    Tinne Tuytelaars
    [J]. International Journal of Computer Vision, 2014, 108 : 186 - 203
  • [9] Understanding mid-level representations in visual processing
    Peirce, Jonathan W.
    [J]. JOURNAL OF VISION, 2015, 15 (07):
  • [10] Emotion recognition from mid-level features
    Sanchez-Mendoza, David
    Masip, David
    Lapedriza, Agata
    [J]. PATTERN RECOGNITION LETTERS, 2015, 67 : 66 - 74