Common Sequential Organization of Face Processing in the Human Brain and Convolutional Neural Networks

被引:0
|
作者
Li, Wenlu [1 ,2 ]
Li, Jin [3 ]
Chu, Congying [1 ]
Cao, Dan [1 ]
Shi, Weiyang [1 ]
Zhang, Yu [4 ]
Jiang, Tianzi [1 ,2 ,4 ,5 ,6 ]
机构
[1] Chinese Acad Sci, Inst Automat, Brainnetome Ctr, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] Capital Normal Univ, Sch Psychol, Beijing 100048, Peoples R China
[4] Zhejiang Lab, Res Ctr Augmented Intelligence, Hangzhou 311100, Peoples R China
[5] Xiaoxiang Inst Brain Hlth, Yongzhou 425000, Hunan, Peoples R China
[6] Yongzhou Cent Hosp, Yongzhou, Hunan, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
face processing; detection-first and recognition-later; human brain; convolutional neural network; computational account; RECOGNITION; MODELS;
D O I
10.1016/j.neuroscience.2024.01.015
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
processing includes two crucial processing levels - face detection and face recognition. However, it remains unclear how human brains organize the two processing levels sequentially. While some studies found that faces are recognized as fast as they are detected, others have reported that faces are detected first, followed by recognition. We discriminated the two processing levels on a fine time scale by combining human intracranial EEG (two females, three males, and three subjects without reported sex information) and representation similarity analysis. Our results demonstrate that the human brain exhibits a "detection-first, recognition-later" pattern during face processing. In addition, we used convolutional neural networks to test the hypothesis that the sequential organization of the two face processing levels in the brain reflects computational optimization. Our findings showed that the networks trained on face recognition also exhibited the "detection-first, recognition-later" pattern. Moreover, this sequential organization mechanism developed gradually during the training of the networks and was observed only for correctly predicted images. These findings collectively support the computational account as to why the brain organizes them in this way. (c) 2024 IBRO. Published by Elsevier Inc. All rights reserved.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [1] Convolutional Neural Networks Applied to Human Face Classification
    Cheung, Brian
    2012 11TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2012), VOL 2, 2012, : 580 - 583
  • [2] Modeling naturalistic face processing in humans with deep convolutional neural networks
    Guo Jiahui
    Ma Feilong
    Castello, Matteo Visconti di Oleggio
    Nastase, Samuel A.
    Haxby, James V.
    Gobbini, M. Ida
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2023, 120 (43)
  • [3] Deep Residual Convolutional Neural Networks for Brain-Computer Interface to Visualize Neural Processing of Hand Movements in the Human Brain
    Fujiwara, Yosuke
    Ushiba, Junichi
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2022, 16
  • [4] Convolutional neural networks for face recognition
    Lawrence, S
    Giles, CL
    Tsoi, AC
    1996 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1996, : 217 - 222
  • [5] Mooney Face Image Processing in Deep Convolutional Neural Networks Compared to Humans
    Zeman, Astrid
    Leers, Tim
    de Beeck, Hans Op
    JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2024, 52 : S99 - S100
  • [6] Mooney Face Image Processing in Deep Convolutional Neural Networks Compared to Humans
    Zeman, Astrid
    Leers, Tim
    de Beeck, Hans Op
    JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2024, 52 : S99 - S100
  • [7] Mooney Face Image Processing in Deep Convolutional Neural Networks Compared to Humans
    Zeman, Astrid
    Leers, Tim
    De Beeck, Hans Op
    PERCEPTION, 2022, 51 : 17 - 18
  • [8] PROCESSING CONVOLUTIONAL NEURAL NETWORKS ON CACHE
    Vieira, Joao
    Roma, Nuno
    Falcao, Gabriel
    Tomas, Pedro
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 1658 - 1662
  • [9] Application of Convolutional Neural Networks for Face Anstispoofing
    Pakulich, D., V
    Alyamkin, S. A.
    OPTOELECTRONICS INSTRUMENTATION AND DATA PROCESSING, 2021, 57 (04) : 412 - 418
  • [10] Deep convolutional neural networks in the face of caricature
    Matthew Q. Hill
    Connor J. Parde
    Carlos D. Castillo
    Y. Ivette Colón
    Rajeev Ranjan
    Jun-Cheng Chen
    Volker Blanz
    Alice J. O’Toole
    Nature Machine Intelligence, 2019, 1 : 522 - 529