CNN-based search model fails to account for human attention guidance by simple visual features

被引:0
|
作者
Endel Põder
机构
[1] University of Tartu,Institute of Psychology
来源
关键词
 Models of attention; Neural network modeling; Visual search - Simple visual features - Feature conjunctions;
D O I
暂无
中图分类号
学科分类号
摘要
Recently, Zhang et al. (Nature communications, 9(1), 3730, 2018) proposed an interesting model of attention guidance that uses visual features learnt by convolutional neural networks (CNNs) for object classification. I adapted this model for search experiments, with accuracy as the measure of performance. Simulation of our previously published feature and conjunction search experiments revealed that the CNN-based search model proposed by Zhang et al. considerably underestimates human attention guidance by simple visual features. Using target-distractor differences instead of target features for attention guidance or computing attention map at lower layers of the network could improve the performance. Still, the model fails to reproduce qualitative regularities of human visual search. The most likely explanation is that standard CNNs that are trained on image classification have not learnt medium- or high-level features required for human-like attention guidance.
引用
收藏
页码:9 / 15
页数:6
相关论文
共 50 条
  • [3] Divided attention and visual search for simple versus complex features
    Davis, ET
    Shikano, T
    Peterson, SA
    Michel, RK
    VISION RESEARCH, 2003, 43 (21) : 2213 - 2232
  • [4] Real Time Eye Gaze Tracking System using CNN-based Facial Features for Human Attention Measurement
    Lorenz, Oliver
    Thomas, Ulrike
    PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 598 - 606
  • [5] CNN-based and DTW features for human activity recognition on depth maps
    Trelinski, Jacek
    Kwolek, Bogdan
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (21): : 14551 - 14563
  • [6] CNN-based and DTW features for human activity recognition on depth maps
    Jacek Trelinski
    Bogdan Kwolek
    Neural Computing and Applications, 2021, 33 : 14551 - 14563
  • [7] Whitening CNN-Based Rotor System Fault Diagnosis Model Features
    Miettinen, Jesse
    Nikula, Riku-Pekka
    Keski-Rahkonen, Joni
    Fagerholm, Fredrik
    Tiainen, Tuomas
    Sierla, Seppo
    Viitala, Raine
    APPLIED SCIENCES-BASEL, 2022, 12 (09):
  • [8] Simulation of neuroplasticity in a CNN-based in-silico model of neurodegeneration of the visual system
    Moore, Jasmine A.
    Wilms, Matthias
    Gutierrez, Alejandro
    Ismail, Zahinoor
    Fakhar, Kayson
    Hadaeghi, Fatemeh
    Hilgetag, Claus C.
    Forkert, Nils D.
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2023, 17
  • [9] Multi-Gram CNN-Based Self-Attention Model for Relation Classification
    Zhang, Chunyun
    Cui, Chaoran
    Gao, Sheng
    Nie, Xiushan
    Xu, Weiran
    Yang, Lu
    Xi, Xiaoming
    Yin, Yilong
    IEEE ACCESS, 2019, 7 : 5343 - 5357
  • [10] A lightweight CNN-based knowledge graph embedding model with channel attention for link prediction
    Zhou, Xin
    Guo, Jingnan
    Jiang, Liling
    Ning, Bo
    Wang, Yanhao
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (06) : 9607 - 9624