Understanding Image Memorability

被引:47
|
作者
Rust, Nicole C. [1 ]
Mehrpour, Vahid [1 ]
机构
[1] Univ Penn, Dept Psychol, Philadelphia, PA 19104 USA
基金
美国国家卫生研究院; 美国国家科学基金会;
关键词
LONG-TERM-MEMORY; INTRINSIC MEMORABILITY; RECOGNITION MEMORY; FAMILIARITY; MODELS; BRAIN; DISTINCTIVENESS; SUPPRESSION; TYPICALITY; REPETITION;
D O I
10.1016/j.tics.2020.04.001
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Why are some images easier to remember than others? Here, we review recent developments in our understanding of 'image memorability', including its behavioral characteristics, its neural correlates, and the optimization principles from which it originates. We highlight work that has used large behavioral data sets to leverage memorability scores computed for individual images. These studies demonstrate that the mapping of image content to image memorability is not only predictable, but also non-intuitive and multifaceted. This work has also led to insights into the neural correlates of image memorability, by way of the discovery of a type of population response magnitude variation that emerges in high-level visual cortex as well as higher stages of deep neural networks trained to categorize objects.
引用
收藏
页码:557 / 568
页数:12
相关论文
共 50 条
  • [41] MemCat: a new category-based image set quantified on memorability
    Goetschalckx, Lore
    Wagemans, Johan
    PEERJ, 2019, 7
  • [42] Multiple instance learning based deep CNN for image memorability prediction
    Basavaraju, Sathisha
    Sur, Arijit
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (24) : 35511 - 35535
  • [43] Population response magnitude variation in inferotemporal cortex predicts image memorability
    Jaegle, Andrew
    Mehrpour, Vahid
    Mohsenzadeh, Yalda
    Meyer, Travis
    Oliva, Aude
    Rust, Nicole
    ELIFE, 2019, 8
  • [44] Multiple instance learning based deep CNN for image memorability prediction
    Sathisha Basavaraju
    Arijit Sur
    Multimedia Tools and Applications, 2019, 78 : 35511 - 35535
  • [45] The resiliency of image memorability: A predictor of memory separate from attention and priming
    Bainbridge, Wilma A.
    NEUROPSYCHOLOGIA, 2020, 141
  • [46] A Survey on Image Memorability Prediction : From Traditional to Deep Learning Models
    Lahrache, Souad
    El Ouazzani, Rajae
    2022 2ND INTERNATIONAL CONFERENCE ON INNOVATIVE RESEARCH IN APPLIED SCIENCE, ENGINEERING AND TECHNOLOGY (IRASET'2022), 2022, : 511 - 520
  • [47] Modular Memorability: Tiered Representations for Video Memorability Prediction
    Dumont, Theo
    Hevia, Juan Segundo
    Fosco, Camilo L.
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 10751 - 10760
  • [48] ResMem-Net: memory based deep CNN for image memorability estimation
    Praveen, Arockia
    Noorwali, Abdulfattah
    Samiayya, Duraimurugan
    Khan, Mohammad Zubair
    Vincent, Durai Raj P. M.
    Bashir, Ali Kashif
    Alagupandi, Vinoth
    PEERJ COMPUTER SCIENCE, 2021, 7 : 1 - 27
  • [49] Image memorability is predicted by discriminability and similarity in different stages of a convolutional neural network
    Koch, Griffin E.
    Akpan, Essang
    Coutanche, Marc N.
    LEARNING & MEMORY, 2020, 27 (12) : 503 - 509
  • [50] Image Memorability Prediction Model Based on Low-Rank Representation Learning
    Chu Jinghui
    Gu Huimin
    Su Yuting
    LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (07)