IMAGE MEMORABILITY: THE ROLE OF DEPTH AND MOTION

被引:0
|
作者
Basavaraju, Sathisha [1 ]
Mittal, Paritosh [1 ]
Sur, Arijit [1 ]
机构
[1] Indian Inst Technol Guwahati, Gauhati, India
关键词
Image Memorability; Deep CNN; Optical Flow; Image Depth; LONG-TERM-MEMORY;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Understanding what makes an image memorable or forgettable is one of the interesting problems in the domain of computer vision and cognitive science. The initial studies have demonstrated that memorability is an inherent characteristic of an image and have found many high-level image properties (such as emotions, saliency, object statistics, popularity, aesthetics, etc.) which influence image memorability. This paper sheds light on the relationship between image memorability and two image features: motion and depth which, to the best of our knowledge, is still unexplored. Experimental analysis reveals that motion and depth cues have a positive influence in determining image memorability. Further, the paper presents a novel deep learning model, FOD-MemNet, to exploit motion and depth cues along with object features to predict image memorability. Experimental results demonstrate that the proposed FOD-MemNet model outperforms the current state-of-the-art model by achieving a rank correlation of 0.655 which is near to human consistency (rho=0.68).
引用
收藏
页码:699 / 703
页数:5
相关论文
共 50 条
  • [1] Image Memorability Prediction Using Depth and Motion Cues
    Basavaraju, Sathisha
    Sur, Arijit
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2020, 7 (03) : 600 - 609
  • [2] Understanding Image Memorability
    Rust, Nicole C.
    Mehrpour, Vahid
    TRENDS IN COGNITIVE SCIENCES, 2020, 24 (07) : 557 - 568
  • [3] Incidental image memorability
    Goetschalckx, Lore
    Moors, Jade
    Wagemans, Johan
    MEMORY, 2019, 27 (09) : 1273 - 1282
  • [4] THE MEMORABILITY OF THE FILMIC IMAGE
    CASEY, ES
    QUARTERLY REVIEW OF FILM AND VIDEO, 1981, 6 (03): : 241 - 264
  • [5] Memorability Based Image to Image Translation
    Basavaraju, Sathisha
    Sharma, Prasen Kumar
    Sur, Arijit
    TWELFTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2019), 2020, 11433
  • [6] The time course of image memorability
    Goetschalckx, Lore
    Wagemans, Johan
    PERCEPTION, 2016, 45 : 67 - 67
  • [7] Review of Image Memorability Prediction
    Liu, Jie
    Wang, Dou-Dou
    Wang, Yan
    Zhang, Hao-Yang
    ICGSP '19 - PROCEEDINGS OF THE 2019 3RD INTERNATIONAL CONFERENCE ON GRAPHICS AND SIGNAL PROCESSING, 2019, : 24 - 28
  • [8] Depth and motion thresholds from relative image motion
    Ohtsuka, S
    Ujike, H
    Sato, T
    Saida, S
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 1997, 38 (04) : 393 - 393
  • [9] Is Image Memorability Prediction Solved?
    Perera, Shay
    Tal, Ayellet
    Zelnik-Manor, Lihi
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 800 - 808
  • [10] Rules of photography for image memorability analysis
    Lahrache, Souad
    El Ouazzani, Rajae
    El Qadi, Abderrahim
    IET IMAGE PROCESSING, 2018, 12 (07) : 1228 - 1236