IMAGE MEMORABILITY: THE ROLE OF DEPTH AND MOTION

被引:0
|
作者
Basavaraju, Sathisha [1 ]
Mittal, Paritosh [1 ]
Sur, Arijit [1 ]
机构
[1] Indian Inst Technol Guwahati, Gauhati, India
关键词
Image Memorability; Deep CNN; Optical Flow; Image Depth; LONG-TERM-MEMORY;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Understanding what makes an image memorable or forgettable is one of the interesting problems in the domain of computer vision and cognitive science. The initial studies have demonstrated that memorability is an inherent characteristic of an image and have found many high-level image properties (such as emotions, saliency, object statistics, popularity, aesthetics, etc.) which influence image memorability. This paper sheds light on the relationship between image memorability and two image features: motion and depth which, to the best of our knowledge, is still unexplored. Experimental analysis reveals that motion and depth cues have a positive influence in determining image memorability. Further, the paper presents a novel deep learning model, FOD-MemNet, to exploit motion and depth cues along with object features to predict image memorability. Experimental results demonstrate that the proposed FOD-MemNet model outperforms the current state-of-the-art model by achieving a rank correlation of 0.655 which is near to human consistency (rho=0.68).
引用
收藏
页码:699 / 703
页数:5
相关论文
共 50 条
  • [31] Integrated segmentation and depth ordering of motion layers in image sequences
    Tweed, DS
    Calway, AD
    IMAGE AND VISION COMPUTING, 2002, 20 (9-10) : 709 - 723
  • [32] Single Image Deblurring and Camera Motion Estimation with Depth Map
    Pan, Liyuan
    Dai, Yuchao
    Liu, Miaomiao
    2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 2116 - 2125
  • [33] A compensation method of motion features with regression for deficient depth image
    1600, Information Processing Society of Japan (06):
  • [34] A Compensation Method of Motion Features with Regression for Deficient Depth Image
    Yumiba, Ryo
    Agata, Yoshiki
    Fujiyoshi, Hironobu
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2013, : 558 - 565
  • [35] Review of Methods to Predict Social Image Interestingness and Memorability
    Amengual, Xesca
    Bosch, Anna
    Lluis de la Rosa, Josep
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2015, PT I, 2015, 9256 : 64 - 76
  • [36] Defining Image Memorability Using the Visual Memory Schema
    Akagunduz, Erdem
    Bors, Adrian G.
    Evans, Karla K.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (09) : 2165 - 2178
  • [37] Auxiliary Means to Improve Motion Guidance Memorability in Extended Reality
    Gebhardt, Patrick
    Weiss, Maximilian
    Huszar, Pascal
    Yu, Xingyao
    Achberger, Alexander
    Zhang, Xiaobing
    Sedlmair, Michael
    2023 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS, VRW, 2023, : 689 - 690
  • [38] Deep Learning for Image Memorability Prediction: the Emotional Bias
    Baveye, Yoann
    Cohendet, Romain
    Da Silva, Matthieu Perreira
    Le Callet, Patrick
    MM'16: PROCEEDINGS OF THE 2016 ACM MULTIMEDIA CONFERENCE, 2016, : 491 - 495
  • [39] Visualizations memorability through visual attention and image features
    Lahrache, Souad
    El Ouazzani, Rajae
    El Qadi, Abderrahim
    PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING IN DATA SCIENCES (ICDS2017), 2018, 127 : 328 - 335
  • [40] Role of the visual area 18 in the perception of motion in depth
    Bisti, S.
    Biral, G. P.
    Trimarchi, C.
    PERCEPTION, 1990, 19 (04) : 331 - 331