IMAGE MEMORABILITY: THE ROLE OF DEPTH AND MOTION

被引:0
|
作者
Basavaraju, Sathisha [1 ]
Mittal, Paritosh [1 ]
Sur, Arijit [1 ]
机构
[1] Indian Inst Technol Guwahati, Gauhati, India
关键词
Image Memorability; Deep CNN; Optical Flow; Image Depth; LONG-TERM-MEMORY;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Understanding what makes an image memorable or forgettable is one of the interesting problems in the domain of computer vision and cognitive science. The initial studies have demonstrated that memorability is an inherent characteristic of an image and have found many high-level image properties (such as emotions, saliency, object statistics, popularity, aesthetics, etc.) which influence image memorability. This paper sheds light on the relationship between image memorability and two image features: motion and depth which, to the best of our knowledge, is still unexplored. Experimental analysis reveals that motion and depth cues have a positive influence in determining image memorability. Further, the paper presents a novel deep learning model, FOD-MemNet, to exploit motion and depth cues along with object features to predict image memorability. Experimental results demonstrate that the proposed FOD-MemNet model outperforms the current state-of-the-art model by achieving a rank correlation of 0.655 which is near to human consistency (rho=0.68).
引用
收藏
页码:699 / 703
页数:5
相关论文
共 50 条
  • [41] Sharp image estimation from a depth-involved motion-blurred image
    Xu, Yuquan
    Hu, Xiyuan
    Peng, Silong
    NEUROCOMPUTING, 2016, 171 : 1185 - 1192
  • [42] Moving Object Detection Using Background Subtraction and Motion Depth Detection in Depth Image Sequences
    Lee, Jichan
    Lim, Sungsoo
    Kim, Jun-Geon
    Kim, Bomin
    Lee, Daeho
    18TH IEEE INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS (ISCE 2014), 2014,
  • [43] Memoir study: Investigating image memorability across developmental stages
    Almog, Gal
    Alavi Naeini, Saeid
    Hu, Yu
    Duerden, Emma G.
    Mohsenzadeh, Yalda
    PLOS ONE, 2023, 18 (12):
  • [44] Embracing New Techniques in Deep Learning for Estimating Image Memorability
    Needell C.D.
    Bainbridge W.A.
    Computational Brain & Behavior, 2022, 5 (2) : 168 - 184
  • [45] Motion image deblurring based on depth residual generative adversarial network
    Wei Bing-cai
    Zhang Li-ye
    Meng Xiao-liang
    Wang Kang-tao
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2021, 36 (12) : 1693 - 1701
  • [46] 2.1 Depth Estimation of Frames in Image Sequences Using Motion Occlusions
    Palou, Guillem
    Salembier, Philippe
    COMPUTER VISION - ECCV 2012, PT III, 2012, 7585 : 516 - 525
  • [47] Image statistics determine the integration of visual cues to motion-in-depth
    Goutcher, Ross
    Murray, Lauren
    Benz, Brooke
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [48] Image statistics determine the integration of visual cues to motion-in-depth
    Ross Goutcher
    Lauren Murray
    Brooke Benz
    Scientific Reports, 12
  • [49] Image Memorability Using Diverse Visual Features and Soft Attention
    Leonardi, Marco
    Celona, Luigi
    Napoletano, Paolo
    Bianco, Simone
    Schettini, Raimondo
    Manessi, Franco
    Rozza, Alessandro
    IMAGE ANALYSIS AND PROCESSING - ICIAP 2019, PT II, 2019, 11752 : 171 - 180
  • [50] Object-centric Scene Understanding for Image Memorability Prediction
    Yoon, Sejong
    Kim, Jongpil
    IEEE 1ST CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2018), 2018, : 305 - 308