Memorability-based image compression

被引:3
|
作者
Khanna, Meera Thapar [1 ]
Ralekar, Chetan [1 ]
Goel, Anurika [1 ,2 ]
Chaudhury, Santanu [1 ,3 ]
Lall, Brejesh [1 ]
机构
[1] Indian Inst Technol Delhi, Dept Elect Engn, Multimedia Lab, New Delhi 110016, India
[2] Goldman Sachs Bengaluru, Bengaluru, Karnataka, India
[3] CSIR Cent Elect Engn Res Inst, Pilani, Rajasthan, India
关键词
Boltzmann machines; data compression; image coding; convolutional neural nets; region-of-interest-based memorability preserving image compression algorithm; memorability prediction; memorability score; memorability map values; optimised image compression; convolutional neural network; restricted Boltzmann machine features; eye tracking experiment; human participants; MODEL; OBSERVERS; PREDICT;
D O I
10.1049/iet-ipr.2018.6097
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study is concerned with achieving the image compression using the concept of memorability. The authors have used memorability of an image, as a perceptual measure while image coding. In the proposed approach, a region-of-interest-based memorability preserving image compression algorithm which is accomplished via two sub-processes namely, memorability prediction and image compression is introduced. The memorability of images is predicted using convolutional neural network and restricted Boltzmann machine features. Based on these features, the memorability score of individual patches in an image is calculated and these scores are used to generate the memorability map. These memorability map values are used for optimised image compression. In order to validate the results, an eye tracking experiment with human participants is performed. The comparative analysis shows that the memorability-based compression outperforms the state-of-the-art compression techniques.
引用
收藏
页码:1490 / 1501
页数:12
相关论文
共 50 条
  • [21] ResMem-Net: memory based deep CNN for image memorability estimation
    Praveen, Arockia
    Noorwali, Abdulfattah
    Samiayya, Duraimurugan
    Khan, Mohammad Zubair
    Vincent, Durai Raj P. M.
    Bashir, Ali Kashif
    Alagupandi, Vinoth
    PEERJ COMPUTER SCIENCE, 2021, 7 : 1 - 27
  • [22] Image Memorability Prediction Model Based on Low-Rank Representation Learning
    Chu Jinghui
    Gu Huimin
    Su Yuting
    LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (07)
  • [23] Cross-cultural consistency of image memorability
    Jeong, Su Keun
    SCIENTIFIC REPORTS, 2023, 13 (01):
  • [24] Increasing Image Memorability with Neural Style Transfer
    Siarohin, Aliaksandr
    Zen, Gloria
    Majtanovic, Cveta
    Alameda-Pineda, Xavier
    Ricci, Elisa
    Sebe, Nicu
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2019, 15 (02)
  • [25] Image Memorability Prediction Using Deep Features
    Zarezadeh, Soodabeh
    Rezaeian, Mehdi
    Sadeghi, Mohammad Taghi
    2017 25TH IRANIAN CONFERENCE ON ELECTRICAL ENGINEERING (ICEE), 2017, : 2176 - 2181
  • [26] Image memorability across longer time intervals
    Goetschalckx, Lore
    Moors, Pieter
    Wagemans, Johan
    MEMORY, 2018, 26 (05) : 581 - 588
  • [27] Cross-cultural consistency of image memorability
    Su Keun Jeong
    Scientific Reports, 13 (1)
  • [28] The effect of intrinsic image memorability on recollection and familiarity
    Broers, N.
    Busch, N. A.
    MEMORY & COGNITION, 2021, 49 (05) : 998 - 1018
  • [29] Understanding and Predicting Image Memorability at a Large Scale
    Khosla, Aditya
    Raju, Akhil S.
    Torralba, Antonio
    Oliva, Aude
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 2390 - 2398
  • [30] Bag-of-features for image memorability evaluation
    Lahrache, Souad
    El Ouazzani, Rajae
    El Qadi, Abderrahim
    IET COMPUTER VISION, 2016, 10 (06) : 577 - 584