Memorability-based image compression

被引:3
|
作者
Khanna, Meera Thapar [1 ]
Ralekar, Chetan [1 ]
Goel, Anurika [1 ,2 ]
Chaudhury, Santanu [1 ,3 ]
Lall, Brejesh [1 ]
机构
[1] Indian Inst Technol Delhi, Dept Elect Engn, Multimedia Lab, New Delhi 110016, India
[2] Goldman Sachs Bengaluru, Bengaluru, Karnataka, India
[3] CSIR Cent Elect Engn Res Inst, Pilani, Rajasthan, India
关键词
Boltzmann machines; data compression; image coding; convolutional neural nets; region-of-interest-based memorability preserving image compression algorithm; memorability prediction; memorability score; memorability map values; optimised image compression; convolutional neural network; restricted Boltzmann machine features; eye tracking experiment; human participants; MODEL; OBSERVERS; PREDICT;
D O I
10.1049/iet-ipr.2018.6097
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study is concerned with achieving the image compression using the concept of memorability. The authors have used memorability of an image, as a perceptual measure while image coding. In the proposed approach, a region-of-interest-based memorability preserving image compression algorithm which is accomplished via two sub-processes namely, memorability prediction and image compression is introduced. The memorability of images is predicted using convolutional neural network and restricted Boltzmann machine features. Based on these features, the memorability score of individual patches in an image is calculated and these scores are used to generate the memorability map. These memorability map values are used for optimised image compression. In order to validate the results, an eye tracking experiment with human participants is performed. The comparative analysis shows that the memorability-based compression outperforms the state-of-the-art compression techniques.
引用
收藏
页码:1490 / 1501
页数:12
相关论文
共 50 条
  • [1] The development of the memorability-based strategy: Insight from a training study
    Ghetti, S
    Papini, S
    Angelini, L
    JOURNAL OF EXPERIMENTAL CHILD PSYCHOLOGY, 2006, 94 (03) : 206 - 228
  • [2] Developmental differences in false-event rejection: Effects of memorability-based warnings
    Ghetti, Simona
    Castelli, Paola
    MEMORY, 2006, 14 (06) : 762 - 776
  • [3] Memorability Based Image to Image Translation
    Basavaraju, Sathisha
    Sharma, Prasen Kumar
    Sur, Arijit
    TWELFTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2019), 2020, 11433
  • [4] Memorability-based multimedia analytics for robotic interestingness prediction system using trimmed Q-learning algorithm
    Hasnain Ali
    Syed Omer Gilani
    Asim Waris
    Umer Hameed Shah
    Muazzam A. Khan Khattak
    Muhammad Jawad Khan
    Namra Afzal
    Scientific Reports, 13
  • [5] Memorability-based multimedia analytics for robotic interestingness prediction system using trimmed Q-learning algorithm
    Ali, Hasnain
    Gilani, Syed Omer
    Waris, Asim
    Shah, Umer Hameed
    Khattak, Muazzam A. Khan
    Khan, Muhammad Jawad
    Afzal, Namra
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [6] Understanding Image Memorability
    Rust, Nicole C.
    Mehrpour, Vahid
    TRENDS IN COGNITIVE SCIENCES, 2020, 24 (07) : 557 - 568
  • [7] Incidental image memorability
    Goetschalckx, Lore
    Moors, Jade
    Wagemans, Johan
    MEMORY, 2019, 27 (09) : 1273 - 1282
  • [8] THE MEMORABILITY OF THE FILMIC IMAGE
    CASEY, ES
    QUARTERLY REVIEW OF FILM AND VIDEO, 1981, 6 (03): : 241 - 264
  • [9] The time course of image memorability
    Goetschalckx, Lore
    Wagemans, Johan
    PERCEPTION, 2016, 45 : 67 - 67
  • [10] Review of Image Memorability Prediction
    Liu, Jie
    Wang, Dou-Dou
    Wang, Yan
    Zhang, Hao-Yang
    ICGSP '19 - PROCEEDINGS OF THE 2019 3RD INTERNATIONAL CONFERENCE ON GRAPHICS AND SIGNAL PROCESSING, 2019, : 24 - 28