Memorability-based image compression

被引:3
|
作者
Khanna, Meera Thapar [1 ]
Ralekar, Chetan [1 ]
Goel, Anurika [1 ,2 ]
Chaudhury, Santanu [1 ,3 ]
Lall, Brejesh [1 ]
机构
[1] Indian Inst Technol Delhi, Dept Elect Engn, Multimedia Lab, New Delhi 110016, India
[2] Goldman Sachs Bengaluru, Bengaluru, Karnataka, India
[3] CSIR Cent Elect Engn Res Inst, Pilani, Rajasthan, India
关键词
Boltzmann machines; data compression; image coding; convolutional neural nets; region-of-interest-based memorability preserving image compression algorithm; memorability prediction; memorability score; memorability map values; optimised image compression; convolutional neural network; restricted Boltzmann machine features; eye tracking experiment; human participants; MODEL; OBSERVERS; PREDICT;
D O I
10.1049/iet-ipr.2018.6097
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study is concerned with achieving the image compression using the concept of memorability. The authors have used memorability of an image, as a perceptual measure while image coding. In the proposed approach, a region-of-interest-based memorability preserving image compression algorithm which is accomplished via two sub-processes namely, memorability prediction and image compression is introduced. The memorability of images is predicted using convolutional neural network and restricted Boltzmann machine features. Based on these features, the memorability score of individual patches in an image is calculated and these scores are used to generate the memorability map. These memorability map values are used for optimised image compression. In order to validate the results, an eye tracking experiment with human participants is performed. The comparative analysis shows that the memorability-based compression outperforms the state-of-the-art compression techniques.
引用
收藏
页码:1490 / 1501
页数:12
相关论文
共 50 条
  • [31] The effect of intrinsic image memorability on recollection and familiarity
    N. Broers
    N.A. Busch
    Memory & Cognition, 2021, 49 : 998 - 1018
  • [32] Correction to: The effect of intrinsic image memorability on recollection and familiarity
    N. Broers
    N. A. Busch
    Memory & Cognition, 2021, 49 : 1019 - 1019
  • [33] Wavelet based image compression
    Kaykusuz, ME
    Üner, MK
    PROCEEDINGS OF THE IEEE 12TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, 2004, : 300 - 303
  • [34] Image Compression Based on PDEs
    Zhao Cui-fang
    Du Meng
    2011 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT), VOLS 1-4, 2012, : 1768 - 1771
  • [35] Security Analyses of Click-based Graphical Passwords via Image Point Memorability
    Zhu, Bin B.
    Yan, Jeff
    Wei, Dongchen
    Yang, Maowei
    CCS'14: PROCEEDINGS OF THE 21ST ACM CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2014, : 1217 - 1231
  • [36] Image Memorability Prediction Using Depth and Motion Cues
    Basavaraju, Sathisha
    Sur, Arijit
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2020, 7 (03) : 600 - 609
  • [37] Review of Methods to Predict Social Image Interestingness and Memorability
    Amengual, Xesca
    Bosch, Anna
    Lluis de la Rosa, Josep
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2015, PT I, 2015, 9256 : 64 - 76
  • [38] Defining Image Memorability Using the Visual Memory Schema
    Akagunduz, Erdem
    Bors, Adrian G.
    Evans, Karla K.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (09) : 2165 - 2178
  • [39] Image compression based on combination of fractal and VQ compression
    Chen, ZL
    Sin, JB
    Tian, QM
    ICEMI'2003: PROCEEDINGS OF THE SIXTH INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS, VOLS 1-3, 2003, : 1909 - 1912
  • [40] Deep Learning for Image Memorability Prediction: the Emotional Bias
    Baveye, Yoann
    Cohendet, Romain
    Da Silva, Matthieu Perreira
    Le Callet, Patrick
    MM'16: PROCEEDINGS OF THE 2016 ACM MULTIMEDIA CONFERENCE, 2016, : 491 - 495