On the Conditional Smooth Renyi Entropy and its Applications in Guessing and Source Coding

被引:9
|
作者
Kuzuoka, Shigeaki [1 ]
机构
[1] Wakayama Univ, Fac Syst Engn, Wakayama 6408510, Japan
基金
日本学术振兴会;
关键词
Entropy; Source coding; Decoding; Upper bound; Error probability; Minimization; Guessing; information-spectrum method; side information; source coding; conditional smooth Renyi entropy; MOMENTS; BOUNDS;
D O I
10.1109/TIT.2019.2937318
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A novel definition of the conditional smooth Renyi entropy, which is different from that of Renner and Wolf, is introduced. It is shown that our definition of the conditional smooth Renyi entropy is appropriate for providing lower and upper bounds on the optimal guessing moment in a guessing problem where the guesser is allowed to stop guessing and declare an error. Further a general formula for the optimal guessing exponent is presented. In particular, a single-letterized formula for a mixture of i.i.d. sources is obtained. It is also shown that our definition is appropriate to characterize the optimal exponential moment of the codeword length in the problem of source coding with common side-information available at the encoder and decoder under a constraint on the probability of a decoding error.
引用
收藏
页码:1674 / 1690
页数:17
相关论文
共 50 条
  • [1] On the Conditional Smooth Renyi Entropy and Its Application in Guessing
    Kuzuoka, Shigeaki
    [J]. 2019 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2019, : 647 - 651
  • [2] Smooth Renyi entropy and applications
    Renner, R
    Wolf, S
    [J]. 2004 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, PROCEEDINGS, 2004, : 233 - 233
  • [3] Source Coding, Lists, and Renyi Entropy
    Bunte, Christoph
    Lapidoth, Amos
    [J]. 2013 IEEE INFORMATION THEORY WORKSHOP (ITW), 2013,
  • [4] On the Smooth Renyi Entropy and Variable-Length Source Coding Allowing Errors
    Kuzuoka, Shigeaki
    [J]. 2016 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, 2016, : 745 - 749
  • [5] Tight Bounds on the Renyi Entropy via Majorization with Applications to Guessing and Compression
    Sason, Igal
    [J]. ENTROPY, 2018, 20 (12)
  • [6] On the Conditional Renyi Entropy
    Fehr, Serge
    Berens, Stefan
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (11) : 6801 - 6810
  • [7] Source coding with escort distributions and Renyi entropy bounds
    Bercher, J. -F.
    [J]. PHYSICS LETTERS A, 2009, 373 (36) : 3235 - 3238
  • [8] Improved Bounds on Lossless Source Coding and Guessing Moments via Renyi Measures
    Sason, Igal
    Verdu, Sergio
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2018, 64 (06) : 4323 - 4346
  • [9] Informed guessing of an eavesdropper's Renyi entropy
    Myers, JM
    Wu, TT
    [J]. QUANTUM INFORMATION AND COMPUTATION, 2003, 5105 : 11 - 18
  • [10] Conditional Renyi Entropy and the Relationships between Renyi Capacities
    Aishwarya, Gautam
    Madiman, Mokshay
    [J]. ENTROPY, 2020, 22 (05)