On some distributions and their pattern entropies

被引:2
|
作者
Shamir, Gil I. [1 ]
机构
[1] Univ Utah, ECE Dept, Salt Lake City, UT 84112 USA
关键词
D O I
10.1109/ISIT.2006.262090
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
We study the block entropy of patterns of sequences generated by uniform and monotonic memoryless source distributions. In the former case, the pattern entropy decreases the most from the memoryless entropy, and in the latter the least. General upper and lower bounds are presented and then applied to these distributions. Tighter bounds are derived for a uniform case. All bounds provide almost precise characterization of the pattern entropies of uniform distributions, distributions over the integers, and the geometric distribution. Of specific interest are distributions over the integers that have infinite entropy rates in the memoryless case but bounded pattern block entropies.
引用
收藏
页码:2541 / 2545
页数:5
相关论文
共 50 条
  • [21] Convexity Properties of Some Entropies
    Ioan Raşa
    Results in Mathematics, 2018, 73
  • [22] Some inequalities on generalized entropies
    Shigeru Furuichi
    Nicuşor Minculete
    Flavia-Corina Mitroi
    Journal of Inequalities and Applications, 2012
  • [23] Complete monotonicity of some entropies
    Rasa, Ioan
    PERIODICA MATHEMATICA HUNGARICA, 2017, 75 (02) : 159 - 166
  • [24] ENTROPIES OF SOME AMINO ACIDS
    HUTCHENS, JO
    COLE, AG
    ROBIE, RA
    STOUT, JW
    FEDERATION PROCEEDINGS, 1957, 16 (01) : 64 - 64
  • [25] Complete monotonicity of some entropies
    Ioan Raşa
    Periodica Mathematica Hungarica, 2017, 75 : 159 - 166
  • [26] Distinct word length frequencies: distributions and symbol entropies
    Smith, Reginald
    GLOTTOMETRICS, 2012, 23 : 7 - 22
  • [27] On new notion of quasi-entropies of eventological distributions
    Semenova, D
    Proceedings of the Second IASTED International Multi-Conference on Automation, Control, and Information Technology - Automation, Control, and Applications, 2005, : 380 - 385
  • [28] Characterization of Distributions through Maximization of alpha-Entropies
    Awad, Adnan M.
    Marzuq, Maher M.
    IMA JOURNAL OF MATHEMATICAL CONTROL AND INFORMATION, 1986, 3 (01) : 1 - 7
  • [29] SOME APPLICATIONS OF MAJORIZATION TO QUANTUM ENTROPIES
    Liu, Lu
    Li, Yuan
    REPORTS ON MATHEMATICAL PHYSICS, 2014, 74 (01) : 1 - 12
  • [30] Some General Properties of Unified Entropies
    Alexey E. Rastegin
    Journal of Statistical Physics, 2011, 143 : 1120 - 1135