On some distributions and their pattern entropies

被引:2
|
作者
Shamir, Gil I. [1 ]
机构
[1] Univ Utah, ECE Dept, Salt Lake City, UT 84112 USA
关键词
D O I
10.1109/ISIT.2006.262090
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
We study the block entropy of patterns of sequences generated by uniform and monotonic memoryless source distributions. In the former case, the pattern entropy decreases the most from the memoryless entropy, and in the latter the least. General upper and lower bounds are presented and then applied to these distributions. Tighter bounds are derived for a uniform case. All bounds provide almost precise characterization of the pattern entropies of uniform distributions, distributions over the integers, and the geometric distribution. Of specific interest are distributions over the integers that have infinite entropy rates in the memoryless case but bounded pattern block entropies.
引用
收藏
页码:2541 / 2545
页数:5
相关论文
共 50 条
  • [1] On some inequalities for entropies of discrete probability distributions
    Jardas, C
    Pecaric, J
    Roki, R
    Sarapa, N
    JOURNAL OF THE AUSTRALIAN MATHEMATICAL SOCIETY SERIES B-APPLIED MATHEMATICS, 1999, 40 : 535 - 541
  • [2] On the entropies and the mutual information of some bivariate continuous distributions used in reliability
    Ahsanullah, M
    Habibullah, M
    LIFETIME DATA: MODELS IN RELIABILITY AND SURVIVAL ANALYSIS, 1996, : 1 - 5
  • [3] Renyi entropies for bernoulli distributions
    Bialas, A.
    Czyz, W.
    Acta Physica Polonica, Series B., 2001, 32 (10): : 2793 - 2800
  • [4] COMPARISON OF ENTROPIES OF POWER DISTRIBUTIONS
    MITTER, J
    MATHUR, YD
    ZEITSCHRIFT FUR ANGEWANDTE MATHEMATIK UND MECHANIK, 1972, 52 (05): : 239 - &
  • [5] Renyi entropies for Bernoulli distributions
    Bialas, A
    Czyz, W
    ACTA PHYSICA POLONICA B, 2001, 32 (10): : 2793 - 2800
  • [6] The Ordering of Shannon Entropies for the Multivariate Distributions and Distributions of Eigenvalues
    Tsai, Ming-Tien
    Hsu, Feng-Ju
    Tsai, Chia-Hsuan
    ENTROPY, 2019, 21 (02)
  • [7] MORE ABOUT ENTROPIES OF POWER DISTRIBUTIONS
    ROY, LK
    ZEITSCHRIFT FUR ANGEWANDTE MATHEMATIK UND MECHANIK, 1980, 60 (01): : 55 - 56
  • [8] COMPARISON OF RENYI ENTROPIES OF POWER DISTRIBUTIONS
    ROY, LK
    ZEITSCHRIFT FUR ANGEWANDTE MATHEMATIK UND MECHANIK, 1976, 56 (05): : 217 - 218
  • [9] Characterising Probability Distributions via Entropies
    Thakor, Satyajit
    Chan, Terence
    Grant, Alex
    PROCEEDINGS OF 2016 INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY AND ITS APPLICATIONS (ISITA 2016), 2016, : 453 - 457
  • [10] ON SOME ENTROPIES FOR IMAGES
    QUESADAMOLINA, JJ
    ROMANROLDAN, R
    COMPUTING AND INFORMATION, 1989, : 263 - 265