On some distributions and their pattern entropies

被引:2
|
作者
Shamir, Gil I. [1 ]
机构
[1] Univ Utah, ECE Dept, Salt Lake City, UT 84112 USA
关键词
D O I
10.1109/ISIT.2006.262090
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
We study the block entropy of patterns of sequences generated by uniform and monotonic memoryless source distributions. In the former case, the pattern entropy decreases the most from the memoryless entropy, and in the latter the least. General upper and lower bounds are presented and then applied to these distributions. Tighter bounds are derived for a uniform case. All bounds provide almost precise characterization of the pattern entropies of uniform distributions, distributions over the integers, and the geometric distribution. Of specific interest are distributions over the integers that have infinite entropy rates in the memoryless case but bounded pattern block entropies.
引用
收藏
页码:2541 / 2545
页数:5
相关论文
共 50 条