Characterising Probability Distributions via Entropies

被引:0
|
作者
Thakor, Satyajit [1 ]
Chan, Terence [2 ]
Grant, Alex [3 ]
机构
[1] Indian Inst Technol Mandi, Mandi, Himachal Prades, India
[2] Univ South Australia, Adelaide, SA, Australia
[3] Myriota Pty Ltd, Adelaide, SA, Australia
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Characterising the capacity region for a network can be extremely difficult, especially when the sources are dependent. Most existing computable outer bounds are relaxations of the Linear Programming hound. One main challenge to extend linear program bounds to the case of correlated sources is the difficulty (or impossibility) of characterising arbitrary dependencies via entropy functions. This paper tackles the problem by addressing how to use entropy functions to characterise correlation among sources.
引用
收藏
页码:453 / 457
页数:5
相关论文
共 50 条
  • [1] On some inequalities for entropies of discrete probability distributions
    Jardas, C
    Pecaric, J
    Roki, R
    Sarapa, N
    [J]. JOURNAL OF THE AUSTRALIAN MATHEMATICAL SOCIETY SERIES B-APPLIED MATHEMATICS, 1999, 40 : 535 - 541
  • [2] Nonadditive Entropies Yield Probability Distributions with Biases not Warranted by the Data
    Presse, Steve
    Ghosh, Kingshuk
    Lee, Julian
    Dill, Ken A.
    [J]. PHYSICAL REVIEW LETTERS, 2013, 111 (18)
  • [3] Improved algorithms via approximations of probability distributions
    Chari, S
    Rohatgi, P
    Srinivasan, A
    [J]. JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2000, 61 (01) : 81 - 107
  • [4] CYCLIC SYMMETRY ON CYCLIC AND NONCYCLIC SETS OF PROBABILITY-DISTRIBUTIONS AND THE ENTROPIES OF DEGREE-ALPHA
    NATH, P
    GULATI, KK
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 1991, 27 (02) : 237 - 247
  • [5] Renyi entropies for bernoulli distributions
    Bialas, A.
    Czyz, W.
    [J]. Acta Physica Polonica, Series B, 2001, 32 (10): : 2793 - 2800
  • [6] On some distributions and their pattern entropies
    Shamir, Gil I.
    [J]. 2006 IEEE International Symposium on Information Theory, Vols 1-6, Proceedings, 2006, : 2541 - 2545
  • [7] COMPARISON OF ENTROPIES OF POWER DISTRIBUTIONS
    MITTER, J
    MATHUR, YD
    [J]. ZEITSCHRIFT FUR ANGEWANDTE MATHEMATIK UND MECHANIK, 1972, 52 (05): : 239 - &
  • [8] Renyi entropies for Bernoulli distributions
    Bialas, A
    Czyz, W
    [J]. ACTA PHYSICA POLONICA B, 2001, 32 (10): : 2793 - 2800
  • [9] WLAN location determination via clustering and probability distributions
    Youssef, MA
    Agrawala, A
    Shankar, AU
    [J]. PROCEEDINGS OF THE FIRST IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS (PERCOM 2003), 2003, : 143 - 150
  • [10] The Ordering of Shannon Entropies for the Multivariate Distributions and Distributions of Eigenvalues
    Tsai, Ming-Tien
    Hsu, Feng-Ju
    Tsai, Chia-Hsuan
    [J]. ENTROPY, 2019, 21 (02)