Basic inequalities for weighted entropies

被引:15
|
作者
Suhov, Yuri [1 ,2 ,3 ]
Stuhl, Izabella [4 ,5 ,6 ]
Sekeh, Salimeh Yasaei [7 ]
Kelbert, Mark [8 ,9 ]
机构
[1] Univ Cambridge, DPMMS, Cambridge, England
[2] Penn State Univ, Dept Math, Philadelphia, PA USA
[3] IPIT RAS, Moscow, Russia
[4] Univ Sao Paulo, IMS, Sao Paulo, SP, Brazil
[5] Univ Denver, Dept Math, Denver, CO 80208 USA
[6] Univ Debrecen, Debrecen, Hungary
[7] Univ Fed Sao Carlos, Dept Stat, Sao Carlos, SP, Brazil
[8] Univ Swansea, Dept Math, Swansea, W Glam, Wales
[9] Moscow Higher Sch Econ, Moscow, Russia
基金
巴西圣保罗研究基金会;
关键词
Weighted entropy; weighted conditional entropy; weighted relative entropy; weighted mutual entropy; weighted Gibbs inequality; convexity; concavity; weighted Hadamard inequality; weighed Fisher information; weighed Cramer-Rao inequalities; QUANTITATIVE-QUALITATIVE MEASURE; INFORMATION; DISTRIBUTIONS; SYSTEMS;
D O I
10.1007/s00010-015-0396-5
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The concept of weighted entropy takes into account values of different outcomes, i.e., makes entropy context-dependent, through the weight function. In this paper, we establish a number of simple inequalities for the weighted entropies (general as well as specific), mirroring similar bounds on standard (Shannon) entropies and related quantities. The required assumptions are written in terms of various expectations of weight functions. Examples are weighted Ky Fan and weighted Hadamard inequalities involving determinants of positive-definite matrices, and weighted Cram,r-Rao inequalities involving the weighted Fisher information matrix.
引用
收藏
页码:817 / 848
页数:32
相关论文
共 50 条
  • [1] Basic inequalities for weighted entropies
    Yuri Suhov
    Izabella Stuhl
    Salimeh Yasaei Sekeh
    Mark Kelbert
    [J]. Aequationes mathematicae, 2016, 90 : 817 - 848
  • [2] Weighted entropies
    Ebanks, Bruce R.
    [J]. CENTRAL EUROPEAN JOURNAL OF MATHEMATICS, 2010, 8 (03): : 602 - 615
  • [3] Weighted entropies and their estimations
    Nourbakhsh, Mohammadreza
    Yari, Gholamhossein
    Mehrali, Yaser
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2020, 49 (05) : 1142 - 1158
  • [4] On weighted exponential entropies
    Kvälseth, TO
    [J]. PERCEPTUAL AND MOTOR SKILLS, 2001, 92 (01) : 3 - 7
  • [5] INEQUALITIES FOR RELATIVE OPERATOR ENTROPIES
    Kluza, Pawel A.
    Niezgoda, Marek
    [J]. ELECTRONIC JOURNAL OF LINEAR ALGEBRA, 2014, 27 : 851 - 864
  • [6] Inequalities for Information Potentials and Entropies
    Acu, Ana Maria
    Maduta, Alexandra
    Otrocol, Diana
    Rasa, Ioan
    [J]. MATHEMATICS, 2020, 8 (11) : 1 - 18
  • [7] Some inequalities on generalized entropies
    Furuichi, Shigeru
    Minculete, Nicusor
    Mitroi, Flavia-Corina
    [J]. JOURNAL OF INEQUALITIES AND APPLICATIONS, 2012,
  • [8] Some inequalities on generalized entropies
    Shigeru Furuichi
    Nicuşor Minculete
    Flavia-Corina Mitroi
    [J]. Journal of Inequalities and Applications, 2012
  • [9] Entropies, convexity, and functional inequalities
    Chafaï, D
    [J]. JOURNAL OF MATHEMATICS OF KYOTO UNIVERSITY, 2004, 44 (02): : 325 - 363
  • [10] Functional Equations for Weighted Entropies
    Bruce Ebanks
    [J]. Results in Mathematics, 2009, 55