Discrete Versions of Jensen-Fisher, Fisher and Bayes-Fisher Information Measures of Finite Mixture Distributions

被引:0
|
作者
Kharazmi, Omid [1 ]
Balakrishnan, Narayanaswamy [2 ]
机构
[1] Vali E Asr Univ, Fac Math Sci, Dept Stat, POB 518, Rafsanjan, Iran
[2] McMaster Univ, Dept Math & Stat, Hamilton, ON L8S 4K1, Canada
关键词
Fisher information; Bayes– chi-square divergence; Kullback– Leibler divergence; Jensen– Shannon entropy;
D O I
10.3390/e23030363
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
In this work, we first consider the discrete version of Fisher information measure and then propose Jensen-Fisher information, to develop some associated results. Next, we consider Fisher information and Bayes-Fisher information measures for mixing parameter vector of a finite mixture probability mass function and establish some results. We provide some connections between these measures with some known informational measures such as chi-square divergence, Shannon entropy, Kullback-Leibler, Jeffreys and Jensen-Shannon divergences.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Fisher and Bayes-Fisher information measures for finite mixture distributions
    Kharazmi, Omid
    Balakrishnan, Narayanaswamy
    [J]. STOCHASTIC MODELS, 2024,
  • [2] Jensen-Fisher information and Jensen-Shannon entropy measures based on complementary discrete distributions with an application to Conway's game of life
    Kharazmi, Omid
    Contreras-Reyes, Javier E.
    Balakrishnan, Narayanaswamy
    [J]. PHYSICA D-NONLINEAR PHENOMENA, 2023, 453
  • [3] Mixture Models, Bayes Fisher Information, and Divergence Measures
    Asadi, Majid
    Ebrahimi, Nader
    Kharazmi, Omid
    Soofi, Ehsan S.
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2019, 65 (04) : 2316 - 2321
  • [4] A NEW DISCRIMINANT TECHNIQUE - BAYES-FISHER DISCRIMINATION
    HUANG, XN
    LI, BB
    [J]. BIOMETRICS, 1991, 47 (02) : 741 - 744
  • [5] Generalized Jensen difference divergence measures and Fisher measure of information
    [J]. Kybernetes: An International Journal of Cybernetics and General Systems, 24 (02):
  • [6] GENERALIZED JENSEN DIFFERENCE DIVERGENCE MEASURES AND FISHER MEASURE OF INFORMATION
    PARDO, L
    MORALES, D
    TANEJA, IJ
    [J]. KYBERNETES, 1995, 24 (02) : 15 - 28
  • [7] DISCRETE APPROXIMATIONS TO THE CSISZAR, RENYI, AND FISHER MEASURES OF INFORMATION
    ZOGRAFOS, K
    FERENTINOS, K
    PAPAIOANNOU, T
    [J]. CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 1986, 14 (04): : 355 - 366
  • [8] Fisher information in weighted distributions
    Iyengar, S
    Kvam, P
    Singh, H
    [J]. CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 1999, 27 (04): : 833 - 841
  • [9] Jensen divergence based on Fisher's information
    Sanchez-Moreno, P.
    Zarzo, A.
    Dehesa, J. S.
    [J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL, 2012, 45 (12)
  • [10] Fisher information and equilibrium distributions in econophysics
    Hawkins, RJ
    Frieden, BR
    [J]. PHYSICS LETTERS A, 2004, 322 (1-2) : 126 - 130