Exact Renyi and Kullback-Leibler Divergences Between Multivariate t-Distributions

被引:3
|
作者
Bouhlel, Nizar [1 ]
Rousseau, David [1 ,2 ]
机构
[1] Univ Angers, Inst Agro, INRAE, IRHS,SFR QuaSaV, F-49000 Angers, France
[2] Univ Angers, LARIS, UMR INRAe IRHS, Angers, France
关键词
Multivariate t-distribution; Renyi divergence of order beta; Kullback-Leibler divergence; Lauricella series; COMPOUND-GAUSSIAN CLUTTER; STOCHASTIC DISTANCES; INFERENCE; SPEECH;
D O I
10.1109/LSP.2023.3324594
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this letter, we propose a closed-form expression of the Renyi divergence (RD) of order beta between two zero-mean real multivariate t-distributions (MTDs). Such distribution has been deployed in several signal and image processing applications where heavy-tailed distribution is well-suited. Based on the computation of the multiple integral involved in the RD, the expression of the divergence is provided without resorting to the conventional time-consuming Monte Carlo (MC) integration technique. In addition, the Kullback-Leibler divergence (KLD) is deduced from RD. Finally, a comparison is made between the MC method and the numerical value of the RD expression to show how the former gives close approximations to the latter.
引用
收藏
页码:1672 / 1676
页数:5
相关论文
共 50 条
  • [1] Universal Portfolios Generated by the Renyi and Generalized Kullback-Leibler Divergences
    Tan, Choon Peng
    Kuang, Kee Seng
    [J]. INNOVATION AND ANALYTICS CONFERENCE AND EXHIBITION (IACE 2015), 2015, 1691
  • [2] Kullback-Leibler Divergence Between Multivariate Generalized Gaussian Distributions
    Bouhlel, Nizar
    Dziri, Ali
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (07) : 1021 - 1025
  • [3] Chained Kullback-Leibler Divergences
    Pavlichin, Dmitri S.
    Weissman, Tsachy
    [J]. 2016 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, 2016, : 580 - 584
  • [4] On the Properties of Kullback-Leibler Divergence Between Multivariate Gaussian Distributions
    Zhang, Yufeng
    Pan, Jialu
    Li, Kenli
    Liu, Wanwei
    Chen, Zhenbang
    Liu, Xinwang
    Wang, Ji
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [5] Exact Expressions for Kullback-Leibler Divergence for Multivariate and Matrix-Variate Distributions
    Nawa, Victor
    Nadarajah, Saralees
    [J]. ENTROPY, 2024, 26 (08)
  • [6] Renyi Divergence and Kullback-Leibler Divergence
    van Erven, Tim
    Harremoes, Peter
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (07) : 3797 - 3820
  • [7] Matrix CFAR detectors based on symmetrized Kullback-Leibler and total Kullback-Leibler divergences
    Hua, Xiaoqiang
    Cheng, Yongqiang
    Wang, Hongqiang
    Qin, Yuliang
    Li, Yubo
    Zhang, Wenpeng
    [J]. DIGITAL SIGNAL PROCESSING, 2017, 69 : 106 - 116
  • [8] The Kullback-Leibler Divergence Between Lattice Gaussian Distributions
    Nielsen, Frank
    [J]. JOURNAL OF THE INDIAN INSTITUTE OF SCIENCE, 2022, 102 (04) : 1177 - 1188
  • [9] Kullback-Leibler Divergence Measure for Multivariate Skew-Normal Distributions
    Contreras-Reyes, Javier E.
    Arellano-Valle, Reinaldo B.
    [J]. ENTROPY, 2012, 14 (09) : 1606 - 1626
  • [10] Combining marginal probability distributions via minimization of weighted sum of Kullback-Leibler divergences
    Kracik, Jan
    [J]. INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2011, 52 (06) : 659 - 671