Density estimation by Maximum Quantum Entropy

被引:0
|
作者
Silver, RN
Wallstrom, T
Martz, HF
机构
关键词
D O I
暂无
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
A new Bayesian method for non-parametric density estimation is proposed, based on a mathematical analogy to quantum statistical physics. The mathematical procedure is related to maximum entropy methods for inverse problems and image reconstruction. The information divergence enforces global smoothing toward default models, convexity, positivity, extensivity and normalization. The novel feature is the replacement of classical entropy by quantum entropy, so that local smoothing is enforced by constraints on differential operators. The linear response of the estimate is proportional to the covariance. The hyperparameters are estimated by type-II maximum likelihood (evidence). The method is demonstrated on textbook data sets.
引用
收藏
页码:161 / 174
页数:14
相关论文
共 50 条
  • [1] Maximum entropy approach to probability density estimation
    Miller, G
    Horn, D
    [J]. 1998 SECOND INTERNATIONAL CONFERENCE ON KNOWLEDGE-BASED INTELLIGENT ELECTRONIC SYSTEMS, KES'98 PROCEEDINGS, VOL 1, 1998, : 225 - 230
  • [2] Maximum Quantum Entropy for classical density functions
    Wallstrom, TC
    [J]. MAXIMUM ENTROPY AND BAYESIAN METHODS - PROCEEDINGS OF THE THIRTEENTH INTERNATIONAL WORKSHOP ON MAXIMUM ENTROPY AND BAYESIAN METHODS, SANTA BARBARA, CALIFORNIA, U.S.A., 1993, 1996, 62 : 149 - 155
  • [3] Maximum entropy density estimation from fractional moments
    Inverardi, PLN
    Tagliani, A
    [J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2003, 32 (02) : 327 - 345
  • [4] Consistency and Generalization Bounds for Maximum Entropy Density Estimation
    Wang, Shaojun
    Greiner, Russell
    Wang, Shaomin
    [J]. ENTROPY, 2013, 15 (12) : 5439 - 5463
  • [5] On estimation error using maximum entropy density estimates
    Noonan, J. P.
    Basu, Prabahan
    [J]. KYBERNETES, 2007, 36 (1-2) : 52 - 64
  • [6] Performance guarantees for regularized maximum entropy density estimation
    Dudík, M
    Phillips, SJ
    Schapire, RE
    [J]. LEARNING THEORY, PROCEEDINGS, 2004, 3120 : 472 - 486
  • [7] MAXIMUM-ENTROPY ESTIMATION OF DENSITY AND REGRESSION-FUNCTIONS
    RYU, HK
    [J]. JOURNAL OF ECONOMETRICS, 1993, 56 (03) : 397 - 440
  • [8] Maximum Entropy Estimation of Density Function Using Order Statistics
    Reza, Ali M.
    Kirlin, R. Lynn
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2021, 67 (05) : 3075 - 3094
  • [9] A new maximum entropy method for estimation of multimodal probability density function
    Li, G.
    Wang, Y. X.
    Zeng, Y.
    He, W. X.
    [J]. APPLIED MATHEMATICAL MODELLING, 2022, 102 : 137 - 152
  • [10] Maximum-Entropy Density Estimation for MRI Stochastic Surrogate Models
    Zhang, Zheng
    Farnoosh, Niloofar
    Klemas, Thomas
    Daniel, Luca
    [J]. IEEE ANTENNAS AND WIRELESS PROPAGATION LETTERS, 2014, 13 : 1656 - 1659