On-line estimation with the multivariate Gaussian distribution

被引:11
|
作者
Dasgupta, Sanjoy [1 ]
Hsu, Daniel [1 ]
机构
[1] Univ Calif San Diego, San Diego, CA 92103 USA
来源
LEARNING THEORY, PROCEEDINGS | 2007年 / 4539卷
关键词
D O I
10.1007/978-3-540-72927-3_21
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We consider on-line density estimation with the multivariate Gaussian distribution. In each of a sequence of trials, the learner must posit a mean mu and covariance Sigma; the learner then receives an instance x and incurs loss equal to the negative log-likelihood of x under the Gaussian density parameterized by (mu, Sigma). We prove bounds on the regret for the follow-the-leader strategy, which amounts to choosing the sample mean and covariance of the previously seen data.
引用
收藏
页码:278 / +
页数:2
相关论文
共 50 条
  • [1] A Gaussian Process Assisted Offline Estimation of Multivariate Gaussian Distribution Algorithm
    Ma, Xin-Xin
    Chen, Wei-Neng
    Yang, Qiang
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 572 - 578
  • [2] On-line speaking rate estimation using Gaussian Mixture Models
    Faltlhauser, R
    Pfau, T
    Ruske, G
    [J]. 2000 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, PROCEEDINGS, VOLS I-VI, 2000, : 1355 - 1358
  • [3] Multivariate Gaussian Copula in Estimation of Distribution Algorithm with Model Migration
    Hyrs, Martin
    Schwarz, Josef
    [J]. 2014 IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTATIONAL INTELLIGENCE (FOCI), 2014, : 114 - 119
  • [4] Latent Gaussian Processes for Distribution Estimation of Multivariate Categorical Data
    Gal, Yarin
    Chen, Yutian
    Ghahramani, Zoubin
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 645 - 654
  • [5] Quantum anomaly detection with density estimation and multivariate Gaussian distribution
    Liang, Jin-Min
    Shen, Shu-Qian
    Li, Ming
    Li, Lei
    [J]. PHYSICAL REVIEW A, 2019, 99 (05)
  • [6] On-line multivariate statistical monitoring of batch processes using Gaussian mixture model
    Chen, Tao
    Zhang, Jie
    [J]. COMPUTERS & CHEMICAL ENGINEERING, 2010, 34 (04) : 500 - 507
  • [7] Batch and on-line parameter estimation of Gaussian mixtures based on the joint entropy
    Singer, Y
    Warmuth, MK
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 11, 1999, 11 : 578 - 584
  • [8] Unified eigen analysis on multivariate Gaussian based estimation of distribution algorithms
    Dong, Weishan
    Yao, Xin
    [J]. INFORMATION SCIENCES, 2008, 178 (15) : 3000 - 3023
  • [9] Sparse on-line Gaussian processes
    Csató, L
    Opper, M
    [J]. NEURAL COMPUTATION, 2002, 14 (03) : 641 - 668
  • [10] The Complex Multivariate Gaussian Distribution
    Hankin, Robin K. S.
    [J]. R JOURNAL, 2015, 7 (01): : 73 - 80