New error bounds for Solomonoff prediction

被引:17
|
作者
Hutter, M [1 ]
机构
[1] IDSIA, CH-6928 Lugano, Switzerland
关键词
induction; Solomonoff; Bayesian; deterministic prediction; algorithmic probability; Kolmogorov complexity;
D O I
10.1006/jcss.2000.1743
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Solomonoff sequence prediction is a scheme to predict digits of binary strings without knowing the underlying probability distribution. We call a prediction scheme informed when it knows the true probability distribution of the sequence. Several neu relations between universal Solomonoff sequence prediction and informed prediction and general probabilistic prediction schemes will be proved. Among others. they show that the number of errors in Solomonoff prediction is finite for computable distributions, if finite in the informed case. Deterministic variants will also be studied. The most interesting result is that the deterministic variant of Solomonoff prediction is optimal compared to any other probabilistic or deterministic prediction scheme apart from additive square root corrections only. This makes it well suited even for difficult prediction problems, where it does not suffice when the number of errors is minimal to within some factor greater than one. Solomonoff's original bound and the ones presented here complement each other in a useful way. (C) 2001 Academic Press.
引用
收藏
页码:653 / 667
页数:15
相关论文
共 50 条
  • [1] A Dilemma for Solomonoff Prediction
    Neth, Sven
    [J]. PHILOSOPHY OF SCIENCE, 2023, 90 (02) : 288 - 306
  • [2] Solomonoff Prediction and Occam's Razor
    Sterkenburg, Tom F.
    [J]. PHILOSOPHY OF SCIENCE, 2016, 83 (04) : 459 - 479
  • [3] Ray Solomonoff and the New Probability
    Solomonoff, Grace
    [J]. ALGORITHMIC PROBABILITY AND FRIENDS: BAYESIAN PREDICTION AND ARTIFICIAL INTELLIGENCE, 2013, 7070 : 37 - 52
  • [4] Prediction error bounds for linear regression with the TREX
    Jacob Bien
    Irina Gaynanova
    Johannes Lederer
    Christian L. Müller
    [J]. TEST, 2019, 28 : 451 - 474
  • [5] Prediction error bounds for linear regression with the TREX
    Bien, Jacob
    Gaynanova, Irina
    Lederer, Johannes
    Mueller, Christian L.
    [J]. TEST, 2019, 28 (02) : 451 - 474
  • [6] New uniform parametric error bounds
    Ye, JJ
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1998, 98 (01) : 197 - 219
  • [7] New uniform parametric error bounds
    Dept. of Mathematics and Statistics, University of Victoria, Victoria, BC, Canada
    [J]. J. Optim. Theory Appl, 1 (197-219):
  • [8] New upper bounds on error exponents
    Litsyn, S
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 1999, 45 (02) : 385 - 398
  • [9] New Uniform Parametric Error Bounds
    J. J. Ye
    [J]. Journal of Optimization Theory and Applications, 1998, 98 : 197 - 219
  • [10] LOWER BOUNDS ON THE ERROR PROBABILITY FOR INVARIANT CAUSAL PREDICTION
    Goddard, Austin
    Xiang, Yu
    Soloveychik, Ilya
    [J]. 2022 IEEE 32ND INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2022,