Online Aggregation of Probabilistic Forecasts Based on the Continuous Ranked Probability Score

被引:1
|
作者
V'yugin, V. V. [1 ]
Trunov, V. G. [1 ]
机构
[1] Kharkevich Inst Informat Transmiss Problems, Moscow 127051, Russia
基金
俄罗斯科学基金会;
关键词
prediction with expert advice; online decision making; regret; aggregating algorithm; continuous ranked probability score (CRPS); mixable loss function;
D O I
10.1134/S1064226920060285
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Methods for generating predictions online and in the form of probability distributions of future outcomes are considered. The difference between the probabilistic forecast (probability distribution) and the numerical outcome is measured using the loss function (scoring rule). In practical statistics, the continuous ranked probability score (CRPS) is often used to estimate the discrepancy between probabilistic forecasts and (quantitative) outcomes. The paper considers the case when several competing methods (experts) give their online predictions as distribution functions. An algorithm is proposed for online aggregation of these distribution functions. The performance bounds of the proposed algorithm are obtained in the form of a comparison of the cumulative loss of the algorithm and the loss of expert hypotheses. Unlike existing estimates, the proposed estimates do not depend on time. The results of numerical experiments illustrating the proposed methods are presented.
引用
收藏
页码:662 / 676
页数:15
相关论文
共 50 条
  • [1] Online Aggregation of Probabilistic Forecasts Based on the Continuous Ranked Probability Score
    V. V. V’yugin
    V. G. Trunov
    [J]. Journal of Communications Technology and Electronics, 2020, 65 : 662 - 676
  • [2] Evaluating probabilistic forecasts of extremes using continuous ranked probability score distributions
    Taillardat, Maxime
    Fougeres, Anne-Laure
    Naveau, Philippe
    de Fondeville, Raphael
    [J]. INTERNATIONAL JOURNAL OF FORECASTING, 2023, 39 (03) : 1448 - 1459
  • [3] Online Learning with Continuous Ranked Probability Score
    V'yugin, Vladimir V.
    Trunov, Vladimir G.
    [J]. CONFORMAL AND PROBABILISTIC PREDICTION AND APPLICATIONS, VOL 105, 2019, 105
  • [4] Evaluating probabilistic forecasts of football matches: the case against the ranked probability score
    Wheatcroft, Edward
    [J]. JOURNAL OF QUANTITATIVE ANALYSIS IN SPORTS, 2021, 17 (04) : 273 - 287
  • [5] Online learning with the Continuous Ranked Probability Score for ensemble forecasting
    Thorey, J.
    Mallet, V.
    Baudin, P.
    [J]. QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY, 2017, 143 (702) : 521 - 529
  • [6] Competitive Online Regression under Continuous Ranked Probability Score
    Dzhamtyrova, Raisa
    Kalnishkan, Yuri
    [J]. CONFORMAL AND PROBABILISTIC PREDICTION AND APPLICATIONS, VOL 105, 2019, 105
  • [7] Estimation of the Continuous Ranked Probability Score with Limited Information and Applications to Ensemble Weather Forecasts
    Zamo, Michael
    Naveau, Philippe
    [J]. MATHEMATICAL GEOSCIENCES, 2018, 50 (02) : 209 - 234
  • [8] A debiased ranked probability skill score to evaluate probabilistic ensemble forecasts with small ensemble sizes
    Müller, WA
    Appenzeller, C
    Doblas-Reyes, FJ
    Liniger, MA
    [J]. JOURNAL OF CLIMATE, 2005, 18 (10) : 1513 - 1523
  • [9] Estimation of the Continuous Ranked Probability Score with Limited Information and Applications to Ensemble Weather Forecasts
    Michaël Zamo
    Philippe Naveau
    [J]. Mathematical Geosciences, 2018, 50 : 209 - 234
  • [10] Online aggregation of probability forecasts with confidence
    V'yugin, Vladimir
    Trunov, Vladimir
    [J]. PATTERN RECOGNITION, 2022, 121