Proper scoring rules for interval probabilistic forecasts

被引:5
|
作者
Mitchell, K. [1 ]
Ferro, C. A. T. [1 ]
机构
[1] Univ Exeter, Coll Engn Math & Phys Sci, Laver Bldg,North Pk Rd, Exeter EX4 4QE, Devon, England
关键词
interval probabilistic forecasts; rounded probabilistic forecasts; forecast verification; proper scoring rules;
D O I
10.1002/qj.3029
中图分类号
P4 [大气科学(气象学)];
学科分类号
0706 ; 070601 ;
摘要
Interval probabilistic forecasts for a binary event are forecasts issued as a range of probabilities for the occurrence of the event: for example, 'chance of rain: 10-20%'. To verify interval probabilistic forecasts, use can be made of a scoring rule that assigns a score to each forecast-outcome pair. An important requirement for scoring rules, if they are to provide a faithful assessment of a forecaster, is that they be proper, by which is meant that they direct forecasters to issue their true beliefs as their forecasts. Proper scoring rules for probabilistic forecasts issued as precise numbers have been studied extensively. However, applying such a proper scoring rule to, for example, the midpoint of an interval probabilistic forecast does not typically produce a proper scoring rule for interval probabilistic forecasts. Complementing parallel work by other authors, we derive a general characterization of scoring rules that are proper for interval probabilistic forecasts and from this characterization we determine particular scoring rules for interval probabilistic forecasts that correspond to the familiar scoring rules used for probabilistic forecasts given as precise probabilities. All the scoring rules we derive apply immediately to rounded probabilistic forecasts, being a special case of interval probabilistic forecasts.
引用
下载
收藏
页码:1597 / 1607
页数:11
相关论文
共 50 条
  • [41] Combining density forecasts using focused scoring rules
    Opschoor, Anne
    van Dijk, Dick
    van der Wel, Michel
    JOURNAL OF APPLIED ECONOMETRICS, 2017, 32 (07) : 1298 - 1313
  • [42] USE OF PROBABILITY ASSESSMENTS AND SCORING RULES FOR AGRICULTURAL FORECASTS
    BESSLER, DA
    MOORE, CV
    AGRICULTURAL ECONOMICS RESEARCH, 1979, 31 (04): : 44 - 47
  • [43] Linear scoring rules for probabilistic binary classification
    Parry, Matthew
    ELECTRONIC JOURNAL OF STATISTICS, 2016, 10 (01): : 1596 - 1607
  • [44] Bayesian Model Selection Based on Proper Scoring Rules
    Dawid, A. Philip
    Musio, Monica
    BAYESIAN ANALYSIS, 2015, 10 (02): : 479 - 499
  • [45] The uniqueness of local proper scoring rules: the logarithmic family
    Yang, Jingni
    THEORY AND DECISION, 2020, 88 (02) : 315 - 322
  • [46] Robust confidence distributions from proper scoring rules
    Ruli, Erlis
    Ventura, Laura
    Musio, Monica
    STATISTICS, 2022, 56 (02) : 455 - 478
  • [47] Tailored proper scoring rules elicit decision weights
    Carvalho, Arthur
    JUDGMENT AND DECISION MAKING, 2015, 10 (01): : 86 - 96
  • [48] The uniqueness of local proper scoring rules: the logarithmic family
    Jingni Yang
    Theory and Decision, 2020, 88 : 315 - 322
  • [49] Incentivizing honest performative predictions with proper scoring rules
    Oesterheld, Caspar
    Treutlein, Johannes
    Cooper, Emery
    Hudson, Rubi
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2023, 216 : 1564 - 1574
  • [50] Local scale invariance and robustness of proper scoring rules
    Bolin, David
    Wallin, Jonas
    ENERGY AND BUILDINGS, 2023, 282 : 140 - 159