Proper scoring rules for interval probabilistic forecasts

被引:5
|
作者
Mitchell, K. [1 ]
Ferro, C. A. T. [1 ]
机构
[1] Univ Exeter, Coll Engn Math & Phys Sci, Laver Bldg,North Pk Rd, Exeter EX4 4QE, Devon, England
关键词
interval probabilistic forecasts; rounded probabilistic forecasts; forecast verification; proper scoring rules;
D O I
10.1002/qj.3029
中图分类号
P4 [大气科学(气象学)];
学科分类号
0706 ; 070601 ;
摘要
Interval probabilistic forecasts for a binary event are forecasts issued as a range of probabilities for the occurrence of the event: for example, 'chance of rain: 10-20%'. To verify interval probabilistic forecasts, use can be made of a scoring rule that assigns a score to each forecast-outcome pair. An important requirement for scoring rules, if they are to provide a faithful assessment of a forecaster, is that they be proper, by which is meant that they direct forecasters to issue their true beliefs as their forecasts. Proper scoring rules for probabilistic forecasts issued as precise numbers have been studied extensively. However, applying such a proper scoring rule to, for example, the midpoint of an interval probabilistic forecast does not typically produce a proper scoring rule for interval probabilistic forecasts. Complementing parallel work by other authors, we derive a general characterization of scoring rules that are proper for interval probabilistic forecasts and from this characterization we determine particular scoring rules for interval probabilistic forecasts that correspond to the familiar scoring rules used for probabilistic forecasts given as precise probabilities. All the scoring rules we derive apply immediately to rounded probabilistic forecasts, being a special case of interval probabilistic forecasts.
引用
下载
收藏
页码:1597 / 1607
页数:11
相关论文
共 50 条
  • [31] Probabilism, entropies and strictly proper scoring rules
    Landes, Juergen
    INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2015, 63 : 1 - 21
  • [32] Proper scoring rules with arbitrary value functions
    Fang, Fang
    Stinchcombe, Maxwell B.
    Whinston, Andrew B.
    JOURNAL OF MATHEMATICAL ECONOMICS, 2010, 46 (06) : 1200 - 1210
  • [33] A note on proper scoring rules and risk aversion
    Peysakhovich, Alexander
    Plagborg-Moller, Mikkel
    ECONOMICS LETTERS, 2012, 117 (01) : 357 - 361
  • [34] Probabilism, entropies and strictly proper scoring rules
    Landes, Jürgen
    International Journal of Approximate Reasoning, 2015, 63 : 1 - 21
  • [35] Proper scoring rules for general decision models
    Chambers, Christopher P.
    GAMES AND ECONOMIC BEHAVIOR, 2008, 63 (01) : 32 - 40
  • [36] Strictly proper scoring rules, prediction, and estimation
    Gneiting, Tilmann
    Raftery, Adrian E.
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2007, 102 (477) : 359 - 378
  • [37] On proper scoring rules and cumulative prospect theory
    Carvalho, Arthur
    Dimitrov, Stanko
    Larson, Kate
    EURO JOURNAL ON DECISION PROCESSES, 2018, 6 (3-4) : 343 - 376
  • [38] Incentive contrats and strictly proper scoring rules
    Robert T. Clemen
    Test, 2002, 11 : 167 - 189
  • [39] Coherent conditional probabilities and proper scoring rules
    Gilio, Angelo
    Sanfilippo, Giuseppe
    ISIPTA '11 - PROCEEDINGS OF THE SEVENTH INTERNATIONAL SYMPOSIUM ON IMPRECISE PROBABILITY: THEORIES AND APPLICATIONS, 2011, : 199 - 208
  • [40] Scoring interval forecasts: Equal-tailed, shortest, and modal interval
    Brehmer, Jonas R.
    Gneiting, Tilmann
    BERNOULLI, 2021, 27 (03) : 1993 - 2010