Proper scoring rules for interval probabilistic forecasts

被引:5
|
作者
Mitchell, K. [1 ]
Ferro, C. A. T. [1 ]
机构
[1] Univ Exeter, Coll Engn Math & Phys Sci, Laver Bldg,North Pk Rd, Exeter EX4 4QE, Devon, England
关键词
interval probabilistic forecasts; rounded probabilistic forecasts; forecast verification; proper scoring rules;
D O I
10.1002/qj.3029
中图分类号
P4 [大气科学(气象学)];
学科分类号
0706 ; 070601 ;
摘要
Interval probabilistic forecasts for a binary event are forecasts issued as a range of probabilities for the occurrence of the event: for example, 'chance of rain: 10-20%'. To verify interval probabilistic forecasts, use can be made of a scoring rule that assigns a score to each forecast-outcome pair. An important requirement for scoring rules, if they are to provide a faithful assessment of a forecaster, is that they be proper, by which is meant that they direct forecasters to issue their true beliefs as their forecasts. Proper scoring rules for probabilistic forecasts issued as precise numbers have been studied extensively. However, applying such a proper scoring rule to, for example, the midpoint of an interval probabilistic forecast does not typically produce a proper scoring rule for interval probabilistic forecasts. Complementing parallel work by other authors, we derive a general characterization of scoring rules that are proper for interval probabilistic forecasts and from this characterization we determine particular scoring rules for interval probabilistic forecasts that correspond to the familiar scoring rules used for probabilistic forecasts given as precise probabilities. All the scoring rules we derive apply immediately to rounded probabilistic forecasts, being a special case of interval probabilistic forecasts.
引用
下载
收藏
页码:1597 / 1607
页数:11
相关论文
共 50 条
  • [1] Variogram-Based Proper Scoring Rules for Probabilistic Forecasts of Multivariate Quantities
    Scheuerer, Michael
    Hamill, Thomas M.
    MONTHLY WEATHER REVIEW, 2015, 143 (04) : 1321 - 1334
  • [2] EFFECTIVE SCORING RULES FOR PROBABILISTIC FORECASTS
    FRIEDMAN, D
    MANAGEMENT SCIENCE, 1983, 29 (04) : 447 - 454
  • [3] Probabilistic Coherence and Proper Scoring Rules
    Predd, Joel B.
    Seiringer, Robert
    Lieb, Elliott H.
    Osherson, Daniel N.
    Poor, H. Vincent
    Kulkarni, Sanjeev R.
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2009, 55 (10) : 4786 - 4792
  • [4] Scoring probabilistic forecasts:: The importance of being proper
    Brocker, Jochen
    Smith, Leonard A.
    WEATHER AND FORECASTING, 2007, 22 (02) : 382 - 388
  • [5] Proper Scoring Rules, Dominated Forecasts, and Coherence
    Schervish, Mark J.
    Seidenfeld, Teddy
    Kadane, Joseph B.
    DECISION ANALYSIS, 2009, 6 (04) : 202 - 221
  • [6] Evaluating probability forecasts in terms of refinement and strictly proper scoring rules
    Krämer, W
    JOURNAL OF FORECASTING, 2006, 25 (03) : 223 - 226
  • [7] Proper Scoring Rules for Evaluating Density Forecasts with Asymmetric Loss Functions
    Iacopini, Matteo
    Ravazzolo, Francesco
    Rossini, Luca
    JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2023, 41 (02) : 482 - 496
  • [8] Probabilistic Forecasts: Scoring Rules and Their Decomposition and Diagrammatic Representation via Bregman Divergences
    Hughes, Gareth
    Topp, Cairistiona F. E.
    ENTROPY, 2015, 17 (08): : 5450 - 5471
  • [9] The geometry of proper scoring rules
    Dawid, A. P.
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2007, 59 (01) : 77 - 93
  • [10] PROPER LOCAL SCORING RULES
    Parry, Matthew
    Dawid, A. Philip
    Lauritzen, Steffen
    ANNALS OF STATISTICS, 2012, 40 (01): : 561 - 592