Proper scoring rules for interval probabilistic forecasts

被引:5
|
作者
Mitchell, K. [1 ]
Ferro, C. A. T. [1 ]
机构
[1] Univ Exeter, Coll Engn Math & Phys Sci, Laver Bldg,North Pk Rd, Exeter EX4 4QE, Devon, England
关键词
interval probabilistic forecasts; rounded probabilistic forecasts; forecast verification; proper scoring rules;
D O I
10.1002/qj.3029
中图分类号
P4 [大气科学(气象学)];
学科分类号
0706 ; 070601 ;
摘要
Interval probabilistic forecasts for a binary event are forecasts issued as a range of probabilities for the occurrence of the event: for example, 'chance of rain: 10-20%'. To verify interval probabilistic forecasts, use can be made of a scoring rule that assigns a score to each forecast-outcome pair. An important requirement for scoring rules, if they are to provide a faithful assessment of a forecaster, is that they be proper, by which is meant that they direct forecasters to issue their true beliefs as their forecasts. Proper scoring rules for probabilistic forecasts issued as precise numbers have been studied extensively. However, applying such a proper scoring rule to, for example, the midpoint of an interval probabilistic forecast does not typically produce a proper scoring rule for interval probabilistic forecasts. Complementing parallel work by other authors, we derive a general characterization of scoring rules that are proper for interval probabilistic forecasts and from this characterization we determine particular scoring rules for interval probabilistic forecasts that correspond to the familiar scoring rules used for probabilistic forecasts given as precise probabilities. All the scoring rules we derive apply immediately to rounded probabilistic forecasts, being a special case of interval probabilistic forecasts.
引用
下载
收藏
页码:1597 / 1607
页数:11
相关论文
共 50 条
  • [21] Existence and Uniqueness of Proper Scoring Rules
    Ovcharov, Evgeni Y.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2015, 16 : 2207 - 2230
  • [22] An Overview of Applications of Proper Scoring Rules
    Carvalho, Arthur
    DECISION ANALYSIS, 2016, 13 (04) : 223 - 242
  • [23] PSYCHOLOGICAL EFFECTS OF PROPER SCORING RULES
    JENSEN, FA
    PETERSON, CR
    ORGANIZATIONAL BEHAVIOR AND HUMAN PERFORMANCE, 1973, 9 (02): : 307 - 317
  • [24] A Study on the Behavior of Crowd Workers when Reporting Forecasts under Proper Scoring Rules Completed Research
    Carvalho, Arthur
    Kroon, Denise
    AMCIS 2018 PROCEEDINGS, 2018,
  • [25] Refining epidemiological forecasts with simple scoring rules
    Moore, Robert E.
    Rosato, Conor
    Maskell, Simon
    PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2022, 380 (2233):
  • [26] LOCAL PROPER SCORING RULES OF ORDER TWO
    Ehm, Werner
    Gneiting, Tilmann
    ANNALS OF STATISTICS, 2012, 40 (01): : 609 - 637
  • [27] Objective Bayesian inference with proper scoring rules
    F. Giummolè
    V. Mameli
    E. Ruli
    L. Ventura
    TEST, 2019, 28 : 728 - 755
  • [28] Objective Bayesian inference with proper scoring rules
    Giummole, F.
    Mameli, V.
    Ruli, E.
    Ventura, L.
    TEST, 2019, 28 (03) : 728 - 755
  • [29] THE ROLE OF DUTCH BOOKS AND OF PROPER SCORING RULES
    DEFINETTI, B
    BRITISH JOURNAL FOR THE PHILOSOPHY OF SCIENCE, 1981, 32 (01): : 55 - 56
  • [30] Incentive contracts and strictly proper scoring rules
    Clemen, RT
    TEST, 2002, 11 (01) : 167 - 189