Flexible forecast value metric suitable for a wide range of decisions:application using probabilistic subseasonal streamflow forecasts

被引:2
|
作者
Laugesen, Richard [1 ,2 ]
Thyer, Mark [1 ]
McInerney, David [1 ]
Kavetski, Dmitri [1 ]
机构
[1] Univ Adelaide, Sch Civil Environm & Min Engn, Adelaide, SA, Australia
[2] Bur Meteorol, Canberra, ACT, Australia
关键词
RELATIVE ECONOMIC VALUE; HYDROLOGICAL FORECASTS; COMPLEX RELATIONSHIP; ENSEMBLE FORECASTS; RAINFALL FORECASTS; PROSPECT-THEORY; SKILL; RISK; PREDICTION; DECISION;
D O I
10.5194/hess-27-873-2023
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Streamflow forecasts have the potential to improve water resource decision-making, but their economic value has not been widely evaluated, since current forecast value methods have critical limitations. The ubiquitous measure for forecast value, the relative economic value (REV)metric, is limited to binary decisions, the cost-loss economic model, andrisk-neutral decision-makers (users). Expected utility theory can flexiblymodel more real-world decisions, but its application in forecasting has been limited and the findings are difficult to compare with those from REV. In this study, a new metric for evaluating forecast value, relative utilityvalue (RUV), is developed using expected utility theory. RUV has the sameinterpretation as REV, which enables a systematic comparison of results, but RUV is more flexible and better represents real-world decisions because more aspects of the decision context are user-defined. In addition, when specific assumptions are imposed, it is shown that REV and RUV are equivalent, hence REV can be considered a special case of the more general RUV. The key differences and similarities between REV and RUV are highlighted, with a set of experiments performed to explore the sensitivity of RUV to different decision contexts, such as different decision types (binary, multi-categorical, and continuous-flow decisions), various levels of user risk aversion, and varying the relative expense of mitigation. These experiments use an illustrative case study of probabilistic subseasonal streamflow forecasts (with lead times up to 30 d) in a catchment in the southern Murray-Darling Basin of Australia. The key outcomes of the experiments are (i) choice of decision type has an impact on forecast value, hence it is critically important to match the decision type with the real-world decision; (ii) forecasts are typically more valuable for risk averse users, but the impact varies depending on the decision context; and (iii) risk aversion impact is mediated by how large the potential damages are for a given decision. All outcomes were found to critically depend on the relative expense of mitigation (i.e. the cost of action to mitigate damages relative to the magnitude of damages). In particular, for users with relatively high expense of mitigation, using an unrealistic binary decision to approximate a multi-categorical or continuous-flow decision gives a misleading measure of forecast value for forecasts longer than 1 week lead time. These findings highlight the importance of the flexibility of RUV, which enable evaluation of forecast value to be tailored to specific decisions/users and hence better capture real-world decision-making. RUV complements forecast verification and enables assessment of forecast systems through the lens of user impact.
引用
收藏
页码:873 / 893
页数:21
相关论文
共 5 条
  • [1] Flexible forecast presentation overcomes longstanding obstacles to using probabilistic seasonal forecasts
    Hansen, James W. W.
    Dinku, Tufa
    Robertson, Andrew W. W.
    Cousin, Remi
    Trzaska, Sylwia
    Mason, Simon J. J.
    FRONTIERS IN CLIMATE, 2022, 4
  • [2] Probabilistic Enhancement of the Failure Forecast Method Using a Stochastic Differential Equation and Application to Volcanic Eruption Forecasts
    Bevilacqua, Andrea
    Pitman, Eric Bruce
    Patra, Abani
    Neri, Augusto
    Bursik, Marcus
    Voight, Barry
    FRONTIERS IN EARTH SCIENCE, 2019, 7
  • [3] Using ensemble forecasts to predict the size of forecast changes, with application to weather swap value at risk
    Jewson, Stephen
    Ziehmann, Christine
    ATMOSPHERIC SCIENCE LETTERS, 2003, 4 (1-4): : 15 - 27
  • [4] Evaluation of ensemble forecast uncertainty using a new proper score: Application to medium-range and seasonal forecasts
    Christensen, H. M.
    Moroz, I. M.
    Palmer, T. N.
    QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY, 2015, 141 (687) : 538 - 549
  • [5] Verification of Precipitation Forecasts from NCEP's Short-Range Ensemble Forecast (SREF) System with Reference to Ensemble Streamflow Prediction Using Lumped Hydrologic Models
    Brown, James D.
    Seo, Dong-Jun
    Du, Jun
    JOURNAL OF HYDROMETEOROLOGY, 2012, 13 (03) : 808 - 836