Tailored proper scoring rules elicit decision weights

被引:0
|
作者
Carvalho, Arthur [1 ]
机构
[1] Eramus Univ, Rotterdam Sch Management, NL-3062 PA Rotterdam, Netherlands
来源
JUDGMENT AND DECISION MAKING | 2015年 / 10卷 / 01期
关键词
proper scoring rules; rank-dependent utility theory; weighting functions; PROBABILITY; UTILITY; RISK; BEHAVIOR;
D O I
暂无
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Proper scoring rules are scoring methods that incentivize honest reporting of subjective probabilities, where an agent strictly maximizes his expected score by reporting his true belief. The implicit assumption behind proper scoring rules is that agents are risk neutral. Such an assumption is often unrealistic when agents are human beings. Modern theories of choice under uncertainty based on rank-dependent utilities assert that human beings weight nonlinear utilities using decision weights, which are differences between weighting functions applied to cumulative probabilities. In this paper, we investigate the reporting behavior of an agent with a rank-dependent utility when he is rewarded using a proper scoring rule tailored to his utility function. We show that such an agent misreports his true belief by reporting a vector of decision weights. my findings thus highlight the risk of utilizing proper scoring rules without prior knowledge about all the components that drive an agent's attitude towards uncertainty. On the positive side, we discuss how tailored proper scoring rules can effectively elicit weighting functions. Moreover, we show how to obtain an agent's true belief from his misreported belief once the weighting functions are known.
引用
收藏
页码:86 / 96
页数:11
相关论文
共 50 条
  • [31] Volumetric Aggregation Methods for Scoring Rules with Unknown Weights
    Viappiani, Paolo
    GROUP DECISION AND NEGOTIATION, 2024, 33 (03) : 515 - 563
  • [32] Bayesian Model Selection Based on Proper Scoring Rules
    Dawid, A. Philip
    Musio, Monica
    BAYESIAN ANALYSIS, 2015, 10 (02): : 479 - 499
  • [33] The uniqueness of local proper scoring rules: the logarithmic family
    Yang, Jingni
    THEORY AND DECISION, 2020, 88 (02) : 315 - 322
  • [34] Robust confidence distributions from proper scoring rules
    Ruli, Erlis
    Ventura, Laura
    Musio, Monica
    STATISTICS, 2022, 56 (02) : 455 - 478
  • [35] The uniqueness of local proper scoring rules: the logarithmic family
    Jingni Yang
    Theory and Decision, 2020, 88 : 315 - 322
  • [36] Incentivizing honest performative predictions with proper scoring rules
    Oesterheld, Caspar
    Treutlein, Johannes
    Cooper, Emery
    Hudson, Rubi
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2023, 216 : 1564 - 1574
  • [37] Local scale invariance and robustness of proper scoring rules
    Bolin, David
    Wallin, Jonas
    ENERGY AND BUILDINGS, 2023, 282 : 140 - 159
  • [38] PROPER LOCAL SCORING RULES ON DISCRETE SAMPLE SPACES
    Dawid, Philip
    Lauritzen, Steffen
    Parry, Matthew
    ANNALS OF STATISTICS, 2012, 40 (01): : 593 - 608
  • [39] Validation of point process predictions with proper scoring rules
    Heinrich-Mertsching, Claudio
    Thorarinsdottir, Thordis L.
    Guttorp, Peter
    Schneider, Max
    SCANDINAVIAN JOURNAL OF STATISTICS, 2024,
  • [40] Scoring Rules and Decision Analysis Education
    Bickel, J. Eric
    DECISION ANALYSIS, 2010, 7 (04) : 346 - 357