Suboptimal human inference can invert the bias-variance trade-off for decisions with asymmetric evidence

被引:0
|
作者
Eissa, Tahra L. [1 ]
Gold, Joshua I. [2 ]
Josic, Kresimir [3 ,4 ]
Kilpatrick, Zachary P. [1 ,5 ]
机构
[1] Univ Colorado Boulder, Dept Appl Math, Boulder, CO 80309 USA
[2] Univ Penn, Dept Neurosci, Philadelphia, PA 19104 USA
[3] Univ Houston, Dept Math, Houston, TX 77204 USA
[4] Univ Houston, Dept Biol & Biochem, Houston, TX USA
[5] Univ Colorado Boulder, Inst Cognit Sci, Boulder, CO USA
基金
美国国家卫生研究院;
关键词
PRIOR PROBABILITY; EXPERIENCE; CHOICE; INFORMATION; FLUTTER; EVENTS;
D O I
10.1371/journal.pcbi.1010323
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Solutions to challenging inference problems are often subject to a fundamental trade-off between: 1) bias (being systematically wrong) that is minimized with complex inference strategies, and 2) variance (being oversensitive to uncertain observations) that is minimized with simple inference strategies. However, this trade-off is based on the assumption that the strategies being considered are optimal for their given complexity and thus has unclear relevance to forms of inference based on suboptimal strategies. We examined inference problems applied to rare, asymmetrically available evidence, which a large population of human subjects solved using a diverse set of strategies that varied in form and complexity. In general, subjects using more complex strategies tended to have lower bias and variance, but with a dependence on the form of strategy that reflected an inversion of the classic bias-variance trade-off: subjects who used more complex, but imperfect, Bayesian-like strategies tended to have lower variance but higher bias because of incorrect tuning to latent task features, whereas subjects who used simpler heuristic strategies tended to have higher variance because they operated more directly on the observed samples but lower, nearnormative bias. Our results help define new principles that govern individual differences in behavior that depends on rare-event inference and, more generally, about the informationprocessing trade-offs that can be sensitive to not just the complexity, but also the optimality, of the inference process.
引用
收藏
页数:30
相关论文
共 44 条
  • [1] Relaxed Molecular Clocks, the Bias-Variance Trade-off, and the Quality of Phylogenetic Inference
    Wertheim, Joel O.
    Sanderson, Michael J.
    Worobey, Michael
    Bjork, Adam
    [J]. SYSTEMATIC BIOLOGY, 2010, 59 (01) : 1 - 8
  • [2] Bias-Variance Trade-Off in Continuous Test Norming
    Voncken, Lieke
    Albers, Casper J.
    Timmerman, Marieke E.
    [J]. ASSESSMENT, 2021, 28 (08) : 1932 - 1948
  • [3] Bias-variance trade-off for prequential model list selection
    Ernest Fokoue
    Bertrand Clarke
    [J]. Statistical Papers, 2011, 52 : 813 - 833
  • [4] Bias-Variance Trade-Off and Shrinkage of Weights in Forecast Combination
    Blanc, Sebastian M.
    Setzer, Thomas
    [J]. MANAGEMENT SCIENCE, 2020, 66 (12) : 5720 - 5737
  • [5] A closer look at the bias-variance trade-off in multivariate calibration
    Faber, NM
    [J]. JOURNAL OF CHEMOMETRICS, 1999, 13 (02) : 185 - 192
  • [6] Bias-variance trade-off for prequential model list selection
    Fokoue, Ernest
    Clarke, Bertrand
    [J]. STATISTICAL PAPERS, 2011, 52 (04) : 813 - 833
  • [7] Bounding User Contributions: A Bias-Variance Trade-off in Differential Privacy
    Amin, Kareem
    Kulesza, Alex
    Medina, Andres Murioz
    Vassilvitskii, Sergei
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [8] Multiclass Learning with Margin: Exponential Rates with No Bias-Variance Trade-Off
    Vigogna, Stefano
    Meanti, Giacomo
    De Vito, Ernesto
    Rosasco, Lorenzo
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [9] Can unbiased be tighter? Assessment of methods to reduce the bias-variance trade-off in WTP estimation
    Genius, Margarita
    Strazzera, Elisabetta
    [J]. RESOURCE AND ENERGY ECONOMICS, 2011, 33 (01) : 293 - 314
  • [10] Meta-Optimization of Bias-Variance Trade-Off in Stochastic Model Learning
    Aotani, Takumi
    Kobayashi, Taisuke
    Sugimoto, Kenji
    [J]. IEEE ACCESS, 2021, 9 : 148783 - 148799