Structured, uncertainty-driven exploration in real-world consumer choice

被引:45
|
作者
Schulz, Eric [1 ]
Bhuia, Rahul [1 ]
Love, Bradley C. [2 ,3 ]
Brier, Bastien [4 ]
Todd, Michael T. [4 ]
Gershman, Samuel J. [1 ]
机构
[1] Harvard Univ, Dept Psychol, 33 Kirkland St, Cambridge, MA 02138 USA
[2] UCL, Dept Expt Psychol, London WC1H 0AP, England
[3] Alan Turing Inst, London NW1 2DB, England
[4] Deliveroo, Data Sci Team, London EC4R 3TE, England
关键词
exploration; generalization; reinforcement learning; decision making; DISCOVERY; BANDITS;
D O I
10.1073/pnas.1821028116
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Making good decisions requires people to appropriately explore their available options and generalize what they have learned. While computational models can explain exploratory behavior in constrained laboratory tasks, it is unclear to what extent these models generalize to real-world choice problems. We investigate the factors guiding exploratory behavior in a dataset consisting of 195,333 customers placing 1,613,967 orders from a large online food delivery service. We find important hallmarks of adaptive exploration and generalization, which we analyze using computational models. In particular, customers seem to engage in uncertainty-directed exploration and use feature-based generalization to guide their exploration. Our results provide evidence that people use sophisticated strategies to explore complex, real-world environments.
引用
下载
收藏
页码:13903 / 13908
页数:6
相关论文
共 50 条
  • [1] Uncertainty-driven Planner for Exploration and Navigation
    Georgakis, Georgios
    Bucher, Bernadette
    Arapin, Anton
    Schmeckpeper, Karl
    Matni, Nikolai
    Daniilidis, Kostas
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022, 2022, : 11295 - 11302
  • [2] Uncertainty-driven regulation of learning and exploration in adolescents: A computational account
    Jepma, Marieke
    Schaaf, Jessica V.
    Visser, Ingmar
    Huizenga, Hilde M.
    PLOS COMPUTATIONAL BIOLOGY, 2020, 16 (09)
  • [3] Dopamine encoding of novelty facilitates efficient uncertainty-driven exploration
    Wang, Yuhao
    Lak, Armin
    Manohar, Sanjay G.
    Bogacz, Rafal
    PLOS COMPUTATIONAL BIOLOGY, 2024, 20 (04)
  • [4] Rostrolateral Prefrontal Cortex and Individual Differences in Uncertainty-Driven Exploration
    Badre, David
    Doll, Bradley B.
    Long, Nicole M.
    Frank, Michael J.
    NEURON, 2012, 73 (03) : 595 - 607
  • [5] Context-dependent choice and evaluation in real-world consumer behavior
    Otto, A. Ross
    Devine, Sean
    Schulz, Eric
    Bornstein, Aaron M.
    Louie, Kenway
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [6] Context-dependent choice and evaluation in real-world consumer behavior
    A. Ross Otto
    Sean Devine
    Eric Schulz
    Aaron M. Bornstein
    Kenway Louie
    Scientific Reports, 12
  • [7] Semi-task-dependent and uncertainty-driven world model maintenance
    Elfring, Jos
    van de Molengraft, Rene
    Steinbuch, Maarten
    AUTONOMOUS ROBOTS, 2015, 38 (01) : 1 - 15
  • [8] Semi-task-dependent and uncertainty-driven world model maintenance
    Jos Elfring
    René van de Molengraft
    Maarten Steinbuch
    Autonomous Robots, 2015, 38 : 1 - 15
  • [9] Should I stay or should I go: genetic bases for uncertainty-driven exploration
    Sallet, Jerome
    Rushworth, Matthew F. S.
    NATURE NEUROSCIENCE, 2009, 12 (08) : 963 - 965
  • [10] Directed Real-World Learned Exploration
    Hutsebaut-Buysse, Matthias
    Guinjoan, Ferran Gebelli
    Rademakers, Erwin
    Latre, Steven
    Temsamani, Abdellatif Bey
    Mets, Kevin
    Mannens, Erik
    De Schepper, Tom
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 5227 - 5234