Solving the credit assignment problem: explicit and implicit learning of action sequences with probabilistic outcomes

被引:34
|
作者
Fu, Wai-Tat [1 ]
Anderson, John R. [2 ]
机构
[1] Univ Illinois, Human Factors Div & Beckman Inst, Urbana, IL 61801 USA
[2] Carnegie Mellon Univ, Dept Psychol, Pittsburgh, PA 15213 USA
来源
PSYCHOLOGICAL RESEARCH-PSYCHOLOGISCHE FORSCHUNG | 2008年 / 72卷 / 03期
关键词
D O I
10.1007/s00426-007-0113-7
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
In most problem-solving activities, feedback is received at the end of an action sequence. This creates a credit-assignment problem where the learner must associate the feedback with earlier actions, and the interdependencies of actions require the learner to remember past choices of actions. In two studies, we investigated the nature of explicit and implicit learning processes in the credit-assignment problem using a probabilistic sequential choice task with and without a secondary memory task. We found that when explicit learning was dominant, learning was faster to select the better option in their first choices than in the last choices. When implicit reinforcement learning was dominant, learning was faster to select the better option in their last choices than in their first choices. Consistent with the probability-learning and sequence-learning literature, the results show that credit assignment involves two processes: an explicit memory encoding process that requires memory rehearsals and an implicit reinforcement-learning process that propagates credits backwards to previous choices.
引用
收藏
页码:321 / 330
页数:10
相关论文
共 50 条
  • [31] Implicit and Explicit Problem-Solving Process during Chinese Radical Assembly Game
    Hong, Jon-Chao
    Wu, Ching-Lin
    Tseng, Chien-Chih
    Chen, Hsueh-Chih
    CREATIVITY RESEARCH JOURNAL, 2020, 32 (04) : 412 - 420
  • [32] On solving the capacity assignment problem using continuous learning automata
    Oommen, BJ
    Roberts, TD
    MULTIPLE APPROACHES TO INTELLIGENT SYSTEMS, PROCEEDINGS, 1999, 1611 : 622 - 631
  • [33] Automatically Exploiting Implicit Design Knowledge When Solving the Class Responsibility Assignment Problem
    Xu, Yongrui
    Liang, Peng
    Babar, Muhammad Ali
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION AND REENGINEERING (SANER 2018), 2018, : 197 - 208
  • [34] Deficits in Explicit Language Problem Solving Rather Than in Implicit Learning in Specific Language Impairment: Evidence From Learning an Artificial Morphological Rule
    Ferman, Sara
    Kishon-Rabin, Liat
    Ganot-Budaga, Hila
    Karni, Avi
    JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2019, 62 (10): : 3790 - 3807
  • [35] Implicit and explicit learning of event sequences:: evidence for distinct coding of perceptual and motor representations
    Rüsseler, J
    Rösler, F
    ACTA PSYCHOLOGICA, 2000, 104 (01) : 45 - 67
  • [36] Accelerated Future Learning via Explicit Instruction of a Problem Solving Strategy
    Chi, Min
    Vanlehn, Kurt
    ARTIFICIAL INTELLIGENCE IN EDUCATION: BUILDING TECHNOLOGY RICH LEARNING CONTEXTS THAT WORK, 2007, 158 : 409 - +
  • [37] Learning Explicit Credit Assignment for Cooperative Multi-Agent Reinforcement Learning via Polarization Policy Gradient
    Chen, Wubing
    Li, Wenbin
    Liu, Xiao
    Yang, Shangdong
    Gao, Yang
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 10, 2023, : 11542 - 11550
  • [38] MODIFIED EQUATION FOR A CLASS OF EXPLICIT AND IMPLICIT SCHEMES SOLVING ONE-DIMENSIONAL ADVECTION PROBLEM
    Bodnar, Tomas
    Fraunie, Philippe
    Kozel, Karel
    ACTA POLYTECHNICA, 2021, 61 : 49 - 58
  • [39] Breakthrough Problem Solving with Action Learning: Concepts and Cases
    Brook, Cheryl
    EUROPEAN JOURNAL OF TRAINING AND DEVELOPMENT, 2013, 37 (02) : 237 - +
  • [40] Breakthrough problem solving with action learning: concepts and cases
    Holmes, Mary
    ACTION LEARNING, 2013, 10 (01): : 77 - 79