Understanding Language Evolution in Overlapping Generations of Reinforcement Learning Agents

被引:0
|
作者
Brace, Lewys G. [1 ]
Bullock, Seth [2 ]
机构
[1] Univ Southampton, Inst Complex Syst Simulat, Southampton, Hants, England
[2] Univ Bristol, Dept Comp Sci, Bristol, Avon, England
关键词
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Understanding how the dynamics of language learning and language change are influenced by the population structure of language users is crucial to understanding how lexical items and grammatical rules become established within the context of the cultural evolution of human language. This paper extends the recent body of work on the development of term-based languages through signalling games by exploring signalling game dynamics in a social population with overlapping generations. Specifically, we present a model with a dynamic population of agents, consisting of both mature and immature language users, where the latter learn from the formers' interactions with one another before reaching maturity. It is shown that populations in which mature individuals converse with many partners are more able to solve more complex signalling games. While interacting with a higher number of individuals initially makes it more difficult for language users to establish a conventionalised language, doing so leads to increased diversity within the input for language learners, and that this prevents them from developing the more idiosyncratic language that emerge when agents only interact with a small number of individuals. This, in turn, prevents the signalling conventions having to be renegotiated with each new generation of language users, resulting in the emerging language being more stable over subsequent generations of language users. Furthermore, it is shown that allowing the children of language users to interact with one another is beneficial to the communicative success of the population when the number of partners that mature agents interact with is low.
引用
收藏
页码:492 / 499
页数:8
相关论文
共 50 条
  • [1] Repeated implementation with overlapping generations of agents
    Helmuts Āzacis
    Social Choice and Welfare, 2020, 55 : 275 - 299
  • [2] Repeated implementation with overlapping generations of agents
    Azacis, Helmuts
    SOCIAL CHOICE AND WELFARE, 2020, 55 (02) : 275 - 299
  • [3] Reflexion: Language Agents with Verbal Reinforcement Learning
    Shinn, Noah
    Cassano, Federico
    Gopinath, Ashwin
    Narasimhan, Karthik
    Yao, Shunyu
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [4] Language evolution by iterated learning with Bayesian agents
    Griffiths, Thomas L.
    Kalish, Michael L.
    COGNITIVE SCIENCE, 2007, 31 (03) : 441 - 480
  • [5] Understanding the Evolution of Linear Regions in Deep Reinforcement Learning
    Cohan, Setareh
    Kim, Nam Hee
    Rolnick, David
    van de Panne, Michiel
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [6] Determinacy of equilibrium in an overlapping generations model with heterogeneous agents
    Nourry, C
    Venditti, A
    JOURNAL OF ECONOMIC THEORY, 2001, 96 (1-2) : 230 - 255
  • [7] Interestingness elements for explainable reinforcement learning: Understanding agents' capabilities and limitations
    Sequeira, Pedro
    Gervasio, Melinda
    ARTIFICIAL INTELLIGENCE, 2020, 288 (288)
  • [8] DISEQUILIBRIUM DYNAMICS WITH NAIVE AGENTS IN THE OVERLAPPING GENERATIONS MODEL WITH MONEY
    SACCO, PL
    MATHEMATICAL SOCIAL SCIENCES, 1993, 26 (02) : 139 - 155
  • [9] Language-based General Action Template for Reinforcement Learning Agents
    Kohita, Ryosuke
    Wachi, Akifumi
    Kimura, Daiki
    Chaudhury, Subhajit
    Tatsubori, Michiaki
    Munawar, Asim
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 2125 - 2139
  • [10] Large Language Models Are Semi-Parametric Reinforcement Learning Agents
    Zhang, Danyang
    Chen, Lu
    Zhang, Situo
    Xu, Hongshen
    Zhao, Zihan
    Yu, Kai
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,