A cognitive model of maze robot with emotion and memory mechanism

被引：0
|
作者：
Zhang X.-P. [1 ]
Li K. [1 ]
Wang L. [1 ]
Yan J.-Q. [1 ]
He Z.-H. [1 ]
机构：
[1] School of Electrical and Control Engineering, North China University of Technology, Beijing
来源：
Kongzhi yu Juece/Control and Decision | 2023年 / 38卷 / 10期
关键词：
cognitive model; emotion; internal reward; maze robot; memory;
D O I：
10.13195/j.kzyjc.2022.0734
中图分类号：
学科分类号：
摘要：
As a higher level of human cognition, emotion plays an important role in environment learning and understanding. In this paper, emotion is introduced into the robot search task. By combined with memory mechanism, a cognitive model is proposed, which is composed of seven parts: internal state, receptor, environmental state system, emotion system, dynamic knowledge base, behavior decision system and actuator. In further, the emotion system consists of three modules: Emotion generation, emotion state and emotion memory, where the emotion memory is used to provide internal rewards. The memory function is implemented in the dynamic knowledge base. Based on the theoretical framework of reinforcement learning, the learning algorithm of the cognitive model is designed by integrating emotional internal reward and memory as a new reward mechanism. The maze robot search task requiring “energy replenishment”is tested, and results show that when faced with different situations, the robot can generate different emotions. Combined with the previous memory, the robot’s decision-making seems more“anthropomorphic”, which firstly proves the effectiveness of the design of the emotion and memory mechanism. The cognitive model, the cognitive model without emotion and the Q-learning algorithm based on the ε-greedy strategy are compared, and results show that with the mechanism of emotion and memory, the robot can learn faster, and at the same time, its learning process is more stable. © 2023 Northeast University. All rights reserved.
引用
收藏
页码：2850 / 2858
页数：8
相关论文
共 27 条
  • [1] Loev S., Epistemic feelings are affective experiences, Emotion Review, 14, 3, pp. 206-216, (2022)
  • [2] Ahumada-Mendez F, Lucero B, Avenanti A, Et al., Affective modulation of cognitive control: A systematic review of EEG studies, Physiology & Behavior, 249, (2022)
  • [3] Culot C, Gevers W., Happy is easy: The influence of affective states on cognitive control and metacognitive reports, Cognition and Emotion, 35, 6, pp. 1195-1202, (2021)
  • [4] Kraljevic N, Schaare H L, Eickhoff S B, Et al., Behavioral, anatomical and heritable convergence of affect and cognition in superior frontal cortex, NeuroImage, 243, (2021)
  • [5] Xia W R, Chen S, Wang L., Neural oscillations underlying the extinction of conditioned fear memory, Progress in Biochemistry and Biophysics, 46, 3, pp. 276-286, (2019)
  • [6] Palomero-Gallagher N, Hoffstaedter F, Mohlberg H, Et al., Human pregenual anterior cingulate cortex: Structural, functional, and connectional heterogeneity, Cerebral Cortex, 29, 6, pp. 2552-2574, (2018)
  • [7] Quinones-Laracuente K, Vega-Medina A, Quirk G J., Time-dependent recruitment of prelimbic prefrontal circuits for retrieval of fear memory, Frontiers in Behavioral Neuroscience, 15, (2021)
  • [8] Madan C R, Fujiwara E, Caplan J B, Et al., Emotional arousal impairs association-memory: Roles of amygdala and hippocampus, NeuroImage, 156, pp. 14-28, (2017)
  • [9] Shao K Q, Pekrun R, Nicholson L J., Emotions in classroom language learning: What can we learn from achievement emotion research?, System, 86, (2019)
  • [10] Lang Y R, Gong S Y, Cao Y, Et al., The relationship between teacher-student interaction and college students’ learning engagement in online learning: Mediation of autonomous motivation and academic emotions, Psychological Development and Education, 38, 4, pp. 530-537, (2022)
123