Continual task learning in natural and artificial agents

被引:9
|
作者
Flesch, Timo [1 ]
Saxe, Andrew [2 ,3 ]
Summer, Christopher [1 ]
机构
[1] Univ Oxford, Dept Expt Psychol, Oxford, England
[2] UCL, Gatsby Computat Neurosci Unit, London, England
[3] UCL, Sainsbury Wellcome Ctr, London, England
基金
欧洲研究理事会; 英国医学研究理事会; 英国惠康基金;
关键词
MEDIAL TEMPORAL-LOBE; PREFRONTAL CORTEX; NEURAL REPRESENTATIONS; MIXED SELECTIVITY; MEMORY; REPLAY; DIMENSIONALITY; MECHANISMS; FRAMEWORK; SYSTEMS;
D O I
10.1016/j.tins.2022.12.006
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
How do humans and other animals learn new tasks? A wave of brain recording studies has investigated how neural representations change during task learn-ing, with a focus on how tasks can be acquired and coded in ways that minimise mutual interference. We review recent work that has explored the geometry and dimensionality of neural task representations in neocortex, and computational models that have exploited these findings to understand how the brain may par-tition knowledge between tasks. We discuss how ideas from machine learning, including those that combine supervised and unsupervised learning, are helping neuroscientists understand how natural tasks are learned and coded in biologi-cal brains.
引用
收藏
页码:199 / 210
页数:12
相关论文
共 50 条
  • [41] Accounting for the Effect of Inter-Task Similarity in Continual Learning Models
    El Khatib, Alaa
    Nasr, Mahmoud
    Karray, Fakhri
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 1241 - 1247
  • [42] Task-Free Dynamic Sparse Vision Transformer for Continual Learning
    Ye, Fei
    Bors, Adrian G.
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16442 - 16450
  • [43] Continual Deep Reinforcement Learning with Task-Agnostic Policy Distillation
    Hafez, Muhammad Burhan
    Erekmen, Kerim
    arXiv,
  • [44] Symbolic Replay: Scene Graph as Prompt for Continual Learning on VQA Task
    Lei, Stan Weixian
    Gao, Difei
    Wu, Jay Zhangjie
    Wang, Yuxuan
    Liu, Wei
    Zhang, Mengmi
    Shou, Mike Zheng
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 1250 - 1259
  • [45] Continual Learning by Task-Wise Shared Hidden Representation Alignment
    Zhan, Xu-Hui
    Liuz, Jian-Wei
    Han, Ya-Nan
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT II, 2022, 13530 : 371 - 382
  • [46] Continual Learning in the Teacher-Student Setup: Impact of Task Similarity
    Lee, Sebastian
    Goldt, Sebastian
    Saxe, Andrew
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [47] Combining replay and LoRA for continual learning in natural language understanding
    Borhanifard, Zeinab
    Faili, Heshaam
    Yaghoobzadeh, Yadollah
    COMPUTER SPEECH AND LANGUAGE, 2025, 90
  • [48] CORA: BENCHMARKS, BASELINES, AND METRICS AS A PLATFORM FOR CONTINUAL REINFORCEMENT LEARNING AGENTS
    Powers, Sam
    Xing, Eliot
    Kolve, Eric
    Mottaghi, Roozbeh
    Gupta, Abhinav
    CONFERENCE ON LIFELONG LEARNING AGENTS, VOL 199, 2022, 199
  • [49] Incorporating neuro-inspired adaptability for continual learning in artificial intelligence
    Wang, Liyuan
    Zhang, Xingxing
    Li, Qian
    Zhang, Mingtian
    Su, Hang
    Zhu, Jun
    Zhong, Yi
    NATURE MACHINE INTELLIGENCE, 2023, 5 (12) : 1356 - 1368
  • [50] Incorporating neuro-inspired adaptability for continual learning in artificial intelligence
    Liyuan Wang
    Xingxing Zhang
    Qian Li
    Mingtian Zhang
    Hang Su
    Jun Zhu
    Yi Zhong
    Nature Machine Intelligence, 2023, 5 : 1356 - 1368