Solutions to the catastrophic forgetting problem

被引：0

作者：

Robins, A ^{[1
]}

机构：

[1] Univ Otago, Dept Comp Sci, Dunedin, New Zealand

来源：

PROCEEDINGS OF THE TWENTIETH ANNUAL CONFERENCE OF THE COGNITIVE SCIENCE SOCIETY | 1998年

关键词：

D O I：

暂无

中图分类号：

H [语言、文字];

学科分类号：

05 ;

摘要：

In this paper we review three kinds of proposed solutions to the catastrophic forgetting problem in neural networks. The solutions are based on reducing hidden unit overlap, rehearsal, and pseudorehearsal mechanisms. We compare the methods and identify some underlying similarities. We then briefly note some potential implications of the rehearsal / pseudorehearsal based methods, including their application to sequential learning tasks.

引用

页码：899 / 904

页数：6

共 50 条

[1] Catastrophic Forgetting: Still a Problem for DNNs
Pfuelb, B.
Gepperth, A.
Abdullah, S.
Kilian, A.
[J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT I, 2018, 11139 : 487 - 497
[2] Contributions by metaplasticity to solving the Catastrophic Forgetting Problem
Jedlicka, Peter
Tomko, Matus
Robins, Anthony
Abraham, Wickliffe C.
[J]. TRENDS IN NEUROSCIENCES, 2022, 45 (09) : 656 - 666
[3] Catastrophic Forgetting Problem in Semi-Supervised Semantic Segmentation
Zhou, Yan
Jiao, Ruyi
Wang, Dongli
Mu, Jinzhen
Li, Jianxun
[J]. IEEE ACCESS, 2022, 10 : 48855 - 48864
[4] Avoiding Catastrophic Forgetting
Hasselmo, Michael E.
[J]. TRENDS IN COGNITIVE SCIENCES, 2017, 21 (06) : 407 - 408
[5] Catastrophic forgetting in connectionist networks
French, RM
[J]. TRENDS IN COGNITIVE SCIENCES, 1999, 3 (04) : 128 - 135
[6] Contributions by metaplasticity to solving the Catastrophic Forgetting Problem (vol 45, pg 656, 2022)
Jedlicka, Peter
Tomko, Matus
Robins, Anthony
Abraham, Wickliffe C.
[J]. TRENDS IN NEUROSCIENCES, 2023, 46 (10) : 893 - 894
[7] Overcoming catastrophic forgetting with classifier expander
Liu, Xinchen
Wang, Hongbo
Tian, Yingjian
Xie, Linyao
[J]. ASIAN CONFERENCE ON MACHINE LEARNING, VOL 222, 2023, 222
[8] USING THE GNG-M ALGORITHM TO DEAL WITH THE PROBLEM OF CATASTROPHIC FORGETTING IN INCREMENTAL MODELLING
Satizabal M, Hector F.
Perez-Uribe, Andres
[J]. NCTA 2011: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON NEURAL COMPUTATION THEORY AND APPLICATIONS, 2011, : 267 - 276
[9] Mitigate Catastrophic Forgetting by Varying Goals
Chen, Lu
Masayuki, Murata
[J]. ICAART: PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE, VOL 2, 2020, : 530 - 537
[10] Overcoming catastrophic forgetting in neural networks
Kirkpatricka, James
Pascanu, Razvan
Rabinowitz, Neil
Veness, Joel
Desjardins, Guillaume
Rusu, Andrei A.
Milan, Kieran
Quan, John
Ramalho, Tiago
Grabska-Barwinska, Agnieszka
Hassabis, Demis
Clopath, Claudia
Kumaran, Dharshan
Hadsell, Raia
[J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2017, 114 (13) : 3521 - 3526

← 1 2 3 4 5 →