Timezone: »
Unlike humans, who are capable of continuallearning over their lifetimes, artificial neural networkshave long been known to suffer from aphenomenon known as catastrophic forgetting,whereby new learning can lead to abrupt erasureof previously acquired knowledge. Whereas in aneural network the parameters are typically modelledas scalar values, an individual synapse inthe brain comprises a complex network of interactingbiochemical components that evolve at differenttimescales. In this paper, we show that byequipping tabular and deep reinforcement learningagents with a synaptic model that incorporatesthis biological complexity (Benna & Fusi, 2016),catastrophic forgetting can be mitigated at multipletimescales. In particular, we find that as wellas enabling continual learning across sequentialtraining of two simple tasks, it can also be used toovercome within-task forgetting by reducing theneed for an experience replay database.
Author Information
Christos Kaplanis (Imperial College London)
PhD student investigating the topic of continual learning in artificial neural networks.
Murray Shanahan (Imperial College London)
Claudia Clopath (Imperial College London)
Related Events (a corresponding poster, oral, or spotlight)
-
2018 Poster: Continual Reinforcement Learning with Complex Synapses »
Wed. Jul 11th 04:15 -- 07:00 PM Room Hall B #26
More from the Same Authors
-
2023 : Local learning in recurrent networks modelling motor cortex »
Claudia Clopath -
2022 Poster: Maslow's Hammer in Catastrophic Forgetting: Node Re-Use vs. Node Activation »
Sebastian Lee · Stefano Sarao Mannelli · Claudia Clopath · Sebastian Goldt · Andrew Saxe -
2022 Spotlight: Maslow's Hammer in Catastrophic Forgetting: Node Re-Use vs. Node Activation »
Sebastian Lee · Stefano Sarao Mannelli · Claudia Clopath · Sebastian Goldt · Andrew Saxe -
2021 Poster: Spectral Normalisation for Deep Reinforcement Learning: An Optimisation Perspective »
Florin Gogianu · Tudor Berariu · Mihaela Rosca · Claudia Clopath · Lucian Busoniu · Razvan Pascanu -
2021 Spotlight: Spectral Normalisation for Deep Reinforcement Learning: An Optimisation Perspective »
Florin Gogianu · Tudor Berariu · Mihaela Rosca · Claudia Clopath · Lucian Busoniu · Razvan Pascanu -
2020 : Invited Talk: Claudia Clopath "Continual learning though consolidation – a neuroscience angle" »
Claudia Clopath -
2019 Poster: Policy Consolidation for Continual Reinforcement Learning »
Christos Kaplanis · Murray Shanahan · Claudia Clopath -
2019 Oral: Policy Consolidation for Continual Reinforcement Learning »
Christos Kaplanis · Murray Shanahan · Claudia Clopath