Sleep prevents catastrophic forgetting in spiking neural networks by forming a joint synaptic weight representation.

ABSTRACT: Artificial neural networks overwrite previously learned tasks when trained sequentially, a phenomenon known as catastrophic forgetting. In contrast, the brain learns continuously, and typically learns best when new training is interleaved with periods of sleep for memory consolidation. Here we used spiking network to study mechanisms behind catastrophic forgetting and the role of sleep in preventing it. The network could be trained to learn a complex foraging task but exhibited catastrophic forgetting when trained sequentially on different tasks. In synaptic weight space, new task training moved the synaptic weight configuration away from the manifold representing old task leading to forgetting. Interleaving new task training with periods of off-line reactivation, mimicking biological slee

SUBMITTER: Golden R 

PROVIDER: S-EPMC9674146 | biostudies-literature | 2022 Nov

REPOSITORIES: biostudies-literature