Learning in deep neural networks and brains with similarity-weighted interleaved learning.

ABSTRACT: Understanding how the brain learns throughout a lifetime remains a long-standing challenge. In artificial neural networks (ANNs), incorporating novel information too rapidly results in catastrophic interference, i.e., abrupt loss of previously acquired knowledge. Complementary Learning Systems Theory (CLST) suggests that new memories can be gradually integrated into the neocortex by interleaving new memories with existing knowledge. This approach, however, has been assumed to require interleaving all existing knowledge every time something new is learned, which is implausible because it is time-consuming and requires a large amount of data. We show that deep, nonlinear ANNs can learn new information by interleaving only a subset of old items that share substantial representational similari

SUBMITTER: Saxena R 

PROVIDER: S-EPMC9271163 | biostudies-literature | 2022 Jul

REPOSITORIES: biostudies-literature