Unknown

Dataset Information

The information theory of developmental pruning: Optimizing global network architectures using local synaptic rules.


ABSTRACT: During development, biological neural networks produce more synapses and neurons than needed. Many of these synapses and neurons are later removed in a process known as neural pruning. Why networks should initially be over-populated, and the processes that determine which synapses and neurons are ultimately pruned, remains unclear. We study the mechanisms and significance of neural pruning in model neural networks. In a deep Boltzmann machine model of sensory encoding, we find that (1) synaptic pruning is necessary to learn efficient network architectures that retain computationally-relevant connections, (2) pruning by synaptic weight alone does not optimize network size and (3) pruning based on a locally-available measure of importance based on Fisher information allows the network to ide

SUBMITTER: Scholl C 

PROVIDER: S-EPMC8584672 | biostudies-literature | 2021 Oct

REPOSITORIES: biostudies-literature