Unknown

Dataset Information

0

A solution to the learning dilemma for recurrent networks of spiking neurons.


ABSTRACT: Recurrently connected networks of spiking neurons underlie the astounding information processing capabilities of the brain. Yet in spite of extensive research, how they can learn through synaptic plasticity to carry out complex network computations remains unclear. We argue that two pieces of this puzzle were provided by experimental data from neuroscience. A mathematical result tells us how these pieces need to be combined to enable biologically plausible online network learning through gradient descent, in particular deep reinforcement learning. This learning method-called e-prop-approaches the performance of backpropagation through time (BPTT), the best-known method for training recurrent neural networks in machine learning. In addition, it suggests a method for powerful on-chip learning in energy-efficient spike-based hardware for artificial intelligence.

SUBMITTER: Bellec G 

PROVIDER: S-EPMC7367848 | biostudies-literature | 2020 Jul

REPOSITORIES: biostudies-literature

altmetric image

Publications

A solution to the learning dilemma for recurrent networks of spiking neurons.

Bellec Guillaume G   Scherr Franz F   Subramoney Anand A   Hajek Elias E   Salaj Darjan D   Legenstein Robert R   Maass Wolfgang W  

Nature communications 20200717 1


Recurrently connected networks of spiking neurons underlie the astounding information processing capabilities of the brain. Yet in spite of extensive research, how they can learn through synaptic plasticity to carry out complex network computations remains unclear. We argue that two pieces of this puzzle were provided by experimental data from neuroscience. A mathematical result tells us how these pieces need to be combined to enable biologically plausible online network learning through gradien  ...[more]

Similar Datasets

| S-EPMC6195349 | biostudies-literature
| S-EPMC9273101 | biostudies-literature
| S-EPMC4758071 | biostudies-literature
| S-EPMC8685685 | biostudies-literature
| S-EPMC9249234 | biostudies-literature
| S-EPMC7524009 | biostudies-literature
| S-EPMC3089610 | biostudies-literature
| S-EPMC6842655 | biostudies-literature