Dataset Information

Multi-Timescale Memory Dynamics Extend Task Repertoire in a Reinforcement Learning Network With Attention-Gated Memory.

ABSTRACT: The interplay of reinforcement learning and memory is at the core of several recent neural network models, such as the Attention-Gated MEmory Tagging (AuGMEnT) model. While successful at various animal learning tasks, we find that the AuGMEnT network is unable to cope with some hierarchical tasks, where higher-level stimuli have to be maintained over a long time, while lower-level stimuli need to be remembered and forgotten over a shorter timescale. To overcome this limitation, we introduce a hybrid AuGMEnT, with leaky (or short-timescale) and non-leaky (or long-timescale) memory units, that allows the exchange of low-level information while maintaining high-level one. We test the performance of the hybrid AuGMEnT network on two cognitive reference tasks, sequence prediction and 12AX.

SUBMITTER: Martinolli M

PROVIDER: S-EPMC6055065 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Multi-Timescale Memory Dynamics Extend Task Repertoire in a Reinforcement Learning Network With Attention-Gated Memory.

Martinolli Marco M Gerstner Wulfram W Gilra Aditya A

Frontiers in computational neuroscience 20180712

The interplay of reinforcement learning and memory is at the core of several recent neural network models, such as the Attention-Gated MEmory Tagging (AuGMEnT) model. While successful at various animal learning tasks, we find that the AuGMEnT network is unable to cope with some hierarchical tasks, where higher-level stimuli have to be maintained over a long time, while lower-level stimuli need to be remembered and forgotten over a shorter timescale. To overcome this limitation, we introduce a hy ...[more]

PMID: 30061819

Similar Datasets

Project description:Network functioning during cognitive tasks is of major interest in Alzheimer's disease (AD). Cognitive functioning in AD includes variable performance in short-term memory (STM). In most studies, the verbal STM functioning in AD patients has been interpreted within the phonological loop subsystem of Baddeley's working memory model. An alternative account considers that domain-general attentional processes explain the involvement of frontoparietal networks in verbal STM beside the functioning of modality-specific subsystems. In this study, we assessed the functional integrity of the dorsal attention network (involved in task-related attention) and the ventral attention network (involved in stimulus-driven attention) by varying attentional control demands in a STM task. Thirty-five AD patients and twenty controls in the seventies performed an fMRI STM task. Variation in load (five versus two items) allowed the dorsal (DAN) and ventral attention networks (VAN) to be studied. ANOVA revealed that performance decreased with increased load in both groups. AD patients performed slightly worse than controls, but accuracy remained above 70% in all patients. Statistical analysis of fMRI brain images revealed DAN activation for high load in both groups. There was no between-group difference or common activation for low compared to high load conditions. Psychophysiological interaction showed a negative relationship between the DAN and the VAN for high versus low load conditions in patients. In conclusion, the DAN remained activated and connected to the VAN in mild AD patients who succeeded in performing an fMRI verbal STM task. DAN was necessary for the task, but not sufficient to reach normal performance. Slightly lower performance in early AD patients compared to controls might be related to maintained bottom-up attention to distractors, to decrease in executive functions, to impaired phonological processing or to reduced capacity in serial order processing.

Dataset Information

Multi-Timescale Memory Dynamics Extend Task Repertoire in a Reinforcement Learning Network With Attention-Gated Memory.

Publications

Multi-Timescale Memory Dynamics Extend Task Repertoire in a Reinforcement Learning Network With Attention-Gated Memory.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets