Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Dopamine transients follow a striatal gradient of reward time horizons.

ABSTRACT: Animals make predictions to guide their behavior and update those predictions through experience. Transient increases in dopamine (DA) are thought to be critical signals for updating predictions. However, it is unclear how this mechanism handles a wide range of behavioral timescales-from seconds or less (for example, if singing a song) to potentially hours or more (for example, if hunting for food). Here we report that DA transients in distinct rat striatal subregions convey prediction errors based on distinct time horizons. DA dynamics systematically accelerated from ventral to dorsomedial to dorsolateral striatum, in the tempo of spontaneous fluctuations, the temporal integration of prior rewards and the discounting of future rewards. This spectrum of timescales for evaluative computations can help achieve efficient learning and adaptive motivation for a broad range of behaviors.

SUBMITTER: Mohebi A

PROVIDER: S-EPMC11001583 | biostudies-literature | 2024 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Dopamine transients follow a striatal gradient of reward time horizons.

Mohebi Ali A Wei Wei W Pelattini Lilian L Kim Kyoungjun K Berke Joshua D JD

Nature neuroscience 20240206 4

Animals make predictions to guide their behavior and update those predictions through experience. Transient increases in dopamine (DA) are thought to be critical signals for updating predictions. However, it is unclear how this mechanism handles a wide range of behavioral timescales-from seconds or less (for example, if singing a song) to potentially hours or more (for example, if hunting for food). Here we report that DA transients in distinct rat striatal subregions convey prediction errors ba ...[more]

PMID: 38321294

Similar Datasets

Dopamine transients encode reward prediction errors independent of learning rates.

Project description:Biological accounts of reinforcement learning posit that dopamine encodes reward prediction errors (RPEs), which are multiplied by a learning rate to update state or action values. These values are thought to be represented by corticostriatal synaptic weights, which are updated by dopamine-dependent plasticity. This suggests that dopamine release reflects the product of the learning rate and RPE. Here, we characterize dopamine encoding of learning rates in the nucleus accumbens core (NAcc) in a volatile environment. Using a task with semi-observable states offering different rewards, we find that rats adjust how quickly they initiate trials across states using RPEs. Computational modeling and behavioral analyses show that learning rates are higher following state transitions and scale with trial-by-trial changes in beliefs about hidden states, approximating normative Bayesian strategies. Notably, dopamine release in the NAcc encodes RPEs independent of learning rates, suggesting that dopamine-independent mechanisms instantiate dynamic learning rates.

| S-EPMC11571066 | biostudies-literature

Optogenetic Blockade of Dopamine Transients Prevents Learning Induced by Changes in Reward Features.

Project description:Prediction errors are critical for associative learning [1, 2]. Transient changes in dopamine neuron activity correlate with positive and negative reward prediction errors and can mimic their effects [3-15]. However, although causal studies show that dopamine transients of 1-2 s are sufficient to drive learning about reward, these studies do not address whether they are necessary (but see [11]). Further, the precise nature of this signal is not yet fully established. Although it has been equated with the cached-value error signal proposed to support model-free reinforcement learning, cached-value errors are typically confounded with errors in the prediction of reward features [16]. Here, we used optogenetic and transgenic approaches to prevent transient changes in midbrain dopamine neuron activity during the critical error-signaling period of two unblocking tasks. In one, learning was unblocked by increasing the number of rewards, a manipulation that induces errors in predicting both value and reward features. In another, learning was unblocked by switching from one to another equally valued reward, a manipulation that induces errors only in reward feature prediction. Preventing dopamine neurons in the ventral tegmental area from firing for 5 s beginning before and continuing until after the changes in reward prevented unblocking of learning in both tasks. A similar duration suppression did not induce extinction when delivered during an expected reward, indicating that it did not act independently as a negative prediction error. This result suggests that dopamine transients play a general role in error signaling rather than being restricted to only signaling errors in value.

| S-EPMC5698141 | biostudies-literature

Local and global consequences of reward-evoked striatal dopamine release.

Project description:The neurotransmitter dopamine is required for the reinforcement of actions by rewarding stimuli1. Neuroscientists have tried to define the functions of dopamine in concise conceptual terms2, but the practical implications of dopamine release depend on its diverse brain-wide consequences. Although molecular and cellular effects of dopaminergic signalling have been extensively studied3, the effects of dopamine on larger-scale neural activity profiles are less well-understood. Here we combine dynamic dopamine-sensitive molecular imaging4 and functional magnetic resonance imaging to determine how striatal dopamine release shapes local and global responses to rewarding stimulation in rat brains. We find that dopamine consistently alters the duration, but not the magnitude, of stimulus responses across much of the striatum, via quantifiable postsynaptic effects that vary across subregions. Striatal dopamine release also potentiates a network of distal responses, which we delineate using neurochemically dependent functional connectivity analyses. Hot spots of dopaminergic drive notably include cortical regions that are associated with both limbic and motor function. Our results reveal distinct neuromodulatory actions of striatal dopamine that extend well beyond its sites of peak release, and that result in enhanced activation of remote neural populations necessary for the performance of motivated actions. Our findings also suggest brain-wide biomarkers of dopaminergic function and could provide a basis for the improved interpretation of neuroimaging results that are relevant to learning and addiction.

| S-EPMC7799633 | biostudies-literature

Striatal Dopamine and Reward Prediction Error Signaling in Unmedicated Schizophrenia Patients.

Project description:Increased striatal dopamine synthesis capacity has consistently been reported in patients with schizophrenia. However, the mechanism translating this into behavior and symptoms remains unclear. It has been proposed that heightened striatal dopamine may blunt dopaminergic reward prediction error signaling during reinforcement learning. In this study, we investigated striatal dopamine synthesis capacity, reward prediction errors, and their association in unmedicated schizophrenia patients (n = 19) and healthy controls (n = 23). They took part in FDOPA-PET and underwent functional magnetic resonance imaging (fMRI) scanning, where they performed a reversal-learning paradigm. The groups were compared regarding dopamine synthesis capacity (Kicer), fMRI neural prediction error signals, and the correlation of both. Patients did not differ from controls with respect to striatal Kicer. Taking into account, comorbid alcohol abuse revealed that patients without such abuse showed elevated Kicer in the associative striatum, while those with abuse did not differ from controls. Comparing all patients to controls, patients performed worse during reversal learning and displayed reduced prediction error signaling in the ventral striatum. In controls, Kicer in the limbic striatum correlated with higher reward prediction error signaling, while there was no significant association in patients. Kicer in the associative striatum correlated with higher positive symptoms and blunted reward prediction error signaling was associated with negative symptoms. Our results suggest a dissociation between striatal subregions and symptom domains, with elevated dopamine synthesis capacity in the associative striatum contributing to positive symptoms while blunted prediction error signaling in the ventral striatum related to negative symptoms.

| S-EPMC7751190 | biostudies-literature

Dopamine D2 receptors bidirectionally regulate striatal enkephalin expression: Implications for cocaine reward.

Project description:Low dopamine D2 receptor (D2R) availability in the striatum can predispose for cocaine abuse; though how low striatal D2Rs facilitate cocaine reward is unclear. Overexpression of D2Rs in striatal neurons or activation of D2Rs by acute cocaine suppresses striatal Penk mRNA. Conversely, low D2Rs in D2-striatal neurons increases striatal Penk mRNA and enkephalin peptide tone, an endogenous mu-opioid agonist. In brain slices, met-enkephalin and inhibition of enkephalin catabolism suppresses intra-striatal GABA transmission. Pairing cocaine with intra-accumbens met-enkephalin during place conditioning facilitates acquisition of preference, while mu-opioid receptor antagonist blocks preference in wild-type mice. We propose that heightened striatal enkephalin potentiates cocaine reward by suppressing intra-striatal GABA to enhance striatal output. Surprisingly, a mu-opioid receptor antagonist does not block cocaine preference in mice with low striatal D2Rs, implicating other opioid receptors. The bidirectional regulation of enkephalin by D2R activity and cocaine offers insights into mechanisms underlying the vulnerability for cocaine abuse.

| S-EPMC9620395 | biostudies-literature

Striatal dopamine D2/D3 receptor regulation of human reward processing and behaviour.

Project description:Signalling at dopamine D2/D3 receptors is thought to underlie motivated behaviour, pleasure experiences and emotional expression based on animal studies, but it is unclear if this is the case in humans or how this relates to neural processing of reward stimuli. Using a randomised, double-blind, placebo-controlled, crossover neuroimaging study, we show in healthy humans that sustained dopamine D2/D3 receptor antagonism for 7 days results in negative symptoms (impairments in motivated behaviour, hedonic experience, verbal and emotional expression) and that this is related to blunted striatal response to reward stimuli. In contrast, 7 days of partial D2/D3 agonism does not disrupt reward signalling, motivated behaviour or hedonic experience. Both D2/D3 antagonism and partial agonism induce motor impairments, which are not related to striatal reward response. These findings identify a central role for D2/D3 signalling and reward processing in the mechanism underlying motivated behaviour and emotional responses in humans, with implications for understanding neuropsychiatric disorders such as schizophrenia and Parkinson's disease.

| S-EPMC11845780 | biostudies-literature

Striatal dopamine supports reward expectation and learning: A simultaneous PET/fMRI study.

Project description:Converging evidence from both human neuroimaging and animal studies has supported a model of mesolimbic processing underlying reward learning behaviors, based on the computation of reward prediction errors. However, competing evidence supports human dopamine signaling in the basal ganglia as also contributing to the generation of higher order learning heuristics. Here, we present data from a large (N = 81, 18-30yo), multi-modal neuroimaging study using simultaneously acquired task fMRI, affording temporal resolution of reward system function, and PET imaging with [11C]Raclopride (RAC), assessing striatal dopamine (DA) D2/3 receptor binding, during performance of a probabilistic reward learning task. Both fMRI activation and PET DA measures showed ventral striatum involvement for signaling rewards. However, greater DA release was uniquely associated with learning strategies (i.e., learning rates) that were more task-optimal within the best fitting reinforcement learning model. This DA response was associated with BOLD activation of a network of regions including anterior cingulate cortex, medial prefrontal cortex, thalamus and posterior parietal cortex, primarily during expectation, rather than prediction error, task epochs. Together, these data provide novel, human in vivo evidence that striatal dopaminergic signaling interacts with a network of cortical regions to generate task-optimal learning strategies, rather than representing reward outcomes in isolation.

| S-EPMC9983071 | biostudies-literature

Insulin enhances striatal dopamine release by activating cholinergic interneurons and thereby signals reward.

Project description:Insulin activates insulin receptors (InsRs) in the hypothalamus to signal satiety after a meal. However, the rising incidence of obesity, which results in chronically elevated insulin levels, implies that insulin may also act in brain centres that regulate motivation and reward. We report here that insulin can amplify action potential-dependent dopamine (DA) release in the nucleus accumbens (NAc) and caudate-putamen through an indirect mechanism that involves striatal cholinergic interneurons that express InsRs. Furthermore, two different chronic diet manipulations in rats, food restriction (FR) and an obesogenic (OB) diet, oppositely alter the sensitivity of striatal DA release to insulin, with enhanced responsiveness in FR, but loss of responsiveness in OB. Behavioural studies show that intact insulin levels in the NAc shell are necessary for acquisition of preference for the flavour of a paired glucose solution. Together, these data imply that striatal insulin signalling enhances DA release to influence food choices.

| S-EPMC4624275 | biostudies-literature

Simultaneous Measurement of Striatal Dopamine and Hydrogen Peroxide Transients Associated with L-DOPA Induced Rotation in Hemiparkinsonian Rats.

Project description:Parkinson's disease (PD) is a neurodegenerative disorder commonly treated with levodopa (L-DOPA), which eventually induces abnormal involuntary movements (AIMs). The neurochemical contributors to these dyskinesias are unknown; however, several lines of evidence indicate an interplay of dopamine (DA) and oxidative stress. Here, DA and hydrogen peroxide (H2O2) were simultaneously monitored at discrete recording sites in the dorsal striata of hemiparkinsonian rats using fast-scan cyclic voltammetry. Mass spectrometry imaging validated the lesions. Hemiparkinsonian rats exhibited classic L-DOPA-induced AIMs and rotations as well as increased DA and H2O2 tone over saline controls after 1 week of treatment. By week 3, DA tone remained elevated beyond that of controls, but H2O2 tone was largely normalized. At this time point, rapid chemical transients were time-locked with spontaneous bouts of rotation. Striatal H2O2 rapidly increased with the initiation of contraversive rotational behaviors in lesioned L-DOPA animals, in both hemispheres. DA signals simultaneously decreased with rotation onset. The results support a role for these striatal neuromodulators in the adaptive changes that occur with L-DOPA treatment in PD and reveal a precise interplay between DA and H2O2 in the initiation of involuntary locomotion.

| S-EPMC9838821 | biostudies-literature

Project description:Characterizing developmental changes in frontostriatal circuitry is critical to understanding adolescent development and can clarify neurobiological mechanisms underlying increased reward sensitivity and risk-taking and the emergence of psychopathology during this period. However, the role of striatal neurobiology in the development of frontostriatal circuitry through human adolescence remains largely unknown. We examined background connectivity during a reward-guided decision-making task ("reward-state"), in addition to resting-state, and assessed the association between age-related changes in frontostriatal connectivity and age-related changes in reward learning and risk-taking through adolescence. Further, we examined the contribution of dopaminergic processes to changes in frontostriatal circuitry and decision-making using MR-based assessments of striatal tissue-iron as a correlate of dopamine-related neurobiology. Connectivity between the nucleus accumbens (NAcc) and ventral anterior cingulate, subgenual cingulate, and orbitofrontal cortices decreased through adolescence into adulthood, and decreases in reward-state connectivity were associated with improvements reward-guided decision-making as well as with decreases in risk-taking. Finally, NAcc tissue-iron mediated age-related changes and was associated with variability in connectivity, and developmental increases in NAcc R2' corresponded with developmental decreases in connectivity. Our results provide evidence that dopamine-related striatal properties contribute to the specialization of frontostriatal circuitry, potentially underlying changes in risk-taking and reward sensitivity into adulthood.

| S-EPMC8096717 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data