Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

The role of state uncertainty in the dynamics of dopamine.

ABSTRACT: Reinforcement learning models of the basal ganglia map the phasic dopamine signal to reward prediction errors (RPEs). Conventional models assert that, when a stimulus predicts a reward with fixed delay, dopamine activity during the delay should converge to baseline through learning. However, recent studies have found that dopamine ramps up before reward in certain conditions even after learning, thus challenging the conventional models. In this work, we show that sensory feedback causes an unbiased learner to produce RPE ramps. Our model predicts that when feedback gradually decreases during a trial, dopamine activity should resemble a "bump," whose ramp-up phase should, furthermore, be greater than that of conditions where the feedback stays high. We trained mice on a virtual navigation task with varying brightness, and both predictions were empirically observed. In sum, our theoretical and experimental results reconcile the seemingly conflicting data on dopamine behaviors under the RPE hypothesis.

SUBMITTER: Mikhael JG

PROVIDER: S-EPMC8930519 | biostudies-literature | 2022 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

The role of state uncertainty in the dynamics of dopamine.

Mikhael John G JG Kim HyungGoo R HR Uchida Naoshige N Gershman Samuel J SJ

Current biology : CB 20220202 5

Reinforcement learning models of the basal ganglia map the phasic dopamine signal to reward prediction errors (RPEs). Conventional models assert that, when a stimulus predicts a reward with fixed delay, dopamine activity during the delay should converge to baseline through learning. However, recent studies have found that dopamine ramps up before reward in certain conditions even after learning, thus challenging the conventional models. In this work, we show that sensory feedback causes an unbia ...[more]

PMID: 35114098

Similar Datasets

The Medial Prefrontal Cortex Shapes Dopamine Reward Prediction Errors under State Uncertainty.

Project description:Animals make predictions based on currently available information. In natural settings, sensory cues may not reveal complete information, requiring the animal to infer the "hidden state" of the environment. The brain structures important in hidden state inference remain unknown. A previous study showed that midbrain dopamine neurons exhibit distinct response patterns depending on whether reward is delivered in 100% (task 1) or 90% of trials (task 2) in a classical conditioning task. Here we found that inactivation of the medial prefrontal cortex (mPFC) affected dopaminergic signaling in task 2, in which the hidden state must be inferred ("will reward come or not?"), but not in task 1, where the state was known with certainty. Computational modeling suggests that the effects of inactivation are best explained by a circuit in which the mPFC conveys inference over hidden states to the dopamine system. VIDEO ABSTRACT.

| S-EPMC5934341 | biostudies-literature

Dopamine Neurons Reflect the Uncertainty in Fear Generalization.

Project description:Generalized fear is a maladaptive behavior in which non-threatening stimuli elicit a fearful response. Here, we demonstrate that discrimination between predictive and non-predictive threat stimuli is highly sensitive to probabilistic discounting and increasing threat intensity in mice. We find that dopamine neurons of the ventral tegmental area (VTA) encode both the negative valence of threat-predictive cues and the certainty of threat prediction. As fear generalization emerges, the dopamine neurons that are activated by a threat predictive cue (CS+) decrease the amplitude of activation and an equivalent signal emerges to a non-predictive cue (CS-). Temporally precise enhancement of dopamine neurons during threat conditioning to high threat levels or uncertain threats can prevent generalization. Moreover, phasic enhancement of genetically captured dopamine neurons activated by threat cues can reverse fear generalization. These findings demonstrate the dopamine neurons reflect the certainty of threat prediction that can be used to inform and update the fear engram.

| S-EPMC6226002 | biostudies-literature

Linking multi-level population dynamics: state, role, and population.

Project description:The dynamics of an ecological community can be described at different focal scales of the species, such as individual states or the population level. More detailed descriptions of ecological dynamics offer more information, but produce more complex models that are difficult to analyze. Adequately controlling the model complexity and the availability of multiple descriptions of the concerned dynamics maximizes our understanding of ecological dynamics. One of the central goals of ecological studies is to develop links between multiple descriptions of an ecological community. In this article, starting from a nonlinear state-level description of an ecological community (generalized McKendrick-von Foerster model), role-level and population-level descriptions (Lotka-Volterra model) are derived in a consistent manner. The role-level description covers a wider range of situations than the population-level description. However, using the established connections, it is demonstrated that the population-level description can be used to predict the equilibrium status of the role-level description. This approach connects state-, role-, and population-level dynamics consistently, and offers a justification for the multiple choices of model description.

| S-EPMC9107789 | biostudies-literature

The Pharmacists' Role in Disease Outbreaks: Navigating the Dynamics of Uncertainty Before, During, and After Disease Outbreaks.

Project description:Vaccination rates are on the decline as parents avoid doctor's visits with their children. In addition, the antivaccination movement has led to a significant portion of the population remaining unvaccinated or undervaccinated. Outbreaks in the United States within the past year have highlighted the need for better education and communication regarding the efficacy and safety of vaccinations as well as important steps to reduce disease transmission. Patients may be fearful and have questions about how these outbreaks will affect themselves and their families, especially those in immunocompromised states and pregnant women. Pharmacists are poised to provide this education and start a dialogue with patients and other health care professionals with regard to disease outbreaks. Additionally, in times of outbreak, pharmacists encounter obscure questions from both healthy and at-risk populations that fear contraction of a particular disease. The purpose of this commentary is to describe previous outbreaks and to explore the pharmacists' role in disease prevention.

| S-EPMC7337136 | biostudies-literature

PEDOT/CNT Flexible MEAs Reveal New Insights into the Clock Gene's Role in Dopamine Dynamics.

Project description:Substantial evidence has shown that the Circadian Locomotor Output Cycles Kaput (Clock) gene is a core transcription factor of circadian rhythms that regulates dopamine (DA) synthesis. To shed light on the mechanism of this interaction, flexible multielectrode arrays (MEAs) are developed that can measure both DA concentrations and electrophysiology chronically. The dual functionality is enabled by conducting polymer PEDOT doped with acid-functionalized carbon nanotubes (CNT). The PEDOT/CNT microelectrode coating maintained stable electrochemical impedance and DA detection by square wave voltammetry for 4 weeks in vitro. When implanted in wild-type (WT) and Clock mutation (MU) mice, MEAs measured tonic DA concentration and extracellular neural activity with high spatial and temporal resolution for 4 weeks. A diurnal change of DA concentration in WT is observed, but not in MU, and a higher basal DA concentration and stronger cocaine-induced DA increase in MU. Meanwhile, striatal neuronal firing rate is found to be positively correlated with DA concentration in both animal groups. These findings offer new insights into DA dynamics in the context of circadian rhythm regulation, and the chronically reliable performance and dual measurement capability of this technology hold great potential for a broad range of neuroscience research.

| S-EPMC11251561 | biostudies-literature

Molecular nonlinear dynamics and protein thermal uncertainty quantification.

Project description:This work introduces molecular nonlinear dynamics (MND) as a new approach for describing protein folding and aggregation. By using a mode system, we show that the MND of disordered proteins is chaotic while that of folded proteins exhibits intrinsically low dimensional manifolds (ILDMs). The stability of ILDMs is found to strongly correlate with protein energies. We propose a novel method for protein thermal uncertainty quantification based on persistently invariant ILDMs. Extensive comparison with experimental data and the state-of-the-art methods in the field validate the proposed new method for protein B-factor prediction.

| S-EPMC3899061 | biostudies-literature

Temporal Dynamics of Uncertainty Cause Anxiety and Avoidance.

Project description:Alfred Hitchcock, film director and "Master of Suspense," observed that terror is not driven by a negative event, but "only in the anticipation of it." This observation is not restricted to the movies: Anxiety builds when we anticipate uncertain negative events, and heightened reactivity during uncertain threat anticipation is a transdiagnostic marker of anxiety (Grupe & Nitschke, 2013; Holley & Fox, 2022; Hur et al., 2020; Krain et al., 2008; Simmons et al., 2008; Yassa et al., 2012). Here, we manipulate the temporal dynamics of an uncertain threat to demonstrate how the evolving expectation of threat can lead people to forgo rewards and experience fear/anxiety. Specifically, we show that increased "hazard rate," which can build during periods of uncertainty, promotes a tendency to avoid threatening contexts while increasing fear/anxiety. These results provide insight into why the anticipation of temporally uncertain threats elicits fear/anxiety, and reframe the underlying causes of related psychopathology.

| S-EPMC11192096 | biostudies-literature

Belief state representation in the dopamine system.

Project description:Learning to predict future outcomes is critical for driving appropriate behaviors. Reinforcement learning (RL) models have successfully accounted for such learning, relying on reward prediction errors (RPEs) signaled by midbrain dopamine neurons. It has been proposed that when sensory data provide only ambiguous information about which state an animal is in, it can predict reward based on a set of probabilities assigned to hypothetical states (called the belief state). Here we examine how dopamine RPEs and subsequent learning are regulated under state uncertainty. Mice are first trained in a task with two potential states defined by different reward amounts. During testing, intermediate-sized rewards are given in rare trials. Dopamine activity is a non-monotonic function of reward size, consistent with RL models operating on belief states. Furthermore, the magnitude of dopamine responses quantitatively predicts changes in behavior. These results establish the critical role of state inference in RL.

| S-EPMC5951832 | biostudies-literature

Ultrafast Excited-State Dynamics of Carotenoids and the Role of the S<sub><i>X</i></sub> State.

Project description:Carotenoids are natural pigments with multiple roles in photosynthesis. They act as accessory pigments by absorbing light where chlorophyll absorption is low, and they quench the excitation energy of neighboring chlorophylls under high-light conditions. The function of carotenoids depends on their polyene-like structure, which controls their excited-state properties. After light absorption to their bright S2 state, carotenoids rapidly decay to the optically dark S1 state. However, ultrafast spectroscopy experiments have shown the signatures of another dark state, termed SX. Here we shed light on the ultrafast photophysics of lutein, a xanthophyll carotenoid, by explicitly simulating its nonadiabatic excited-state dynamics in solution. Our simulations confirm the involvement of SX in the relaxation toward S1 and reveal that it is formed through a change in the nature of the S2 state driven by the decrease in the bond length alternation coordinate of the carotenoid conjugated chain.

| S-EPMC9340805 | biostudies-literature

Substrate-induced conformational dynamics of the dopamine transporter

Project description:The dopamine transporter is a member of the neurotransmitter:sodium symporters (NSSs), which are responsible for termination of neurotransmission through Na+-driven reuptake of neurotransmitter from the extracellular space. Experimental evidence elucidating the coordinated conformational rearrangements related to the transport mechanism has so far been limited. Here we probe the global Na+- and dopamine-induced conformational dynamics of the wild-type Drosophila melanogaster dopamine transporter using hydrogen-deuterium exchange mass spectrometry. We identify Na+- and dopamine-induced changes in specific regions of the transporter, suggesting their involvement in protein conformational transitions. Furthermore, we detect ligand-dependent slow cooperative fluctuations of helical stretches in several domains of the transporter, which could be a molecular mechanism that assists in the transporter function. Our results provide a framework for understanding the molecular mechanism underlying the function of NSSs by revealing detailed insight into the state-dependent conformational changes associated with the alternating access model of the dopamine transporter.

2019-11-12 | PXD013841 | Pride

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data