Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Independent and interacting value systems for reward and information in the human brain.

ABSTRACT: Theories of prefrontal cortex (PFC) as optimizing reward value have been widely deployed to explain its activity in a diverse range of contexts, with substantial empirical support in neuroeconomics and decision neuroscience. Similar neural circuits, however, have also been associated with information processing. By using computational modeling, model-based functional magnetic resonance imaging analysis, and a novel experimental paradigm, we aim at establishing whether a dedicated and independent value system for information exists in the human PFC. We identify two regions in the human PFC that independently encode reward and information. Our results provide empirical evidence for PFC as an optimizer of independent information and reward signals during decision-making under realistic scenarios, with potential implications for the interpretation of PFC activity in both healthy and clinical populations.

SUBMITTER: Cogliati Dezza I

PROVIDER: S-EPMC9064296 | biostudies-literature | 2022 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Independent and interacting value systems for reward and information in the human brain.

Cogliati Dezza Irene I Cleeremans Axel A Alexander William H WH

eLife 20220413

Theories of prefrontal cortex (PFC) as optimizing <i>reward</i> value have been widely deployed to explain its activity in a diverse range of contexts, with substantial empirical support in neuroeconomics and decision neuroscience. Similar neural circuits, however, have also been associated with information processing. By using computational modeling, model-based functional magnetic resonance imaging analysis, and a novel experimental paradigm, we aim at establishing whether a dedicated and inde ...[more]

PMID: 35416151

Similar Datasets

Two spatiotemporally distinct value systems shape reward-based learning in the human brain.

Project description:Avoiding repeated mistakes and learning to reinforce rewarding decisions is critical for human survival and adaptive actions. Yet, the neural underpinnings of the value systems that encode different decision-outcomes remain elusive. Here coupling single-trial electroencephalography with simultaneously acquired functional magnetic resonance imaging, we uncover the spatiotemporal dynamics of two separate but interacting value systems encoding decision-outcomes. Consistent with a role in regulating alertness and switching behaviours, an early system is activated only by negative outcomes and engages arousal-related and motor-preparatory brain structures. Consistent with a role in reward-based learning, a later system differentially suppresses or activates regions of the human reward network in response to negative and positive outcomes, respectively. Following negative outcomes, the early system interacts and downregulates the late system, through a thalamic interaction with the ventral striatum. Critically, the strength of this coupling predicts participants' switching behaviour and avoidance learning, directly implicating the thalamostriatal pathway in reward-based learning.

| S-EPMC4569710 | biostudies-literature

Common neural code for reward and information value.

Project description:Adaptive information seeking is critical for goal-directed behavior. Growing evidence suggests the importance of intrinsic motives such as curiosity or need for novelty, mediated through dopaminergic valuation systems, in driving information-seeking behavior. However, valuing information for its own sake can be highly suboptimal when agents need to evaluate instrumental benefit of information in a forward-looking manner. Here we show that information-seeking behavior in humans is driven by subjective value that is shaped by both instrumental and noninstrumental motives, and that this subjective value of information (SVOI) shares a common neural code with more basic reward value. Specifically, using a task where subjects could purchase information to reduce uncertainty about outcomes of a monetary lottery, we found information purchase decisions could be captured by a computational model of SVOI incorporating utility of anticipation, a form of noninstrumental motive for information seeking, in addition to instrumental benefits. Neurally, trial-by-trial variation in SVOI was correlated with activity in striatum and ventromedial prefrontal cortex. Furthermore, cross-categorical decoding revealed that, within these regions, SVOI and expected utility of lotteries were represented using a common code. These findings provide support for the common currency hypothesis and shed insight on neurocognitive mechanisms underlying information-seeking behavior.

| S-EPMC6600919 | biostudies-literature

Information-based autonomous reconfiguration in systems of interacting DNA nanostructures.

Project description:The dynamic interactions between complex molecular structures underlie a wide range of sophisticated behaviors in biological systems. In building artificial molecular machines out of DNA, an outstanding challenge is to develop mechanisms that can control the kinetics of interacting DNA nanostructures and that can compose the interactions together to carry out system-level functions. Here we show a mechanism of DNA tile displacement that follows the principles of toehold binding and branch migration similar to DNA strand displacement, but occurs at a larger scale between interacting DNA origami structures. Utilizing this mechanism, we show controlled reaction kinetics over five orders of magnitude and programmed cascades of reactions in multi-structure systems. Furthermore, we demonstrate the generality of tile displacement for occurring at any location in an array in any order, illustrated as a tic-tac-toe game. Our results suggest that tile displacement is a simple-yet-powerful mechanism that opens up the possibility for complex structural components in artificial molecular machines to undergo information-based reconfiguration in response to their environments.

| S-EPMC6299139 | biostudies-literature

Separate Neural Systems Value Prosocial Behaviors and Reward: An ALE Meta-Analysis.

Project description:Background: It has been argued that prosocial behaviors and momentary rewards activate similar reward systems. However, a recent theoretical hypothesis encourages a fundamentally different view. Specifically, the social heuristic hypothesis posits that individuals internalize prosocial behaviors that are advantageous in their daily social life. These advantageous behaviors are fundamentally different from tangible and immediate reward. Objectives: Our objectives are to test a hypothesis that these advantageous prosocial behaviors are so critical to survival that it is necessary to have a neural system in the brain that leads people to maintain repeated social interactions. These neural systems are different from the computations of rewards because prosocial behaviors are not advantageous if only considering the computations of rewards. Methods: To deepen the understanding of the neural systems of prosocial behaviors and reward, we conducted activation likelihood estimation (ALE) to examine brain activation in prosocial behaviors and reward tasks. Results: Prosocial behaviors specifically activated distinct brain systems to a greater degree than reward. These systems were implicated in the processing of social behaviors and included the insula, temporal lobe, and superior temporal gyrus. By contrast, reward specifically activated the lentiform nucleus, thalamus, caudate nucleus, parahippocampal gyrus, and anterior cingulate cortex, which are associated with the brain reward system. Conclusions: These findings suggest that prosocial behaviors are different from reward and involve specific brain mechanisms.

| S-EPMC6707092 | biostudies-literature

Brain regions and molecular pathways responding to food reward type and value in honey bees

Project description:The ability of honey bees to evaluate differences in food type and value is crucial for colony success, but these assessments are made by individuals who bring food to the hive, eating little, if any, of it themselves. We tested the hypothesis that responses to food type (pollen or nectar) and value involve different subsets of brain regions, and genes responsive to food. mRNA in situ hybridization of c‐jun revealed that brain regions responsive to differences in food type were mostly different from regions responsive to differences in food value, except those dorsal and lateral to the mushroom body calyces, which responded to all three. Transcriptomic profiles of the mushroom bodies generated by RNA sequencing gave the following results: (1) responses to differences in food type or value included a subset of molecular pathways involved in the response to food reward; (2) genes responsive to food reward, food type and food value were enriched for (the Gene Ontology categories) mitochondrial and endoplasmic reticulum activity; (3) genes responsive to only food and food type were enriched for regulation of transcription and translation; and (4) genes responsive to only food and food value were enriched for regulation of neuronal signaling. These results reveal how activities necessary for colony survival are channeled through the reward system of individual honey bees.

2019-07-02 | GSE130701 | GEO

Memory and reward systems coproduce 'nostalgic' experiences in the brain.

Project description:People sometimes experience an emotional state known as 'nostalgia', which involves experiencing predominantly positive emotions while remembering autobiographical events. Nostalgia is thought to play an important role in psychological resilience. Previous neuroimaging studies have shown involvement of memory and reward systems in such experiences. However, it remains unclear how these two systems are collaboratively involved with nostalgia experiences. Here, we conducted a functional magnetic resonance imaging study of healthy females to investigate the relationship between memory-reward co-activation and nostalgia, using childhood-related visual stimuli. Moreover, we examined the factors constituting nostalgia and their neural correlates. We confirmed the presence of nostalgia-related activity in both memory and reward systems, including the hippocampus (HPC), substantia nigra/ventral tegmental area (SN/VTA), and ventral striatum (VS). We also found significant HPC-VS co-activation, with its strength correlating with individual 'nostalgia tendencies'. Factor analyses showed that two dimensions underlie nostalgia: emotional and personal significance and chronological remoteness, with the former correlating with caudal SN/VTA and left anterior HPC activity, and the latter correlating with rostral SN/VTA activity. These findings demonstrate the cooperative activity of memory and reward systems, where each system has a specific role in the construction of the factors that underlie the experience of nostalgia.

| S-EPMC4927028 | biostudies-literature

Risk-dependent reward value signal in human prefrontal cortex.

Project description:When making choices under uncertainty, people usually consider both the expected value and risk of each option, and choose the one with the higher utility. Expected value increases the expected utility of an option for all individuals. Risk increases the utility of an option for risk-seeking individuals, but decreases it for risk averse individuals. In 2 separate experiments, one involving imperative (no-choice), the other choice situations, we investigated how predicted risk and expected value aggregate into a common reward signal in the human brain. Blood oxygen level dependent responses in lateral regions of the prefrontal cortex increased monotonically with increasing reward value in the absence of risk in both experiments. Risk enhanced these responses in risk-seeking participants, but reduced them in risk-averse participants. The aggregate value and risk responses in lateral prefrontal cortex contrasted with pure value signals independent of risk in the striatum. These results demonstrate an aggregate risk and value signal in the prefrontal cortex that would be compatible with basic assumptions underlying the mean-variance approach to utility.

| S-EPMC2678436 | biostudies-literature

Value of sample information in dynamic, structurally uncertain resource systems.

Project description:Few if any natural resource systems are completely understood and fully observed. Instead, there almost always is uncertainty about the way a system works and its status at any given time, which can limit effective management. A natural approach to uncertainty is to allocate time and effort to the collection of additional data, on the reasonable assumption that more information will facilitate better understanding and lead to better management. But the collection of more data, either through observation or investigation, requires time and effort that often can be put to other conservation activities. An important question is whether the use of limited resources to improve understanding is justified by the resulting potential for improved management. In this paper we address directly a change in value from new information collected through investigation. We frame the value of information in terms of learning through the management process itself, as well as learning through investigations that are external to the management process but add to our base of understanding. We provide a conceptual framework and metrics for this issue, and illustrate them with examples involving Florida scrub-jays (Aphelocoma coerulescens).

| S-EPMC6025880 | biostudies-literature

Learning the value of information and reward over time when solving exploration-exploitation problems.

Project description:To flexibly adapt to the demands of their environment, animals are constantly exposed to the conflict resulting from having to choose between predictably rewarding familiar options (exploitation) and risky novel options, the value of which essentially consists of obtaining new information about the space of possible rewards (exploration). Despite extensive research, the mechanisms that subtend the manner in which animals solve this exploitation-exploration dilemma are still poorly understood. Here, we investigate human decision-making in a gambling task in which the informational value of each trial and the reward potential were separately manipulated. To better characterize the mechanisms that underlined the observed behavioural choices, we introduce a computational model that augments the standard reward-based reinforcement learning formulation by associating a value to information. We find that both reward and information gained during learning influence the balance between exploitation and exploration, and that this influence was dependent on the reward context. Our results shed light on the mechanisms that underpin decision-making under uncertainty, and suggest new approaches for investigating the exploration-exploitation dilemma throughout the animal kingdom.

| S-EPMC5717252 | biostudies-literature

Correction: Value of sample information in dynamic, structurally uncertain resource systems.

Project description:[This corrects the article DOI: 10.1371/journal.pone.0199326.].

| S-EPMC6394911 | biostudies-literature