biostudies-literatureHogeveen JIntramural NIH HHSNIMH NIH HHSNational Institute of Mental HealthNational Institute of General Medical SciencesNIH HHSNIGMS NIH HHSNational Science Foundation1869-1879.e5https://www.ebi.ac.uk/biostudies/studies/S-EPMC9167768biostudies-literatureUnknown110(11)Flexible decision-making requires animals to forego immediate rewards (exploitation) and try novel choice options (exploration) to discover if they are preferable to familiar alternatives. Using the same task and a partially observable Markov decision process (POMDP) model to quantify the value of choices, we first determined that the computational basis for managing explore-exploit tradeoffs is conserved across monkeys and humans. We then used fMRI to identify where in the human brain the immediate value of exploitative choices and relative uncertainty about the value of exploratory choices were encoded. Consistent with prior neurophysiological evidence in monkeys, we observed divergent encoding of reward value and uncertainty in prefrontal and parietal regions, including frontopolar cortex, and parallel encoding of these computations in motivational regions including the amygdala, ventral striatum, and orbitofrontal cortex. These results clarify the interplay between prefrontal and motivational circuits that supports adaptive explore-exploit decisions in humans and nonhuman primates.NeuronThe neurocomputational bases of explore-exploit decision-making.PMC9167768MH125824ZIA MH002928R01 MH125824ZIA MH002929P51 OD011092P30GM122734P20 GM109089P20GM109089P30 GM122734Romero JDRogge-Obando KMullins TSCosta VDEversole EHogeveen JMayer ARfalseThe neurocomputational bases of explore-exploit decision-making.Flexible decision-making requires animals to forego immediate rewards (exploitation) and try novel choice options (exploration) to discover if they are preferable to familiar alternatives. Using the same task and a partially observable Markov decision process (POMDP) model to quantify the value of choices, we first determined that the computational basis for managing explore-exploit tradeoffs is conserved across monkeys and humans. We then used fMRI to identify where in the human brain the immediate value of exploitative choices and relative uncertainty about the value of exploratory choices were encoded. Consistent with prior neurophysiological evidence in monkeys, we observed divergent encoding of reward value and uncertainty in prefrontal and parietal regions, including frontopolar cortex, and parallel encoding of these computations in motivational regions including the amygdala, ventral striatum, and orbitofrontal cortex. These results clarify the interplay between prefrontal and motivational circuits that supports adaptive explore-exploit decisions in humans and nonhuman primates.2022-01-01T00:00:00Z2022 Jun2024-11-13T14:51:26.835Z2024-11-13T14:51:26.835ZS-EPMC91677683539027810.1016/j.neuron.2022.03.014