Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning
- PMID: 16192338
- DOI: 10.1152/jn.00382.2005
Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning
Abstract
To select appropriate behaviors leading to rewards, the brain needs to learn associations among sensory stimuli, selected behaviors, and rewards. Recent imaging and neural-recording studies have revealed that the dorsal striatum plays an important role in learning such stimulus-action-reward associations. However, the putamen and caudate nucleus are embedded in distinct cortico-striatal loop circuits, predominantly connected to motor-related cerebral cortical areas and frontal association areas, respectively. This difference in their cortical connections suggests that the putamen and caudate nucleus are engaged in different functional aspects of stimulus-action-reward association learning. To determine whether this is the case, we conducted an event-related and computational model-based functional MRI (fMRI) study with a stochastic decision-making task in which a stimulus-action-reward association must be learned. A simple reinforcement learning model not only reproduced the subject's action selections reasonably well but also allowed us to quantitatively estimate each subject's temporal profiles of stimulus-action-reward association and reward-prediction error during learning trials. These two internal representations were used in the fMRI correlation analysis. The results revealed that neural correlates of the stimulus-action-reward association reside in the putamen, whereas a correlation with reward-prediction error was found largely in the caudate nucleus and ventral striatum. These nonuniform spatiotemporal distributions of neural correlates within the dorsal striatum were maintained consistently at various levels of task difficulty, suggesting a functional difference in the dorsal striatum between the putamen and caudate nucleus during stimulus-action-reward association learning.
Similar articles
-
Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning.Neural Netw. 2006 Oct;19(8):1242-54. doi: 10.1016/j.neunet.2006.06.007. Epub 2006 Sep 20. Neural Netw. 2006. PMID: 16987637
-
A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task.J Neurosci. 2004 Feb 18;24(7):1660-5. doi: 10.1523/JNEUROSCI.3417-03.2004. J Neurosci. 2004. PMID: 14973239 Free PMC article.
-
Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior.Prog Brain Res. 2000;126:193-215. doi: 10.1016/S0079-6123(00)26015-9. Prog Brain Res. 2000. PMID: 11105648 Review.
-
Differential roles of caudate nucleus and putamen during instrumental learning.Neuroimage. 2011 Aug 15;57(4):1580-90. doi: 10.1016/j.neuroimage.2011.05.059. Epub 2011 May 27. Neuroimage. 2011. PMID: 21664278
-
Reward-dependent learning in neuronal networks for planning and decision making.Prog Brain Res. 2000;126:217-29. doi: 10.1016/S0079-6123(00)26016-0. Prog Brain Res. 2000. PMID: 11105649 Review.
Cited by
-
To lie or to tell the truth? The influence of processing the opponent's feedback on the forthcoming choice.Front Psychol. 2024 May 9;15:1275884. doi: 10.3389/fpsyg.2024.1275884. eCollection 2024. Front Psychol. 2024. PMID: 38784609 Free PMC article.
-
Corticostriatal activity related to performance during continuous de novo motor learning.Sci Rep. 2024 Feb 14;14(1):3731. doi: 10.1038/s41598-024-54176-9. Sci Rep. 2024. PMID: 38355810 Free PMC article.
-
Novel five-phase model for understanding the nature of misophonia, a conditioned aversive reflex disorder.F1000Res. 2023 Oct 4;12:808. doi: 10.12688/f1000research.133506.3. eCollection 2023. F1000Res. 2023. PMID: 37881332 Free PMC article.
-
Multifunctional fibers enable modulation of cortical and deep brain activity during cognitive behavior in macaques.Sci Adv. 2023 Oct 6;9(40):eadh0974. doi: 10.1126/sciadv.adh0974. Epub 2023 Oct 6. Sci Adv. 2023. PMID: 37801492 Free PMC article.
-
A voxel-based morphometry study on gray matter correlates of need for cognition and exploratory information seeking.Brain Behav. 2023 Sep;13(9):e3138. doi: 10.1002/brb3.3138. Epub 2023 Jul 25. Brain Behav. 2023. PMID: 37491807 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources