doi: 10.1126/science.1094285.
Dissociable roles of ventral and dorsal striatum in instrumental conditioning
Affiliations
- PMID: 15087550
- DOI: 10.1126/science.1094285
Item in Clipboard
Dissociable roles of ventral and dorsal striatum in instrumental conditioning
Science.
.
Abstract
Instrumental conditioning studies how animals and humans choose actions appropriate to the affective structure of an environment. According to recent reinforcement learning models, two distinct components are involved: a "critic," which learns to predict future reward, and an "actor," which maintains information about the rewarding outcomes of actions to enable better ones to be chosen more frequently. We scanned human participants with functional magnetic resonance imaging while they engaged in instrumental conditioning. Our results suggest partly dissociable contributions of the ventral and dorsal striatum, with the former corresponding to the critic and the latter corresponding to the actor.
Similar articles
-
Effects of dorsal and ventral striatal lesions on delayed matching trained with retractable levers.Behav Brain Res. 2001 Jul;122(1):67-78. doi: 10.1016/s0166-4328(01)00169-3. Behav Brain Res. 2001. PMID: 11287078
-
Microinjections of flupenthixol into the caudate-putamen but not the nucleus accumbens, amygdala or frontal cortex of rats produce intra-session declines in food-rewarded operant responding.Behav Brain Res. 1993 Jun 30;55(2):203-12. doi: 10.1016/0166-4328(93)90116-8. Behav Brain Res. 1993. PMID: 8395180
-
Differential roles of caudate nucleus and putamen during instrumental learning.Neuroimage. 2011 Aug 15;57(4):1580-90. doi: 10.1016/j.neuroimage.2011.05.059. Epub 2011 May 27. Neuroimage. 2011. PMID: 21664278
-
Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning.Neurosci Biobehav Rev. 2004 Jan;27(8):765-76. doi: 10.1016/j.neubiorev.2003.11.015. Neurosci Biobehav Rev. 2004. PMID: 15019426 Review.
-
Prediction error in reinforcement learning: a meta-analysis of neuroimaging studies.Neurosci Biobehav Rev. 2013 Aug;37(7):1297-310. doi: 10.1016/j.neubiorev.2013.03.023. Epub 2013 Apr 6. Neurosci Biobehav Rev. 2013. PMID: 23567522 Review.
Cited by
-
To lie or to tell the truth? The influence of processing the opponent's feedback on the forthcoming choice.Front Psychol. 2024 May 9;15:1275884. doi: 10.3389/fpsyg.2024.1275884. eCollection 2024. Front Psychol. 2024. PMID: 38784609 Free PMC article.
-
Active reinforcement learning versus action bias and hysteresis: control with a mixture of experts and nonexperts.PLoS Comput Biol. 2024 Mar 29;20(3):e1011950. doi: 10.1371/journal.pcbi.1011950. eCollection 2024 Mar. PLoS Comput Biol. 2024. PMID: 38552190 Free PMC article.
-
Neural inhibition as implemented by an actor-critic model involves the human dorsal striatum and ventral tegmental area.Sci Rep. 2024 Mar 16;14(1):6363. doi: 10.1038/s41598-024-56161-8. Sci Rep. 2024. PMID: 38493169 Free PMC article.
-
Dynamics of striatal action selection and reinforcement learning.bioRxiv [Preprint]. 2024 Feb 19:2024.02.14.580408. doi: 10.1101/2024.02.14.580408. bioRxiv. 2024. PMID: 38464083 Free PMC article. Preprint.
-
Ghrelin decreases sensitivity to negative feedback and increases prediction-error related caudate activity in humans, a randomized controlled trial.Neuropsychopharmacology. 2024 May;49(6):1042-1049. doi: 10.1038/s41386-024-01821-6. Epub 2024 Feb 26. Neuropsychopharmacology. 2024. PMID: 38409282 Free PMC article. Clinical Trial.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
