Show Summary Details
- Title Pages
- Preface
-
I ANATOMICAL BASIS OF CONTROL -
1 Neuroanatomical Basis of Motivational and Cognitive Control: A Focus on the Medial and Lateral Prefrontal Cortex -
2 Neural Circuits of Reward and Decision Making: Integrative Networks across Corticobasal Ganglia Loops -
3 Neurochemistry of Performance Monitoring -
II A CORTICAL PERSPECTIVE ON THE FUNCTIONAL BASIS OF CONTROL -
4 Contributions of Ventromedial Prefrontal and Frontal Polar Cortex to Reinforcement Learning and Value-Based Choice -
5 Decision Making in Frontal Cortex: From Single Units to fMRI -
6 A Comparative Perspective on Executive and Motivational Control by the Medial Prefrontal Cortex -
7 Top-Down Control over the Motor Cortex -
8 A Role for Posterior Cingulate Cortex in Policy Switching and Cognitive Control -
III A SUBCORTICAL PERSPECTIVE ON THE FUNCTIONAL BASIS OF CONTROL -
9 Subcortical Contributions to the Motivational and Cognitive Control of Instrumental Performance by Pavlovian and Discriminative Stimuli -
10 The Influence of Dopamine in Generating Action from Motivation -
11 Fronto-Basal-Ganglia Circuits for Stopping Action -
12 Learning, the P3, and the Locus Coeruleus-Norepinephrine System -
IV INDIVIDUAL VARIATIONS IN CONTROL -
13 The Neurocognitive Development of Social Decision Making -
14 Motivational Modulation of Action Control: How Interindividual Variability May Shed Light on the Motivation-Control Interface and Its Neurocognitive Mechanisms -
15 Pathological Changes in Performance Monitoring -
V COMPUTATIONAL MODELS OF MOTIVATIONAL AND COGNITIVE CONTROL -
16 Neural Correlates of Hierarchical Reinforcement Learning -
17 Reinforcement Learning, Conflict Monitoring, and Cognitive Control: An Integrative Model of Cingulate-Striatal Interactions and the ERN -
18 An Integrative Theory of Anterior Cingulate Cortex Function: Option Selection in Hierarchical Reinforcement Learning -
19 Meta-Learning, Cognitive Control, and Physiological Interactions between Medial and Lateral Prefrontal Cortex -
20 Wherefore a Horse Race: Inhibitory Control as Rational Decision Making -
VI PERSPECTIVES -
21 The Neuroeconomics of Cognitive Control -
22 Frames of Reference in Human Social Decision Making -
23 Model-Based Approaches to the Study of the Neural Basis of Cognitive Control - List of Contributors
- Index
Neural Correlates of Hierarchical Reinforcement Learning
Neural Correlates of Hierarchical Reinforcement Learning
- Chapter:
- (p.284) (p.285) 16 Neural Correlates of Hierarchical Reinforcement Learning
- Source:
- Neural Basis of Motivational and Cognitive Control
- Author(s):
José J. F. Ribas-Fernandes
Yael Niv
Matthew M. Botvinick
- Publisher:
- The MIT Press
DOI:10.7551/mitpress/9780262016438.003.0016
This chapter discusses the relevance of reinforcement learning (RL) to its hierarchical structure. It first reviews the fundamentals of RL, with a focus on temporal-difference learning in actor-critic models. Next, it discusses the scaling problem and the computational issues that stimulated the development of hierarchical reinforcement learning (HRL). The potential neuroscientific correlates of HRL are also described. The chapter also presents the results of some initial empirical tests and ends with directions for further research.
Keywords: reinforcement learning, RL, hierarchical reinforcement learning, HRL, temporal-difference learning, actor-critic models
MIT Press Scholarship Online requires a subscription or purchase to access the full text of books within the service. Public users can however freely search the site and view the abstracts and keywords for each book and chapter.
Please, subscribe or login to access full text content.
If you think you should have access to this title, please contact your librarian.
To troubleshoot, please check our FAQs, and if you can't find the answer there, please contact us.
- Title Pages
- Preface
-
I ANATOMICAL BASIS OF CONTROL -
1 Neuroanatomical Basis of Motivational and Cognitive Control: A Focus on the Medial and Lateral Prefrontal Cortex -
2 Neural Circuits of Reward and Decision Making: Integrative Networks across Corticobasal Ganglia Loops -
3 Neurochemistry of Performance Monitoring -
II A CORTICAL PERSPECTIVE ON THE FUNCTIONAL BASIS OF CONTROL -
4 Contributions of Ventromedial Prefrontal and Frontal Polar Cortex to Reinforcement Learning and Value-Based Choice -
5 Decision Making in Frontal Cortex: From Single Units to fMRI -
6 A Comparative Perspective on Executive and Motivational Control by the Medial Prefrontal Cortex -
7 Top-Down Control over the Motor Cortex -
8 A Role for Posterior Cingulate Cortex in Policy Switching and Cognitive Control -
III A SUBCORTICAL PERSPECTIVE ON THE FUNCTIONAL BASIS OF CONTROL -
9 Subcortical Contributions to the Motivational and Cognitive Control of Instrumental Performance by Pavlovian and Discriminative Stimuli -
10 The Influence of Dopamine in Generating Action from Motivation -
11 Fronto-Basal-Ganglia Circuits for Stopping Action -
12 Learning, the P3, and the Locus Coeruleus-Norepinephrine System -
IV INDIVIDUAL VARIATIONS IN CONTROL -
13 The Neurocognitive Development of Social Decision Making -
14 Motivational Modulation of Action Control: How Interindividual Variability May Shed Light on the Motivation-Control Interface and Its Neurocognitive Mechanisms -
15 Pathological Changes in Performance Monitoring -
V COMPUTATIONAL MODELS OF MOTIVATIONAL AND COGNITIVE CONTROL -
16 Neural Correlates of Hierarchical Reinforcement Learning -
17 Reinforcement Learning, Conflict Monitoring, and Cognitive Control: An Integrative Model of Cingulate-Striatal Interactions and the ERN -
18 An Integrative Theory of Anterior Cingulate Cortex Function: Option Selection in Hierarchical Reinforcement Learning -
19 Meta-Learning, Cognitive Control, and Physiological Interactions between Medial and Lateral Prefrontal Cortex -
20 Wherefore a Horse Race: Inhibitory Control as Rational Decision Making -
VI PERSPECTIVES -
21 The Neuroeconomics of Cognitive Control -
22 Frames of Reference in Human Social Decision Making -
23 Model-Based Approaches to the Study of the Neural Basis of Cognitive Control - List of Contributors
- Index
