TY - JOUR
T1 - Anatomy of a decision
T2 - Striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal
AU - Frank, Michael J.
AU - Claus, Eric D.
PY - 2006/4
Y1 - 2006/4
N2 - The authors explore the division of labor between the basal ganglia-dopamine (BG-DA) system and the orbitofrontal cortex (OFC) in decision making. They show that a primitive neural network model of the BG-DA system slowly learns to make decisions on the basis of the relative probability of rewards but is not as sensitive to (a) recency or (b) the value of specific rewards. An augmented model that explores BG-OFC interactions is more successful at estimating the true expected value of decisions and is faster at switching behavior when reinforcement contingencies change. In the augmented model, OFC areas exert top-down control on the BG and premoter areas by representing reinforcement magnitudes in working memory. The model successfully captures patterns of behavior resulting from OFC damage in decision making, reversal learning, and devaluation paradigms and makes additional predictions for the underlying source of these deficits.
AB - The authors explore the division of labor between the basal ganglia-dopamine (BG-DA) system and the orbitofrontal cortex (OFC) in decision making. They show that a primitive neural network model of the BG-DA system slowly learns to make decisions on the basis of the relative probability of rewards but is not as sensitive to (a) recency or (b) the value of specific rewards. An augmented model that explores BG-OFC interactions is more successful at estimating the true expected value of decisions and is faster at switching behavior when reinforcement contingencies change. In the augmented model, OFC areas exert top-down control on the BG and premoter areas by representing reinforcement magnitudes in working memory. The model successfully captures patterns of behavior resulting from OFC damage in decision making, reversal learning, and devaluation paradigms and makes additional predictions for the underlying source of these deficits.
UR - http://www.scopus.com/inward/record.url?scp=33744550336&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=33744550336&partnerID=8YFLogxK
U2 - 10.1037/0033-295X.113.2.300
DO - 10.1037/0033-295X.113.2.300
M3 - Article
C2 - 16637763
AN - SCOPUS:33744550336
SN - 0033-295X
VL - 113
SP - 300
EP - 326
JO - Psychological Review
JF - Psychological Review
IS - 2
ER -