Abstract
Bernard W Balleine, Amir Dezfouli, Makato Ito, Kenji Doya
Abstract
Authors
Institutions
No ROR-resolved institution is linked to this work yet.
Provenance
crossref
Confidence 100%
unpaywall
Confidence 95%
datacite
Confidence 0%
No local reference links have been materialized yet.
No local citing links have been materialized yet.
Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action
10.1038/npp.2009.131 · 2010
Complementary roles of basal ganglia and cerebellum in learning and motor control
10.1016/s0959-4388(00)00153-7 · 2000
Internal models in the cerebellum
10.1016/s1364-6613(98)01221-2 · 1998
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control
10.1038/nn1560 · 2005
Hierarchically organized behavior and its neural foundations: a reinforcement learning perspective
10.1016/j.cognition.2008.08.011 · 2009
Learning and production of movement sequences: behavioral, neurophysiological, and modeling perspectives
10.1016/j.humov.2004.10.008 · 2004
The problem of serial order in behavior
1951
Hierarchical approaches
2012
Habits, action sequences and reinforcement learning
10.1111/j.1460-9568.2012.08050.x · 2012
Multiple representations and algorithms for reinforcement learning in the cortico-basal ganglia circuit
10.1016/j.conb.2011.04.001 · 2011
Actions, action sequences and habits: evidence that goal-directed and habitual action control are hierarchically organized
10.1371/journal.pcbi.1003364 · 2013
Unresolved referenced work
1998
Reinforcement learning: computational theory and biological mechanisms
10.2976/1.2732246/10.2976/1 · 2007
Improved switching among temporally abstract actions
1999
Hierarchical reinforcement learning with the MAXQ value function decomposition
10.1613/jair.639 · 2000
Feudal reinforcement learning
1993
Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning
10.1016/s0921-8890(01)00113-0 · 2001
Evolutionary development of hierarchical learning structures
10.1109/tevc.2006.890270 · 2007
Optimal behavioral hierarchy
10.1371/journal.pcbi.1003779 · 2014
‘Fine-to-coarse’ route planning and navigation in regionalized environments
10.1207/s15427633scc0304_5 · 2003
Evidence of action sequence chunking in goal-directed instrumental conditioning and its dependence on the dorsomedial prefrontal cortex
10.1523/jneurosci.1176-09.2009 · 2009
Instrumental conditioning
1994
The problem of serial order in behavior: Lashley's legacy
10.1016/j.humov.2007.04.001 · 2007
Differential recruitment of the sensorimotor putamen and frontoparietal cortex during motor chunking in humans
10.1016/j.neuron.2012.03.038 · 2012
Sequential organization of multiple movements: involvement of cortical motor areas
10.1146/annurev.neuro.24.1.631 · 2001
Parallel neural networks for learning sequential procedures
10.1016/s0166-2236(99)01439-3 · 1999
Start/stop signals emerge in nigrostriatal circuits during sequence learning
10.1038/nature09263 · 2010
Acquisition of hierarchical control over the temporal organization of a skill
10.1037/h0023100 · 1966
Movement control in skilled motor performance
10.1037/h0026739 · 1968
Between MDPs and semi-MDPs: a framework for temporal abstraction in reinforcement learning
10.1016/s0004-3702(99)00052-1 · 1999
Role of [corrected] nigrostriatal dopamine system in learning to perform sequential motor tasks in a predictive manner
10.1152/jn.1999.82.2.978 · 1999
On the ability to inhibit thought and action: general and special theories of an act of control
10.1037/a0035230 · 2014
The reward circuit: linking primate anatomy and human imaging
10.1038/npp.2009.129 · 2010
Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning
10.1016/j.neunet.2006.06.007 · 2006
Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuo-motor sequences – a computational approach
10.1162/089892901750363208 · 2001
Multiple representations of belief states and action values in corticobasal ganglia loops
10.1196/annals.1390.024 · 2007
Functional architecture of basal ganglia circuits: neural substrates of parallel processing
10.1016/0166-2236(90)90107-l · 1990
Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum
10.1523/jneurosci.20-06-02369.2000 · 2000
Basal ganglia and cerebellar loops: motor and cognitive circuits
10.1016/s0165-0173(99)00040-5 · 2000
Putting a spin on the dorsal–ventral divide of the striatum
10.1016/j.tins.2004.06.006 · 2004
A neural signature of hierarchical reinforcement learning
10.1016/j.neuron.2011.05.042 · doi-reference
Hierarchical learning induces two simultaneous, but separable, prediction errors in human basal ganglia
10.1523/jneurosci.5445-12.2013 · doi-reference
Two types of dopamine neuron distinctly convey positive and negative motivational signals
10.1038/nature08028 · doi-reference
Prototypic and arkypallidal neurons in the dopamine-intact external globus pallidus
10.1523/jneurosci.4662-14.2015 · doi-reference
Dichotomous organization of the external globus pallidus
10.1016/j.neuron.2012.04.027 · doi-reference
Functional significance of the cortico-subthalamo-pallidal ‘hyperdirect’ pathway
10.1016/s0168-0102(02)00027-5 · doi-reference
Cortical and subcortical contributions to stop signal response inhibition: role of the subthalamic nucleus
10.1523/jneurosci.4682-05.2006 · doi-reference
Hierarchical and binary associations compete for behavioral control during instrumental biconditional discrimination
10.1037/a0030941 · doi-reference
The sensorimotor striatum is necessary for serial order learning
10.1523/jneurosci.3989-10.2010 · doi-reference
Basal ganglia subcircuits distinctively encode the parsing and concatenation of action sequences
10.1038/nn.3632 · doi-reference
The basal ganglia and chunking of action repertoires
10.1006/nlme.1998.3843 · doi-reference
Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning
10.1111/j.1460-9568.2004.03095.x · doi-reference
A specific role for posterior dorsolateral striatum in human habit learning
10.1111/j.1460-9568.2009.06796.x · doi-reference
Habits as action sequences: hierarchical action control and changes in outcome value
10.1098/rstb.2013.0482 · doi-reference
Premotor cortex is critical for goal-directed actions
10.3389/fncom.2013.00110 · doi-reference
The role of the murine motor cortex in action duration and order
10.3389/neuro.07.023.2009 · doi-reference
Action-value comparisons in the dorsolateral prefrontal cortex control choice between goal-directed actions
10.1038/ncomms5390 · doi-reference
Neuronal activity in medial frontal cortex during learning of sequential procedures
10.1152/jn.1998.80.5.2671 · doi-reference
Self-initiated versus externally triggered movements: I. An investigation using measurement of regional cerebral blood flow with PET and movement-related potentials in normal and Parkinson's disease subjects
10.1093/brain/118.4.913 · doi-reference
Volition and conflict in human medial frontal cortex
10.1016/j.cub.2005.01.006 · doi-reference
Neuronal connections of orbital cortex in rats: topography of cortical and thalamic afferents
10.1007/bf00227299 · doi-reference
Functional role of the supplementary and pre-supplementary motor areas
10.1038/nrn2478 · doi-reference
Efferent connections of the rostral portion of medial agranular cortex in rats
10.1016/0361-9230(87)90086-4 · doi-reference
Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning
10.1523/jneurosci.1921-05.2005 · doi-reference
The role of the dorsal striatum in reward and decision-making
10.1523/jneurosci.1554-07.2007 · doi-reference
Distinct neural representation in the dorsolateral, dorsomedial, and ventral parts of the striatum during fixed- and free-choice tasks
10.1523/jneurosci.1962-14.2015 · doi-reference