Contact and support
Need help, have a question, or want to contact the ResearchHub team?
© 2026 ResearchHub. Built for responsible scholarly connection.
Privacy-aware community infrastructureResearch graph
References from Learning Representation and Control in Markov Decision Processes: New Frontiers. Local targets link to admitted publications; unresolved targets remain external evidence.
Sampling techniques for Kernel methods
2002 · External reference
On the spectra of nonsymmetric Laplacian matrices
10.1016/j.laa.2004.09.003 · 2005 · External reference
On representations of problems of reasoning about actions
1968 · External reference
10.1007/978-1-4757-8137-3
10.1007/978-1-4757-8137-3 · 2001 · External reference
Covariant Policy Search
2003 · External reference
Unresolved reference
1977 · External reference
Recent advances in hierarchical reinforcement learning
10.1023/a:1022140919877 · 2003 · External reference
Semi-supervised learning on Riemannian manifolds
10.1023/b:mach.0000033120.25363.1e · 2004 · External reference
Spectral partitioning with indefinite Kernels using the Nyström extension
2002 · External reference
10.1137/1.9781611971262
10.1137/1.9781611971262 · 1994 · External reference
Adaptive Aggregation Methods for infinite horizon dynamic programming
10.1109/9.24227 · 1989 · External reference
Unresolved reference
1996 · External reference
Approximate dynamic programming using support vector regression
10.1109/cdc.2008.4739322 · 2008 · External reference
Fast wavelet transforms and numerical algorithms
10.1002/cpa.3160440202 · 1991 · External reference
A geometric interpretation of the Metropolis Hasting algorithm
10.1214/ss/1015346318 · 2001 · External reference
Least-squares temporal difference learning
1999 · External reference
10.1017/cbo9780511804441
10.1017/cbo9780511804441 · 2004 · External reference
Linear least-squares algorithms for temporal difference learning
10.1023/a:1018056104778 · 1996 · External reference
Diffusion wavelet packets
10.1016/j.acha.2006.04.005 · 2006 · External reference
Unresolved reference
1979 · External reference
The relations among potentials, perturbation analysis, and Markov decision processes
10.1023/a:1008260528575 · 1998 · External reference
Kernels of directed graph Laplacians
10.37236/1065 · 2006 · External reference
Unresolved reference
1984 · External reference
Forest matrices around the Laplacian matrix
10.1016/s0024-3795(02)00388-9 · 2002 · External reference
Generalized matrix inversion and rank computation by repeated squaring
10.1016/s0167-8191(06)80014-1 · 1994 · External reference
Unresolved reference
1997 · External reference
Laplacians and the Cheeger inequality for directed graphs
10.1007/s00026-005-0237-z · 2005 · External reference
Geometric diffusions as a tool for harmonic analysis and structure definition of data. Part I: Diffusion maps
10.1073/pnas.0500334102 · 2005 · External reference
Geometric diffusions as a tool for harmonic analysis and structure definition of data. Part II: Multiscale methods
10.1073/pnas.0500896102 · 2005 · External reference
Diffusion wavelets
10.1016/j.acha.2006.04.004 · 2006 · External reference
Geometric diffusions for the analysis of data from sensor networks
10.1016/j.conb.2005.08.012 · 2005 · External reference
Unresolved reference
1980 · External reference
Solving semi-Markov decision problems using average-reward reinforcement learning
10.1287/mnsc.45.4.560 · 1999 · External reference
10.1137/1.9781611970104
10.1137/1.9781611970104 · 1992 · External reference
Improving generalisation for temporal difference learning: The successor representation
10.1162/neco.1993.5.4.613 · 1993 · External reference
The linear programming approach to approximate dynamic programming
10.1287/opre.51.6.850.24925 · 2003 · External reference
10.1007/978-1-4684-9298-9
10.1007/978-1-4684-9298-9 · 2001 · External reference
Batch value function approximation using support vectors
2002 · External reference
On the Nyström method for approximating a Gram matrix for improved Kernel-based learning
2005 · External reference
Accelerating reinforcement learning by composing solutions of automatically identified subtasks
10.1613/jair.904 · 2002 · External reference
Geometric aspects of the theory of Krylov subspace methods
10.1017/s0962492901000046 · 2001 · External reference
Bayes meets Bellman: The Gaussian process approach to temporal difference learning
2003 · External reference
Proto-transfer learning in Markov decision processes using spectral methods
2006 · External reference
Algebraic connectivity of graphs
10.21136/cmj.1973.101168 · 1973 · External reference
Structure in the space of value functions
10.1023/a:1017944732463 · 2002 · External reference
Fast Monte Carlo algorithms for finding low-rank approximations
1998 · External reference
Hierarchical average-reward reinforcement learning
2007 · External reference
Model minimization in Markov decision processes
1997 · External reference
Unresolved reference
1989 · External reference
Stable function approximation in dynamic programming
10.1016/b978-1-55860-377-6.50040-2 · 1995 · External reference
Efficient solution algorithms for factored MDPs
10.1613/jair.1000 · 2003 · External reference
Unresolved reference
1992 · External reference
Graph Laplacians and their convergence on random neighborhood graphs
2007 · External reference
Online learning over graphs
10.1145/1102351.1102390 · 2005 · External reference
SPUDD: Stochastic planning using decision diagrams
1999 · External reference
Unresolved reference
1960 · External reference
Constructing basis functions from directed graphs for value function approximation
10.1145/1273496.1273545 · 2007 · External reference
Compact spectral bases for value function approximation using Kronecker factorization
2007 · External reference
10.1007/978-1-4757-1904-8
10.1007/978-1-4757-1904-8 · 1986 · External reference
Universal parametrizations via Eigenfunctions of the Laplacian and heat kernels
2007 · External reference
A natural policy gradient
2002 · External reference
A fast and high quality multilevel scheme for partitioning irregular graphs
10.1137/s1064827595287997 · 1999 · External reference
Block diagonalization of Laplacian matrices of symmetric graphs using group theory
10.1002/nme.1794 · 2007 · External reference
Using temporal neighborhoods to adapt function approximators in reinforcement learning
1999 · External reference
Unresolved reference
2003 · External reference
Learning basis functions in hybrid domains
2006 · External reference
Diffusion Kernels on statistical manifolds
2005 · External reference
Diffusion maps and geometric harmonics
2004 · External reference
Least-squares policy iteration
2003 · External reference
Updating the stationary vector of an irreducible Markov chain with an eye on Google’s PageRank
10.1137/040619028 · 2005 · External reference
10.1007/978-1-4615-4022-9
10.1007/978-1-4615-4022-9 · 1991 · External reference
10.1017/cbo9780511546877
10.1017/cbo9780511546877 · 2006 · External reference
10.1007/978-0-387-39351-3
10.1007/978-0-387-39351-3 · 2007 · External reference
10.1007/978-0-387-21752-9
10.1007/978-0-387-21752-9 · 2003 · External reference
Towards a unified theory of state abstraction for MDPs
2006 · External reference
Fast direct policy evaluation using multiscale analysis of Markov diffusion processes
10.1145/1143844.1143920 · 2006 · External reference
Proto-value functions: Developmental reinforcement learning
10.1145/1102351.1102421 · 2005 · External reference
Representation policy iteration
2005 · External reference
Fast spectral learning using Lanczos eigenspace projections
2008 · External reference
10.1007/978-3-031-01546-5
10.1007/978-3-031-01546-5 · 2008 · External reference
Automatic programming of behavior based robots using reinforcement learning
10.1016/0004-3702(92)90058-6 · 1992 · External reference
Value function approximation with diffusion wavelets and Laplacian eigenfunctions
2006 · External reference
Proto-value functions: A Laplacian framework for learning representation and control in Markov decision processes
2007 · External reference
Learning representation and control in continuous Markov decision processes
2006 · External reference
Self-improving factory simulation using continuous-time average-reward reinforcement learning
1997 · External reference
A theory for multiresolution signal decomposition: The wavelet representation
10.1109/34.192463 · 1989 · External reference
Unresolved reference
1998 · External reference
Computing isotypic projections with the Lanczos iteration
2003 · External reference
Dynamic abstraction in reinforcement learning via clustering
10.1145/1015330.1015355 · 2004 · External reference
Autonomous discovery of temporal abstractions from interactions with an environment
2002 · External reference
Learning segmentation by random walks
2001 · External reference
Sensitivity of the stationary distribution of a Markov chain
10.1137/s0895479892228900 · 1994 · External reference
Barycentric interpolators for continuous space and time reinforcement learning
1998 · External reference
Error bounds for approximate policy iteration
2003 · External reference
10.1515/9781400879236
10.1515/9781400879236 · 1968 · External reference
On spectral clustering: Analysis and an algorithm
2002 · External reference
Autonomous helicopter flight via reinforcement learning
2004 · External reference
Semi-supervised learning on Riemannian manifolds
2001 · External reference
Regression and regularization on large graphs
2003 · External reference
Kernel-based reinforcement learning
10.1023/a:1017928328829 · 2002 · External reference
Action-based representation discovery in Markov decision processes
2009 · External reference
Learning state action basis functions for hierarchical Markov decision processes
10.1145/1273496.1273585 · 2007 · External reference
Analyzing feature generation for value function approximation
10.1145/1273496.1273589 · 2007 · External reference
An analysis of linear models, linear value-function approximation, and feature selection for reinforcement learning
10.1145/1390156.1390251 · 2008 · External reference
Reinforcement learning for humanoid robots
2003 · External reference
An analysis of Laplacian methods for value function approximation in MDPs
2007 · External reference
Value Directed Compression of POMDPs
2003 · External reference
Piecewise linear value function approximation for factored Markov decision processes
2002 · External reference
10.1002/9780470182963
10.1002/9780470182963 · 2007 · External reference
10.1002/9780470316887
10.1002/9780470316887 · 1994 · External reference
Gaussian processes in reinforcement learning
2004 · External reference
SMDP homomorphisms: An algebraic approach to abstraction in semi-Markov decision processes
2003 · External reference
Unresolved reference
2005 · External reference
Coarticulation: An approach for generating concurrent plans in Markov decision processes
10.1145/1102351.1102442 · 2005 · External reference
10.1017/cbo9780511623783
10.1017/cbo9780511623783 · 1997 · External reference
Nonlinear dimensionality reduction by local linear embedding
10.1126/science.290.5500.2323 · 2000 · External reference
Unresolved reference
2002 · External reference
10.1137/1.9780898718003
10.1137/1.9780898718003 · 2003 · External reference
Reinforcement learning with factored states and actions
2004 · External reference
10.7551/mitpress/4175.001.0001
10.7551/mitpress/4175.001.0001 · 2001 · External reference
Perturbation theory and finite Markov chains
10.2307/3212261 · 1968 · External reference
Generalized polynomial approximations in Markov decision processes
10.1016/0022-247x(85)90317-8 · 1985 · External reference
10.1007/978-1-4684-9458-7
10.1007/978-1-4684-9458-7 · 1977 · External reference
Approximate policy construction using decision diagrams
2000 · External reference
Unresolved reference
2003 · External reference
Unresolved reference
1990 · External reference
Unresolved reference
2003 · External reference
A theory of justified reformulations
10.1016/b978-1-55860-036-2.50109-0 · 1989 · External reference
10.1109/tnn.1998.712192
10.1109/tnn.1998.712192 · 1998 · External reference
Learning to predict by the methods of temporal differences
10.1023/a:1022633531479 · 1988 · External reference
A global geometric framework for nonlinear dimensionality reduction
10.1126/science.290.5500.2319 · 2000 · External reference
Td-gammon, a self-teaching backgammon program, achieves master-level play
10.1162/neco.1994.6.2.215 · 1994 · External reference
Graph Laplacian based transfer learning in reinforcement learning
2008 · External reference
Unresolved reference
2007 · External reference
Many-layered learning
10.1162/08997660260293319 · 2002 · External reference
Unresolved reference
1987 · External reference
Approximation with Kronecker products
10.1007/978-94-015-8196-7_17 · 1993 · External reference
Learning and value function approximation in complex decision processes
1998 · External reference
10.1137/1.9781611970128
10.1137/1.9781611970128 · 1990 · External reference
Learning from delayed rewards
1989 · External reference
Successive matrix squaring algorithm for computing the Drazin inverse
10.1016/s0096-3003(98)10118-2 · 2000 · External reference
Using the Nyström method to speed up kernel machines
2000 · External reference
A reinforcement learning approach to job-shop scheduling
1995 · External reference
Semi-supervised learning with graphs
2005 · External reference
