A Non-Parametric Approach to Approximate Dynamic Programming - CentraleSupélec Access content directly
Conference Papers Year : 2011

A Non-Parametric Approach to Approximate Dynamic Programming


Approximate Dynamic Programming (ADP) is a machine learning method aiming at learning an optimal control policy for a dynamic and stochastic system from a logged set of observed interactions between the system and one or several non-optimal controlers. It defines a class of particular Reinforcement Learning (RL) algorithms which is a general paradigm for learning such a control policy from interactions. ADP addresses the problem of systems exhibiting a state space which is too large to be enumerated in the memory of a computer. Because of this, approximation schemes are used to generalize estimates over continuous state spaces. Nevertheless, RL still suffers from a lack of scalability to multidimensional continuous state spaces. In this paper, we propose the use of the Locally Weighted Projection Regression (LWPR) method to handle this scalability problem. We prove the efficacy of our approach on two standard benchmarks modified to exhibit larger state spaces.
Fichier principal
Vignette du fichier
ICMLA_2011_HGFAMGOP.pdf (595.46 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-00652438 , version 1 (15-12-2011)


  • HAL Id : hal-00652438 , version 1


Hadrien Glaude, Fadi Akrimi, Matthieu Geist, Olivier Pietquin. A Non-Parametric Approach to Approximate Dynamic Programming. ICMLA 2011, Dec 2011, Honolulu, Hawaii, United States. pp.1-6. ⟨hal-00652438⟩
151 View
252 Download


Gmail Facebook X LinkedIn More