Sciweavers

FLAIRS
2008

A Novel Prioritization Technique for Solving Markov Decision Processes

13 years 6 months ago
A Novel Prioritization Technique for Solving Markov Decision Processes
We address the problem of computing an optimal value function for Markov decision processes. Since finding this function quickly and accurately requires substantial computation effort, techniques that accelerate fundamental algorithms have been a main focus of research. Among them prioritization solvers suggest solutions to the problem of ordering backup operations. Prioritization techniques for ordering the sequence of backup operations reduce the number of needed backups considerably, but involve significant overhead. This paper provides a new way to order backups, based on a mapping of states space into a metric space. Empirical evaluation verifies that our method achieves the best balance between the number of backups executed and the effort required to prioritized backups, showing order of magnitude improvement in runtime over number of benchmarks.
Jilles Steeve Dibangoye, Brahim Chaib-draa, Abdel-
Added 02 Oct 2010
Updated 02 Oct 2010
Type Conference
Year 2008
Where FLAIRS
Authors Jilles Steeve Dibangoye, Brahim Chaib-draa, Abdel-Illah Mouaddib
Comments (0)