Sciweavers

AAAI
2015

Factored MCTS for Large Scale Stochastic Planning

8 years 2 days ago
Factored MCTS for Large Scale Stochastic Planning
This paper investigates stochastic planning problems with large factored state and action spaces. We show that even with moderate increase in the size of existing challenge problems, the performance of state of the art algorithms deteriorates rapidly, making them ineffective. To address this problem we propose a family of simple but scalable online planning algorithms that combine sampling, as in Monte Carlo tree search, with “aggregation”, where the aggregation approximates a distribution over random variables by the product of their marginals. The algorithms are correct under some rather strong technical conditions and can serve as an unsound but effective heuristic when the conditions do not hold. An extensive experimental evaluation demonstrates that the new algorithms provide significant improvement over the state of the art when solving large problems in a number of challenge benchmark domains.
Hao Cui, Roni Khardon, Alan Fern, Prasad Tadepalli
Added 27 Mar 2016
Updated 27 Mar 2016
Type Journal
Year 2015
Where AAAI
Authors Hao Cui, Roni Khardon, Alan Fern, Prasad Tadepalli
Comments (0)