Sciweavers

AIPS
2010

Improving Determinization in Hindsight for On-line Probabilistic Planning

13 years 6 months ago
Improving Determinization in Hindsight for On-line Probabilistic Planning
Recently, `determinization in hindsight' has enjoyed surprising success in on-line probabilistic planning. This technique evaluates the actions available in the current state by using non-probabilistic planning in deterministic approximations of the original domain. Although the approach has proven itself effective in many challenging domains, it is computationally very expensive. In this paper, we present three significant improvements to help mitigate this expense. First, we use a method for detecting potentially useful actions, allowing us to avoid estimating the values of unnecessary ones. Second, we exploit determinism in the domain by reusing relevant plans rather than computing new ones. Third, we improve action evaluation by increasing the chance that at least one deterministic plan reaches a goal. Taken together, these improvements allow determinization in hindsight to scale significantly better on large or mostly-deterministic problems.
Sung Wook Yoon, Wheeler Ruml, J. Benton, Minh Do
Added 02 Oct 2010
Updated 02 Oct 2010
Type Conference
Year 2010
Where AIPS
Authors Sung Wook Yoon, Wheeler Ruml, J. Benton, Minh Do
Comments (0)