Exploiting Coordination Locales in Distributed POMDPs via Social Model Shaping

Distributed POMDPs provide an expressive framework for modeling multiagent collaboration problems, but NEXPComplete complexity hinders their scalability and application in real-world domains. This paper introduces a subclass of distributed POMDPs, and TREMOR, an algorithm to solve such distributed POMDPs. The primary novelty of TREMOR is that agents plan individually with a single agent POMDP solver and use social model shaping to implicitly coordinate with other agents. Experiments demonstrate that TREMOR can provide solutions orders of magnitude faster than existing algorithms while achieving comparable, or even superior, solution quality.

• Type: Conference
• Year: 2009
• Where: AIPS
• Authors: Pradeep Varakantham, Jun-young Kwak, Matthew E. Taylor, Janusz Marecki, Paul Scerri, Milind Tambe
• Keywords: AIPS 2009, Artificial Intelligence, Distributed Pomdps, Multiagent Collaboration Problems, NEXPComplete Complexity Hinders