Sciweavers

Share
ROBOCUP
2007
Springer

Cooperative/Competitive Behavior Acquisition Based on State Value Estimation of Others

9 years 5 months ago
Cooperative/Competitive Behavior Acquisition Based on State Value Estimation of Others
The existing reinforcement learning approaches have been suffering from the curse of dimension problem when they are applied to multiagent dynamic environments. One of the typical examples is a case of RoboCup competitions since other agents and their behaviors easily cause state and action space explosion. This paper presents a method of modular learning in a multiagent environment by which the learning agent can acquire cooperative behaviors with its team mates and competitive ones against its opponents. The key ideas to resolve the issue are as follows. First, a two-layer hierarchical system with multi learning modules is adopted to reduce the size of the sensor and action spaces. The state space of the top layer consists of the state values from the lower level, and the macro actions are used to reduce the size of the physical action space. Second, the state of the other to what extent it is close to its own goal is estimated by observation and used as a state value in the top lay...
Kentarou Noma, Yasutake Takahashi, Minoru Asada
Added 09 Jun 2010
Updated 09 Jun 2010
Type Conference
Year 2007
Where ROBOCUP
Authors Kentarou Noma, Yasutake Takahashi, Minoru Asada
Comments (0)
books