Transfer Learning in Real-Time Strategy Games Using Hybrid CBR/RL

The goal of transfer learning is to use the knowledge acquired in a set of source tasks to improve performance in a related but previously unseen target task. In this paper, we present a multilayered architecture named CAse-Based Reinforcement Learner (CARL). It uses a novel combination of Case-Based Reasoning (CBR) and Reinforcement Learning (RL) to achieve transfer while playing against the Game AI across a variety of scenarios in MadRTSTM , a commercial Real Time Strategy game. Our experiments demonstrate that CARL not only performs well on individual tasks but also exhibits significant performance gains when allowed to transfer knowledge from previous tasks. 1 Transfer Learning Transferring knowledge from previous experiences to new circumstances is a fundamental human capability. In general, the AI community has focused its attention on generalization, the ability to learn from example instances from a task and then to interpolate or extrapolate to unseen instances of the same t...

• Type: Conference
• Year: 2007
• Where: IJCAI
• Authors: Manu Sharma, Michael P. Holmes, Juan Carlos Santamaría, Arya Irani, Charles Lee Isbell Jr., Ashwin Ram
• Keywords: Artificial Intelligence, Example Instances, IJCAI 2007, Transfer Learning, Transfer Learning Agent