The Design of Puzzle Selection Strategies for ESP-Like GWAP Systems

The `Games With A Purpose' (GWAP) genre is a type of `Human Computation' that outsources certain steps of the computational process to humans. Although most GWAP studies focus on the design and analysis of GWAP systems, a systematic and thorough evaluation of existing systems is lacking. We address the issue in this paper. Taking the ESP game as an example, we propose a metric, called system utility, for evaluating the performance of GWAP systems, and use analysis to study the properties of the ESP game. We argue that GWAP systems should be designed and played with strategies. To this end, based on our analysis, we implement an Optimal Puzzle Selection Strategy (OPSA) to improve GWAP systems. Using a comprehensive set of simulations, we show that the proposed OPSA approach can improve the system utility of the ESP game significantly. In addition, we implement a quasi ESP game, called ESP Lite, which embeds three puzzle selection algorithms transparently and records the comple...

• Type: Journal
• Year: 2010
• Where: TCIAIG
• Authors: Ling-Jyh Chen, Bo-Chun Wang, Wen-Yuan Zhu
• Keywords: ESP Game, GWAP Systems, Puzzle Selection, Software Engineering, TCIAIG 2010