Dynamic Workload Management for Very Large Data Warehouses: Juggling Feathers and Bowling Balls

Workload management for business intelligence (BI) queries poses different challenges than those addressed in the online transaction processing (OLTP) context. The fundamental problem is that the execution times of BI queries can range from milliseconds to hours, and it is difficult to estimate these times accurately. Key challenges raised by this problem are how to identify queries that are not performing properly and what to do about them. We propose here a workload management system for controlling the execution of individual queries based on realistic customer service level objectives. In order to validate our proposal, we have implemented an experimental system that includes a dynamic execution controller that leverages fuzzy logic. We present results from a number of experiments that we ran using workloads based on actual industrial workloads and customer objectives that we gathered by interviewing industry practitioners. Our experiments show that even a handful of moderately mi...

• Type: Conference
• Year: 2007
• Where: VLDB
• Authors: Stefan Krompass, Umeshwar Dayal, Harumi A. Kuno, Alfons Kemper
• Keywords: Database, VLDB 2007