Multi-scale Real-Time Grid Monitoring with Job Stream Mining

14 years 1 months ago
Multi-scale Real-Time Grid Monitoring with Job Stream Mining
—The ever increasing scale and complexity of large computational systems ask for sophisticated management tools, paving the way toward Autonomic Computing. A first step toward Autonomic Grids is presented in this paper; the interactions between the grid middleware and the stream of computational queries are modeled using statistical learning. The approach is implemented and validated in the context of the EGEE grid. The GSTRAP system, embedding the STRAP Data Streaming algorithm, provides manageable and understandable views of the computational workload based on gLite reporting services. An online monitoring module shows the instant distribution of the jobs in real-time and its dynamics, enabling anomaly detection. An offline monitoring module provides the administrator with a consolidated view of the workload, enabling the visual inspection of its long-term trends.
Xiangliang Zhang, Michèle Sebag, Céc
Added 20 May 2010
Updated 20 May 2010
Type Conference
Year 2009
Authors Xiangliang Zhang, Michèle Sebag, Cécile Germain-Renaud
Comments (0)