Sciweavers

Share
CCGRID
2008
IEEE

Scalable Data Gathering for Real-Time Monitoring Systems on Distributed Computing

10 years 1 months ago
Scalable Data Gathering for Real-Time Monitoring Systems on Distributed Computing
Real-time monitoring is increasingly becoming important in various scenes of large scale, multi-site distributed/parallel computing, e.g, understanding behavior of systems, scheduling resources, and debugging applications. Dedicated networks on inter-site communications are rarely available for the monitoring purposes. Therefore, for realtime monitoring systems, reducing communication cost is important to handle a large number of nodes with limited network resources. We implemented a real-time Grid monitoring system called VGXP, with techniques for low cost data gathering. It tries to send only diffs to recent data, and adapts to the requested data freshness and tolerable errors to minimize required communication. We evaluate monitoring overheads of the proposed method on a distributed environment consisting of 8-sites with 500 nodes. In a realistic setting where the sampling interval is set to 0.5 seconds and the tolerable error to 2%, the CPU usage of the server to gather data from ...
Yoshikazu Kamoshida, Kenjiro Taura
Added 29 May 2010
Updated 29 May 2010
Type Conference
Year 2008
Where CCGRID
Authors Yoshikazu Kamoshida, Kenjiro Taura
Comments (0)
books