Sciweavers

Share
ICPP
2008
IEEE

Dynamic Meta-Learning for Failure Prediction in Large-Scale Systems: A Case Study

8 years 10 months ago
Dynamic Meta-Learning for Failure Prediction in Large-Scale Systems: A Case Study
Despite great efforts on the design of ultra-reliable components, the increase of system size and complexity has outpaced the improvement of component reliability. As a result, fault management becomes crucial in high performance computing. The advance of fault management relies on effective failure prediction. Despite years of research on failure prediction, it remains an open problem, especially in large-scale systems. In this paper, we address the problem by presenting a dynamic meta-learning prediction engine. It extends our previous work by exploring dynamic training, testing and prediction. Here, the “dynamic” part is from two perspectives: one is to continuously increase the training set during the system operation; and the other is to dynamically modify the rules of failure patterns by tracing prediction accuracy at runtime. Our case study indicates that the proposed predictor is promising by being capable of capturing more than 70% of failures, with the false alarm rate l...
Jiexing Gu, Ziming Zheng, Zhiling Lan, John White,
Added 30 May 2010
Updated 30 May 2010
Type Conference
Year 2008
Where ICPP
Authors Jiexing Gu, Ziming Zheng, Zhiling Lan, John White, Eva Hocks, Byung-Hoon Park
Comments (0)
books