Sciweavers

Share
ICDE
2007
IEEE

A Load Shedding Framework and Optimizations for M-way Windowed Stream Joins

12 years 9 months ago
A Load Shedding Framework and Optimizations for M-way Windowed Stream Joins
Tuple dropping, though commonly used for load shedding in most stream operations, is inadequate for m-way, windowed stream joins. The join output rate can be overly reduced because it fails to exploit the time correlations likely to exist among interrelated streams. In this paper, we introduce GrubJoin: an adaptive, m-way, windowed stream join that effectively performs time correlation-aware CPU load shedding. GrubJoin maximizes the output rate by achieving nearoptimal window harvesting, which picks only the most profitable window segments for the join. Due to combinatorial explosion of possible m-way join sequences involving window segments, m-way, windowed stream joins pose several unique challenges. We focus on addressing two of them: (1) How can we quickly determine the optimal window harvesting configuration for any m-way, windowed stream join? (2) How can we monitor and learn the time correlations among the streams with high accuracy and minimal overhead? To tackle these challen...
Bugra Gedik, Kun-Lung Wu, Philip S. Yu, Ling Liu
Added 01 Nov 2009
Updated 01 Nov 2009
Type Conference
Year 2007
Where ICDE
Authors Bugra Gedik, Kun-Lung Wu, Philip S. Yu, Ling Liu
Comments (0)
books