Sciweavers

Share
ACIIDS
2009
IEEE

Processing Exact Results for Sliding Window Joins over Time-Sequence, Streaming Data Using a Disk Archive

10 years 9 months ago
Processing Exact Results for Sliding Window Joins over Time-Sequence, Streaming Data Using a Disk Archive
— We consider the problem of processing exact results for sliding window joins over data streams with limited memory. Existing approaches deal with memory limitations by shedding loads, and therefore cannot provide exact or even highly accurate results for sliding window joins over data streams showing time varying rate of data arrivals. We provide an Exact Window Join (EWJ) algorithm incorporating disk storage as an archive. Our algorithm spills window data onto the disk on a periodic basis, refines the output result by properly retrieving the disk resident data, and maximizes output rate by employing techniques to manage the memory blocks. The problem of managing the window blocks in memory—similar in nature to the caching issue— captures both the temporal and frequency related properties of the stream arrivals. At the same, we improve I/O efficiency by amortizing a disk scan over a large number of input tuple. We provide experimental results demonstrating the performance and...
Abhirup Chakraborty, Ajit Singh
Added 09 Jul 2010
Updated 09 Jul 2010
Type Conference
Year 2009
Where ACIIDS
Authors Abhirup Chakraborty, Ajit Singh
Comments (0)
books