A Deterministic Algorithm for Summarizing Asynchronous Streams over a Sliding Window

13 years 10 months ago

Download www.csc.lsu.edu

We consider the problem of maintaining aggregates over recent elements of a massive data stream. Motivated by applications involving network data, we consider asynchronous data streams, where the observed order of data may be diﬀerent from the order in which the data was generated. The set of recent elements is modeled as a sliding timestamp window of the stream, whose elements are changing continuously with time. We present the ﬁrst deterministic algorithms for maintaining a small space summary of elements in a sliding timestamp window of an asynchronous data stream. The summary can return approximate answers for the following fundamental aggregates: basic count, the number of elements within the sliding window, and sum, the sum of all element values within the sliding window. For basic counting, the space taken by our summary is O(log W · log B · (log W + log B)/ ) bits, where B is an upper bound on the value of the basic count, W is an upper bound on the width of the timestamp...

Costas Busch, Srikanta Tirthapura

Real-time Traffic