Sampling Algorithms in a Stream Operator

12 years 8 months ago
Sampling Algorithms in a Stream Operator
Complex queries over high speed data streams often need to rely on approximations to keep up with their input. The research community has developed a rich literature on approximate streaming algorithms for this application. Many of these algorithms produce samples of the input stream, providing better properties than conventional random sampling. In this paper, we the stream sampling process and design a new stream sample operator. We show how it can be used to implement a wide variety of algorithms that perform sampling and samplingbased aggregations. Also, we show how to implement the operator in Gigascope - a high speed stream database specialized for IP network monitoring applications. As an example study, we apply the operator within such an enhanced Gigascope to perform subset-sum sampling which is of great interest for IP network management. We evaluate this implemention on a live, high speed internet traffic data stream and find that (a) the operator is a flexible, versatile a...
Theodore Johnson, S. Muthukrishnan, Irina Rozenbau
Added 08 Dec 2009
Updated 08 Dec 2009
Type Conference
Year 2005
Authors Theodore Johnson, S. Muthukrishnan, Irina Rozenbaum
Comments (0)