Compression, Indexing, and Retrieval for Massive String Data

13 years 9 months ago

Download www.ittc.ku.edu

The ﬁeld of compressed data structures seeks to achieve fast search time, but using a compressed representation, ideally requiring less space than that occupied by the original input data. The challenge is to construct a compressed representation that provides the same functionality and speed as traditional data structures. In this invited presentation, we discuss some breakthroughs in compressed data structures over the course of the last decade that have signiﬁcantly reduced the space requirements for fast text and document indexing. One interesting consequence is that, for the ﬁrst time, we can construct data structures for text indexing that are competitive in time and space with the well-known technique of inverted indexes, but that provide more general search capabilities. Several challenges remain, and we focus in this presentation on two in particular: building I/O-eﬃcient search structures when the input data are so massive that external memory must be used, and incorp...

Wing-Kai Hon, Rahul Shah, Jeffrey Scott Vitter

Real-time Traffic