Sciweavers

Share
INFOCOM
2010
IEEE

Efficient Similarity Estimation for Systems Exploiting Data Redundancy

9 years 7 months ago
Efficient Similarity Estimation for Systems Exploiting Data Redundancy
Many modern systems exploit data redundancy to improve efficiency. These systems split data into chunks, generate identifiers for each of them, and compare the identifiers among other data items to identify duplicate chunks. As a result, chunk size becomes a critical parameter for the efficiency of these systems: it trades potentially improved similarity detection (smaller chunks) with increased overhead to represent more chunks. Unfortunately, the similarity between files increases unpredictably with smaller chunk sizes, even for data of the same type. Existing systems often pick one chunk size that is "good enough" for many cases because they lack efficient techniques to determine the benefits at other chunk sizes. This paper addresses this deficiency via two contributions: (1) we present multi-resolution (MR) handprinting, an application-independent technique that efficiently estimates similarity between data items at different chunk sizes using a compact, multi-size repre...
Kanat Tangwongsan, Himabindu Pucha, David G. Ander
Added 13 Feb 2011
Updated 13 Feb 2011
Type Journal
Year 2010
Where INFOCOM
Authors Kanat Tangwongsan, Himabindu Pucha, David G. Andersen, Michael Kaminsky
Comments (0)
books