Sciweavers

Share
ICDE
2004
IEEE

Improved File Synchronization Techniques for Maintaining Large Replicated Collections over Slow Networks

9 years 7 months ago
Improved File Synchronization Techniques for Maintaining Large Replicated Collections over Slow Networks
We study the problem of maintaining large replicated collections of files or documents in a distributed environment with limited bandwidth. This problem arises in a number of important applications, such as synchronization of data between accounts or devices, content distibution and web caching networks, web site mirroring, storage networks, and large scale web search and mining. At the core of the problem lies the following challenge, called the file synchronization problem: given two versions of a file on different machines, say an outdated and a current one, how can we update the outdated version with minimum communication cost, by exploiting the significant similarity between the versions? While a popular open source tool for this problem called rsync is used in hundreds of thousands of installations, there have been only very few attempts to improve upon this tool in practice. In this paper, we propose a framework for remote file synchronization and describe several new technique...
Torsten Suel, Patrick Noel, Dimitre Trendafilov
Added 01 Nov 2009
Updated 01 Nov 2009
Type Conference
Year 2004
Where ICDE
Authors Torsten Suel, Patrick Noel, Dimitre Trendafilov
Comments (0)
books