WWW
2004
ACM
15 years 10 months ago
2004
ACM
The massive distribution of the crawling task can lead to inefficient exploration of the same portion of the Web. We propose a technique to guide crawlers exploration based on the...