117
click to vote
VLDB
2000
ACM
15 years 6 months ago
2000
ACM
In this paper we study how to build an effective incremental crawler. The crawler selectively and incrementally updates its index and/or local collection of web pages, instead of ...