2 search results - page 1 / 1 » Low-load server crawler: design and evaluation |
WWW
2008
ACM
14 years 5 months ago
2008
ACM
This paper proposes a method of crawling Web servers connected to the Internet without imposing a high processing load. We are using the crawler for a field survey of the digital ...
ICDE
2003
IEEE
14 years 5 months ago
2003
IEEE
Web crawlers generate significant loads on Web servers, and are difficult to operate. Instead of repeatedly running crawlers at many "client" sites, we propose a central...