295 search results - page 15 / 59 » Web Crawling |
CN
1998
14 years 9 months ago
1998
In this paper we study in what order a crawler should visit the URLs it has seen, in order to obtain more "important" pages first. Obtaining important pages rapidly can ...
HT
2006
ACM
15 years 3 months ago
2006
ACM
We have developed a web-repository crawler that is used for reconstructing websites when backups are unavailable. Our crawler retrieves web resources from the Internet Archive, Go...
136
click to vote
CORR
2012
Springer
13 years 5 months ago
2012
Springer
A typical web search engine consists of three principal parts: crawling engine, indexing engine, and searching engine. The present work aims to optimize the performance of the cra...
SIGIR
2002
ACM
14 years 9 months ago
2002
ACM
We measure the WT10g test collection, used in the TREC-9 and TREC 2001 Web Tracks, and the .GOV test collection used in the TREC 2002 Web and Interactive Tracks, with common measu...
ICAPR
2005
Springer
15 years 3 months ago
2005
Springer
The number of vertical search engines and portals has rapidly increased over the last years, making the importance of a topic-driven (focused) crawler evident. In this paper, we de...