6 search results - page 1 / 2 » Evaluation of crawling policies for a web-repository crawler |
HT
2006
ACM
13 years 11 months ago
2006
ACM
We have developed a web-repository crawler that is used for reconstructing websites when backups are unavailable. Our crawler retrieves web resources from the Internet Archive, Go...
WIDM
2006
ACM
13 years 11 months ago
2006
ACM
Backup of websites is often not considered until after a catastrophic event has occurred to either the website or its webmaster. We introduce “lazy preservation” – digital p...
CIKM
2011
Springer
12 years 4 months ago
2011
Springer
Word prediction performed by language models has an important role in many tasks as e.g. word sense disambiguation, speech recognition, hand-writing recognition, query spelling an...
WWW
2008
ACM
14 years 5 months ago
2008
ACM
This paper proposes a method of crawling Web servers connected to the Internet without imposing a high processing load. We are using the crawler for a field survey of the digital ...
CORR
2012
Springer
12 years 19 days ago
2012
Springer
A typical web search engine consists of three principal parts: crawling engine, indexing engine, and searching engine. The present work aims to optimize the performance of the cra...