103 search results - page 1 / 21 » The Architecture and Implementation of an Extensible Web Cra... |
NSDI
2010
13 years 6 months ago
2010
Many Web services operate their own Web crawlers to discover data of interest, despite the fact that largescale, timely crawling is complex, operationally intensive, and expensive...
ICDE
2002
IEEE
14 years 6 months ago
2002
IEEE
Broad web search engines as well as many more specialized search tools rely on web crawlers to acquire large collections of pages for indexing and analysis. Such a web crawler may...
WWW
2007
ACM
14 years 5 months ago
2007
ACM
Given a huge online social network, how do we retrieve information from it through crawling? Even better, how do we improve the crawling performance by using parallel crawlers tha...
ICADL
2004
Springer
13 years 10 months ago
2004
Springer
This paper presents our implementation techniques for an intelligent Web image search engine. A reference architecture of the system is provided and addressed in this paper. The s...
SPIRE
1999
Springer
13 years 9 months ago
1999
Springer
One of the key components of current Web search engines is the document collector. This paper describes CoBWeb, an automatic document collector, whose architecture is distributed ...