197 search results - page 1 / 40 » Using Reinforcement Learning to Spider the Web Efficiently |
ICML
1999
IEEE
14 years 5 months ago
1999
IEEE
Consider the task of exploring the Web in order to find pages of a particular kind or on a particular topic. This task arises in the construction of search engines and Web knowled...
IR
2000
13 years 4 months ago
2000
Domain-specific internet portals are growing in popularity because they gather content from the Web and organize it for easy access, retrieval and search. For example, www.campsear...
GCC
2005
Springer
13 years 10 months ago
2005
Springer
Web spider is a widely used approach to obtain information for search engines. As the size of the Web grows, it becomes a natural choice to parallelize the spider’s crawling proc...
ML
2000
ACM
13 years 4 months ago
2000
ACM
This paper discusses a novel distributed adaptive algorithm and representation used to construct populations of adaptive Web agents. These InfoSpiders browse networked information ...
DSS
2008
13 years 5 months ago
2008
While small-scale search engines in specific domains and languages are increasingly used by Web users, most existing search engine development tools do not support the development...