104
Voted
WWW
2008
ACM
16 years 4 months ago
2008
ACM
It is crucial for a web crawler to distinguish between ephemeral and persistent content. Ephemeral content (e.g., quote of the day) is usually not worth crawling, because by the t...