Monitoring the dynamic web to respond to continuous queries

Continuous queries are queries for which responses given to users must be continuously updated, as the sources of interest get updated. Such queries occur, for instance, during on-line decision making, e.g., traffic flow control, weather monitoring, etc. The problem of keeping the responses current reduces to the problem of deciding how often to visit a source to determine if and how it has been modified so that a user response can be updated accordingly. On the surface, this seems to be similar to the crawling problem since crawlers attempt to keep indexes up-to-date as users pose search queries. We show that this is not the case, both due to the inherent differences between the nature of the two problems as well as the performance metric. We also develop and evaluate a novel multi-phase (Continuous Adaptive Monitoring) (CAM) solution to the problem of maintaining the currency of query results. Some of the important phases are: The tracking phase, in which changes, to an initially id...

• Type: Conference
• Year: 2003
• Where: WWW
• Authors: Sandeep Pandey, Krithi Ramamritham, Soumen Chakrabarti
• Keywords: Continuous Adaptive Monitoring, Continuous Queries, Internet Technology, Resource Allocation Phase, WWW 2003