Threshold Setting and Performance Optimization in Adaptive Filtering

An experimental adaptive filtering system, built on the Okapi search engine, is described. In addition to the regular text retrieval functions, the system requires a complex set of procedures for setting score thresholds and adapting them following feedback. These procedures need to be closely related to the evaluation measures to be used. A mixture of quantitative methods relating a threshold to the number of documents expected to be retrieved in a time period, and qualitative methods relating to the probability of relevance, is defined. Experiments under the TREC

• Type: Journal
• Year: 2002
• Where: IR
• Authors: Stephen E. Robertson
• Keywords: IR 2002, Natural Language Processing, Okapi Search Engine, Regular Text Retrieval, Score Thresholds