Using Web-Search Results to Measure Word-Group Similarity

11 years 9 months ago
Using Web-Search Results to Measure Word-Group Similarity
Semantic relatedness between words is important to many NLP tasks, and numerous measures exist which use a variety of resources. Thus far, such work is confined to measuring similarity between two words (or two texts), and only a handful utilize the web as a corpus. This paper introduces a distributional similarity measure which uses internet search counts and also extends to calculating the similarity within word-groups. The evaluation results are encouraging: for word-pairs, the correlations with human judgments are comparable with state-ofthe-art web-search page-count heuristics. When used to measure similarities within sets of 10 words, the results correlate highly (up to 0.8) with those expected. Relatively little comparison has been made between the results of different search-engines. Here, we compare experimental results from Google, Windows Live Search and Yahoo and find noticeable differences.
Ann Gledson, John Keane
Added 29 Oct 2010
Updated 29 Oct 2010
Type Conference
Year 2008
Authors Ann Gledson, John Keane
Comments (0)