Sciweavers

Share
FSKD
2007
Springer

Using Fuzzy-Word Correlation Factors to Compute Document Similarity Based on Phrase Matching

10 years 1 months ago
Using Fuzzy-Word Correlation Factors to Compute Document Similarity Based on Phrase Matching
One of the Web information Retrieval (IR) problems these days is to identify redundant information that exist in (replicated) Web documents. These documents can easily be found in several forms, such as documents in different versions, small documents combined with others to form a larger document, etc. As the Web is becoming more and more popular, the number of documents on the Web is increasing on a daily basis, and filtering redundant ones among this huge number of documents becomes a more difficult and an urgent task. As one of the solutions to this problem, we present a new method that identifies similar documents based on phrase matching using the fuzzy-word correlation factors among words in phrases. Since phrases can be treated as sequences of words in a sentence in any document, we consider the correlation factors of different words in any two phrases of two different documents to determine the degree of similarity of the phrases, which in turns can determine the similarit...
Jun won Lee, Yiu-Kai Ng
Added 07 Jun 2010
Updated 07 Jun 2010
Type Conference
Year 2007
Where FSKD
Authors Jun won Lee, Yiu-Kai Ng
Comments (0)
books