Sciweavers

Share
DMKD
2004
ACM

Iterative record linkage for cleaning and integration

10 years 4 months ago
Iterative record linkage for cleaning and integration
Record linkage, the problem of determining when two records refer to the same entity, has applications for both data cleaning (deduplication) and for integrating data from multiple sources. Traditional approaches use a similarity measure that compares tuples’ attribute values; tuples with similarity scores above a certain threshold are declared to be matches. While this method can perform quite well in many domains, particularly domains where there is not a large amount of noise in the data, in some domains looking only at tuple values is not enough. By also examining the context of the tuple, i.e. the other tuples to which it is linked, we can come up with a more accurate linkage decision. But this additional accuracy comes at a price. In order to correctly find all duplicates, we may need to make multiple passes over the data; as linkages are discovered, they may in turn allow us to discover additional linkages. We present results that illustrate the power and feasibility of maki...
Indrajit Bhattacharya, Lise Getoor
Added 30 Jun 2010
Updated 30 Jun 2010
Type Conference
Year 2004
Where DMKD
Authors Indrajit Bhattacharya, Lise Getoor
Comments (0)
books