Sciweavers

Share
APWEB
2006
Springer

The Case of the Duplicate Documents Measurement, Search, and Science

9 years 3 months ago
The Case of the Duplicate Documents Measurement, Search, and Science
Many of the documents in large text collections are duplicates and versions of each other. In recent research, we developed new methods for finding such duplicates; however, as there was no directly comparable prior work, we had no measure of whether we had succeeded. Worse, the concept of "duplicate" not only proved difficult to define, but on reflection was not logically defensible. Our investigation highlighted a paradox of computer science research: objective measurement of outcomes involves a subjective choice of preferred measure; and attempts to define measures can easily founder in circular reasoning. Also, some measures are abstractions that simplify complex real-world phenomena, so success by a measure may not be meaningful outside the context of the research. These are not merely academic concerns, but are significant problems in the design of research projects. In this paper, the case of the duplicate documents is used to explore whether and when it is reasonable ...
Justin Zobel, Yaniv Bernstein
Added 20 Aug 2010
Updated 20 Aug 2010
Type Conference
Year 2006
Where APWEB
Authors Justin Zobel, Yaniv Bernstein
Comments (0)
books