Sciweavers

19 search results - page 1 / 4
» Evaluation Metrics for the Lexical Substitution Task
Sort
View
NAACL
2010
13 years 3 months ago
Evaluation Metrics for the Lexical Substitution Task
We identify some problems of the evaluation metrics used for the English Lexical Substitution Task of SemEval-2007, and propose alternative metrics that avoid these problems, whic...
Sanaz Jabbari, Mark Hepple, Louise Guthrie
LREC
2010
116views Education» more  LREC 2010»
13 years 6 months ago
Evaluating Lexical Substitution: Analysis and New Measures
Lexical substitution is the task of finding a replacement for a target word in a sentence so as to preserve, as closely as possible, the meaning of the original sentence. It has b...
Sanaz Jabbari, Mark Hepple, Louise Guthrie
LREC
2008
88views Education» more  LREC 2008»
13 years 6 months ago
Lexical Substitution as a Framework for Multiword Evaluation
In this paper we analyse data from the SemEval lexical substitution task in those cases where the annotators indicated that the target word was part of a phrase before substitutin...
Diana McCarthy
COLING
2008
13 years 6 months ago
Instance-Based Ontology Population Exploiting Named-Entity Substitution
We present an approach to ontology population based on a lexical substitution technique. It consists in estimating the plausibility of sentences where the named entity to be class...
Claudio Giuliano, Alfio Massimiliano Gliozzo
LREC
2008
111views Education» more  LREC 2008»
13 years 6 months ago
Sensitivity of Automated MT Evaluation Metrics on Higher Quality MT Output: BLEU vs Task-Based Evaluation Methods
We report the results of an experiment to assess the ability of automated MT evaluation metrics to remain sensitive to variations in MT quality as the average quality of the compa...
Bogdan Babych, Anthony Hartley