Sciweavers

11 search results - page 2 / 3
» Mining the Correlation between Human and Automatic Evaluatio...
Sort
View
ECIR
2010
Springer
13 years 6 months ago
Aggregation of Multiple Judgments for Evaluating Ordered Lists
Abstract. Many tasks (e.g., search and summarization) result in an ordered list of items. In order to evaluate such an ordered list of items, we need to compare it with an ideal or...
Hyun Duk Kim, ChengXiang Zhai, Jiawei Han
COLING
2002
13 years 5 months ago
An Automatic Evaluation Method for Localization Oriented Lexicalised EBMT System
To help developing a localization oriented EBMT system, an automatic machine translation evaluation method is implemented which adopts edit distance, cosine correlation and Dice c...
Jianmin Yao, Ming Zhou, Tiejun Zhao, Hao Yu, Sheng...
MT
2010
110views more  MT 2010»
13 years 3 months ago
Metrics for MT evaluation: evaluating reordering
Translating between dissimilar languages requires an account of the use of divergent word orders when expressing the same semantic content. Reordering poses a serious problem for s...
Alexandra Birch, Miles Osborne, Phil Blunsom
ANLP
2000
157views more  ANLP 2000»
13 years 6 months ago
Experiments on Sentence Boundary Detection
This paper explores the problem of identifying sentence boundaries in the transcriptions produced by automatic speech recognition systems. An experiment which determines the level...
Mark Stevenson, Robert J. Gaizauskas
LREC
2008
81views Education» more  LREC 2008»
13 years 6 months ago
Speech Errors on Frequently Observed Homophones in French: Perceptual Evaluation vs Automatic Classification
The present contribution aims at increasing our understanding of automatic speech recognition (ASR) errors involving frequent homophone or almost homophone words by confronting th...
Rena Nemoto, Ioana Vasilescu, Martine Adda-Decker