Sciweavers

TC
2010
12 years 11 months ago
On the Problem of Evaluating the Performance of Multiprogrammed Workloads
Multithreaded architectures are becoming more and more popular. In order to evaluate their behavior, several methodologies and metrics have been proposed. A methodology defines whe...
Francisco J. Cazorla, Alex Pajuelo, Oliverio J. Sa...
SIGMOBILE
2010
147views more  SIGMOBILE 2010»
12 years 11 months ago
TCPSpeaker: clean and dirty sides of the same slate
As new approaches toward clean-slate network transport continue to emerge in the wireless domain and beyond, so grows the difficulty of conducting reproducible, head-to-head evalu...
Dan Levin, Harald Schiöberg, Ruben Merz, Cigd...
SIGIR
2010
ACM
12 years 11 months ago
Crowdsourcing for search evaluation
The Crowdsourcing for Search Evaluation Workshop (CSE 2010) was held on July 23,
Vitor R. Carvalho, Matthew Lease, Emine Yilmaz
SIGIR
2010
ACM
12 years 11 months ago
PRES: a score metric for evaluating recall-oriented information retrieval applications
Information retrieval (IR) evaluation scores are generally designed to measure the effectiveness with which relevant documents are identified and retrieved. Many scores have been ...
Walid Magdy, Gareth J. F. Jones
JASIS
2011
109views more  JASIS 2011»
12 years 11 months ago
The scholarly impact of TRECVid (2003-2009)
This paper reports on an investigation into the scholarly impact of the TRECVid (TREC Video Retrieval Evaluation) benchmarking conferences between 2003 and 2009. The contribution ...
Clare Thornley, Andrea C. Johnson, Alan F. Smeaton...
CLEF
2010
Springer
13 years 1 months ago
Examining the Robustness of Evaluation Metrics for Patent Retrieval with Incomplete Relevance Judgements
Recent years have seen a growing interest in research into patent retrieval. One of the key issues in conducting information retrieval (IR) research is meaningful evaluation of the...
Walid Magdy, Gareth J. F. Jones
HRI
2009
ACM
13 years 2 months ago
Evaluating the ICRA 2008 HRI challenge
This paper reports on the evaluation of the ICRA 2008 Human-Robot Interaction (HRI) Challenge. Five research groups demonstrated state-of-the-art work on HRI with a special focus ...
Astrid Weiss, Thomas Scherndl, Manfred Tscheligi, ...
EMNLP
2009
13 years 2 months ago
Automatically Evaluating Content Selection in Summarization without Human Models
We present a fully automatic method for content selection evaluation in summarization that does not require the creation of human model summaries. Our work capitalizes on the assu...
Annie Louis, Ani Nenkova
CLEF
2009
Springer
13 years 2 months ago
Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task
The large-scale visual concept detection and annotation task (LS-VCDT) in ImageCLEF 2009 aims at the detection of 53 concepts in consumer photos. These concepts are structured in ...
Stefanie Nowak, Peter Dunker
WEBI
2010
Springer
13 years 2 months ago
Agent-Based Online Quality Measurement Approach in Cloud Computing Environment
This paper studies online quality measurement in cloud computing environment. The paper analyzes concentration measure evaluation method of the current software quality evaluation...
Zhenyu Liu, Tiejiang Liu, Tun Lu, Lizhi Cai, Genxi...