Sciweavers

Share
WIDM
2004
ACM

User evaluation of the NASA technical report server recommendation service

9 years 5 months ago
User evaluation of the NASA technical report server recommendation service
We present the user evaluation of two recommendation server methodologies implemented for the NASA Technical Report Server (NTRS). One methodology for generating recommendations uses log analysis to identify co-retrieval events on full-text documents. For comparison, we used the Vector Space Model (VSM) as the second methodology. We calculated cosine similarities and used the top 10 most similar documents (based on metadata) as “recommendations”. We then ran an experiment with NASA Langley Research Center (LaRC) staff members to gather their feedback on which method produced the most “quality” recommendations. We found that in most cases VSM outperformed log analysis of co-retrievals. However, analyzing the data revealed the evaluations might have been structurally biased in favor of the VSM generated recommendations. We explore some possible methods for combining log analysis and VSM generated recommendations and suggest areas of future work. Categories and Subject Descriptor...
Michael L. Nelson, Johan Bollen, JoAnne R. Calhoun
Added 30 Jun 2010
Updated 30 Jun 2010
Type Conference
Year 2004
Where WIDM
Authors Michael L. Nelson, Johan Bollen, JoAnne R. Calhoun, Calvin E. Mackey
Comments (0)
books