Using query term order for result summarisation

We report on two experiments performed to test the importance of Term Order in automatic summarisation. Experiment one was undertaken as part of DUC 2004 to which three systems were submitted, each with a different summarisation approach. The system that used document Term Order outperformed those that did not use Term Order in the ROUGE evaluation. Experiment two made use of human evaluations of search engine results, comparing our Query Term Order summaries with a simulation of current Google search engine result summaries in terms of summary quality. Our QTO system’s summaries aided users’ relevance judgements to a significantly greater extent than Google’s. Categories and Subject Descriptors H.3.3 [Information Storage and Retrieval]: Information Search and Retrieval - Query formulation. General Terms Algorithms, Performance, Experimentation. Keywords Query Term Order, Term Order, Summary Quality.

• Type: Conference
• Year: 2005
• Where: SIGIR
• Authors: Shao Fen Liang, Siobhan Devlin, John Tait
• Keywords: Query Term Order, SIGIR 2005, Term Order, Term Order Summaries