Performance Evaluation of State-of-the-Art Ranked Retrieval Methods and Their Combinations for Query Suggestion

Suthira Plansangket, John Q. Gan

2014

Abstract

This paper investigates several state-of-the-art ranked retrieval methods, adapts and combines them as well for query suggestion. Four performance criteria plus user evaluation have been adopted to evaluate these query suggestion methods in terms of ranking and relevance from different perspectives. Extensive experiments have been conducted using carefully designed eighty test queries which are related to eight topics. The experimental results show that the method developed in this paper, which combines the TF-IDF and Jaccard coefficient methods, is the best method for query suggestion among the six methods evaluated, outperforming the most popularly used TF-IDF method. Furthermore, it is shown that re-ranking query suggestions using Cosine similarity improves the performance of query suggestions.

Paper Citation

in Harvard Style

Plansangket S. and Q. Gan J. (2014). Performance Evaluation of State-of-the-Art Ranked Retrieval Methods and Their Combinations for Query Suggestion . In Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2014) ISBN 978-989-758-048-2, pages 141-148. DOI: 10.5220/0005018401410148

in Bibtex Style

@conference{kdir14,
author={Suthira Plansangket and John Q. Gan},
title={Performance Evaluation of State-of-the-Art Ranked Retrieval Methods and Their Combinations for Query Suggestion},
booktitle={Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2014)},
year={2014},
pages={141-148},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005018401410148},
isbn={978-989-758-048-2},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2014)
TI - Performance Evaluation of State-of-the-Art Ranked Retrieval Methods and Their Combinations for Query Suggestion
SN - 978-989-758-048-2
AU - Plansangket S.
AU - Q. Gan J.
PY - 2014
SP - 141
EP - 148
DO - 10.5220/0005018401410148