返回
Topic-sensitive search engine evaluation
DOI:10.1108/14684521111193184.png)
摘要
En 中文
Purpose - This work aims to investigate the sensitivity of ranking performance with respect to the topic distribution of queries selected for ranking evaluation. Design/methodology/approach - The authors reweight queries used in two TREC tasks to make them match three real background topic distributions, and show that the performance rankings of retrieval systems are quite different. Findings - It is found that search engines tend to perform similarly on queries about the same topic; and search engine performance is sensitive to the topic distribution of queries used in evaluation. Originality/value - Using experiments with multiple real-world query logs, the paper demonstrates weaknesses in the current evaluation model of retrieval systems.
Keyword:
Search engines
Query stream
Query classification
Topic distribution
Ranking evaluation
Function evaluation
Information retrieval
Functional analysis
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.5
论文数:
2.1K
被引数:
3.0K

