arrow
返回

Topic-sensitive search engine evaluation

delete2011-11-29
delete3
PRE
AI
N
Na Dai *
B
Brian D. Davison
DOI:10.1108/14684521111193184delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Purpose - This work aims to investigate the sensitivity of ranking performance with respect to the topic distribution of queries selected for ranking evaluation. Design/methodology/approach - The authors reweight queries used in two TREC tasks to make them match three real background topic distributions, and show that the performance rankings of retrieval systems are quite different. Findings - It is found that search engines tend to perform similarly on queries about the same topic; and search engine performance is sensitive to the topic distribution of queries used in evaluation. Originality/value - Using experiments with multiple real-world query logs, the paper demonstrates weaknesses in the current evaluation model of retrieval systems.
Keyword:
Search engines
Query stream
Query classification
Topic distribution
Ranking evaluation
Function evaluation
Information retrieval
Functional analysis
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Online Information Review 封面图
Online Information Review
IF:
3.5
论文数:
2.1K
被引数:
3.0K

机构

L
Lehigh University
学者数:
4.8K
论文数: 5.1K
被引数: 6.3K
引用论文

引用论文

Fellow eye comparison between alcohol-assisted and single-step transepithelial photorefractive keratectomy: late mid-term outcomes
err2020-06-18
err0
PREAI
errAlexander Harold Rodriguez; Virgilio Galvis; Alejandro Tello; Margarita María Parra; Marcela Ángela Rojas; Samuel Arba-Mosquera; Anthony Paul Camacho
err分享
err收藏
Hierarchical Data-Driven Analysis of Clinical Symptoms Among Patients With Parkinson's Disease
err2019-05-21
err0
errOAAI
errTal Kozlovski; Alexis Mitelpunkt; Avner Thaler; Tanya Gurevich; Avi Orr-Urtreger; Mali Gana-Weisz; Netta Shachar; Tal Galili; Mira Marcus-Kalish; Susan Bressman; Karen Marder; Nir Giladi; Yoav Benjamini; Anat Mirelman
err分享
err收藏
Dynamic imaging of vocal fold oscillation with four‐dimensional optical coherence tomography
err2010-06-25
err0
errOAAI
errJames B. Kobler; Ernest W. Chang; Steven M. Zeitels; Seok‐Hyun Yun
err分享
err收藏
Evaluating the accuracy of implicit feedback from clicks and query reformulations in Web search
err2007-04-01
err387
errOAAI
errJoachims, Thorsten; Granka, Laura; Pan, Bing; Hembrooke, Helene; Radlinski, Filip; Gay, Geri
err分享
err收藏
学者 查看更多内容