arrow
返回

Statistical inference in retrieval effectiveness evaluation

delete1997-07-01
delete68
PRE
AI
J
Jacques Savoy
DOI:10.1016/S0306-4573(97)00027-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Evaluation methodology, and particularly its statistical tests associated, plays a central role in the information retrieval domain which maintains a strong empirical tradition. In an effort to evaluate the retrieval effectiveness of a search algorithm, this paper focuses on the average precision over a set of fixed recall values. After reviewing traditional evaluation methodology through the use of examples, this study suggests applying another statistical inference methodology called bootstrap, within which no particular assumption is needed about the distribution of the observations. Moreover, this scheme may be used to assert the accuracy of virtually any statistic, to build approximate confidence interval, and to verify whether a statistically significant difference exists between two retrieval schemes, even when dealing with a relatively small sample size. This study also suggests selecting the sample median rather than the sample mean in evaluating retrieval effectiveness where the justification for this choice is based on the nature of the information retrieval data. (C) 1997 Elsevier Science Ltd.
Keyword:
INFORMATION-RETRIEVAL
RELEVANCE
ALGORITHM
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
Information Processing and Management
IF:
6.9
论文数:
5.2K
被引数:
1.4W

机构

暂无机构信息
引用论文

引用论文

Movement quality and links to measures of fitness in firefighters
errWork
IF0
err2013-01-01
err0
PREAI
errStuart McGill; David Frost; Jordan Andersen; Ian Crosby; Darren Gardiner
err分享
err收藏
Cold pressed avocado (Persea americana Mill.) oil
err2020-01-01
err0
PREAI
errValeria da Silva Santos; Gabriel Deschamps Fernandes
err分享
err收藏
COMPARAÇÃO ENTRE OS DADOS DE VENTO DAS REANÁLISES METEOROLÓGICAS ERA-INTERIM E CFSR COM OS DADOS DAS ESTAÇÕES AUTOMÁTICAS DO INMET NO RIO GRANDE DO SUL
err2016-07-20
err0
errOAAI
errEduardo Stüker; Cristiano Henrique Schuster; Jean Jonathan Schuster; Daniel Caetano Santos; Luis Eduardo Medeiros; Felipe Denardin Costa; Giuliano Demarco; Franciano Scremin Puhales
err分享
err收藏
The Difference in Autofluorescence Features of Lipofuscin between Brain and Adrenal
err1995-06-01
err0
errOAAI
errYasuhiro Mochizuki; Min Kyun Park; Takao Mori; Seiichiro Kawashima
err分享
err收藏
学者 查看更多内容