arrow
返回

Two-Stage Document Length Normalization for Information Retrieval

delete2015-02-17
delete9
delete
OA
AI
S
Seung‐Hoon Na *
DOI:10.1145/2699669delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The standard approach for term frequency normalization is based only on the document length. However, it does not distinguish the verbosity from the scope, these being the two main factors determining the document length. Because the verbosity and scope have largely different effects on the increase in term frequency, the standard approach can easily suffer from insufficient or excessive penalization depending on the specific type of long document. To overcome these problems, this article proposes two-stage normalization by performing verbosity and scope normalization separately, and by employing different penalization functions. In verbosity normalization, each document is prenormalized by dividing the term frequency by the verbosity of the document. In scope normalization, an existing retrieval model is applied in a straightforward manner to the prenormalized document, finally leading us to formulate our proposed verbosity normalized (VN) retrieval model. Experimental results carried out on standard TREC collections demonstrate that the VN model leads to marginal but statistically significant improvements over standard retrieval models.
Keyword:
Algorithms
Experimentation
Performance
Theory
Verbosity normalization
scope normalization
document length normalization
retrieval heuristics
term frequency
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Information Systems 封面图
ACM Transactions on Information Systems
IF:
9.1
论文数:
1.2K
被引数:
4.7K

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
err分享
err收藏
err分享
err收藏
Correction pen based paper fluidic device for the detection of multiple gene targets of Leptospira using Loop Mediated Isothermal Amplification
err2020-07-01
err0
PREAI
errVenkatesh Varsha; Sitaraman Aishwarya; Sarma Murchana; Gattuboyena Naveen; Mohandass Ramya; Pasupathi Rathinasabapathi
err分享
err收藏
Multifaceted Quadruplet of Low-Lying Spin-Zero States in Ni66 : Emergence of Shape Isomerism in Light Nuclei
err2017-04-20
err0
errOAAI
errS. Leoni; B. Fornal; N. Mărginean; M. Sferrazza; Y. Tsunoda; T. Otsuka; G. Bocchi; F. C. L. Crespi; A. Bracco; S. Aydin; M. Boromiza; D. Bucurescu; N. Cieplicka-Oryǹczak; C. Costache; S. Călinescu; N. Florea; D. G. Ghiţă; T. Glodariu; A. Ionescu; Ł.W. Iskra; M. Krzysiek; R. Mărginean; C. Mihai; R. E. Mihai; A. Mitu; A. Negreţ; C. R. Niţă; A. Olăcel; A. Oprea; S. Pascu; P. Petkov; C. Petrone; G. Porzio; A. Şerban; C. Sotty; L. Stan; I. Ştiru; L. Stroe; R. Şuvăilă; S. Toma; A. Turturică; S. Ujeniuc; C. A. Ur
err分享
err收藏
err分享
err收藏
A COMPARATIVE ANALYSIS OF UREMIC AND NONUREMIC CALCIPHYLAXIS尿毒症与非尿毒症钙化防御的对比分析
err2025-04-01
err0
PREAI
errSeto, Aaron; El Mouhayyar, Christopher; Ouyang, Tianqi; Bouchouar, Houda; Nigwekar, Sagar
err分享
err收藏
学者 查看更多内容