arrow
Return

Choosing document structure weights

delete2005-03-01
delete34
PRE
AI
A
Andrew Trotman
DOI:10.1016/j.ipm.2003.10.003delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Existing ranking schemes assume all term occurrences in a given document are of equal influence. Intuitively, terms occurring in some places should have a greater influence than those elsewhere. An occurrence in an abstract may be more important than an occurrence in the body text. Although this observation is not new, there remains the issue of finding good weight: for each structure. Vector space, probability, and Okapi BM25 ranking are extended to include structure weighting. Weights are then selected for the TREC WSJ collection using a genetic algorithm. The learned weights are then tested on an evaluation set of queries. Structure weighted vector :space inner product and structure weighted probabilistic retrieval show an about 5% improvement in mean average precision over their unstructured counterparts. Structure weighted BM25 shows nearly no improvement. Analysis suggests BM25 cannot be improved using structure weighting. (C) 2003 Elsevier Ltd. All rights reserved.
Keywords:
structured information retrieval
genetic algorithms
vector space model
probability model
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

I
Information Processing and Management
IF:
6.9
Papers:
5.2K
Citations:
1.4W

Organization

No organization information available
Cited Papers

Cited Papers

VECTOR-SPACE MODEL FOR AUTOMATIC INDEXING
err1975-11-01
err4.8K
errOAAI
errSALTON, G; WONG, A; YANG, CS
errShare
errSave
Pituitary Microadenoma
err2016-08-30
err0
PREAI
errW. Wu; K.-Å. Thuomas
errShare
errSave
The Poincaré-sphere approach to polarization: Formalism and new labs with Poincaré beams
err2016-11-01
err0
PREAI
errJoshua A. Jones; Anthony J. D’Addario; Brett L. Rojec; G. Milione; Enrique J. Galvez
errShare
errSave
researcher View more