arrow
Return

Incremental cluster-based retrieval using compressed cluster-skipping inverted files

delete2008-06-20
delete28
delete
OA
AI
İ
İsmail Sengör Altıngövde *
E
Engin Demir
F
Fazlı Can
Ö
Özgür Ulusoy
DOI:10.1145/1361684.1361688delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We propose a unique cluster-based retrieval (CBR) strategy using a new cluster-skipping inverted file for improving query processing efficiency. The new inverted file incorporates cluster membership and centroid information along with the usual document information into a single structure. In our incremental-CBR strategy, during query evaluation, both best(-matching) clusters and the best(-matching) documents of such clusters are computed together with a single posting-list access per query term. As we switch from term to term, the best clusters are recomputed and can dynamically change. During query-document matching, only relevant portions of the posting lists corresponding to the best clusters are considered and the rest are skipped. The proposed approach is essentially tailored for environments where inverted files are compressed, and provides substantial efficiency improvement while yielding comparable, or sometimes better, effectiveness figures. Our experiments with various collections show that the incremental- CBR strategy using a compressed cluster-skipping inverted file significantly improves CPU time efficiency, regardless of query length. The new compressed inverted file imposes an acceptable storage overhead in comparison to a typical inverted file. We also show that our approach scales well with the collection size.
Keywords:
experimentation
measurement
performance
best match
cluster-based retrieval (CBR)
cluster-skipping inverted index structure (CS-IIS)
full search (FS)
index compression
inverted index structure (IIS)
query processing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ACM Transactions on Information Systems cover
ACM Transactions on Information Systems
IF:
9.1
Papers:
1.2K
Citations:
4.7K

Organization

I
ihsan dogramaci bilkent university
Scholars:
3.6K
Papers: 3.5K
Citations: 8