arrow
返回

Engineering Basic Algorithms of an In-Memory Text Search Engine

delete2010-12-27
delete23
PRE
AI
F
Frederik Transier *
P
Peter Sanders
DOI:10.1145/1877766.1877768delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Inverted index data structures are the key to fast text search engines. We first investigate one of the predominant operation on inverted indexes, which asks for intersecting two sorted lists of document IDs of different lengths. We explore compression and performance of different inverted list data structures. In particular, we present Lookup, a new data structure that allows intersection in expected time linear in the smaller list. Based on this result, we present the algorithmic core of a full text data base that allows fast Boolean queries, phrase queries, and document reporting using less space than the input text. The system uses a carefully choreographed combination of classical data compression techniques and inverted-index-based search data structures. Our experiments show that inverted indexes are preferable over purely suffix-array-based techniques for in-memory (English) text search engines. A similar system is now running in practice in each core of the distributed data base engine TREX of SAP.
Keyword:
Algorithms
Performance
Inverted index
in-memory search engine
randomization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Information Systems 封面图
ACM Transactions on Information Systems
IF:
9.1
论文数:
1.2K
被引数:
4.7K

机构

K
karlsruhe institute of technology
学者数:
2.0W
论文数: 1.5W
被引数: 23
H
Helmholtz Association
学者数:
13.2W
论文数: 10.7W
被引数: 145
引用论文

引用论文

Methylation Marks of Blood Leukocytes of Native Hucul Mares Differentiated in Age
err2019-06-02
err0
errOAAI
errT. Ząbek; E. Semik-Gurgul; T. Szmatoła; A. Gurgul; A. Fornal; M. Bugno-Poniewierska
err分享
err收藏
err分享
err收藏
err分享
err收藏
Polynomial identification of POD based low-order dynamical system
err2006-01-01
err0
PREAI
errLaurent Perret; Erwan Collin; Joël Delville
err分享
err收藏
Nitric Oxide Contributes to Resistance of the Brown Norway Rat to Experimental Autoimmune Encephalomyelitis
err2005-01-01
err0
errOAAI
errMaria A. Staykova; Judith T. Paridaen; William B. Cowden; David O. Willenborg
err分享
err收藏
学者 查看更多内容