arrow
Return

Index Intersection for High-Dimensional Range Queries

delete2025-12-01
delete0
PRE
AI
M
Maximilian Berens *
J
Jens Teubner
DOI:10.14778/3785297.3785315delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
For high-dimensional analytics queries in scientific domains, a full table scan is often seen as the only feasible execution path, even if result cardinalities are known to be small. In this paper, we argue for intersecting multiple indices built over medium-sized attribute subsets (Teams) as a means to produce a list of (candidate) tuple IDs for further processing. While this strategy is compatible with various index structures, significant discriminative power lies in the combined selectivity of multiple predicates. Akin to bitmap indices and VA-files, adopting simple and lightweight index approaches for each Team, instead of highly accurate but costly ones, still enables high overall selectivity and precision. Thus, the focus shifts away from individual indices towards their efficient intersection. Teams with just 1 member/attribute (bitmap indices) are outperformed for selective queries due to the inability to avoid access to large parts of the index. For example, Teams with 5 members are up to 6-7 times faster for 85 dimensions and require 1.58-2.07 times less storage. Team-based Indexing is most useful for queries with high selectivity and dimensionality, such as the search for rare objects.
Keywords:
Team-based Indexing
High-dimensional analytics
Index intersection
Selective queries
Range queries

Journal

P
Proceedings of the VLDB Endowment
IF:
3.3
Papers:
563
Citations:
1.2W

Organization

D
dortmund university of technology
Scholars:
9.4K
Papers: 9.1K
Citations: 15
Cited Papers

Cited Papers

Better bitmap performance with Roaring bitmaps
err2015-04-21
err0
errOAAI
errSamy Chambi; Daniel Lemire; Owen Kaser; Robert Godin
errShare
errSave
Introduction to Information Retrieval
err
IF0
err2012-06-05
err0
errOAAI
errChristopher D. Manning; Prabhakar Raghavan; Hinrich Schütze
errShare
errSave
Learned cardinality estimation
err2022-01-14
err0
PREAI
errJi Sun; Jintao Zhang; Zhaoyan Sun; Guoliang Li; Nan Tang
errShare
errSave
Efficient Set Intersection for Inverted Indexing
err2010-12-27
err85
PREAI
errCulpepper, J. Shane; Moffat, Alistair
errShare
errSave
Efficient binning for bitmap indices on high-cardinality attributes
err
IF0
err
err0
PREAI
errRotem,Doron; Stockinger,Kurt; Wu,Kesheng
errShare
errSave
The Sloan Digital Sky Survey: Technical summary
err2000-09-01
err9.3K
errOAAI
errYork, DG; Adelman, J; Anderson, JE; Anderson, SF; Annis, J; Bahcall, NA; Bakken, JA; Barkhouser, R; Bastian, S; Berman, E; Boroski, WN; Bracker, S; Briegel, C; Briggs, JW; Brinkmann, J; Brunner, R; Burles, S; Carey, L; Carr, MA; Castander, FJ; Chen, B; Colestock, PL; Connolly, AJ; Crocker, JH; Csabai, I; Czarapata, PC; Davis, JE; Doi, M; Dombeck, T; Eisenstein, D; Ellman, N; Elms, BR; Evans, ML; Fan, XH; Federwitz, GR; Fiscelli, L; Friedman, S; Frieman, JA; Fukugita, M; Gillespie, B; Gunn, JE; Gurbani, VK; de Haas, E; Haldeman, M; Harris, FH; Hayes, J; Heckman, TM; Hennessy, GS; Hindsley, RB; Holm, S; Holmgren, DJ; Huang, CH; Hull, C; Husby, D; Ichikawa, S; Ichikawa, T; Ivezic, Z; Kent, S; Kim, RSJ; Kinney, E; Klaene, M; Kleinman, AN; Kleinman, S; Knapp, GR; Korienek, J; Kron, RG; Kunszt, PZ; Lamb, DQ; Lee, B; Leger, RF; Limmongkol, S; Lindenmeyer, C; Long, DC; Loomis, C; Loveday, J; Lucinio, R; Lupton, RH; MacKinnon, B; Mannery, EJ; Mantsch, PM; Margon, B; McGehee, P; McKay, TA; Meiksin, A; Merelli, A; Monet, DG; Munn, JA; Narayanan, VK; Nash, T; Neilsen, E; Neswold, R; Newberg, HJ; Nichol, RC; Nicinski, T; Nonino, M; Okada, N; Okamura, S; Ostriker, JP; Owen, R; Pauls, AG; Peoples, J; Peterson, RL; Petravick, D; Pier, JR; Pope, A; Pordes, R; Prosapio, A; Rechenmacher, R; Quinn, TR; Richards, GT; Richmond, MW; Rivetta, CH; Rockosi, CM; Ruthmansdorfer, K; Sandford, D; Schlegel, DJ; Schneider, DP; Sekiguchi, M; Sergey, G; Shimasaku, K; Siegmund, WA; Smee, S; Smith, JA; Snedden, S; Stone, R; Stoughton, C; Strauss, MA; Stubbs, C; SubbaRao, M; Szalay, AS; Szapudi, I; Szokoly, GP; Thakar, AR; Tremonti, C; Tucker, DL; Uomoto, A; Berk, DV; Vogeley, MS; Waddell, P; Wang, SI; Watanabe, M; Weinberg, DH; Yanny, B; Yasuda, N
errShare
errSave
researcher View more