arrow
Return

Virtual Denormalization via Array Index Reference for Main Memory OLAP

delete2016-04-01
delete13
delete
OA
AI
Y
Yansong Zhang
X
Xuan Zhou *
张颖 cover
张颖 (Ying Zhang)
Z
Zhang, Yu
S
Shan Wang
DOI:10.1109/TKDE.2015.2499199delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Denormalization is a common tactic for enhancing performance of data warehouses, though its side-effect is quite obvious. Besides being confronted with update abnormality, denormalization has to consume additional storage space. As a result, this tactic is rarely used in main memory databases, which regards storage space, i.e., RAM, as scarce resource. Nevertheless, our research reveals that main memory database can benefit enormously from denormalization, as it is able to remarkably simplify the query processing plans and reduce the computation cost. In this paper, we present A-Store, a main memory OLAP engine customized for star/snowflake schemas. Instead of generating fully materialized denormalization, A-Store resorts to virtual denormalization by treating array indexes as primary keys. This design allows us to harvest the benefit of denormalization without sacrificing additional RAM space. A-Store uses a generic query processing model for all SPJGA queries. It applies a number of state-of-the-art optimization methods, such as vectorized scan and aggregation, to achieve superior performance. Our experiments show that A-Store outperforms the most prestigious MMDB systems significantly in star/snowflake schema based query processing.
Keywords:
Main-memory
OLAP
denormalization
A-Store
array index

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

R
Renmin University of China
Scholars:
8.1K
Papers: 7.7K
Citations: 1.1W
Cited Papers

Cited Papers

A meta‐synthesis of qualitative studies on stress urinary incontinence in women for the development of a Core Outcome Set: A systematic review
err2021-10-11
err0
PREAI
errMaria Patricia Rada; Stephanie Jones; Cornelia Betschart; Gabriele Falconi; Jorge Milhem Haddad; Stergios K. Doumouchtsis
errShare
errSave
Preparation of spermatogenic cell populations at specific stages of differentiation in the human
err2005-02-04
err0
PREAI
errY. Blanchard; M. T. Lavault; D. Quernee; D. Le Lannou; B. Lobel; D. Lescoat
errShare
errSave
Breaking the Memory Wall in MonetDB
err2008-12-01
err143
errOAAI
errBoncz, Peter A.; Kersten, Martin L.; Manegold, Stefan
errShare
errSave
errShare
errSave
errShare
errSave
Denormalization strategies for data retrieval from data warehouses
err2006-10-01
err37
PREAI
errShin, Seung Kyoon; Sanders, G. Lawrence
errShare
errSave
researcher View more