arrow
Return

AnalyticDB-PG: A Cloud-Native High-Performance Data Warehouse in Alibaba Cloud

delete2025-08-01
delete0
PRE
AI
F
Fangyuan Zhang *
Y
Yin, Caihua
H
Hua Fan
F
F. Fang
Y
Yineng Chen
X
Xuqi Wang
M
Mengqi Wu
陈冰 (Bing Chen)
T
Tianbo Jin
S
Sibo Wang
DOI:10.14778/3750601.3750633delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In the era of big data, the landscape of data management and ana-lytics has significantly transformed, presenting diverse challengesfor cloud platforms. Modern data warehouses face increasing chal-lenges in handling hybrid transactional and analytical processing(HTAP) workloads efficiently in cloud environments. Traditionalshared-nothing architectures provide high-performance query exe-cution but suffer from high storage costs and limited elasticity, whileshared-storage approaches improve scalability but often strugglewith query efficiency due to increased data movement and indexingoverhead. Furthermore, existing execution engines lack optimizedsupport for vectorized processing and real-time analytics, limitingtheir ability to handle large-scale workloads efficiently. To address these limitations, we introduce AnalyticDB-PG (ADB-PG), a cloud-native, high-performance data warehouse designedfor modern analytical workloads. It integrates a unified architec-ture supporting both Shared-Nothing and Shared-Storage modes,allowing flexible deployment and seamless elasticity. In ADB-PG,we introduce Beam, a hybrid storage engine that efficiently bal-ances row-based and columnar storage for real-time analytics, andLaser, an optimized execution engine leveraging vectorized execu-tion and Just-In-Time compilation to accelerate query processing.The system further incorporates advanced indexing mechanisms,adaptive runtime filtering, and dictionary encoding to enhanceperformance. Extensive evaluations on TPC-H and TPC-DS bench-marks demonstrate that ADB-PG achieves significant performanceimprovements while reducing storage and operational costs, mak-ing it a compelling solution for modern cloud-based data analytics
Keywords:
CHALLENGES

Journal

P
Proceedings of the VLDB Endowment
IF:
3.3
Papers:
556
Citations:
1.2W

Organization

U
University of Hong Kong
Scholars:
4.1W
Papers: 3.9W
Citations: 10.1W
A
Alibaba Group
Scholars:
303
Papers: 113
Citations: 0