arrow
返回

AnalyticDB-PG: A Cloud-Native High-Performance Data Warehouse in Alibaba Cloud

delete2025-08-01
delete0
PRE
AI
F
Fangyuan Zhang *
Y
Yin, Caihua
H
Hua Fan
F
F. Fang
Y
Yineng Chen
X
Xuqi Wang
M
Mengqi Wu
陈
陈冰 (Bing Chen)
T
Tianbo Jin
S
Sibo Wang
DOI:10.14778/3750601.3750633delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In the era of big data, the landscape of data management and ana-lytics has significantly transformed, presenting diverse challengesfor cloud platforms. Modern data warehouses face increasing chal-lenges in handling hybrid transactional and analytical processing(HTAP) workloads efficiently in cloud environments. Traditionalshared-nothing architectures provide high-performance query exe-cution but suffer from high storage costs and limited elasticity, whileshared-storage approaches improve scalability but often strugglewith query efficiency due to increased data movement and indexingoverhead. Furthermore, existing execution engines lack optimizedsupport for vectorized processing and real-time analytics, limitingtheir ability to handle large-scale workloads efficiently. To address these limitations, we introduce AnalyticDB-PG (ADB-PG), a cloud-native, high-performance data warehouse designedfor modern analytical workloads. It integrates a unified architec-ture supporting both Shared-Nothing and Shared-Storage modes,allowing flexible deployment and seamless elasticity. In ADB-PG,we introduce Beam, a hybrid storage engine that efficiently bal-ances row-based and columnar storage for real-time analytics, andLaser, an optimized execution engine leveraging vectorized execu-tion and Just-In-Time compilation to accelerate query processing.The system further incorporates advanced indexing mechanisms,adaptive runtime filtering, and dictionary encoding to enhanceperformance. Extensive evaluations on TPC-H and TPC-DS bench-marks demonstrate that ADB-PG achieves significant performanceimprovements while reducing storage and operational costs, mak-ing it a compelling solution for modern cloud-based data analytics
Keyword:
CHALLENGES

期刊

P
Proceedings of the VLDB Endowment
IF:
3.3
论文数:
563
被引数:
1.2W

机构

U
University of Hong Kong
学者数:
4.1W
论文数: 3.9W
被引数: 10.1W
A
Alibaba Group
学者数:
306
论文数: 114
被引数: 0
引用论文

引用论文

TiDB
err2020-09-14
err0
PREAI
errDongxu Huang; Qi Liu; Qiu Cui; Zhuhe Fang; Xiaoyu Ma; Fei Xu; Li Shen; Liu Tang; Yuxing Zhou; Menglong Huang; Wan Wei; Cong Liu; Jian Zhang; Jianjun Li; Xuelian Wu; Lingyu Song; Ruoxi Sun; Shuaipeng Yu; Lei Zhao; Nicholas Cameron; Liquan Pei; Xin Tang
err分享
err收藏
CockroachDB: The Resilient Geo-Distributed SQL Database
err2020-05-31
err0
errOAAI
errRebecca Taft; Irfan Sharif; Andrei Matei; Nathan VanBenschoten; Jordan Lewis; Tobias Grieger; Kai Niemi; Andy Woods; Anne Birzin; Raphael Poss; Paul Bardea; Amruta Ranade; Ben Darnell; Bram Gruneir; Justin Jaffray; Lucy Zhang; Peter Mattis
err分享
err收藏
AnalyticDB-V
err2020-09-14
err0
PREAI
errChuangxian Wei; Bin Wu; Sheng Wang; Renjie Lou; Chaoqun Zhan; Feifei Li; Yuanzhe Cai
err分享
err收藏
Spanner
err2013-08-01
err0
errOAAI
errJames C. Corbett; Jeffrey Dean; Michael Epstein; Andrew Fikes; Christopher Frost; J. J. Furman; Sanjay Ghemawat; Andrey Gubarev; Christopher Heiser; Peter Hochschild; Wilson Hsieh; Sebastian Kanthak; Eugene Kogan; Hongyi Li; Alexander Lloyd; Sergey Melnik; David Mwaura; David Nagle; Sean Quinlan; Rajesh Rao; Lindsay Rolig; Yasushi Saito; Michal Szymaniak; Christopher Taylor; Ruth Wang; Dale Woodford
err分享
err收藏
Amazon Aurora
err2017-05-09
err0
PREAI
errAlexandre Verbitski; Anurag Gupta; Debanjan Saha; Murali Brahmadesam; Kamal Gupta; Raman Mittal; Sailesh Krishnamurthy; Sandor Maurice; Tengiz Kharatishvili; Xiaofeng Bao
err分享
err收藏
The mixed workload CH-benCHmark
err2011-06-13
err0
PREAI
errRichard Cole; Florian Funke; Leo Giakoumakis; Wey Guy; Alfons Kemper; Stefan Krompass; Harumi Kuno; Raghunath Nambiar; Thomas Neumann; Meikel Poess; Kai-Uwe Sattler; Michael Seibold; Eric Simon; Florian Waas
err分享
err收藏
Towards Millions of Database Transmission Services in the Cloud面向云中数百万数据库传输服务
err2024-11-08
err0
PREAI
errFan, Hua; Fu, Dachao; Wang, Xu; Zhang, Jiachi; Zuo, Chaoji; Wu, Zhengyi; Zhang, Miao; Yuan, Kang; Ni, Xizi; Huo, Guocheng; Zhou, Wenchao; Li, Feifei; Zhou, Jingren
err分享
err收藏
Database Meets Deep Learning
err2016-09-28
err0
errOAAI
errWei Wang; Meihui Zhang; Gang Chen; H. V. Jagadish; Beng Chin Ooi; Kian-Lee Tan
err分享
err收藏
ClickHouse - Lightning Fast Analytics for EveryoneClickHouse - 为每个人提供闪电般快速的分析
err2024-11-08
err1
PREAI
errSchulze, Robert; Schreiber, Tom; Yatsishin, Ilya; Dahimene, Ryadh; Milovidov, Alexey
err分享
err收藏
学者 查看更多内容