arrow
Return

TDSQL: Tencent Distributed Database System

delete2024-11-08
delete0
PRE
AI
Y
Yuxing Chen
A
Anqun Pan *
H
Hailin Lei
A
Anda Ye
S
S. Han
T
Tang Yan
卢卫 cover
卢卫 (Wei Lu)
柴云鹏 cover
柴云鹏 (Yunpeng Chai)
F
Feng Zhang
X
Xiaoyong Du
DOI:10.14778/3685800.3685812delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Distributed databases have become indispensable in contemporary computing and data processing, owing to their pivotal role in ensuring high availability and scalability. They effectively cater to the requirements of data management and high-concurrency access. However, developing a distributed database system that is well-suited for diverse application scenarios, particularly for large-scale applications, presents several challenges. These challenges include ensuring data consistency and achieving high levels of performance. This paper presents TDSQL, a distributed database system that prioritizes core design principles of distributed systems, including high availability, strong consistency, and scalability. In particular, TDSQL has achieved high performance through over a decade of practical experience and optimization in various modules, such as the kernel, synchronous replication, and transaction processing, in large-scale application scenarios. By conducting the TPC-C benchmark test, TDSQL demonstrated outstanding performance, achieving a throughput of 814 million tpmC across 1650 database nodes, with a jitter rate of less than 0.2%. This jitter rate is an order of magnitude lower than the standard required, showcasing the system's stability and reliability. During the 8-hour TPC-C standard stress test, TDSQL successfully completed over 860 billion transactions and processed 40 trillion order details, with zero forced rollbacks and zero data inconsistency.
Keywords:
REPLICATION
RECOVERY
PERFORMANCE
LOCKING

Journal

P
Proceedings of the VLDB Endowment
IF:
3.3
Papers:
563
Citations:
1.2W

Organization

T
Tencent Inc
Scholars:
27
Papers: 11
Citations: 2
R
Renmin Univ China
Scholars:
637
Papers: 392
Citations: 126
Cited Papers

Cited Papers

F1
err2013-08-01
err0
PREAI
errJeff Shute; Radek Vingralek; Bart Samwel; Ben Handy; Chad Whipkey; Eric Rollins; Mircea Oancea; Kyle Littlefield; David Menestrina; Stephan Ellner; John Cieslewicz; Ian Rae; Traian Stancescu; Himani Apte
errShare
errSave
H-store
err2008-08-01
err0
PREAI
errRobert Kallman; Hideaki Kimura; Jonathan Natkins; Andrew Pavlo; Alexander Rasin; Stanley Zdonik; Evan P. C. Jones; Samuel Madden; Michael Stonebraker; Yang Zhang; John Hugg; Daniel J. Abadi
errShare
errSave
errShare
errSave
Disaggregating RocksDB: A Production Experience
err2023-06-20
err0
errOAAI
errSiying Dong; Shiva Shankar P; Satadru Pan; Anand Ananthabhotla; Dhanabal Ekambaram; Abhinav Sharma; Shobhit Dayal; Nishant Vinaybhai Parikh; Yanqin Jin; Albert Kim; Sushil Patil; Jay Zhuang; Sam Dunster; Akanksha Mahajan; Anirudh Chelluri; Chaitanya Datye; Lucas Vasconcelos Santana; Nitin Garg; Omkar Gawde
errShare
errSave
ARIES
err1992-03-01
err0
errOAAI
errC. Mohan; Don Haderle; Bruce Lindsay; Hamid Pirahesh; Peter Schwarz
errShare
errSave
Strong consistency is not hard to get
err2019-09-01
err0
errOAAI
errClaude Barthels; Ingo Müller; Konstantin Taranov; Gustavo Alonso; Torsten Hoefler
errShare
errSave
TiDB
err2020-09-14
err0
PREAI
errDongxu Huang; Qi Liu; Qiu Cui; Zhuhe Fang; Xiaoyu Ma; Fei Xu; Li Shen; Liu Tang; Yuxing Zhou; Menglong Huang; Wan Wei; Cong Liu; Jian Zhang; Jianjun Li; Xuelian Wu; Lingyu Song; Ruoxi Sun; Shuaipeng Yu; Lei Zhao; Nicholas Cameron; Liquan Pei; Xin Tang
errShare
errSave
Scalable replay-based replication for fast databases
err2017-09-01
err0
PREAI
errDai Qin; Angela Demke Brown; Ashvin Goel
errShare
errSave
MorphoSys
err2020-10-27
err0
PREAI
errMichael Abebe; Brad Glasbergen; Khuzaima Daudjee
errShare
errSave
researcher View more