arrow
Return

PALF: Replicated Write-Ahead Logging for Distributed Databases

delete2024-11-08
delete0
PRE
AI
F
Fusheng Han
H
Hao Liu
B
Bin Chen
D
Debin Jia
J
Jianfeng Zhou
X
Xuwang Teng
C
Chuanhui Yang
H
Huafeng Xi
W
Wei Tian
S
S. Tao
S
Sen Wang
Q
Quanqing Xu *
Z
Zhenkun Yang
DOI:10.14778/3685800.3685803delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Distributed databases have been widely researched and developed in recent years due to their scalability, availability, and consistency guarantees. The write-ahead logging (WAL) system is one of the most vital components in a database. It is still a non-trivial problem to design a replicated logging system as the foundation of a distributed database with the power of ACID transactions. This paper proposes PALF, a Paxos-backed Append-only Log File System, to address these challenges. The basic idea behind PALF is to co-design the logging system with the entire database for supporting database-specific functions and to abstract the functions as PALF primitives to power other distributed systems. Many database functions, including transaction processing, database restore, and physical standby databases, have been built based on PALF primitives. Evaluation shows that PALF greatly outperforms well-known implementations of consensus protocols and is fully competent for distributed database workloads. PALF has been deployed as a component of the OceanBase 4.0 database and has been made open-source along with it.
Keywords:
BROADCAST
OCEANBASE

Journal

P
Proceedings of the VLDB Endowment
IF:
3.3
Papers:
563
Citations:
1.2W

Organization

O
oceanbase
Scholars:
12
Papers: 1
Citations: 1
A
Ant Grp
Scholars:
45
Papers: 14
Citations: 2
Cited Papers

Cited Papers

OceanBase
err2022-09-29
err0
PREAI
errZhenkun Yang; Chuanhui Yang; Fusheng Han; Mingqiang Zhuang; Bing Yang; Zhifeng Yang; Xiaojun Cheng; Yuzhong Zhao; Wenhui Shi; Huafeng Xi; Huang Yu; Bin Liu; Yi Pan; Boxue Yin; Junquan Chen; Quanqing Xu
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Cornus
err2022-11-23
err0
PREAI
errZhihan Guo; Xinyu Zeng; Kan Wu; Wuh-Chwen Hwang; Ziwei Ren; Xiangyao Yu; Mahesh Balakrishnan; Philip A. Bernstein
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
errShare
errSave
CockroachDB: The Resilient Geo-Distributed SQL Database
err2020-05-31
err0
errOAAI
errRebecca Taft; Irfan Sharif; Andrei Matei; Nathan VanBenschoten; Jordan Lewis; Tobias Grieger; Kai Niemi; Andy Woods; Anne Birzin; Raphael Poss; Paul Bardea; Amruta Ranade; Ben Darnell; Bram Gruneir; Justin Jaffray; Lucy Zhang; Peter Mattis
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
The log-structured merge-tree (LSM-tree)
err1996-06-01
err0
PREAI
errPatrick O’Neil; Edward Cheng; Dieter Gawlick; Elizabeth O’Neil
errShare
errSave
researcher View more