arrow
Return

PALF: Replicated Write-Ahead Logging for Distributed Databases

delete2024-11-08
delete0
PRE
AI
F
Fusheng Han
H
Hao Liu
B
Bin Chen
D
Debin Jia
J
Jianfeng Zhou
X
Xuwang Teng
C
Chuanhui Yang
H
Huafeng Xi
W
Wei Tian
S
S. Tao
S
Sen Wang
Q
Quanqing Xu *
Z
Zhenkun Yang
DOI:10.14778/3685800.3685803delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Distributed databases have been widely researched and developed in recent years due to their scalability, availability, and consistency guarantees. The write-ahead logging (WAL) system is one of the most vital components in a database. It is still a non-trivial problem to design a replicated logging system as the foundation of a distributed database with the power of ACID transactions. This paper proposes PALF, a Paxos-backed Append-only Log File System, to address these challenges. The basic idea behind PALF is to co-design the logging system with the entire database for supporting database-specific functions and to abstract the functions as PALF primitives to power other distributed systems. Many database functions, including transaction processing, database restore, and physical standby databases, have been built based on PALF primitives. Evaluation shows that PALF greatly outperforms well-known implementations of consensus protocols and is fully competent for distributed database workloads. PALF has been deployed as a component of the OceanBase 4.0 database and has been made open-source along with it.
Keywords:
BROADCAST
OCEANBASE

Journal

P
Proceedings of the VLDB Endowment
IF:
3.3
Papers:
553
Citations:
1.2W

Organization

O
oceanbase
Scholars:
12
Papers: 1
Citations: 1
A
Ant Grp
Scholars:
45
Papers: 14
Citations: 2