arrow
Return

Pilotfish: Distributed Execution for Scalable Blockchains

delete2026-01-01
delete0
PRE
AI
Q
Quentin Kniep
L
Lefteris Kokoris-Kogias
A
Alberto Sonnino
I
Igor Zablotchi *
N
Nuda Zhang
DOI:10.1007/978-3-032-07024-1_17delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Scalability is a crucial requirement for modern large-scale systems, enabling elasticity and ensuring responsiveness under varying load. While cloud systems have achieved scalable architectures, blockchain systems remain constrained by the need to over-provision validator machines to handle peak load. This leads to resource inefficiency, poor cost scaling, and limits on performance. To address these challenges, we introduce Pilotfish, the first scale-out transaction execution engine for blockchains. Pilotfish enables validators to scale horizontally by distributing transaction execution across multiple worker machines, allowing elasticity without compromising consistency or determinism. It integrates seamlessly with the lazy blockchain architecture, completing the missing piece of execution elasticity. To achieve this, Pilotfish tackles several key challenges: ensuring scalable and strongly consistent distributed transactions, handling partial crash recovery with lightweight replication, and maintaining concurrency with a novel versioned-queue scheduling algorithm. Our evaluation shows that Pilotfish scales linearly up to at least eight workers per validator for compute-bound workloads, while maintaining low latency. By solving scalable execution, Pilotfish brings blockchains closer to achieving end-to-end elasticity, unlocking new possibilities for efficient and adaptable blockchain systems.
Keywords:
TRANSACTIONS

Journal

F
FINANCIAL CRYPTOGRAPHY AND DATA SECURITY, FC 2025, PT I
IF:
0
Papers:
23
Citations:
0

Organization

I
institute of science & technology - austria
Scholars:
1.5K
Papers: 1.2K
Citations: 2
U
university college london
Scholars:
8.9K
Papers: 4.8K
Citations: 1
E
eth zurich
Scholars:
2.3K
Papers: 1.1K
Citations: 0
S
swiss federal institutes of technology domain
Scholars:
9.0W
Papers: 8.0W
Citations: 163
researcher View more organizations
Cited Papers

Cited Papers

Calvin
err2012-05-20
err0
PREAI
errAlexander Thomson; Thaddeus Diamond; Shu-Chun Weng; Kun Ren; Philip Shao; Daniel J. Abadi
errShare
errSave
Sui Lutris: A Blockchain Combining Broadcast and Consensus
err2024-12-02
err0
PREAI
errBlackshear,Sam; Chursin,Andrey; Danezis,George; Kichidis,Anastasios; Kokoris-Kogias,Lefteris; Li,Xun; Logan,Mark; Menon,Ashok; Nowacki,Todd; Sonnino,Alberto; Williams,Brandon; Zhang,Lu
errShare
errSave
Fast Distributed Transactions and Strongly Consistent Replication for OLTP Database Systems
err2014-05-26
err0
errOAAI
errAlexander Thomson; Thaddeus Diamond; Shu-Chun Weng; Kun Ren; Philip Shao; Daniel J. Abadi
errShare
errSave
Block-STM
err2023-02-21
err0
PREAI
errRati Gelashvili; Alexander Spiegelman; Zhuolun Xiang; George Danezis; Zekun Li; Dahlia Malkhi; Yu Xia; Runtian Zhou
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
SLOG
err2019-07-01
err0
PREAI
errKun Ren; Dennis Li; Daniel J. Abadi
errShare
errSave
QueCC
err2018-11-26
err0
PREAI
errThamir M. Qadah; Mohammad Sadoghi
errShare
errSave
High performance transactions via early write visibility
err2017-01-01
err0
PREAI
errJose M. Faleiro; Daniel J. Abadi; Joseph M. Hellerstein
errShare
errSave
errShare
errSave
researcher View more