arrow
Return

Differentially Private Stream Processing at Scale

delete2024-11-08
delete0
delete
OA
AI
B
Bing Zhang *
V
Vadym Doroshenko
P
Peter Kairouz
T
Thomas Steinke
A
Abhradeep Thakurta
Z
Ziyin Ma
E
E. Cohen
H
Himani Apte
J
Jodi Spacek
DOI:10.14778/3685800.3685833delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We design, to the best of our knowledge, the first differentially private (DP) stream aggregation processing system at scale. Our system - Differential Privacy SQL Pipelines (DP-SQLP) - is built using a streaming framework similar to Spark streaming, and is built on top of the Spanner database and the F1 query engine from Google. Towards designing DP-SQLP we make both algorithmic and systemic advances, namely, we (i) design a novel (user-level) DP key selection algorithm that can operate on an unbounded set of possible keys, and can scale to one billion keys that users have contributed, (ii) design a preemptive execution scheme for DP key selection that avoids enumerating all the keys at each triggering time, and (iii) use algorithmic techniques from DP continual observation to release a continual DP histogram of user contributions to different keys over the stream length. We empirically demonstrate the efficacy by obtaining at least 16x reduction in error over meaningful baselines we consider. We implemented a streaming differentially private user impressions for Google Shopping with DP-SQLP. The streaming DP algorithms are further applied to Google Trends.

Journal

P
Proceedings of the VLDB Endowment
IF:
3.3
Papers:
556
Citations:
1.2W

Organization

G
google res
Scholars:
318
Papers: 30
Citations: 60
G
google deepmind
Scholars:
229
Papers: 60
Citations: 44
G
Google
Scholars:
246
Papers: 97
Citations: 4
researcher View more organizations