arrow
返回

Differentially private Riemannian optimization

delete2024-02-01
delete0
delete
OA
AI
A
Andi Han *
B
Bamdev Mishra
P
Pratik Jawanpuria
Junbin Gao 封面图
Junbin Gao (Junbin Gao)
DOI:10.1007/s10994-023-06508-5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we study the differentially private empirical risk minimization problem where the parameter is constrained to a Riemannian manifold. We introduce a framework for performing differentially private Riemannian optimization by adding noise to the Riemannian gradient on the tangent space. The noise follows a Gaussian distribution intrinsically defined with respect to the Riemannian metric on the tangent space. We adapt the Gaussian mechanism from the Euclidean space to the tangent space compatible to such generalized Gaussian distribution. This approach presents a novel analysis as compared to directly adding noise on the manifold. We further prove privacy guarantees of the proposed differentially private Riemannian (stochastic) gradient descent using an extension of the moments accountant technique. Overall, we provide utility guarantees under geodesic (strongly) convex, general nonconvex objectives as well as under the Riemannian Polyak-Lojasiewicz condition. Empirical results illustrate the versatility and efficacy of the proposed framework in several applications.
Keyword:
Riemannian manifold
Riemannian optimization
Stochastic optimization
Differential privacy
Empirical risk minimization
Tangent Gaussian

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

U
University of Sydney
学者数:
6.5W
论文数: 6.2W
被引数: 90
引用论文

引用论文

The relationship of monodentate and bidentate coordinated uranium(VI) sulfate in aqueous solution
err2009-09-25
err0
PREAI
errChristoph Hennig; A. Ikeda; K. Schmeide; Vinzenz Brendler; Henry Moll; S. Tsushima; A. C. Scheinost; Suntharalingam Skanthakumar; R. Wilson; L. Soderholm; K. Servaes; et al.
err分享
err收藏
err分享
err收藏
Tear Gas Dermatitis
err2007-05-31
err0
PREAI
errYoung Suck Ro; Chang Woo Lee
err分享
err收藏
A quantitative theory of coherent delocalization
err2014-03-05
err0
errOAAI
errFederico Levi; Florian Mintert
err分享
err收藏
err分享
err收藏
Safety and tolerability of inhaled hypertonic saline in young children with cystic fibrosis
err2008-09-30
err0
PREAI
errElisabeth P. Dellon; Scott H. Donaldson; Robin Johnson; Stephanie D. Davis
err分享
err收藏
Amniotic fluid contains tissue factor, a potent initiator of coagulation
err1991-11-01
err0
PREAI
errCharles J. Lockwood; Ronald Bach; Arabinda Guha; Xiaodong Zhou; Wayne A. Miller; Yale Nemerson
err分享
err收藏
Identification of Small Molecules that Disrupt Signaling between ABL and Its Positive Regulator RIN1
err2015-03-26
err0
errOAAI
errPamela Y. Ting; Robert Damoiseaux; Björn Titz; Kenneth A. Bradley; Thomas G. Graeber; Virneliz Fernández-Vega; Thomas D. Bannister; Peter Chase; Reji Nair; Louis Scampavia; Peter Hodder; Timothy P. Spicer; John Colicelli
err分享
err收藏
学者 查看更多内容