arrow
返回

Bounding information leakage in machine learning

delete2023-05-01
delete5
delete
OA
AI
G
Ganesh Del Grosso *
G
Georg Pichler
C
Catuscia Palamidessi
P
Pablo Piantanida
DOI:10.1016/j.neucom.2023.02.058delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Recently, it has been shown that Machine Learning models can leak sensitive information about their training data. This information leakage is exposed through membership and attribute inference attacks. Although many attack strategies have been proposed, little effort has been made to formalize these problems. We present a novel formalism, generalizing membership and attribute inference attack setups previously studied in the literature and connecting them to memorization and generalization. First, we derive a universal bound on the success rate of inference attacks and connect it to the generalization gap of the target model. Second, we study the question of how much sensitive information is stored by the algorithm about its training set and we derive bounds on the mutual information between the sensitive attributes and model parameters. Experimentally, we illustrate the potential of our approach by applying it to both synthetic data and classification tasks on natural images. Finally, we apply our formalism to different attribute inference strategies, with which an adversary is able to recover the identity of writers in the PenDigits dataset.
Keyword:
Membership inference
Privacy
Attacks in machine learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

E
Ecole Polytechnique
学者数:
6.6K
论文数: 4.8K
被引数: 211
I
institut polytechnique de paris
学者数:
1.3W
论文数: 1.0W
被引数: 6
引用论文

引用论文

Explanation, prediction, and causality: Three sides of the same coin?
err
IF0
err2018-10-31
err0
errOAAI
errDuncan J Watts; Emorie D Beck; Elisa Jayne Bienenstock; Jake Bowers; Aaron Frank; Anthony Grubesic; Jake M. Hofman; Julia M. Rohrer; Matthew Salganik
err分享
err收藏
err
IF0
err2022-12-02
err0
PREAI
err
err分享
err收藏
Simulation of switching effects in electrically dipolar manganites
err2009-03-17
err0
errOAAI
errV. Morchshakov; M. P. Annaorazov; H. Ş. Aybar; C. P. Yang; I. O. Troyanchuk; K. Bärner
err分享
err收藏
学者 查看更多内容