arrow
Return

Algorithms that remember: model inversion attacks and data protection law

delete2018-10-15
delete104
delete
OA
AI
M
Michael Veale *
R
Reuben Binns
L
Lilian Edwards
DOI:10.1098/rsta.2018.0083delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Many individuals are concerned about the governance of machine learning systems and the prevention of algorithmic harms. The EU's recent General Data Protection Regulation (GDPR) has been seen as a core tool for achieving better governance of this area. While the GDPR does apply to the use of models in some limited situations, most of its provisions relate to the governance of personal data, while models have traditionally been seen as intellectual property. We present recent work from the information security literature around 'model inversion' and 'membership inference' attacks, which indicates that the process of turning training data into machine-learned systems is not one way, and demonstrate how this could lead some models to be legally classified as personal data. Taking this as a probing experiment, we explore the different rights and obligations this would trigger and their utility, and posit future directions for algorithmic governance and regulation. This article is part of the theme issue 'Governing artificial intelligence: ethical, legal, and technical opportunities and challenges'.
Keywords:
model inversion
personal data
model trading
machine learning

Journal

P
Philosophical Transactions of the Royal Society A-Mathematical Physical and Engineering Sciences
IF:
3.7
Papers:
7.8K
Citations:
2.8W

Organization

U
University College London
Scholars:
7.9W
Papers: 6.2W
Citations: 15.7W
U
university of oxford
Scholars:
9.8W
Papers: 8.6W
Citations: 137
U
university of london
Scholars:
21.5W
Papers: 19.7W
Citations: 305
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
Influence of Collectors on Flotation of Fine Tin Middlings after Gravity Separation
err2013-08-16
err0
PREAI
errWen Juan Zhao; Ming Xiao Li; Sheng Jian; Chen Hu Zhang; Li Ping Feng
errShare
errSave
Is fish able to regulate filamentous blue-green dominated phytoplankton?
err2016-06-13
err0
PREAI
errTiina Nõges; Ain Järvalt; Juta Haberman; Priit Zingel; Peeter Nõges
errShare
errSave
The COVID-19 crisis and its consequences for global warming and climate change
err2022-01-01
err0
errOAAI
errAbdullah Kaviani Rad; Mehdi Zarei; Hamid Reza Pourghasemi; John P. Tiefenbacher
errShare
errSave
Genome-wide meta-analysis of SNP-by9-ACEI/ARB and SNP-by-thiazide diuretic and effect on serum potassium in cohorts of European and African ancestry
err2018-06-01
err0
errOAAI
errMarguerite R. Irvin; Colleen M. Sitlani; Raymond Noordam; Christie L. Avery; Joshua C. Bis; James S. Floyd; Jin Li; Nita A. Limdi; Vinodh Srinivasasainagendra; James Stewart; Renée de Mutsert; Dennis O. Mook-Kanamori; Leonard Lipovich; Erica L. Kleinbrink; Albert Smith; Traci M. Bartz; Eric A. Whitsel; Andre G. Uitterlinden; Kerri L. Wiggins; James G. Wilson; Degui Zhi; Bruno H. Stricker; Jerome I. Rotter; Donna K. Arnett; Bruce M. Psaty; Leslie A. Lange
errShare
errSave
Cloud Computing: Survey on Energy Efficiency
err2014-12-19
err205
errOAAI
errMastelic, Toni; Oleksiak, Ariel; Claussen, Holger; Brandic, Ivona; Pierson, Jean-Marc; Vasilakos, Athanasios V.
errShare
errSave
researcher View more