arrow
返回

Coded Machine Unlearning

delete2021-01-01
delete9
delete
OA
AI
N
Nasser Aldaghri *
H
Hessam Mahdavifar
A
Ahmad Beirami
DOI:10.1109/ACCESS.2021.3090019delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
There are applications that may require removing the trace of a sample from the system, e.g., a user requests their data to be deleted, or corrupted data is discovered. Simply removing a sample from storage units does not necessarily remove its entire trace since downstream machine learning models may store some information about the samples used to train them. A sample can be perfectly unlearned if we retrain all models that used it from scratch with that sample removed from their training dataset. When multiple such unlearning requests are expected to be served, unlearning by retraining becomes prohibitively expensive. Ensemble learning enables the training data to be split into smaller disjoint shards that are assigned to non-communicating weak learners. Each shard is used to produce a weak model. These models are then aggregated to produce the final central model. This setup introduces an inherent trade-off between performance and unlearning cost, as reducing the shard size reduces the unlearning cost but may cause degradation in performance. In this paper, we propose a coded learning protocol where we utilize linear encoders to encode the training data into shards prior to the learning phase. We also present the corresponding unlearning protocol and show that it satisfies the perfect unlearning criterion. Our experimental results show that the proposed coded machine unlearning provides a better performance versus unlearning cost trade-off compared to the uncoded baseline.
Keyword:
Training
Protocols
Kernel
Machine learning
Encoding
Predictive models
Licenses
Machine unlearning
random coding
efficient sample removal
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

U
University of Michigan
学者数:
6.4W
论文数: 5.3W
被引数: 124
U
university of michigan system
学者数:
9.1W
论文数: 8.6W
被引数: 133
引用论文

引用论文

The COVID-19 crisis and its consequences for global warming and climate change
err2022-01-01
err0
errOAAI
errAbdullah Kaviani Rad; Mehdi Zarei; Hamid Reza Pourghasemi; John P. Tiefenbacher
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容