arrow
Return

Secure collaborative few-shot learning

delete2020-09-01
delete25
PRE
AI
Y
Yu Xie
H
Han Wang
B
Bin Yu *
C
Chen Zhang
DOI:10.1016/j.knosys.2020.106157delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Few-shot learning aims at training a model that can effectively recognize novel classes with extremely limited training examples. Few-shot learning via meta-learning can improve the performance on novel tasks by leveraging previously acquired knowledge as a prior when the training examples are extremely limited. However, most of these existing few-shot learning methods involve parameter transfer, which usually requires sharing models trained on the examples for specific tasks, thus posing a potential threat to the privacy of data owners. To tackle this, we design a novel secure collaborative few-shot learning framework. More specifically, we incorporate differential privacy into few-shot learning through adding the calibrated Gaussian noise to its optimization process to prevent sensitive information in the training set from being leaked. To prevent potential privacy disclosure to other participants and the central server, homomorphic encryption is integrated while calculating global loss functions and interacting with a central server. Furthermore, we implement our framework on the classical few-shot learning methods such as MAML and Reptile, and extensively evaluate its performance on Omniglot, Mini-ImageNet and Fewshot-CIFAR100 datasets. The experimental results demonstrate the effectiveness of our framework in both utility and privacy. (C) 2020 Elsevier B.V. All rights reserved.
Keywords:
Few-shot learning
Meta-learning
Differential privacy
Additively homomorphic encryption
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K