arrow
返回

Privacy-Preserving Audio Classification Using Variational Information Feature Extraction

delete2021-01-01
delete4
PRE
AI
A
Alexandru Nelus *
R
Rainer Martin
DOI:10.1109/TASLP.2021.3108063delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper we investigate and tackle the privacy risks of deep-neural-network-based feature extraction for sound classification in acoustic sensor networks. To this end, we analyze a single-label domestic activity monitoring and a multi-label urban sound tagging scenario. We show that in both cases, the feature representations designed for sound classification also carry a significant amount of speaker-dependent data, thus posing serious privacy risks for speaker recognition attacks based on feature interception. We then propose to mitigate the aforementioned privacy risks by introducing a variational information feature extraction scheme that allows sound classification while, concurrently, minimizing the feature representation's level of information and hence, inhibiting speaker recognition attempts. We control and analyze the balance between the performance of the trusted and attacker tasks via the resulting model's composite loss function, its budget scaling factor, and latent space size. It is empirically demonstrated that the proposed privacy-preserving feature representation generalizes well to both single-label and multi-label scenarios with vast as well as reduced training-dataset resources. Furthermore, it exhibits robustness against x-vector-based, state-of-the-art speaker recognition attacks.
Keyword:
Feature extraction
Task analysis
Data models
Speaker recognition
Data privacy
Computational modeling
Privacy
Audio features
feature interception
mutual information
privacy
speaker identification
speaker verification
sound classification
x-vectors

期刊

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
论文数:
2.6K
被引数:
1.1W

机构

R
ruhr university bochum
学者数:
2.3W
论文数: 1.9W
被引数: 14
引用论文

引用论文

Nitrate Assay for Plant Tissues
err2017-01-01
err0
errOAAI
errLufei Zhao; Yong Wang
err分享
err收藏
err分享
err收藏
Movement decisions in natural catastrophes: how a flying scavenger deals with a volcanic eruption自然灾难中的移动决策:一种飞行食腐动物如何应对火山喷发
err2015-08-05
err0
errOAAI
errPablo A.E. Alarcón; Sergio A. Lambertucci; José A. Donázar; Fernando Hiraldo; José A. Sánchez-Zapata; Guillermo Blanco; Juan M. Morales
err分享
err收藏
err分享
err收藏
SONYC : A System for Monitoring, Analyzing, and Mitigating Urban Noise Pollution
err2019-01-28
err148
errOAAI
errBello, Juan P.; Silva, Claudio; Nov, Oded; Dubois, R. Luke; Arora, Anish; Salamon, Justin; Mydlarz, Charles; Doraiswamy, Harish
err分享
err收藏
学者 查看更多内容