返回
Privacy-Preserving Audio Classification Using Variational Information Feature Extraction
DOI:10.1109/TASLP.2021.3108063.png)
摘要
En 中文
In this paper we investigate and tackle the privacy risks of deep-neural-network-based feature extraction for sound classification in acoustic sensor networks. To this end, we analyze a single-label domestic activity monitoring and a multi-label urban sound tagging scenario. We show that in both cases, the feature representations designed for sound classification also carry a significant amount of speaker-dependent data, thus posing serious privacy risks for speaker recognition attacks based on feature interception. We then propose to mitigate the aforementioned privacy risks by introducing a variational information feature extraction scheme that allows sound classification while, concurrently, minimizing the feature representation's level of information and hence, inhibiting speaker recognition attempts. We control and analyze the balance between the performance of the trusted and attacker tasks via the resulting model's composite loss function, its budget scaling factor, and latent space size. It is empirically demonstrated that the proposed privacy-preserving feature representation generalizes well to both single-label and multi-label scenarios with vast as well as reduced training-dataset resources. Furthermore, it exhibits robustness against x-vector-based, state-of-the-art speaker recognition attacks.
Keyword:
Feature extraction
Task analysis
Data models
Speaker recognition
Data privacy
Computational modeling
Privacy
Audio features
feature interception
mutual information
privacy
speaker identification
speaker verification
sound classification
x-vectors
期刊
I
IF:
5.1
论文数:
2.6K
被引数:
1.1W
机构
引用论文
Tmetoceratidae (Ammonitina) fauna from the Gerecse Mts (Hungary)来自匈牙利Gerecse山(Ammonitina)的Tmetoceratidae动物群
Movement decisions in natural catastrophes: how a flying scavenger deals with a volcanic eruption自然灾难中的移动决策:一种飞行食腐动物如何应对火山喷发
Dumortieria and Pleydellia (Ammonoidea) from the Shemshak Formation (Late Triassic - Middle Jurassic) east of Shahmirzad (SE Alborz, Iran)杜莫蒂耶菊石和普莱德尔菊石(Ammonoidea)来自沙姆斯哈克组(晚三叠世—中侏罗世)(伊朗沙赫米尔扎德以东,阿尔borz南部)。

