.png){kind=icon}
.png){kind=icon}
Return
Privacy-Preserving Audio Classification Using Variational Information Feature Extraction
.png){kind=icon}
PRE
AI
DOI：10.1109/TASLP.2021.3108063.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
In this paper we investigate and tackle the privacy risks of deep-neural-network-based feature extraction for sound classification in acoustic sensor networks. To this end, we analyze a single-label domestic activity monitoring and a multi-label urban sound tagging scenario. We show that in both cases, the feature representations designed for sound classification also carry a significant amount of speaker-dependent data, thus posing serious privacy risks for speaker recognition attacks based on feature interception. We then propose to mitigate the aforementioned privacy risks by introducing a variational information feature extraction scheme that allows sound classification while, concurrently, minimizing the feature representation's level of information and hence, inhibiting speaker recognition attempts. We control and analyze the balance between the performance of the trusted and attacker tasks via the resulting model's composite loss function, its budget scaling factor, and latent space size. It is empirically demonstrated that the proposed privacy-preserving feature representation generalizes well to both single-label and multi-label scenarios with vast as well as reduced training-dataset resources. Furthermore, it exhibits robustness against x-vector-based, state-of-the-art speaker recognition attacks.
Keywords:
Feature extraction
Task analysis
Data models
Speaker recognition
Data privacy
Computational modeling
Privacy
Audio features
feature interception
mutual information
privacy
speaker identification
speaker verification
sound classification
x-vectors
Journal
I
IF:
5.1
Papers:
2.6K
Citations:
1.1W