.png){kind=icon}
返回
Semi-supervised classification-aware cross-modal deep adversarial data augmentation
.png){kind=icon}
PRE
AI
DOI：10.1016/j.future.2021.05.029.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep neural networks are usually data-starved in real-world applications, while manually annotation can be costly-for example, the audio emotion recognition from the audio. In contrast, the continued research in image-based facial expression recognition grants us a rich source of public available labeled IFER datasets. Using images to support audio emotion recognition with limited labeled data according to their inherent correlations can be a meaningful and challenging task. This paper proposes a system that facilitates knowledge transfer from the labeled visual to the heterogeneous labeled audio domain by learning a joint distribution of examples in different modalities then the system can map an IFER example to a corresponding audio spectrogram. Next, our work reformulates the audio emotion classification into a K+1 class discriminator of GAN-based semi-supervised learning. Good semi-supervised learning requires that the generator does NOT sample from a distribution well matching the true data distribution. Therefore, we demand the generated examples are from the low-density areas of the marginal distribution in the audio spectrogram modality. Concretely, the proposed model translates image samples to audios class-wisely in the form of spectrograms. To harness the decoded samples in a sparsely distributed area and construct a tighter decision boundary, we give a solution to precisely estimate the density on feature space and incorporate low-density pieces with an annealing scheme. Our method requires the network to discriminate against the low-density data points from high-density data points throughout the classification, and we evidence that this technique effectively improves task performance. (C) 2021 Published by Elsevier B.V.
Keyword:
Adversarial network
Data augmentation
Density estimation
Graph representation
Semi supervised learning
期刊
F
IF:
6.1
论文数:
6.9K
被引数:
2.3W
机构
引用论文
A Face Emotion Recognition Method Using Convolutional Neural Network and Image Edge Computing.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏The changing epidemiology of paediatric brain tumours: a review from the Hospital for Sick Children
PREAI
分享收藏A Review of Technical Impact of Electrical Vehicle Charging Stations on Distribution Grid电动汽车充电站对配电网的技术影响研究综述
PREAI
分享收藏Multi attribute auction based incentivized solution against DDoS attacksCOMPUTERS & SECURITY
COMPUTERS & SECURITYIF5.4
PREAI
分享收藏
查看更多内容