.png){kind=icon}
返回
Multi-representation knowledge distillation for audio classification
.png){kind=icon}
PRE
AI
DOI：10.1007/s11042-021-11610-8.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Audio classification aims to discriminate between different audio signal types, and it has received intensive attention due to its wide applications. In deep learning-based audio classification methods, researchers usually transform the raw signal of audios into different feature representations (such as Short Time Fourier Transform and Mel Frequency Cepstral Coefficients) as the inputs of networks. However, selecting the feature representation requires expert knowledge and extensive experimental verification. Besides, using a single type of feature representation may cause suboptimal results as the information implied in different kinds of feature representations may be complementary. Previous works show that ensembling the networks trained on different representations can greatly boost classification performance. However, making inferences using multiple networks is cumbersome and computation expensive. In this paper, we propose a novel end-to-end collaborative training framework for the audio classification task. The framework takes multiple representations as inputs to train the networks jointly with a knowledge distillation method. Consequently, our framework significantly promotes the performance of networks without increasing the computational overhead in the inference stage. Extensive experimental results demonstrate that the proposed approach improves classification performance and achieves competitive results on both acoustic scene classification tasks and general audio tagging tasks.
Keyword:
Neural networks
Multiple representations
Acoustic classification
Knowledge distillation
期刊
IF:
3
论文数:
2.0W
被引数:
3.2W
机构
引用论文
Pumilio1 phosphorylation precedes translational activation of its target mRNA in zebrafish oocytes.png)
Zygote
OAAI
ZygoteIF0
OAAI分享收藏China guideline for diagnosis and comprehensive treatment of colorectal liver metastases (Version 2023)中国结直肠癌肝转移诊断和综合治疗指南（2023年版）
IF0
PREAI
分享收藏分享收藏An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomizationMACHINE LEARNINGOAAI
MACHINE LEARNINGIF2.9
OAAI分享收藏
查看更多内容