arrow
返回

An Adversarial Feature Distillation Method for Audio Classification

delete2019-01-01
delete16
delete
OA
AI
L
Liang Gao
H
Haibo Mi *
B
Boqing Zhu
D
Dawei Feng
Y
Yicong Li
Y
Yuxing Peng
DOI:10.1109/ACCESS.2019.2931656delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The audio classification task aims to discriminate between different audio signal types. In this task, deep neural networks have achieved better performance than the traditional shallow architecture-based machine-learning method. However, deep neural networks often require huge computational and storage requirements that hinder the deployment in embedded devices. In this paper, we proposed a distillation method which transfers knowledge from well-trained networks to a small network, and the method can compress model size while improving audio classification precision. The contributions of the proposed method are two folds: a multi-level feature distillation method was proposed and an adversarial learning strategy was employed to improve the knowledge transfer. The extensive experiments are conducted on three audio classification tasks, audio scene classification, general audio tagging, and speech command recognition. The experimental results demonstrate that: the small network can provide better performance while achieves the calculated amount of floating-point operations per second (FLOPS) compression ratio of 76:1 and parameters compression ratio of 3:1.
Keyword:
Convolutional neural networks
audio tagging
knowledge distillation
model compression
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

N
national university of defense technology - china
学者数:
1.8W
论文数: 1.4W
被引数: 9
引用论文

引用论文

Lead‐Free Ceramics for High Performance Supercapacitors
err2023-10-12
err0
PREAI
errAsma Farrukh; Sara Yaseen; Abdul Ghafar Wattoo; Adnan Khalil; Muhammad Sohaib Ali; Kamran Ikram; Muhammad Bilal Tahir
err分享
err收藏
The Rungwe Volcanic Province, Tanzania – A volcanological review
err2012-02-01
err0
PREAI
errKaren Fontijn; David Williamson; Evelyne Mbede; Gerald G.J. Ernst
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容