arrow
Return

Lightweight Deep Learning: An Overview

delete2024-07-01
delete53
PRE
AI
C
Ching-Hao Wang
K
Kang-Yang Huang
Y
Yi Yao
J
Jun-Cheng Chen
H
Hong-Han Shuai
W
Wen-Huang Cheng *
DOI:10.1109/MCE.2022.3181759delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the recent success of the deep neural networks (DNNs) in the field of artificial intelligence, the urge of deploying DNNs has drawn tremendous attention because it can benefit a wide range of applications on edge or embedded devices. Lightweight deep learning indicates the procedures of compressing DNN models into more compact ones, which are suitable to be executed on edge devices due to their limited resources and computational capabilities while maintaining comparable performance to the original. Currently, the approaches of model compression include but are not limited to network pruning, quantization, knowledge distillation, and neural architecture search. In this work, we present a fresh overview to summarize recent development and challenges for model compression.
Keywords:
Quantization (signal)
Computational modeling
Training
Neurons
Computer architecture
Deep learning
Costs

Journal

IEEE Consumer Electronics Magazine cover
IEEE Consumer Electronics Magazine
IF:
4.1
Papers:
1.3K
Citations:
1.8K

Organization

A
academia sinica - taiwan
Scholars:
1.9W
Papers: 1.6W
Citations: 17
N
National Yang Ming Chiao Tung University
Scholars:
2.5W
Papers: 2.3W
Citations: 2.2W