arrow
Return

Lightweight Deep Learning: An Overview

delete2024-07-01
delete53
PRE
AI
C
Ching-Hao Wang
K
Kang-Yang Huang
Y
Yi Yao
J
Jun-Cheng Chen
H
Hong-Han Shuai
W
Wen-Huang Cheng *
DOI:10.1109/MCE.2022.3181759delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the recent success of the deep neural networks (DNNs) in the field of artificial intelligence, the urge of deploying DNNs has drawn tremendous attention because it can benefit a wide range of applications on edge or embedded devices. Lightweight deep learning indicates the procedures of compressing DNN models into more compact ones, which are suitable to be executed on edge devices due to their limited resources and computational capabilities while maintaining comparable performance to the original. Currently, the approaches of model compression include but are not limited to network pruning, quantization, knowledge distillation, and neural architecture search. In this work, we present a fresh overview to summarize recent development and challenges for model compression.
Keywords:
Quantization (signal)
Computational modeling
Training
Neurons
Computer architecture
Deep learning
Costs

Journal

IEEE Consumer Electronics Magazine cover
IEEE Consumer Electronics Magazine
IF:
4.1
Papers:
1.3K
Citations:
1.8K

Organization

A
academia sinica - taiwan
Scholars:
1.9W
Papers: 1.6W
Citations: 17
N
National Yang Ming Chiao Tung University
Scholars:
2.5W
Papers: 2.3W
Citations: 2.2W
Cited Papers

Cited Papers

Transplantation of CD34+ peripheral blood progenitor cells after high- dose chemotherapy for patients with advanced multiple myeloma
err1995-07-01
err0
errOAAI
errG Schiller; R Vescio; C Freytes; G Spitzer; F Sahebi; M Lee; CH Wu; J Cao; JC Lee; CH Hong
errShare
errSave
errShare
errSave
errShare
errSave
Ectomesenchymal Chondromyxoid Tumor
err2018-10-01
err0
errOAAI
errBrendan C. Dickson; Cristina R. Antonescu; Prokopios P. Argyris; Elizabeth A. Bilodeau; Martin J. Bullock; Paul D. Freedman; Douglas R. Gnepp; Richard C. Jordan; Ioannis G. Koutlas; Cheng-Han Lee; Iona Leong; Mihai Merzianu; Bibianna M. Purgina; Lester D.R. Thompson; Bret Wehrli; John M. Wright; David Swanson; Lei Zhang; Justin A. Bishop
errShare
errSave
Characterization of the Reaction Performance for Residue Hydrotreating Feedstocks
err2010-12-16
err0
PREAI
errYu-dong Sun; Chao-he Yang; Hong-hong Shan; Ben-xian Shen
errShare
errSave
Knowledge Distillation: A Survey
err2021-03-22
err1.5K
PREAI
errGou, Jianping; Yu, Baosheng; Maybank, Stephen J.; Tao, Dacheng
errShare
errSave
errShare
errSave
Pre-existing antibodies to candidate gene therapy vectors (adeno-associated vector serotypes) in domestic cats
err2019-03-21
err0
errOAAI
errPengfei Li; Eva Boenzli; Regina Hofmann-Lehmann; A. Katrin Helfer-Hungerbuehler
errShare
errSave
researcher View more