arrow
返回

Tiny Machine Learning: Progress and Futures

delete2023-01-01
delete27
delete
OA
AI
J
Ji Lin
L
Ligeng Zhu
W
Wei-Ming Chen
W
Wei-Chen Wang
韩
韩松 (Song Han) *
DOI:10.1109/MCAS.2023.3302182delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Tiny machine learning (TinyML) is a new frontier of machine learning. By squeezing deep learning models into billions of IoT devices and microcontrollers (MCUs), we expand the scope of applications and enable ubiquitous intelligence. However, TinyML is challenging due to the hardware constraints: the tiny memory resource is difficult hold deep learning models designed for cloud and mobile platforms. There is also limited compiler and inference engine support for bare-metal devices. Therefore, we need to co-design the algorithm and system stack to enable TinyML. In this review, we will first discuss the definition, challenges, and applications of TinyML. We then survey the recent progress in TinyML and deep learning on MCUs. Next, we will introduce MCUNet, showing how we can achieve ImageNet-scale AI applications on IoT devices with system-algorithm co-design. We will further extend the solution from inference to training and introduce tiny on-device training techniques. Finally, we present future directions in this area. Today's large model might be tomorrow's tiny model. The scope of TinyML should evolve and adapt over time.
Keyword:
Deep learning
Training
Adaptation models
Microcontrollers
Memory management
Inference algorithms
Tiny machine learning
Machine learning
TinyML
efficient deep learning
on-device training
learning on the edge

期刊

IEEE Circuits and Systems Magazine 封面图
IEEE Circuits and Systems Magazine
IF:
3.5
论文数:
530
被引数:
1.3K

机构

暂无机构信息
引用论文

引用论文

A safe and just space for urban mobility: a framework for sector-based sustainable consumption corridor development
err2021-12-03
err0
errOAAI
errKevin Joseph Dillman; Michał Czepkiewicz; Jukka Heinonen; Brynhildur Davíðsdóttir
err分享
err收藏
High prevalence of malaria in a non-endemic setting among febrile episodes in travellers and migrants coming from endemic areas: a retrospective analysis of a 2013–2018 cohort
err2021-11-27
err0
errOAAI
errAlejandro Garcia-Ruiz de Morales; Covadonga Morcate; Elena Isaba-Ares; Ramon Perez-Tanoira; Jose A. Perez-Molina
err分享
err收藏
err分享
err收藏
学者 查看更多内容