arrow
返回

AutoTinyML for microcontrollers: Dealing with black-box deployability

delete2022-11-01
delete5
PRE
AI
R
Riccardo Perego *
A
Antonio Candelieri
F
Francesco Archetti
D
Danilo Pau
DOI:10.1016/j.eswa.2022.117876delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
While many companies are currently leveraging on Cloud, data centres and specialized hardware (e.g., GPUs and TPUs) to train very accurate Machine Learning models, the need to deploy and run these models on tiny devices is emerging as the most relevant challenge, with a massive untapped market. Although Automated Machine Learning and Neural Architecture Search frameworks are successfully used to find accurate models by trying a small number of alternatives, they are typically performed on large computational platforms and they cannot directly deal with deployability, leading to an accurate model which could result undeployable on a tiny device. To bridge the gap between these two worlds, we present an approach extending these frameworks to include the constraints related to the limited hardware resources of the tiny device which the trained model has to run on. Experimental results on two benchmark classification tasks and two microcontrollers prove that our AutoTinyML framework can efficiently identify models which are both accurate and deployable, in case accepting a reasonable reduction in accuracy compared to a significant reduction in hardware usages, without applying any quantization techniques of the model.
Keyword:
Tiny Machine Learning
Deep Neural Networks
Automated Machine Learning
Neural Architecture Search
Hyperparameter optimization
Bayesian Optimization

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

U
university of milano-bicocca
学者数:
2.0W
论文数: 1.5W
被引数: 22
引用论文

引用论文

APNAS: Accuracy-and-Performance-Aware Neural Architecture Search for Neural Hardware Accelerators
err2020-01-01
err18
errOAAI
errAchararit, Paniti; Hanif, Muhammad Abdullah; Putra, Rachmad Vidya Wicaksana; Shafique, Muhammad; Hara-Azumi, Yuko
err分享
err收藏
Polymerization Equilibria
err1984-01-01
err0
PREAI
errHans-Georg Elias
err分享
err收藏
Neural architecture search for image saliency fusion
err2020-05-01
err21
PREAI
errBianco, Simone; Buzzelli, Marco; Ciocca, Gianluigi; Schettini, Raimondo
err分享
err收藏
Taking the Human Out of the Loop: A Review of Bayesian Optimization将人类带出循环: 贝叶斯优化的回顾
err2016-01-01
err3.5K
PREAI
errShahriari, Bobak; Swersky, Kevin; Wang, Ziyu; Adams, Ryan P.; de Freitas, Nando
err分享
err收藏
Quantifying the electrochemical active site density of precious metal-free catalysts in situ in fuel cells
err2022-02-24
err0
errOAAI
errRifael Z. Snitkoff-Sol; Ariel Friedman; Hilah C. Honig; Yan Yurko; Alisa Kozhushner; Michael J. Zachman; Piotr Zelenay; Alan M. Bond; Lior Elbaz
err分享
err收藏
err分享
err收藏
学者 查看更多内容