返回
AutoTinyML for microcontrollers: Dealing with black-box deployability
DOI:10.1016/j.eswa.2022.117876.png)
摘要
En 中文
While many companies are currently leveraging on Cloud, data centres and specialized hardware (e.g., GPUs and TPUs) to train very accurate Machine Learning models, the need to deploy and run these models on tiny devices is emerging as the most relevant challenge, with a massive untapped market. Although Automated Machine Learning and Neural Architecture Search frameworks are successfully used to find accurate models by trying a small number of alternatives, they are typically performed on large computational platforms and they cannot directly deal with deployability, leading to an accurate model which could result undeployable on a tiny device. To bridge the gap between these two worlds, we present an approach extending these frameworks to include the constraints related to the limited hardware resources of the tiny device which the trained model has to run on. Experimental results on two benchmark classification tasks and two microcontrollers prove that our AutoTinyML framework can efficiently identify models which are both accurate and deployable, in case accepting a reasonable reduction in accuracy compared to a significant reduction in hardware usages, without applying any quantization techniques of the model.
Keyword:
Tiny Machine Learning
Deep Neural Networks
Automated Machine Learning
Neural Architecture Search
Hyperparameter optimization
Bayesian Optimization
期刊
IF:
7.5
论文数:
3.0W
被引数:
10.2W
机构
引用论文
APNAS: Accuracy-and-Performance-Aware Neural Architecture Search for Neural Hardware Accelerators
IEEE ACCESS
IF3.6
Taking the Human Out of the Loop: A Review of Bayesian Optimization将人类带出循环: 贝叶斯优化的回顾
PROCEEDINGS OF THE IEEE
IF25.9
Intrapartum‐related perinatal deaths in births planned in midwifery‐led settings in Great Britain: findings and recommendations from the ESMiE confidential enquiry英国计划在助产士主导的环境中分娩的与肿瘤相关的围产期死亡: ESMiE机密调查的发现和建议

