arrow
返回

MicroFlow: An Efficient Rust-Based Inference Engine for TinyML

delete2025-03-01
delete0
delete
OA
AI
M
Matteo Carnelos
F
Francesco Pasti
N
Nicola Bellotto *
DOI:10.1016/j.iot.2025.101498delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In recent years, there has been a significant interest in developing machine learning algorithms on embedded systems. This is particularly relevant for bare metal devices in Internet of Things, Robotics, and Industrial applications that face limited memory, processing power, and storage, and which require extreme robustness. To address these constraints, we present MicroFlow, an open-source TinyML framework for the deployment of Neural Networks (NNs) on embedded systems using the Rust programming language. The compiler-based inference engine of MicroFlow, coupled with Rust's memory safety, makes it suitable for TinyML applications in critical environments. The proposed framework enables the successful deployment of NNs on highly resource-constrained devices, including bare-metal 8-bit microcontrollers with only 2 kB of RAM. Furthermore, MicroFlow is able to use less Flash and RAM memory than other stateof-the-art solutions for deploying NN reference models (i.e. wake-word and person detection), achieving equally accurate but faster inference compared to existing engines on medium-size NNs, and similar performance on bigger ones. The experimental results prove the efficiency and suitability of MicroFlow for the deployment of TinyML models in critical environments where resources are particularly limited.
Keyword:
TinyML
Rust
Neural networks
Embedded systems
IoT
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Internet of Things 封面图
Internet of Things
IF:
7.6
论文数:
1.9K
被引数:
6.9K

机构

U
University of Padua
学者数:
5.1W
论文数: 4.3W
被引数: 57
引用论文

引用论文

A TinyML Platform for On-Device Continual Learning With Quantized Latent Replays
err2021-12-01
err44
errOAAI
errRavaglia, Leonardo; Rusci, Manuele; Nadalini, Davide; Capotondi, Alessandro; Conti, Francesco; Benini, Luca
err分享
err收藏
TinyML-Enabled Frugal Smart Objects: Challenges and Opportunities
err2020-01-01
err162
PREAI
errSanchez-Iborra, Ramon; Skarmeta, Antonio F.
err分享
err收藏
Naivete and need for affection among pedophiles
err1992-09-01
err0
PREAI
errShawn A. Johnston; Alfred P. French; William F. Schouweiler; Frances A. Johnston
err分享
err收藏
TinyML Meets IoT: A Comprehensive Survey
err2021-12-01
err120
PREAI
errDutta, Lachit; Bharali, Swapna
err分享
err收藏
err分享
err收藏
Histidine-rich glycoprotein blocks collagen-binding integrins and adhesion of endothelial cells through low-affinity interaction with α2 integrin
err2015-10-01
err0
PREAI
errFrancis Roche; Kalle Sipilä; Satoshi Honjo; Staffan Johansson; Sònia Tugues; Jyrki Heino; Lena Claesson-Welsh
err分享
err收藏
err分享
err收藏
学者 查看更多内容