返回
MicroFlow: An Efficient Rust-Based Inference Engine for TinyML
DOI:10.1016/j.iot.2025.101498.png)
摘要
En 中文
In recent years, there has been a significant interest in developing machine learning algorithms on embedded systems. This is particularly relevant for bare metal devices in Internet of Things, Robotics, and Industrial applications that face limited memory, processing power, and storage, and which require extreme robustness. To address these constraints, we present MicroFlow, an open-source TinyML framework for the deployment of Neural Networks (NNs) on embedded systems using the Rust programming language. The compiler-based inference engine of MicroFlow, coupled with Rust's memory safety, makes it suitable for TinyML applications in critical environments. The proposed framework enables the successful deployment of NNs on highly resource-constrained devices, including bare-metal 8-bit microcontrollers with only 2 kB of RAM. Furthermore, MicroFlow is able to use less Flash and RAM memory than other stateof-the-art solutions for deploying NN reference models (i.e. wake-word and person detection), achieving equally accurate but faster inference compared to existing engines on medium-size NNs, and similar performance on bigger ones. The experimental results prove the efficiency and suitability of MicroFlow for the deployment of TinyML models in critical environments where resources are particularly limited.
Keyword:
TinyML
Rust
Neural networks
Embedded systems
IoT
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.9K
被引数:
6.9K
机构
引用论文
Federated learning for IoT devices: Enhancing TinyML with on-board training物联网设备的联合学习: 通过车载培训增强TinyML
INFORMATION FUSION
IF15.5
TinyML: Enabling of Inference Deep Learning Models on Ultra-Low-Power IoT Edge Devices for AI ApplicationsTinyML: 在用于AI应用的超低功耗IoT边缘设备上启用推理深度学习模型
Pruning and quantization for deep neural network acceleration: A survey用于深度神经网络加速的修剪和量化: 一项调查
NEUROCOMPUTING
IF6.5

