返回
TinyWolf - Efficient on-device TinyML training for IoT using enhanced Grey Wolf Optimization
DOI:10.1016/j.iot.2024.101365.png)
摘要
En 中文
Training a deep learning model generally requires a huge amount of memory and processing power. Once trained, the learned model can make predictions very fast with very little resource consumption. The learned weights can be fitted into a microcontroller to build affordable embedded intelligence systems which is also known as TinyML. Although few attempts have been made, the limits of the state-of-the-art training of a deep learning model within a microcontroller can be pushed further. Generally deep learning models are trained with gradient optimizers which predict with high accuracy but require a very high amount of resources. On the other hand, nature-inspired meta-heuristic optimizers can be used to build a fast approximation of the model's optimal solution with low resources. After a rigorous test, we have found that Grey Wolf Optimizer can be modified for enhanced uses of main memory, paging and swap space among alpha,beta,delta and omega wolves. This modification saved up to 71% memory requirements compared to gradient optimizers. We have used this modification to train the TinyML model within a microcontroller of 256KB RAM. The performances of the proposed framework have been meticulously benchmarked on 13 open-sourced datasets.
Keyword:
Internet of Things
Evolutionary algorithms
Deep learning
Nature inspired algorithms
Embedded intelligence
Memory optimization
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.9K
被引数:
6.9K
机构
引用论文
Major Advances in Particle Swarm Optimization: Theory, Analysis, and Application粒子群优化的主要进展: 理论,分析和应用
Interaction Analysis Reveals Complex Genetic Associations with Alzheimer’s Disease in the CLU and ABCA7 Gene Regions
Genes
IF0
Machine Learning for Microcontroller-Class Hardware: A Review微控制器级硬件的机器学习: 综述
IEEE SENSORS JOURNAL
IF4.5

