arrow
返回

TinyWolf - Efficient on-device TinyML training for IoT using enhanced Grey Wolf Optimization

delete2024-12-01
delete0
delete
OA
AI
S
Subhrangshu Adhikary
S
Subhayu Dutta
A
Ashutosh Dhar Dwivedi *
DOI:10.1016/j.iot.2024.101365delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Training a deep learning model generally requires a huge amount of memory and processing power. Once trained, the learned model can make predictions very fast with very little resource consumption. The learned weights can be fitted into a microcontroller to build affordable embedded intelligence systems which is also known as TinyML. Although few attempts have been made, the limits of the state-of-the-art training of a deep learning model within a microcontroller can be pushed further. Generally deep learning models are trained with gradient optimizers which predict with high accuracy but require a very high amount of resources. On the other hand, nature-inspired meta-heuristic optimizers can be used to build a fast approximation of the model's optimal solution with low resources. After a rigorous test, we have found that Grey Wolf Optimizer can be modified for enhanced uses of main memory, paging and swap space among alpha,beta,delta and omega wolves. This modification saved up to 71% memory requirements compared to gradient optimizers. We have used this modification to train the TinyML model within a microcontroller of 256KB RAM. The performances of the proposed framework have been meticulously benchmarked on 13 open-sourced datasets.
Keyword:
Internet of Things
Evolutionary algorithms
Deep learning
Nature inspired algorithms
Embedded intelligence
Memory optimization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Internet of Things 封面图
Internet of Things
IF:
7.6
论文数:
1.9K
被引数:
6.9K

机构

D
dr. b. c. roy engineering college
学者数:
155
论文数: 134
被引数: 0
A
aalborg university
学者数:
1.6W
论文数: 1.7W
被引数: 22
引用论文

引用论文

GABA Neurons and Their Role in Activity-Dependent Plasticity of Adult Primate Visual Cortex
err1994-01-01
err0
PREAI
errE. G. Jones; S. H. C. Hendry; J. DeFelipe; D. L. Benson
err分享
err收藏
TinyML Meets IoT: A Comprehensive Survey
err2021-12-01
err120
PREAI
errDutta, Lachit; Bharali, Swapna
err分享
err收藏
A Survey of Using Swarm Intelligence Algorithms in IoT
errSENSORS
IF3.5
err2020-03-05
err79
errOAAI
errSun, Weifeng; Tang, Min; Zhang, Lijun; Huo, Zhiqiang; Shu, Lei
err分享
err收藏
Grey Wolf Optimizer灰狼优化器
err2014-03-01
err1.3W
PREAI
errMirjalili, Seyedali; Mirjalili, Seyed Mohammad; Lewis, Andrew
err分享
err收藏
err分享
err收藏
Interaction Analysis Reveals Complex Genetic Associations with Alzheimer’s Disease in the CLU and ABCA7 Gene Regions
err2023-08-23
err0
errOAAI
errAlireza Nazarian; Brandon Cook; Marissa Morado; Alexander M. Kulminski
err分享
err收藏
err分享
err收藏
Particle Swarm Optimization: A Comprehensive Survey
err2022-01-01
err545
errOAAI
errShami, Tareq M.; El-Saleh, Ayman A.; Alswaitti, Mohammed; Al-Tashi, Qasem; Summakieh, Mhd Amen; Mirjalili, Seyedali
err分享
err收藏
Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data
err2020-09-01
err1.0K
errOAAI
errSattler, Felix; Wiedemann, Simon; Mueller, Klaus-Robert; Samek, Wojciech
err分享
err收藏
学者 查看更多内容