arrow
Return

On-device Training: A First Overview on Existing Systems

delete2024-10-08
delete2
PRE
AI
S
Shuai Zhu
T
Thiemo Voigt
F
Fatemeh Rahimian
J
JeongGil Ko *
DOI:10.1145/3696003delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The recent breakthroughs in machine learning (ML) and deep learning (DL) have catalyzed the design and development of various intelligent systems over wide application domains. While most existing machine learning models require large memory and computing power, efforts have been made to deploy some models on resource-constrained devices as well. A majority of the early application systems focused on exploiting the inference capabilities of ML and DL models, where data captured from different mobile and embedded sensing components are processed through these models for application goals such as classification and segmentation. More recently, the concept of exploiting the mobile and embedded computing resources for ML/DL model training has gained attention, as such capabilities allow (i) the training of models via local data without the need to share data over wireless links, thus enabling privacy-preserving computation by design, (ii) model personalization and environment adaptation, and (iii) deployment of accurate models in remote and hardly accessible locations without stable internet connectivity. This work summarizes and analyzes state-of-the-art systems research that allows such on-device model training capabilities and provides a survey of on-device training from a systems perspective.
Keywords:
Machine learning
IoT devices
on-device training

Journal

ACM Transactions on Sensor Networks cover
ACM Transactions on Sensor Networks
IF:
4.7
Papers:
995
Citations:
2.0K

Organization

R
RISE Research Institutes of Sweden
Scholars:
1.9K
Papers: 1.5K
Citations: 2.5K
Y
Yonsei University
Scholars:
4.8W
Papers: 4.6W
Citations: 5.2W