arrow
Return

Certainty-Based Neural Network Architecture Selection Framework for TinyML Systems

delete2024-01-01
delete0
delete
OA
AI
J
Joanna Komorniczak *
T
Tobiasz Puślecki
P
Paweł Ksieniewicz
K
Krzysztof Walkowiak
DOI:10.1109/ACCESS.2024.3482111delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The development of technologies related to the TinyML concept observed in recent years forces us to consider the trade-off between inference time and recognition quality. Moreover, employing data stream processing methods to analyze large volumes of data in real-time becomes necessary. In this work, considering Computer Vision data streams with a time-varying difficulty, we present a framework that allows finding a compromise between inference time and recognition quality. This trade-off can be measured using the proposed Time to Accuracy Loss measure. The presented Certainty-based Architecture Selection framework allows the selection of the neural network architecture depending on the current difficulty of the data stream. The work presents computer and TinyML device experiments. The results show that the proposed framework can effectively select the neural network architecture depending on the current difficulty of the data stream and bring benefits in the inference time.
Keywords:
Computer architecture
Tiny machine learning
Computational modeling
Accuracy
Neural networks
Data models
Switches
Loss measurement
Streaming media
Uncertainty
Classification
computer vision
data streams
TinyML
uncertainty quantification

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

W
wroclaw university of science & technology
Scholars:
7.4K
Papers: 7.1K
Citations: 2