.png){kind=icon}
.png){kind=icon}
Return
Nanoscale Computing
.png){kind=icon}
PRE
AI
DOI：10.1109/MNANO.2025.3607072.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The performance in terms of execution time of Transformer-based models when run on edge-computing platforms is hard to predict, because it depends on many factors such as the nanoscale technology used for implementation or model architecture. Another dimension of interest when evaluating the execution time is the size of the model, as in many cases, several versions of the model with different sizes can be used. The smaller size versions reduce significantly the number of parameters and thus of the nanoscale memory and arithmetic operations needed to run the model, however this does not necessarily map to similar reductions in execution times. This paper studies the relation between model size and execution time by evaluating three different Transformer-based models: Bidirectional Encoder Representations from Transformer (BERT), Transfer Text-to-Text Transformer (T5) and Contrastive Language-Image Pre-training model (CLIP), and their corresponding reduced versions when run on three different nanoscale hardware platforms.
Keywords:
Encoding
Computational modeling
Bidirectional control
Transformers
Graphics processing units
Hardware
Decoding
Complexity theory
Central Processing Unit
Nanoscale devices
Artificial intelligence
transformers
nanoscale computing
evaluation
tiny models
Journal
I
IF:
2.7
Papers:
27
Citations:
0