arrow
返回

Nanoscale Computing

delete2025-09-01
delete0
PRE
AI
高振 封面图
高振 (Zhen Gao)
W
Weimin Zeng
Y
Yingtao Zhang
刘爽 封面图
刘爽 (Shuang Liu)
P
Pedro Reviriego
S
Shanshan Liu *
F
Fabrizio Lombardi
DOI:10.1109/MNANO.2025.3607072delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
基于Transformer的模型在边缘计算平台上的执行时间性能难以预测,因为它取决于许多因素,例如用于实现的纳米级技术或模型架构。在评估执行时间时,另一个值得关注的维度是模型大小,因为在许多情况下,可以使用不同尺寸的模型版本。较小的尺寸版本可显著减少参数数量,进而减少运行模型所需的纳米级内存和算术运算量,但这一点并不一定意味着执行时间会相应减少。本文通过评估三种不同的基于Transformer的模型——Bidirectional Encoder Representations from Transformer(BERT)、Transfer Text-to-Text Transformer(T5)和Contrastive Language-Image Pre-training model(CLIP)及其在三种不同纳米级硬件平台上运行时对应的缩减版本,研究了模型大小与执行时间之间的关系。
Keyword:
Encoding
Computational modeling
Bidirectional control
Transformers
Graphics processing units
Hardware
Decoding
Complexity theory
Central Processing Unit
Nanoscale devices
Artificial intelligence
transformers
nanoscale computing
evaluation
tiny models

期刊

I
IEEE Nanotechnology Magazine
IF:
2.7
论文数:
28
被引数:
5

机构

天津大学 封面图
天津大学
学者数:
8.5K
论文数: 2.4K
被引数: 4.7W
U
Universidad Politecnica de Madrid
学者数:
546
论文数: 260
被引数: 7.0K
引用论文

引用论文

Learning Semantic Textual Similarity from Conversations
err2018-01-01
err0
errOAAI
errYinfei Yang; Steve Yuan; Daniel Cer; Sheng-yi Kong; Noah Constant; Petr Pilar; Heming Ge; Yun-Hsuan Sung; Brian Strope; Ray Kurzweil
err分享
err收藏
Advances in Neuromorphic Spin-Based Spiking Neural Networks: A review
err2021-10-01
err0
PREAI
errVerma,Gaurav; Bindal,Namita; Nisar,Arshid; Dhull,Seema; Kaushik,Brajesh Kumar
err分享
err收藏
Attention-Based Adversarial Robust Distillation in Radio Signal Classifications for Low-Power IoT Devices
err2023-02-01
err8
errOAAI
errZhang, Lu; Lambotharan, Sangarapillai; Zheng, Gan; Liao, Guisheng; AsSadhan, Basil; Roli, Fabio
err分享
err收藏
Emerging Computing Mechanisms for Edge AI
err
IF0
err2025-01-01
err0
PREAI
errBokyung Kim; Hai Helen Li; Yiran Chen
err分享
err收藏
err
IF0
err
err0
errOAAI
err
err分享
err收藏
TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight InheritanceTinyCLIP: 基于亲和度模仿和权重继承的CLIP蒸馏
err2023-10-01
err0
errOAAI
errKan Wu; Houwen Peng; Zhenghong Zhou; Bin Xiao; Mengchen Liu; Lu Yuan; Hong Xuan; Michael Valenzuela; Xi Stephen Chen; Xinggang Wang; Hongyang Chao; Han Hu
err分享
err收藏
TFormer: A Transmission-Friendly ViT Model for IoT Devices
err2023-02-01
err5
errOAAI
errLu, Zhichao; Ding, Chuntao; Juefei-Xu, Felix; Boddeti, Vishnu Naresh; Wang, Shangguang; Yang, Yun
err分享
err收藏
学者 查看更多内容