.png){kind=icon}
返回
Efficient Transformers: A Survey
.png){kind=icon}
OA
AI
DOI：10.1145/3530811.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Transformer model architectures have garnered immense interest lately due to their effectiveness across a range of domains like language, vision, and reinforcement learning. In the field of natural language processing for example, Transformers have become an indispensable staple in the modern deep learning stack. Recently, a dizzying number of X- former models have been proposed-Reformer, Linformer, Performer, Longformer, to name a few which improve upon the original Transformer architecture, many of which make improvements around computational and memory efficiency. With the aim of helping the avid researcher navigate this flurry, this article characterizes a large and thoughtful selection of recent efficiency-flavored X-former models, providing an organized and comprehensive overview of existing work and models across multiple domains.
Keyword:
Transformers
attention
deep learning
neural networks
期刊
IF:
28
论文数:
2.4K
被引数:
3.5W
机构
引用论文
Recent Development of Dual-Dictionary Learning Approach in Medical Image Analysis and Reconstruction
OAAI
OAAI分享收藏Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系？
PREAI
分享收藏分享收藏Phosphomimetic Substitution of CytochromecTyrosine 48 Decreases Respiration and Binding to Cardiolipin and Abolishes Ability to Trigger Downstream Caspase Activation.png)
Biochemistry
BiochemistryIF0
PREAI
分享收藏Brain-derived neurotrophic factor as a model system for examining gene by environment interactions across developmentNeuroscienceOAAI
NeuroscienceIF0
OAAI分享收藏
查看更多内容