arrow
Return

Efficient Methods for Natural Language Processing: A Survey

delete2023-07-12
delete22
delete
OA
AI
M
Marcos Treviso *
J
Ji, Tianchu
J
Ji-Ung Lee
B
Betty van Aken
Q
Qingqing Cao
M
Manuel R. Ciosici
M
Michael Hassid
K
Kenneth Heafield
S
Sara Hooker
H
H. Martins, Pedro
F
F. T. Martins, Andre
M
Milder, Peter
R
Raffel, Colin
E
Edwin Simpson
S
Slonim, Noam
D
Dodge, Jesse
S
Strubell, Emma
B
Balasubramanian, Niranjan
D
Derczynski, Leon
G
Gurevych, Iryna
S
Schwartz, Roy
DOI:10.1162/tacl_a_00577delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Getting the most out of limited resources allows advances in natural language processing (NLP) research and practice while being conservative with resources. Those resources may be data, time, storage, or energy. Recent work in NLP has yielded interesting results from scaling; however, using only scale to improve results means that resource consumption also scales. That relationship motivates research into efficient methods that require less resources to achieve similar results. This survey relates and synthesises methods and findings in those efficiencies in NLP, aiming to guide new researchers in the field and inspire the development of new methods.
Keywords:
ATTENTION

Journal

T
Transactions of the Association for Computational Linguistics
IF:
6.9
Papers:
486
Citations:
5.7K

Organization

B
berliner hochschule fur technik
Scholars:
132
Papers: 104
Citations: 0
U
universidade de lisboa
Scholars:
3.4W
Papers: 3.1W
Citations: 29
B
Brown University
Scholars:
2.4W
Papers: 2.2W
Citations: 3.2W
U
university of southern california
Scholars:
4.6W
Papers: 3.8W
Citations: 51
S
stony brook university
Scholars:
1.3W
Papers: 1.0W
Citations: 20
U
university of north carolina
Scholars:
7.4W
Papers: 6.5W
Citations: 93
U
University of Washington
Scholars:
8.0W
Papers: 7.0W
Citations: 12.5W
S
state university of new york (suny) system
Scholars:
6.5W
Papers: 5.8W
Citations: 65
I
international business machines (ibm)
Scholars:
5.7K
Papers: 4.5K
Citations: 4
H
Hebrew University of Jerusalem
Scholars:
2.8W
Papers: 2.3W
Citations: 2.7W
U
University of Bristol
Scholars:
3.1W
Papers: 3.0W
Citations: 5.3W
U
University of North Carolina Chapel Hill
Scholars:
3.9W
Papers: 3.1W
Citations: 46
T
Technical University of Darmstadt
Scholars:
1.3W
Papers: 10.0K
Citations: 1.2W
U
University of Edinburgh
Scholars:
5.1W
Papers: 4.6W
Citations: 71
researcher View more organizations