.png){kind=icon}
返回
Pre-trained language models: What do they know?
.png){kind=icon}
PRE
AI
DOI：10.1002/widm.1518.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Large language models (LLMs) have substantially pushed artificial intelligence (AI) research and applications in the last few years. They are currently able to achieve high effectiveness in different natural language processing (NLP) tasks, such as machine translation, named entity recognition, text classification, question answering, or text summarization. Recently, significant attention has been drawn to OpenAI's GPT models' capabilities and extremely accessible interface. LLMs are nowadays routinely used and studied for downstream tasks and specific applications with great success, pushing forward the state of the art in almost all of them. However, they also exhibit impressive inference capabilities when used off the shelf without further training. In this paper, we aim to study the behavior of pre-trained language models (PLMs) in some inference tasks they were not initially trained for. Therefore, we focus our attention on very recent research works related to the inference capabilities of PLMs in some selected tasks such as factual probing and common-sense reasoning. We highlight relevant achievements made by these models, as well as some of their current limitations that open opportunities for further research.This article is categorized under:Fundamental Concepts of Data and Knowledge > Key Design Issues in DataMiningTechnologies > Artificial Intelligence
Keyword:
large language models
natural language
pretrained language models
processing
期刊
IF:
11.7
论文数:
546
被引数:
5.3K
机构
引用论文
.png){kind=icon}
Exergy efficiency optimization of a thermoacoustic engine with a complex heat transfer exponent
PREAI
分享收藏
分享收藏
Optimal design of step-stress accelerated degradation tests based on the Wiener degradation process基于维纳退化过程的步进应力加速退化试验优化设计
PREAI
分享收藏
查看更多内容