arrow
Return

Evaluating factual accuracy in complex data-to-text

delete2023-05-01
delete5
delete
OA
AI
C
Craig Thomson *
E
Ehud Reiter
B
Barkavi Sundararajan
DOI:10.1016/j.csl.2023.101482delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
It is essential that data-to-text Natural Language Generation (NLG) systems produce texts which are factually accurate. We examine accuracy issues in the task of generating summaries of basketball games, including what accuracy means in this context, how accuracy errors can be detected by human annotators, as well as the types of accuracy mistakes made by both neural NLG systems and human authors. We also look at the effectiveness of automatic metrics in measuring factual accuracy.
Keywords:
Natural Language Generation
Complex data -to -text
Evaluation
Annotation
Factual accuracy
Neural data -to -text
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

C
Computer Speech and Language
IF:
3.4
Papers:
1.5K
Citations:
2.6K

Organization

U
University of Aberdeen
Scholars:
1.3W
Papers: 1.3W
Citations: 2.0W