Return
Evaluating factual accuracy in complex data-to-text
DOI:10.1016/j.csl.2023.101482.png)
Abstract
En 中文
It is essential that data-to-text Natural Language Generation (NLG) systems produce texts which are factually accurate. We examine accuracy issues in the task of generating summaries of basketball games, including what accuracy means in this context, how accuracy errors can be detected by human annotators, as well as the types of accuracy mistakes made by both neural NLG systems and human authors. We also look at the effectiveness of automatic metrics in measuring factual accuracy.
Keywords:
Natural Language Generation
Complex data -to -text
Evaluation
Annotation
Factual accuracy
Neural data -to -text
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
C
IF:
3.4
Papers:
1.5K
Citations:
2.6K

