.png){kind=icon}
Return
Evaluating Human Pairwise Preference Judgments
.png){kind=icon}
OA
AI
DOI：10.1162/COLI_a_00222.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Human evaluation plays an important role in NLP, often in the form of preference judgments. Although there has been some use of classical non-parametric and bespoke approaches to evaluating these sorts of judgments, there is an entire body of work on this in the context of sensory discrimination testing and the human judgments that are central to it, backed by rigorous statistical theory and freely available software, that NLP can draw on. We investigate one approach, Log-Linear Bradley-Terry models, and apply it to sample NLP data.
Keywords:
RESPONSES
MODELS
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
5.3
Papers:
837
Citations:
2.7K
Organization
Cited Papers
Dynamics of the composite gauge boson in the CPN−1 model with fermion and the charge-spin separation
PREAI
ShareSaveIntermarriage and COVID-19 mortality among immigrants. A population-based cohort study from Sweden.png)
BMJ Open
OAAI
BMJ OpenIF0
OAAIShareSaveModels for Paired Comparison Data: A Review with Emphasis on Dependent DataSTATISTICAL SCIENCEOAAI
STATISTICAL SCIENCEIF3.4
OAAIShareSaveShareSaveShareSave no more
no more