arrow
Return

Machine Learning-Driven Language Assessment

delete2020-12-01
delete47
delete
OA
AI
B
Burr Settles *
G
Geoffrey T. LaFlair
M
Masato Hagiwara
DOI:10.1162/tacl_a_00310delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We describe a method for rapidly creating language proficiency assessments, and provide experimental evidence that such tests can be valid, reliable, and secure. Our approach is the first to use machine learning and natural language processing to induce proficiency scales based on a given standard, and then use linguistic models to estimate item difficulty directly for computer-adaptive testing. This alleviates the need for expensive pilot testing with human subjects. We used these methods to develop an online proficiency exam called the Duolingo English Test, and demonstrate that its scores align significantly with other high-stakes English assessments. Furthermore, our approach produces test scores that are highly reliable, while generating item banks large enough to satisfy security requirements.
Keywords:
ENGLISH
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

T
Transactions of the Association for Computational Linguistics
IF:
6.9
Papers:
486
Citations:
5.7K

Organization

No organization information available