arrow
返回

The interactive reading task: Transformer-based automatic item generation

delete2022-07-22
delete25
delete
OA
AI
Y
Yigal Attali *
A
Andrew Runge
G
Geoffrey T. LaFlair
K
Kevin Yancey
S
Sarah Goodwin
Y
Yena Park
DOI:10.3389/frai.2022.903077delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Automatic item generation (AIG) has the potential to greatly expand the number of items for educational assessments, while simultaneously allowing for a more construct-driven approach to item development. However, the traditional item modeling approach in AIG is limited in scope to content areas that are relatively easy to model (such as math problems), and depends on highly skilled content experts to create each model. In this paper we describe the interactive reading task, a transformer-based deep language modeling approach for creating reading comprehension assessments. This approach allows a fully automated process for the creation of source passages together with a wide range of comprehension questions about the passages. The format of the questions allows automatic scoring of responses with high fidelity (e.g., selected response questions). We present the results of a large-scale pilot of the interactive reading task, with hundreds of passages and thousands of questions. These passages were administered as part of the practice test of the Duolingo English Test. Human review of the materials and psychometric analyses of test taker results demonstrate the feasibility of this approach for automatic creation of complex educational assessments.
Keyword:
automatic item generation
reading assessment
language modeling
transformer models
psychometrics
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

F
Frontiers in Artificial Intelligence
IF:
4.7
论文数:
2.5K
被引数:
4.4K

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
err分享
err收藏
err分享
err收藏
Next-Generation Sequencing Gene Panels in Inheritable Cardiomyopathies and Channelopathies: Prevalence of Pathogenic Variants and Variants of Unknown Significance in Uncommon Genes
err2022-10-03
err0
errOAAI
errCristina Mazzaccara; Raffaella Lombardi; Bruno Mirra; Ferdinando Barretta; Maria Valeria Esposito; Fabiana Uomo; Martina Caiazza; Emanuele Monda; Maria Angela Losi; Giuseppe Limongelli; Valeria D’Argenio; Giulia Frisso
err分享
err收藏
Preparation and characterization of metal/ceramic nanoporous nanocomposite powders
err2003-10-01
err0
PREAI
errY.-H Choa; J.-K Yang; B.-H Kim; Y.-K Jeong; J.-S Lee; T Nakayama; T Sekino; K Niihara
err分享
err收藏
Total synthesis of madindoline A
err2000-08-01
err0
PREAI
errSeijiro Hosokawa; Kazuhiko Sekiguchi; Kanako Hayase; Yasushi Hirukawa; Susumu Kobayashi
err分享
err收藏
err分享
err收藏
学者 查看更多内容