arrow
Return

Automated short answer grading with computer-assisted grading example acquisition based on active learning

delete2022-12-05
delete1
PRE
AI
A
Andrew Kwok-Fai Lui *
S
Sin-Chun Ng
S
Stella Wing-Nga Cheung
DOI:10.1080/10494820.2022.2137530delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The technology of automated short answer grading (ASAG) can efficiently process answers according to human-prepared grading examples. Computer-assisted acquisition of grading examples uses a computer algorithm to sample real student responses for potentially good examples. The process is critical for optimizing the grading accuracy of machine learning models given a budget of human effort and the appeal of ASAG to online learning providers. This paper presents a novel method called short answer grading with active learning (SAGAL) that features a unified formulation comprising the heuristics for identifying potentially optimal examples of representative answers, borderline answers, and anomalous answers. The method is based on active learning, which iteratively samples good examples and queries for annotation to increase the sampling accuracy. SAGAL has been evaluated with three different public datasets of distinctive characteristics. The results show that the resulting models generally outperform the baseline semi-supervised learning methods on the same number of grading examples.
Keywords:
Short answer grading
active learning
classification
auto-grading
cost-effectiveness

Journal

Interactive Learning Environments cover
Interactive Learning Environments
IF:
5.3
Papers:
2.8K
Citations:
9.0K

Organization

A
Anglia Ruskin University
Scholars:
2.6K
Papers: 2.5K
Citations: 3.3K
H
Hong Kong Metropolitan University
Scholars:
1.0K
Papers: 1.1K
Citations: 805
Cited Papers

Cited Papers

Framework for Active Clustering With Ensembles
err2014-11-01
err7
PREAI
errBarr, Jeremiah R.; Bowyer, Kevin W.; Flynn, Patrick J.
errShare
errSave
errShare
errSave
errShare
errSave
Retrospective study on PET–SPECT imaging in a large cohort of myotonic dystrophy type 1 patients
err2010-09-15
err0
PREAI
errVincenzo Romeo; E. Pegoraro; F. Squarzanti; G. Sorarù; C. Ferrati; M. Ermani; P. Zucchetta; F. Chierichetti; C. Angelini
errShare
errSave
Visual deficits and cognitive assessment of multiple sclerosis: confounder, correlate, or both?
err2021-02-15
err0
PREAI
errDejan Jakimovski; Ralph H. B. Benedict; Bianca Weinstock-Guttman; Osman Ozel; Tom A. Fuchs; Norah Lincoff; Niels Bergsland; Michael G. Dwyer; Robert Zivadinov
errShare
errSave
Kappa coefficients in medical research
err2002-06-19
err0
PREAI
errHelena Chmura Kraemer; Vyjeyanthi S. Periyakoil; Art Noda
errShare
errSave
Active sampling for class probability estimation and ranking
err2004-02-01
err102
errOAAI
errSaar-Tsechansky, M; Provost, F
errShare
errSave
Fatigue Damage
err1986-01-01
err0
PREAI
errL. M. Kachanov
errShare
errSave
researcher View more