arrow
返回

CSF2: Formative Feedback in Autograding

delete2021-05-10
delete7
PRE
AI
G
Georgiana Haldeman *
M
Monica Babeş-Vroman
A
Andrew Tjang
T
Thu D. Nguyen
DOI:10.1145/3445983delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Autograding systems are being increasingly deployed to meet the challenges of teaching programming at scale. Studies show that formative feedback can greatly help novices learn programming. This work extends an autograder, enabling it to provide formative feedback on programming assignment submissions. Our methodology starts with the design of a knowledge map, which is the set of concepts and skills that are necessary to complete an assignment, followed by the design of the assignment and that of a comprehensive test suite for identifying logical errors in the submitted code. Test cases are used to test the student submissions and learn classes of common errors. For each assignment, we train a classifier that automatically categorizes errors in a submission based on the outcome of the test suite. The instructor maps the errors to corresponding concepts and skills and writes hints to help students find their misconceptions and mistakes. We apply this methodology to two assignments in our Introduction to Computer Science course and find that the automatic error categorization has a 90% average accuracy. We report and compare data from two semesters, one semester when hints are given for the two assignments and one when hints are not given. Results show that the percentage of students who successfully complete the assignments after an initial erroneous submission is three times greater when hints are given compared to when hints are not given. However, on average, even when hints are provided, almost half of the students fail to correct their code so that it passes all the test cases. The initial implementation of the framework focuses on the functional correctness of the programs as reflected by the outcome of the test cases. In our future work, we will explore other kinds of feedback and approaches to automatically generate feedback to better serve the educational needs of the students.
Keyword:
Autograding
computer science concepts and skills map
error extraction and categorization
code clustering
formative and corrective feedback
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

A
ACM Transactions on Quantum Computing
IF:
6.8
论文数:
542
被引数:
508

机构

R
rutgers university system
学者数:
4.1W
论文数: 3.7W
被引数: 53
引用论文

引用论文

Enhanced gene expression of transforming growth factor-? and c-met in rat urinary bladder cancer
err1996-02-01
err0
PREAI
errM. Inui; N. Nishi; A. Yasumoto; I. Takenaka; H. Miyanaka; K. Matsumoto; T. Nakamura; F. Wada
err分享
err收藏
err分享
err收藏
Comparison of Three Prehospital Cervical Spine Protocols for Missed Injuries
err2014-07-07
err0
errOAAI
errRick Hong; Molly Meenan; Erin Prince; Ronald Murphy; Caitlin Tambussi; Rick Rohrbach; Brigitte Baumann
err分享
err收藏
err分享
err收藏
Text features and preschool teachers’ use of print referencing
err2011-11-29
err0
PREAI
errJaclyn M. Dynia; Laura M. Justice; Jill M. Pentimonti; Shayne B. Piasta; Joan N. Kaderavek
err分享
err收藏
Flexible head-casts for high spatial precision MEG
err2017-01-01
err0
errOAAI
errSofie S. Meyer; James Bonaiuto; Mark Lim; Holly Rossiter; Sheena Waters; David Bradbury; Sven Bestmann; Matthew Brookes; Martina F. Callaghan; Nikolaus Weiskopf; Gareth R. Barnes
err分享
err收藏
学者 查看更多内容