返回
CSF2: Formative Feedback in Autograding
DOI:10.1145/3445983.png)
摘要
En 中文
Autograding systems are being increasingly deployed to meet the challenges of teaching programming at scale. Studies show that formative feedback can greatly help novices learn programming. This work extends an autograder, enabling it to provide formative feedback on programming assignment submissions. Our methodology starts with the design of a knowledge map, which is the set of concepts and skills that are necessary to complete an assignment, followed by the design of the assignment and that of a comprehensive test suite for identifying logical errors in the submitted code. Test cases are used to test the student submissions and learn classes of common errors. For each assignment, we train a classifier that automatically categorizes errors in a submission based on the outcome of the test suite. The instructor maps the errors to corresponding concepts and skills and writes hints to help students find their misconceptions and mistakes. We apply this methodology to two assignments in our Introduction to Computer Science course and find that the automatic error categorization has a 90% average accuracy. We report and compare data from two semesters, one semester when hints are given for the two assignments and one when hints are not given. Results show that the percentage of students who successfully complete the assignments after an initial erroneous submission is three times greater when hints are given compared to when hints are not given. However, on average, even when hints are provided, almost half of the students fail to correct their code so that it passes all the test cases. The initial implementation of the framework focuses on the functional correctness of the programs as reflected by the outcome of the test cases. In our future work, we will explore other kinds of feedback and approaches to automatically generate feedback to better serve the educational needs of the students.
Keyword:
Autograding
computer science concepts and skills map
error extraction and categorization
code clustering
formative and corrective feedback
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
A
IF:
6.8
论文数:
542
被引数:
508
机构
引用论文
Temporal expression profiling of plasma proteins reveals oxidative stress in early stages of Type 1 Diabetes progression血浆蛋白的时间表达谱揭示了1型糖尿病进展早期的氧化应激
PERCEIVED USEFULNESS, PERCEIVED EASE OF USE, AND USER ACCEPTANCE OF INFORMATION TECHNOLOGY感知有用性、感知易用性和用户对信息技术的接受度

