jul 3, 2017 - Automatic Grading and Feedback Using Program Repair for Introductory Programming Courses
Description:
Authors:
- Sagar Parihar
- Rajdeep Das
- Ziyaan Dadachanji
- Amey Karkare
- Praveen Kumar Singh
- Arnab Bhattacharya
Conference:
Innovation and Technology in Computer Science Education 2017 (ITiCSE'17)
Abstract:
We present GradeIT, a system that combines the dual objectives of automated grading and program repairing for introductory programming courses (CS1). Syntax errors pose a significant challenge for testcase-based grading as it is difficult to differentiate between a submission that is almost correct and has some minor syntax errors and another submission that is completely off-the-mark. GradeIT also uses program repair to help in grading submissions that do not compile. This enables running testcases on submissions containing minor syntax errors, thereby awarding partial marks for these submissions (which, without repair, do not compile successfully and, hence, do not pass any testcase). Our experiments on 15613 submissions show that GradeIT results are comparable to manual grading by teaching assistants (TAs), and do not suffer from unintentional variability that happens when multiple TAs grade the same assignment. The repairs performed by GradeIT enabled successful compilation of 56% of the submissions having compilation errors, and resulted in an improvement in marks for 11% of these submissions.
Keywords:
CS1; Programming Assignments; Automated Grading
Link:
file:///C:/Users/yeray/Zotero/storage/5N57TDC7/Parihar%20et%20al.%20-%202017%20-%20Automatic%20Grading%20and%20Feedback%20Using%20Program%20Repai.pdf
Added to timeline:
Automatic Assessment Systems Timeline
Date:
