Better feedback for educational online judges
Visualitza/Obre
Cita com:
hdl:2117/28174
Tipus de documentText en actes de congrés
Data publicació2014
EditorSciTePress
Condicions d'accésAccés obert
Tots els drets reservats. Aquesta obra està protegida pels drets de propietat intel·lectual i
industrial corresponents. Sense perjudici de les exempcions legals existents, queda prohibida la seva
reproducció, distribució, comunicació pública o transformació sense l'autorització del titular dels drets
Abstract
The verdicts of most online programming judges are, essentially, binary: the submitted codes are either “good enough” or not. Whilst this policy is appropriate for competitive or recruitment platforms, it can hinder the adoption of online judges on educative settings, where it could be adequate to provide better feedback to a student (or instructor) that has submitted a wrong code. An obvious option would be to just show him or her an instance where the code fails. However, that particular instance could be not very significant, and so could induce unreflectively patching the code. The approach considered in this paper is to data mine all the past incorrect submissions by all the users of the judge, so to extract a small subset of private test cases that may be relevant to most future users. Our solution is based on parsing the test files, building a bipartite graph, and solving a Set Cover problem by means of Integer Linear Programming. We have tested our solution with a hundred problems in Jutge.org. Those experiments suggest that our approach is general, efficient, and provides high quality results.
CitacióMani, A. [et al.]. Better feedback for educational online judges. A: International Conference on Computer Supported Education. "Proceedings of the 6th International Conference on Computer Supported Education, Volume 2: Barcelona, Spain, 1-3 April, 2014". Barcelona: SciTePress, 2014, p. 176-183.
ISBN978-989-758-021-5
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
csedu-2014.pdf | 133,3Kb | Visualitza/Obre |