A Tool for N-way analysis of programming exercises
Document typeConference report
PublisherEuropean Association for Computer Graphics (Eurographics)
Rights accessOpen Access
Programming exercises are a corner stone in Computer Science courses. If used properly, these exercises provide valuable feedback both to students and instructors. Unfortunately, the assessment of student submissions through code inspection requires a considerable amount of time. In this work we present an interactive tool to support the analysis of code submissions before, during, and after grading. The key idea is to compute a dissimilarity matrix for code submissions, using a metric that incorporates syntactic, semantic and functional aspects of the code. This matrix is used to embed the submissions in 2D space, so that similar submissions are mapped to nearby locations. The tool allows users to visually identify clusters, inspect individual submissions, and perform detailed pair-wise and abridged n-way comparisons. Finally, our approach facilitates comparative scoring by presenting submissions in a nearly-optimal order, i.e. similar submissions appear close in the sequence. Our initial evaluation indicates that the tool (currently supporting C++/GLSL code) provides clear benefits both to students (more fair scores, less bias, more consistent feedback) and instructors (less effort, better feedback on student performance).
CitationAndújar, C. [et al.]. A Tool for N-way analysis of programming exercises. A: Eurographics Conference on Visualization. "EuroVis 2020, Eurographics / IEEE VGTC Conference on Visualization 2020: Norrköping, Sweden, May 25–29, 2020: posters". European Association for Computer Graphics (Eurographics), 2020, p. 33-35.
All rights reserved. This work is protected by the corresponding intellectual and industrial property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public communication or transformation of this work are prohibited without permission of the copyright holder