Toward more robust automatic analysis of student program outputs for assessment and learning
Author(s)
Poon, Chung Keung
Wong, Tak Lam
Author(s)
Yu, Y. T.
Lee, V. C. S.
Tang, C. M.
Date Issued
2016
Publisher
IEEE
Related Publication(s)
2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC)
Volume
1
Start page
780
End page
785
Abstract
Automated analysis and assessment of students' programs, typically implemented in automated program assessment systems (APASs), are very helpful to both students and instructors in modern day computer programming classes. The mainstream of APASs employs a black-box testing approach which compares students' program outputs with instructor-prepared outputs. A common weakness of existing APASs is their inflexibility and limited capability to deal with admissible output variants, that is, outputs produced by acceptable correct programs that differ from the instructor's. This paper proposes a more robust framework for automatically modelling and analysing student program output variations based on a novel hierarchical program output structure called HiPOS. Our framework assesses student programs by means of a set of matching rules tagged to the HiPOS, which produces a better verdict of correctness. We also demonstrate the capability of our framework by means of a pilot case study using real student programs.
SFU Affiliated Publication
Yes
Availability at SFU Library
No database links found.