Towards Computer-based Exams in CS1

Vesa Lappalainen, Antti-Jussi Lakanen, Harri Högmander

2017

Abstract

Even though IDEs are often a central tool when learning to program in CS1, many teachers still lean on paper-based exams. In this study, we examine the “test mode effect” in CS1 exams using the Rainfall problem. The test mode was two-phased. Half of the participants started working on the problem with pen and paper, while the other half had access to an IDE. After submitting their solution, all students could rework their solution on an IDE. The experiment was repeated twice during subsequent course instances. The results were mixed. From the marking perspective, there was no statistically significant difference resulting from the mode. However, the students starting with the paper-based part tended to make more errors in their code, but after the computer-based reworking phase, they matched or exceeded the level of the students who started with the computer-based phase. We also discuss the reliability of automatic assessment that is based on a unit test suite that was developed for the purposes of this study.

Paper Citation

in Harvard Style

Lappalainen V., Lakanen A. and Högmander H. (2017). Towards Computer-based Exams in CS1 . In Proceedings of the 9th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-240-0, pages 125-136. DOI: 10.5220/0006323501250136

in Bibtex Style

@conference{csedu17,
author={Vesa Lappalainen and Antti-Jussi Lakanen and Harri Högmander},
title={Towards Computer-based Exams in CS1},
booktitle={Proceedings of the 9th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2017},
pages={125-136},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006323501250136},
isbn={978-989-758-240-0},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - Towards Computer-based Exams in CS1
SN - 978-989-758-240-0
AU - Lappalainen V.
AU - Lakanen A.
AU - Högmander H.
PY - 2017
SP - 125
EP - 136
DO - 10.5220/0006323501250136