Detection of Inconsistencies in Student Evaluations

Štefan Pero, Tomáš Horváth

2013

Abstract

Evaluation of the solutions for the tasks or projects solved by students is a complex process driven mainly by the subjective evaluation criteria of a given teacher. Each teacher is somehow biased meaning how strict she is in assessing grades to solutions. Besides the teacher’s bias there are also some other factors contributing to grading, for example, teachers can make mistakes, the grading scale is too rough-grained or too fine-grained, etc. Grades are often provided together with teacher’s textual evaluations which are considered to be more expressive as a single number. Such textual evaluations, however, should be consistent with grades, meaning that if two solutions have very similar textual evaluations their grades should be also very similar. Though, some inconsistencies between textual evaluations and grades provided by the teacher used to arise, especially, when a teacher has to assess a large number of solutions, or if more than one teacher is involved in the evaluation process. We propose a simple approach for detection of inconsistencies between textual evaluations and grades in this paper. Experiments are provided on two real-world datasets collected from the teaching process at our university.

Paper Citation

in Harvard Style

Pero Š. and Horváth T. (2013). Detection of Inconsistencies in Student Evaluations . In Proceedings of the 5th International Conference on Computer Supported Education - Volume 1: CSEDU, ISBN 978-989-8565-53-2, pages 246-249. DOI: 10.5220/0004385602460249

in Bibtex Style

@conference{csedu13,
author={Štefan Pero and Tomáš Horváth},
title={Detection of Inconsistencies in Student Evaluations},
booktitle={Proceedings of the 5th International Conference on Computer Supported Education - Volume 1: CSEDU,},
year={2013},
pages={246-249},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004385602460249},
isbn={978-989-8565-53-2},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Computer Supported Education - Volume 1: CSEDU,
TI - Detection of Inconsistencies in Student Evaluations
SN - 978-989-8565-53-2
AU - Pero Š.
AU - Horváth T.
PY - 2013
SP - 246
EP - 249
DO - 10.5220/0004385602460249