Evaluation of Concept Importance in Concept Maps Mined from Lecture Notes - Computer Vs Human

Thushari Atapattu, Katrina Falkner, Nickolas Falkner

2014

Abstract

Concept maps are commonly used tools for organising and representing knowledge in order to assist meaningful learning. Although the process of constructing concept maps improves learners’ cognitive structures, novice students typically need substantial assistance from experts. Alternatively, expert-constructed maps may be given to students, which increase the workload of academics. To overcome this issue, automated concept map extraction has been introduced. One of the key limitations is the lack of an evaluation framework to measure the quality of machine-extracted concept maps. At present, researchers in this area utilise human experts’ judgement or expert-constructed maps as the gold standard to measure the relevancy of extracted knowledge components. However, in the educational context, particularly in course materials, the majority of knowledge presented is relevant to the learner, resulting in a large amount of information that has to be organised. Therefore, this paper introduces a machine-based approach which studies the relative importance of knowledge components and organises them hierarchically. We compare machine-extracted maps with human judgment, based on expert knowledge and perception. This paper describes three ranking models to organise domain concepts. The results show that the auto-generated map positively correlates with human judgment (rs~1) for well-structured courses with rich grammar (well-fitted contents).

Paper Citation

in Harvard Style

Atapattu T., Falkner K. and Falkner N. (2014). Evaluation of Concept Importance in Concept Maps Mined from Lecture Notes - Computer Vs Human . In Proceedings of the 6th International Conference on Computer Supported Education - Volume 1: CSEDU, ISBN 978-989-758-020-8, pages 75-84. DOI: 10.5220/0004842300750084

in Bibtex Style

@conference{csedu14,
author={Thushari Atapattu and Katrina Falkner and Nickolas Falkner},
title={Evaluation of Concept Importance in Concept Maps Mined from Lecture Notes - Computer Vs Human},
booktitle={Proceedings of the 6th International Conference on Computer Supported Education - Volume 1: CSEDU,},
year={2014},
pages={75-84},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004842300750084},
isbn={978-989-758-020-8},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 6th International Conference on Computer Supported Education - Volume 1: CSEDU,
TI - Evaluation of Concept Importance in Concept Maps Mined from Lecture Notes - Computer Vs Human
SN - 978-989-758-020-8
AU - Atapattu T.
AU - Falkner K.
AU - Falkner N.
PY - 2014
SP - 75
EP - 84
DO - 10.5220/0004842300750084