Interaction Patterns in Computer-assisted Semantic Annotation of Text - An Empirical Evaluation

Jaroslav Dytrych, Pavel Smrz

2016

Abstract

This paper examines user interface options and interaction patterns evinced in tools for computer-assisted semantic enrichment of text. It focuses on advanced annotation tasks such as hierarchical annotation of complex relations and linking entities with highly ambiguous names and explores how decisions on particular aspects of annotation interfaces influence the speed and the quality of computer-assisted human annotation processes. Reported experiments compare the 4A annotation system, designed and implemented by our team, to RDFaCE and GATE tools that all provide advanced annotation functionality. Results show that users are able to reach better consistency of event annotations in less time when using the 4A editor. A set of experiments is then conducted that employ 4A’s high flexibility and customizability to find an optimal amount of displayed information and its presentation form to reach best results in linking entities with highly ambiguous names. The last set of experiments then proves that 4A’s particular way of implementing the concept of semantic filtering speeds up event annotation processes and brings higher consistency when compared to alternative approaches.

Paper Citation

in Harvard Style

Dytrych J. and Smrz P. (2016). Interaction Patterns in Computer-assisted Semantic Annotation of Text - An Empirical Evaluation . In Proceedings of the 8th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-172-4, pages 74-84. DOI: 10.5220/0005695900740084

in Bibtex Style

@conference{icaart16,
author={Jaroslav Dytrych and Pavel Smrz},
title={Interaction Patterns in Computer-assisted Semantic Annotation of Text - An Empirical Evaluation},
booktitle={Proceedings of the 8th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2016},
pages={74-84},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005695900740084},
isbn={978-989-758-172-4},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - Interaction Patterns in Computer-assisted Semantic Annotation of Text - An Empirical Evaluation
SN - 978-989-758-172-4
AU - Dytrych J.
AU - Smrz P.
PY - 2016
SP - 74
EP - 84
DO - 10.5220/0005695900740084