SCALABLE CORPUS ANNOTATION BY GRAPH CONSTRUCTION AND LABEL PROPAGATION

Thomas Lansdall-Welfare, Ilias Flaounas, Nello Cristianini

2012

Abstract

The efficient annotation of documents in vast corpora calls for scalable methods of text classification. Representing the documents in the form of graph vertices, rather than in the form of vectors in a bag of words space, allows for the necessary information to be pre-computed and stored. It also fundamentally changes the problem definition, from a content-based to a relation-based classification problem. Efficiently creating a graph where nearby documents are likely to have the same annotation is the central task of this paper. We compare the effectiveness of various approaches to graph construction by building graphs of 800,000 vertices based on the Reuters corpus, showing that relation-based classification is competitive with Support VectorMachines, which can be considered as state of the art. We further show that the combination of our relation-based approach and Support Vector Machines leads to an improvement over the methods individually.

Paper Citation

in Harvard Style

Lansdall-Welfare T., Flaounas I. and Cristianini N. (2012). SCALABLE CORPUS ANNOTATION BY GRAPH CONSTRUCTION AND LABEL PROPAGATION . In Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-8425-98-0, pages 25-34. DOI: 10.5220/0003728700250034

in Bibtex Style

@conference{icpram12,
author={Thomas Lansdall-Welfare and Ilias Flaounas and Nello Cristianini},
title={SCALABLE CORPUS ANNOTATION BY GRAPH CONSTRUCTION AND LABEL PROPAGATION},
booktitle={Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2012},
pages={25-34},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003728700250034},
isbn={978-989-8425-98-0},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - SCALABLE CORPUS ANNOTATION BY GRAPH CONSTRUCTION AND LABEL PROPAGATION
SN - 978-989-8425-98-0
AU - Lansdall-Welfare T.
AU - Flaounas I.
AU - Cristianini N.
PY - 2012
SP - 25
EP - 34
DO - 10.5220/0003728700250034