Explaining Unintelligible Words by Means of their Context

Balázs Pintér, Gyula Vörös, Zoltán Szabó, András Lőrincz

2013

Abstract

Explaining unintelligible words is a practical problem for text obtained by optical character recognition, from the Web (e.g., because of misspellings), etc. Approaches to wikification, to enriching text by linking words to Wikipedia articles, could help solve this problem. However, existing methods for wikification assume that the text is correct, so they are not capable of wikifying erroneous text. Because of errors, the problem of disambiguation (identifying the appropriate article to link to) becomes large-scale: as the word to be disambiguated is unknown, the article to link to has to be selected from among hundreds, maybe thousands of candidate articles. Existing approaches for the case where the word is known build upon the distributional hypothesis: words that occur in the same contexts tend to have similar meanings. The increased number of candidate articles makes the difficulty of spuriously similar contexts (when two contexts are similar but belong to different articles) more severe. We propose a method to overcome this difficulty by combining the distributional hypothesis with structured sparsity, a rapidly expanding area of research. Empirically, our approach based on structured sparsity compares favorably to various traditional classification methods.

Download


Paper Citation


in Harvard Style

Pintér B., Vörös G., Szabó Z. and Lőrincz A. (2013). Explaining Unintelligible Words by Means of their Context . In Proceedings of the 2nd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-8565-41-9, pages 382-387. DOI: 10.5220/0004267003820387

in Bibtex Style

@conference{icpram13,
author={Balázs Pintér and Gyula Vörös and Zoltán Szabó and András Lőrincz},
title={Explaining Unintelligible Words by Means of their Context},
booktitle={Proceedings of the 2nd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2013},
pages={382-387},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004267003820387},
isbn={978-989-8565-41-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Explaining Unintelligible Words by Means of their Context
SN - 978-989-8565-41-9
AU - Pintér B.
AU - Vörös G.
AU - Szabó Z.
AU - Lőrincz A.
PY - 2013
SP - 382
EP - 387
DO - 10.5220/0004267003820387