A Word Association Based Approach for Improving Retrieval Performance from Noisy OCRed Text

Anirban Chakraborty, Kripabandhu Ghosh, Utpal Roy

2014

Abstract

OCR errors hurt retrieval performance to a great extent. Research has been done on modelling and correction of OCR errors. However, most of the existing systems use language dependent resources or training texts for studying the nature of errors. Not much research has been reported on improving retrieval performance from erroneous text when no training data is available. We propose an algorithm of detecting OCR errors and improving retrieval performance from the erroneous corpus. We present two versions of the algorithm: one based on word cooccurrence and the other based on Pointwise Mutual Information. Our algorithm does not use any training data or any language specific resources like thesaurus. It also does not use any knowledge about the language except that the word delimiter is a blank space. We have tested our algorithm on erroneous Bangla FIRE collection and obtained significant improvements.

Paper Citation

in Harvard Style

Chakraborty A., Ghosh K. and Roy U. (2014). A Word Association Based Approach for Improving Retrieval Performance from Noisy OCRed Text . In Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2014) ISBN 978-989-758-048-2, pages 450-456. DOI: 10.5220/0005157304500456

in Bibtex Style

@conference{kdir14,
author={Anirban Chakraborty and Kripabandhu Ghosh and Utpal Roy},
title={A Word Association Based Approach for Improving Retrieval Performance from Noisy OCRed Text},
booktitle={Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2014)},
year={2014},
pages={450-456},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005157304500456},
isbn={978-989-758-048-2},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2014)
TI - A Word Association Based Approach for Improving Retrieval Performance from Noisy OCRed Text
SN - 978-989-758-048-2
AU - Chakraborty A.
AU - Ghosh K.
AU - Roy U.
PY - 2014
SP - 450
EP - 456
DO - 10.5220/0005157304500456