NEW CONFIDENCE MEASURES FOR STATISTICAL MACHINE TRANSLATION

Sylvain Raybaud, Caroline Lavecchia, David Langlois, Kamel Smaïli

2009

Abstract

A confidence measure is able to estimate the reliability of an hypothesis provided by a machine translation system. The problem of confidence measure can be seen as a process of testing: we want to decide whether the most probable sequence of words provided by the machine translation system is correct or not. In the following we describe several original word-level confidence measures for machine translation, based on mutual information, n-gram language model and lexical features language model. We evaluate how well they perform individually or together, and show that using a combination of confidence measures based on mutual information yields a classification error rate as low as 25.1% with an F-measure of 0.708.

Paper Citation

in Harvard Style

Raybaud S., Lavecchia C., Langlois D. and Smaïli K. (2009). NEW CONFIDENCE MEASURES FOR STATISTICAL MACHINE TRANSLATION . In Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-8111-66-1, pages 61-68. DOI: 10.5220/0001660600610068

in Bibtex Style

@conference{icaart09,
author={Sylvain Raybaud and Caroline Lavecchia and David Langlois and Kamel Smaïli},
title={NEW CONFIDENCE MEASURES FOR STATISTICAL MACHINE TRANSLATION},
booktitle={Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2009},
pages={61-68},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001660600610068},
isbn={978-989-8111-66-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - NEW CONFIDENCE MEASURES FOR STATISTICAL MACHINE TRANSLATION
SN - 978-989-8111-66-1
AU - Raybaud S.
AU - Lavecchia C.
AU - Langlois D.
AU - Smaïli K.
PY - 2009
SP - 61
EP - 68
DO - 10.5220/0001660600610068