Using F-structures in Machine Translation Evaluation

Karolina Owczarzak, Yvette Graham and Josef van Genabith

Abstract

Despite a growing interest in automatic evaluation methods for Machine Translation (MT) quality, most existing automatic metrics are still limited to surface comparison of translation and reference strings. In this paper we show how Lexical-Functional Grammar (LFG) labelled dependencies obtained from an automatic parse can be used to assess the quality of MT on a deeper linguistic level, giving as a result higher correlations with human judgements.

Proceedings of LFG07; CSLI Publications On-line