Back to Main Conference 2000
LREC 2000main
Evaluation of Word Alignment Systems
Proceedings of the Second International Conference on Language Resources and Evaluation (LREC 2000)
Abstract
Recent years have seen a few serious attempts to develop methods and measures for the evaluation of word alignment systems, notably the Blinker project (Melamed, 1998) and the ARCADE project (Véronis and Langlais, forthcoming). In this paper we discuss different approaches to the problem and report on results from a project where two word alignment systems have been evaluated. These results include methods and tools for the generation of reference data and a set of measures for system performance. We note that the selection and sampling of reference data can have a great impact on scoring results.