| Title |
Computer-Aided Specification of Quality Models for Machine Translation Evaluation |
| Authors |
Eduard Hovy (USC Information Sciences Institute, 4676 Admiralty Way Marina del Rey, CA 90292-6695, USA) Margaret King (ISSCO / TIM / ETI, University of Geneva, 40 Bvd. du Pont d’Arve CH–1211 Geneva 4, Switzerland) Andrei Popescu-Belis (ISSCO / TIM / ETI, University of Geneva, 40 Bvd. du Pont d’Arve CH–1211 Geneva 4, Switzerland) |
| Session |
EO4: MT Evaluation |
| Abstract |
This article describes the principles and mechanism of an integrative effort in machine translation (MT) evaluation. Building upon previous standardization initiatives, above all ISO/IEC 9126, 14598 and EAGLES, we attempt to classify into a coherent taxonomy most of the characteristics, attributes and metrics that have been proposed for MT evaluation. The main articulation of this flexible framework is the link between a taxonomy that helps evaluators define a context of use for the evaluated software, and a taxonomy of the quality characteristics and associated metrics. The article explains the theoretical grounds of this articulation, along with an overview of the taxonomies in their present state, and a perspective on ongoing work in MT evaluation standardization. |
| Keywords |
Computer-Aided, Taxonomy |
| Full Paper |