Back to Main Conference 2012
LREC 2012main
LG-Eval: A Toolkit for Creating Online Language Evaluation Experiments
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC 2012)
Abstract
In this paper we describe the LG-Eval toolkit for creating online language evaluation experiments. LG-Eval is the direct result of our work setting up and carrying out the human evaluation experiments in several of the Generation Challenges shared tasks. It provides tools for creating experiments with different kinds of rating tools, allocating items to evaluators, and collecting the evaluation scores.