Back to Main Conference 2004
LREC 2004main
NIST Language Technology Evaluation Cookbook
Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 2004)
Abstract
We review some of the methodology applied to the various NIST language technology evaluations. We discuss the elements included in each evaluation plan, and suggest what we believe are key practices for successful evaluations, and what pitfalls should be avoided. A couple of lessons learned are noted.