Back to Main Conference 2002
LREC 2002main
Toward an objective and generic Method for Spoken Language Understanding Systems Evaluation: an extension of the DCR method
Proceedings of the Third International Conference on Language Resources and Evaluation (LREC 2002)
Abstract
In this paper, we present an extension of the DCR method, which is a framework for the deep evaluation of Spoken Language Understanding (SLU) Systems. The key point of our contribution is the use of a linguistic typology in order to generate an evaluation corpus that covers a significant number of the linguistic phenomena we want to evaluate our system on. This allows to have more objective and deep evaluation of SLU systems.