Comparative Evaluation of a Stochastic Parser on Semantic and Syntactic-semantic Labels

Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 2004)

Abstract

This paper deals with the evaluation of a stochastic component for natural language understanding alternatively trained on semantic and syntactic-semantic labels. The parser uses semantically-labeled speech data gathered using the LIMSI-ARISE interactive speech system for train travel information retrieval in French. The study shows that introducing additional and coherent information into the semantic corpus allows to relatively improve the semantic frame accuracy of the parser by up to 16.5%. The more complex models yielding a high number of parameters are justified, as long as they convey significant information.