LREC 2000 2nd International Conference on Language Resources & Evaluation
 

Previous Paper   Next Paper

Title Methods and Metrics for the Evaluation of Dictation Systems: a Case Study
Authors Canelli Maria (TIM/ISSCO, ETI, University of Geneva, 40 blvd du Pont d’Arve, CH-1211 Geneva 4)
Grasso Daniele (TIM/ISSCO, ETI, University of Geneva, 40 blvd du Pont d’Arve, CH-1211 Geneva 4)
King Margaret (TIM/ISSCO, ETI, University of Geneva, 40 blvd du Pont d’Arve, CH-1211 Geneva 4., Margaret.King©issco.unige.ch)
Keywords Dictation Systems, EAGLES, Evaluation, ISO
Session Session SO6 - Recognition
Full Paper 56.ps, 56.pdf
Abstract This paper describes the practical evaluation of two commercial dictation systems in order to assess the potential usefulness of such technology in the specific context of a translation service translating legal text into Italian. The service suffers at times from heavy workload, lengthy documents and short deadlines. Use of dictation systems accepting continuous speech might improve productivity at these times. Design and execution of the evaluation followed the methodology worked out by the EAGLES Evaluation Working Group. The evaluation therefore also constitutes a test bed application of this methodology.