Summary of the paper
| Title | EASY, Evaluation of Parsers of French: what are the Results? |
|---|---|
| Authors | Patrick Paroubek, Isabelle Robba, Anne Vilnat and Christelle Ayache |
| Abstract | This paper presents EASY, which has been the first campaign evaluating syntactic parsers on all the common syntactic phenomena and a large set of dependency relations. The language analyzed was French. During this campaign, an annotation scheme has been elaborated with the different actors: participants and corpus providers; then a corpus made of several syntactic materials has been built and annotated: it reflects a great variety of linguistic styles (from literature to oral transcriptions, and from newspapers to medical texts). Both corpus and annotation scheme are here briefly presented. Moreover, evaluation measures are explained and detailed results are given. The results of the 15 parsers coming from 12 teams are analyzed. To conclude, a first experiment aiming to combine the outputs of the different systems is shown. |
| Language | Single language |
| Topics | Evaluation methodologies, Parsing Systems, Corpus (creation, annotation, etc.) |
Full paper |
EASY, Evaluation of Parsers of French: what are the Results? |
Slides |
EASY, Evaluation of Parsers of French: what are the Results? |
| Bibtex | @InProceedings{PAROUBEK08.621, author = {Patrick Paroubek, Isabelle Robba, Anne Vilnat and Christelle Ayache}, title = {EASY, Evaluation of Parsers of French: what are the Results?}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, month = {may}, date = {28-30}, address = {Marrakech, Morocco}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-4-0}, note = {http://www.lrec-conf.org/proceedings/lrec2008/}, language = {english} } |