| Title |
Evaluation of parsed corpora: Experiments in user-transparent and user-visible evaluation |
| Authors |
Diana Santos (SINTEF Tele og Data ) Caroline Gasperin, (Faculdade de Informática, PPGCC, PUCRS) |
| Session |
EP1: Evaluation |
| Abstract |
In the present paper, we describe and discuss the evaluation of parsed corpora, namely the ones that are available on the Web for querying in the AC/DC project. The paper has two parts: the first one suggests a set of different evaluation parameters and measures that are much more illuminating than commonly used simple precision measures, while the second evaluates the parsed corpus for a particular task -- that of automatic thesaurus building. The two evaluations are thus complementary, in that, in Gaizauskas (1998) terminology, the first is a typical user-transparent evaluation, while the second is user-visible. |
| Keywords |
Parse evaluation, Parsed corpora, Portuguese, Semantic aquisition, Tagging |
| Full Paper |