Summary of the paper
| Title | Evaluating Distributional Properties of Tagsets |
|---|---|
| Authors | Markus Dickinson and Charles Jochim |
| Abstract | We investigate which distributional properties should be present in a tagset by examining different mappings of various current part-of-speech tagsets, looking at English, German, and Italian corpora. Given the importance of distributional information, we present a simple model for evaluating how a tagset mapping captures distribution, specifically by utilizing a notion of frames to capture the local context. In addition to an accuracy metric capturing the internal quality of a tagset, we introduce a way to evaluate the external quality of tagset mappings so that we can ensure that the mapping retains linguistically important information from the original tagset. Although most of the mappings we evaluate are motivated by linguistic concerns, we also explore an automatic, bottom-up way to define mappings, to illustrate that better distributional mappings are possible. Comparing our initial evaluations to POS tagging results, we find that more distributional tagsets can sometimes result in worse accuracy, underscring the need to carefully define the properties of a tagset. |
| Topics | Part of speech tagging, Evaluation methodologies, Grammar and Syntax |
Full paper |
Evaluating Distributional Properties of Tagsets |
Slides |
Evaluating Distributional Properties of Tagsets |
| Bibtex | @InProceedings{DICKINSON10.227, author = {Markus Dickinson and Charles Jochim}, title = {Evaluating Distributional Properties of Tagsets}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |