Errator: a Tool to Help Detect Annotation Errors in the Universal Dependencies Project

Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)

Abstract

Enforcing guidelines compliance is today one of the main challenge faced by the Universal Dependencies project. This work introduces ERRATOR, a set of tools implementing the annotation variation principle that can be used to help annotators find and correct errors in the different layers of annotations of UD treebanks. The results of a first annotation campaign that used ERRATOR to correct and harmonize the annotations of the different French corpora are also described.