Annotating Football Matches: Influence of the Source Medium on Manual Annotation

Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC 2012)

Abstract

In this paper, we present an annotation campaign of football (soccer) matches, from a heterogeneous text corpus of both match minutes and video commentary transcripts, in French. The data, annotations and evaluation process are detailed, and the quality of the annotated corpus is discussed. In particular, we propose a new technique to better estimate the annotator agreement when few elements of a text are to be annotated. Based on that, we show how the source medium influenced the process and the quality.