Polish Multimodal Corpus — a collection of referential gestures

Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC 2012)

Abstract

In face to face interaction, people refer to objects and events not only by means of speech but also by means of gesture. The present paper describes building a corpus of referential gestures. The aim is to investigate gestural reference by incorporating insights from semantic ontologies and by employing a more holistic view on referential gestures. The paper's focus is on presenting the data collection procedure and discussing the corpus' design; additionally the first insights from constructing the annotation scheme are described.