Summary of the paper
| Title | Annotating and Learning Morphological Segmentation of Egyptian Colloquial Arabic |
|---|---|
| Authors | Emad Mohamed, Behrang Mohit and Kemal Oflazer |
| Abstract | We present an annotation and morphological segmentation scheme for Egyptian Colloquial Arabic (ECA) in which we annotate user-generated content that significantly deviates from the orthographic and grammatical rules of Modern Standard Arabic and thus cannot be processed by the commonly used MSA tools. Using a per letter classification scheme in which each letter is classified as either a segment boundary or not, and using a memory-based classifier, with only word-internal context, prove effective and achieve a 92% exact match accuracy at the word level. The well-known MADA system achieves 81% while the per letter classification scheme using the ATB achieves 82%. Error analysis shows that the major problem is that of character ambiguity since the ECA orthography overloads the characters which would otherwise be more specific in MSA, like the differences between y (ي) and Y (ى) and A (ا) , > ( أ), and < (إ) which are collapsed to y (ي) and A (ا) respectively or even totally confused and interchangeable. While normalization helps alleviate orthographic inconsistencies, it aggravates the problem of ambiguity. |
| Topics | Corpus (creation, annotation, etc.), Morphology, Statistical and machine learning methods |
Full paper  |
Annotating and Learning Morphological Segmentation of Egyptian Colloquial Arabic |
| Bibtex | @InProceedings{MOHAMED12.465, author = {Emad Mohamed and Behrang Mohit and Kemal Oflazer}, title = {Annotating and Learning Morphological Segmentation of Egyptian Colloquial Arabic}, booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)}, year = {2012}, month = {may}, date = {23-25}, address = {Istanbul, Turkey}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Uğur Doğan and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-7-7}, language = {english} } |