Tokenization via Language Modeling: the Role of Preceding Text

Proceedings of the Second Workshop on Computation and Written Language (CAWL) @ LREC-COLING 2024

Abstract

No abstract available.

Paper ID

lrec2024-ws-cawl-4

Pages

pp. 23-35

DOI

BibKey

hronsky-keuleers-2024-tokenization

Editor

N/A

Publisher

European Language Resources Association (ELRA) and ICCL

ISSN

N/A

ISBN

N/A

Workshop

Proceedings of the Second Workshop on Computation and Written Language (CAWL) @ LREC-COLING 2024

Location

undefined, undefined

Date

20 May 2024 — 25 May 2024