Back to DETERMIT 2024
LREC-COLING 2024workshop

Enhancing Lexical Complexity Prediction through Few-shot Learning with Gpt-3

Proceedings of the Workshop on DeTermIt! Evaluating Text Difficulty in a Multilingual Context @ LREC-COLING 2024

DOI:10.63317/443tky679vvs

Abstract

This paper describes an experiment to evaluate the ability of the GPT-3 language model to classify terms regarding their lexical complexity. This was achieved through the creation and evaluation of different versions of the model: text-Davinci-002 y text-Davinci-003 and prompts for few-shot learning to determine the complexity of the words. The results obtained on the CompLex dataset achieve a minimum average error of 0.0856. Although this is not better than the state of the art (which is 0.0609), it is a performing and promising approach to lexical complexity prediction without the need for model fine-tuning.

Details

Paper ID
lrec2024-ws-determit-07
Pages
pp. 68-76
BibKey
ortiz-zambrano-etal-2024-enhancing
Editor
N/A
Publisher
European Language Resources Association (ELRA) and ICCL
ISSN
N/A
ISBN
N/A
Workshop
Proceedings of the Workshop on DeTermIt! Evaluating Text Difficulty in a Multilingual Context @ LREC-COLING 2024
Location
undefined, undefined
Date
20 May 2024 25 May 2024

Authors

  • JO

    Jenny Alexandra Ortiz-Zambrano

  • CE

    César Humberto Espín-Riofrío

  • AM

    Arturo Montejo-Ráez

Links