LLM-based proficiency assignment for learner corpora

Description

This dataset accompanies the study on LLM-based proficiency assignment for learner corpora. The study addresses the lack of comprehensive proficiency assessment data in learner corpus research and tests whether large language models (LLMs) can provide useful proficiency information for large collections of learner writing. Two approaches were investigated: direct assignment of Common European Framework of Reference for Languages (CEFR) levels and comparative judgment (CJ), in which essays are evaluated relative to calibrated proficiency reference texts. The analyses were conducted on texts from the International Corpus of Learner English (ICLE). The ICLE texts themselves are not included in this repository because they are copyrighted material belonging to the Catholic University of Louvain and cannot be redistributed. The repository therefore contains only derived data and analysis outputs associated with the proficiency assessment procedures.

Categories

Funders

• Fundação de Amparo à Pesquisa do Estado de São Paulo

  São Paulo, São Paulo

  Grant ID: 2022/05848-7
• Conselho Nacional de Desenvolvimento Científico e Tecnológico

  Ministry of Science, Technology and Innovation

  Federal District, Brasília

  Grant ID: 310140/2021-8, 444019/2024-3, 403130/2024-7

Licence