Please use this identifier to cite or link to this item: https://repository.isls.org/handle/1/11281
Title: Evaluating Language Models Using Linguistic Variations in Multilingual Learners’ Writing: A Teacher Study
Authors: Barron, Kaycie
Tseng, Nora
Karumbaiah, Shamya
Baeza, Cynthia T.
Keywords: Learning Sciences
Issue Date: 2025
Publisher: International Society of the Learning Sciences
Citation: Barron, K., Tseng, N., Karumbaiah, S., & Baeza, C. T. (2025). Evaluating Language Models Using Linguistic Variations in Multilingual Learners’ Writing: A Teacher Study. In Rajala, A., Cortez, A., Hofmann, R., Jornet, A., Lotz-Sisitka, H., & Markauskaite, L. (Eds.), Proceedings of the 19th International Conference of the Learning Sciences - ICLS 2025 (pp. 1389-1393). International Society of the Learning Sciences.
Series/Report no.: Proceedings of the 19th International Conference of the Learning Sciences - ICLS 2025
Abstract: This paper investigates teachers’ perceptions on linguistic variations in bi/multilingual learners’ (MLs) writing to evaluate the (in)effectiveness of Multilingual Large Language Models (MLLMs), which are artificial intelligence (AI) models that generate texts in multiple languages. Due to their inherent linguistic biases, these models often struggle to interpret MLs’ linguistic variations. To address this gap, we elicit teacher feedback on prevalent linguistic variations in MLs’ writing and assess how Meta Llama 3.1, a state-of-the-art MLLM, responds to these variations. Using translanguaging as a lens—the fluid use of multiple languages to convey meaning across social contexts—we propose a new approach to evaluate MLLMs in multilingual learning contexts. With the increasing prevalence of AI in K12 classrooms, this paper advocates for the inclusion of bi/multilingual educators to better align the use of AI with progressive pedagogies such as translanguaging.
Description: Short Paper
URI: https://doi.org/10.22318/icls2025.103145
https://repository.isls.org//handle/1/11281
Appears in Collections:ISLS Annual Meeting 2025

Files in This Item:
File SizeFormat 
ICLS2025_1389-1393.pdf398.74 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.