Please use this identifier to cite or link to this item:
https://repository.isls.org/handle/1/11281| Title: | Evaluating Language Models Using Linguistic Variations in Multilingual Learners’ Writing: A Teacher Study |
| Authors: | Barron, Kaycie Tseng, Nora Karumbaiah, Shamya Baeza, Cynthia T. |
| Keywords: | Learning Sciences |
| Issue Date: | 2025 |
| Publisher: | International Society of the Learning Sciences |
| Citation: | Barron, K., Tseng, N., Karumbaiah, S., & Baeza, C. T. (2025). Evaluating Language Models Using Linguistic Variations in Multilingual Learners’ Writing: A Teacher Study. In Rajala, A., Cortez, A., Hofmann, R., Jornet, A., Lotz-Sisitka, H., & Markauskaite, L. (Eds.), Proceedings of the 19th International Conference of the Learning Sciences - ICLS 2025 (pp. 1389-1393). International Society of the Learning Sciences. |
| Series/Report no.: | Proceedings of the 19th International Conference of the Learning Sciences - ICLS 2025 |
| Abstract: | This paper investigates teachers’ perceptions on linguistic variations in bi/multilingual learners’ (MLs) writing to evaluate the (in)effectiveness of Multilingual Large Language Models (MLLMs), which are artificial intelligence (AI) models that generate texts in multiple languages. Due to their inherent linguistic biases, these models often struggle to interpret MLs’ linguistic variations. To address this gap, we elicit teacher feedback on prevalent linguistic variations in MLs’ writing and assess how Meta Llama 3.1, a state-of-the-art MLLM, responds to these variations. Using translanguaging as a lens—the fluid use of multiple languages to convey meaning across social contexts—we propose a new approach to evaluate MLLMs in multilingual learning contexts. With the increasing prevalence of AI in K12 classrooms, this paper advocates for the inclusion of bi/multilingual educators to better align the use of AI with progressive pedagogies such as translanguaging. |
| Description: | Short Paper |
| URI: | https://doi.org/10.22318/icls2025.103145 https://repository.isls.org//handle/1/11281 |
| Appears in Collections: | ISLS Annual Meeting 2025 |
Files in This Item:
| File | Size | Format | |
|---|---|---|---|
| ICLS2025_1389-1393.pdf | 398.74 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.