Please use this identifier to cite or link to this item: https://repository.isls.org/handle/1/11088
Title: The Impact of Middle School Students’ Writing Quality on the Accuracy of the Automated Assessment of Science Content
Authors: Gnesdilow, Dana
Dey, Indrani
Gengler, Diane
Malkin, Linda
Puntambekar, Sadhana
Passonneau, Rebecca
Kim, Chanmin
Keywords: Learning Sciences
Issue Date: 2024
Publisher: International Society of the Learning Sciences
Citation: Gnesdilow, D., Dey, I., Gengler, D., Malkin, L., Puntambekar, S., Passonneau, R., & Kim, C. (2024). The Impact of Middle School Students’ Writing Quality on the Accuracy of the Automated Assessment of Science Content. In Lindgren, R., Asino, T. I., Kyza, E. A., Looi, C. K., Keifert, D. T., & Suárez, E. (Eds.), Proceedings of the 18th International Conference of the Learning Sciences - ICLS 2024 (pp. 250-257). International Society of the Learning Sciences.
Abstract: Helping students learn how to write is essential. However, students have few opportunities to develop this skill, since giving timely feedback is difficult for teachers. AI applications can provide quick feedback on students’ writing. But, ensuring accurate assessment can be challenging, since students’ writing quality can vary. We examined the impact of students’ writing quality on the error rate of our natural language processing (NLP) system when assessing scientific content in initial and revised design essays. We also explored whether aspects of writing quality were linked to the number of NLP errors. Despite finding that students’ revised essays were significantly different from their initial essays in a few ways, our NLP systems’ accuracy was similar. Further, our multiple regression analyses showed, overall, that students’ writing quality did not impact our NLP systems’ accuracy. This is promising in terms of ensuring students with different writing skills get similarly accurate feedback.
Description: Long Paper
URI: https://doi.org/10.22318/icls2024.136951
https://repository.isls.org//handle/1/11088
Appears in Collections:ISLS Annual Meeting 2024

Files in This Item:
File SizeFormat 
ICLS2024_250-257.pdf426.98 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.