Please use this identifier to cite or link to this item: https://repository.isls.org/handle/1/12975
Title: Beyond one-sided arguments: Evaluating perspective-taking in middle school essays with GPT-4o and human scoring
Other Titles: Beyond One-Sided Arguments: Evaluating Perspective-Taking in Middle School Essays with GPT-4o and Human Scoring
Authors: Song, Yi
Suhan, Michael
Keywords: ICLS
Issue Date: 2026
metadata.dc.format.pagerange: 2546-2548
Publisher: International Society of the Learning Sciences
Citation: Song, Y. & Suhan, M. (2026). Beyond one-sided arguments: Evaluating perspective-taking in middle school essays with GPT-4o and human scoring. In Litts, B. K., DeLiema, D., Lee, C., Krist, S. Mawasi, A., Martin, L., & Kumpulainen, K. (Eds.), Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 (pp. 2546-2548). International Society of the Learning Sciences.
Series/Report no.: Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026
Abstract: In this exploratory study, we compared GPT-4o zero-shot scoring with human ratings of middle school students’ essays collected across multiple studies. Results showed that GPT-4o achieved acceptable reliability with human raters, highlighting the potential of GenAI for assessing perspective-taking. Further, we compared linguistic features of essays with a single perspective versus those with multiple perspectives. Future research should examine the quality of perspective-taking, moving beyond recognition of alternative perspectives to evaluating attempts at rebutting counterarguments.
Description: POSTER
URI: https://doi.org/10.22318/icls2026.138633
https://repository.isls.org/handle/1/12975
ISBN: 979-8-9906980-7-9
ISSN: 1819-0138
Appears in Collections:ISLS Annual Meeting 2026

Files in This Item:
File SizeFormat 
ICLS2026_2546-2548.pdf207.17 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.