Please use this identifier to cite or link to this item:
https://repository.isls.org/handle/1/12975| Title: | Beyond one-sided arguments: Evaluating perspective-taking in middle school essays with GPT-4o and human scoring |
| Other Titles: | Beyond One-Sided Arguments: Evaluating Perspective-Taking in Middle School Essays with GPT-4o and Human Scoring |
| Authors: | Song, Yi Suhan, Michael |
| Keywords: | ICLS |
| Issue Date: | 2026 |
| metadata.dc.format.pagerange: | 2546-2548 |
| Publisher: | International Society of the Learning Sciences |
| Citation: | Song, Y. & Suhan, M. (2026). Beyond one-sided arguments: Evaluating perspective-taking in middle school essays with GPT-4o and human scoring. In Litts, B. K., DeLiema, D., Lee, C., Krist, S. Mawasi, A., Martin, L., & Kumpulainen, K. (Eds.), Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 (pp. 2546-2548). International Society of the Learning Sciences. |
| Series/Report no.: | Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 |
| Abstract: | In this exploratory study, we compared GPT-4o zero-shot scoring with human ratings of middle school students’ essays collected across multiple studies. Results showed that GPT-4o achieved acceptable reliability with human raters, highlighting the potential of GenAI for assessing perspective-taking. Further, we compared linguistic features of essays with a single perspective versus those with multiple perspectives. Future research should examine the quality of perspective-taking, moving beyond recognition of alternative perspectives to evaluating attempts at rebutting counterarguments. |
| Description: | POSTER |
| URI: | https://doi.org/10.22318/icls2026.138633 https://repository.isls.org/handle/1/12975 |
| ISBN: | 979-8-9906980-7-9 |
| ISSN: | 1819-0138 |
| Appears in Collections: | ISLS Annual Meeting 2026 |
Files in This Item:
| File | Size | Format | |
|---|---|---|---|
| ICLS2026_2546-2548.pdf | 207.17 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.