Please use this identifier to cite or link to this item: https://repository.isls.org/handle/1/12777
Title: AI-feedback system: Integrating human-in-the-loop for customized support
Other Titles: AI-Feedback System: Integrating Human-in-the-Loop for Customized Support
Authors: Shin, Namsoo
Miller, Cory
Qian, Xunlei
Krajcik, Joseph
Xing, Yue
Keywords: ICLS
Issue Date: 2026
metadata.dc.format.pagerange: 1388-1392
Publisher: International Society of the Learning Sciences
Citation: Shin, N., Miller, C., Qian, X., Krajcik, J., & Xing, Y. (2026). AI-feedback system: Integrating human-in-the-loop for customized support. In Litts, B. K., DeLiema, D., Lee, C., Krist, S. Mawasi, A., Martin, L., & Kumpulainen, K. (Eds.), Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 (pp. 1388-1392). International Society of the Learning Sciences.
Series/Report no.: Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026
Abstract: This study presents an iterative human-AI collaboration design process for developing an AI-Feedback system aligned with learning theories, providing timely, customized feedback to support teachers and students in developing usable knowledge. The process involved collaboration among teachers, content experts, and learning scientists to refine rubrics and validate AI models for analyzing elementary students’ written responses on complex science tasks—often vague or inconsistent—to identify weaknesses and uncertainty in students’ understanding. Using a multi-agent human-in-the-loop system, we improved analytical accuracy, quantified uncertainty, and generated analytical rationales to guide customized feedback. Analyses of 90 student responses demonstrates an overall accuracy 88%, showing that integrating Generative AI with continuous expert guidance can provide reliable and meaningful feedback, even for lower elementary student writing.
Description: SHORT
URI: https://doi.org/10.22318/icls2026.103130
https://repository.isls.org/handle/1/12777
ISBN: 979-8-9906980-7-9
ISSN: 1819-0138
Appears in Collections:ISLS Annual Meeting 2026

Files in This Item:
File SizeFormat 
ICLS2026_1388-1392.pdf303.85 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.