Please use this identifier to cite or link to this item:
https://repository.isls.org/handle/1/12777| Title: | AI-feedback system: Integrating human-in-the-loop for customized support |
| Other Titles: | AI-Feedback System: Integrating Human-in-the-Loop for Customized Support |
| Authors: | Shin, Namsoo Miller, Cory Qian, Xunlei Krajcik, Joseph Xing, Yue |
| Keywords: | ICLS |
| Issue Date: | 2026 |
| metadata.dc.format.pagerange: | 1388-1392 |
| Publisher: | International Society of the Learning Sciences |
| Citation: | Shin, N., Miller, C., Qian, X., Krajcik, J., & Xing, Y. (2026). AI-feedback system: Integrating human-in-the-loop for customized support. In Litts, B. K., DeLiema, D., Lee, C., Krist, S. Mawasi, A., Martin, L., & Kumpulainen, K. (Eds.), Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 (pp. 1388-1392). International Society of the Learning Sciences. |
| Series/Report no.: | Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 |
| Abstract: | This study presents an iterative human-AI collaboration design process for developing an AI-Feedback system aligned with learning theories, providing timely, customized feedback to support teachers and students in developing usable knowledge. The process involved collaboration among teachers, content experts, and learning scientists to refine rubrics and validate AI models for analyzing elementary students’ written responses on complex science tasks—often vague or inconsistent—to identify weaknesses and uncertainty in students’ understanding. Using a multi-agent human-in-the-loop system, we improved analytical accuracy, quantified uncertainty, and generated analytical rationales to guide customized feedback. Analyses of 90 student responses demonstrates an overall accuracy 88%, showing that integrating Generative AI with continuous expert guidance can provide reliable and meaningful feedback, even for lower elementary student writing. |
| Description: | SHORT |
| URI: | https://doi.org/10.22318/icls2026.103130 https://repository.isls.org/handle/1/12777 |
| ISBN: | 979-8-9906980-7-9 |
| ISSN: | 1819-0138 |
| Appears in Collections: | ISLS Annual Meeting 2026 |
Files in This Item:
| File | Size | Format | |
|---|---|---|---|
| ICLS2026_1388-1392.pdf | 303.85 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.