Please use this identifier to cite or link to this item: https://repository.isls.org/handle/1/12776
Title: Four years of AI-powered formative assessment: Exploring the 2-sigma effect and fairness
Other Titles: Four Years of AI-Powered Formative Assessment: Exploring the 2-Sigma Effect and Fairness
Authors: Bae, Yoojin
Kim, Jinho
Kim, Min Kyu
Keywords: ICLS
Issue Date: 2026
metadata.dc.format.pagerange: 1383-1387
Publisher: International Society of the Learning Sciences
Citation: Bae, Y., Kim, J., & Kim, M. K. (2026). Four years of AI-powered formative assessment: Exploring the 2-sigma effect and fairness. In Litts, B. K., DeLiema, D., Lee, C., Krist, S. Mawasi, A., Martin, L., & Kumpulainen, K. (Eds.), Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 (pp. 1383-1387). International Society of the Learning Sciences.
Series/Report no.: Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026
Abstract: Bloom’s (1984) two-sigma problem highlights the substantial learning gains achieved through individualized tutoring. With advances in artificial intelligence (AI), scalable personalized support may help approach such effectiveness while ensuring fairness across diverse learners. This study reports findings from a four-year deployment of an AI-powered formative feedback tool in a technical college English course. Two sequential studies were conducted: Study 1 synthesized data from seven semesters (Spring 2022-Spring 2024) to examine the longitudinal impact of AI feedback on learners’ concept learning and subsequent task performance. Study 2 used a quasi-experimental design (Fall 2024-Spring 2025) to compare learners with and without AI support, analyzing demographic differences in outcomes. Results showed that iterative AI feedback enhanced conceptual representation and improved later performance. Between-group comparisons favored AI-supported learners for concept learning, with no demographic disparities detected. Overall, AI-powered formative assessment produced learning gains approximating one sigma while maintaining equitable outcomes across learners.
Description: SHORT
URI: https://doi.org/10.22318/icls2026.454960
https://repository.isls.org/handle/1/12776
ISBN: 979-8-9906980-7-9
ISSN: 1819-0138
Appears in Collections:ISLS Annual Meeting 2026

Files in This Item:
File SizeFormat 
ICLS2026_1383-1387.pdf287.55 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.