Please use this identifier to cite or link to this item:
https://repository.isls.org/handle/1/12776| Title: | Four years of AI-powered formative assessment: Exploring the 2-sigma effect and fairness |
| Other Titles: | Four Years of AI-Powered Formative Assessment: Exploring the 2-Sigma Effect and Fairness |
| Authors: | Bae, Yoojin Kim, Jinho Kim, Min Kyu |
| Keywords: | ICLS |
| Issue Date: | 2026 |
| metadata.dc.format.pagerange: | 1383-1387 |
| Publisher: | International Society of the Learning Sciences |
| Citation: | Bae, Y., Kim, J., & Kim, M. K. (2026). Four years of AI-powered formative assessment: Exploring the 2-sigma effect and fairness. In Litts, B. K., DeLiema, D., Lee, C., Krist, S. Mawasi, A., Martin, L., & Kumpulainen, K. (Eds.), Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 (pp. 1383-1387). International Society of the Learning Sciences. |
| Series/Report no.: | Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 |
| Abstract: | Bloom’s (1984) two-sigma problem highlights the substantial learning gains achieved through individualized tutoring. With advances in artificial intelligence (AI), scalable personalized support may help approach such effectiveness while ensuring fairness across diverse learners. This study reports findings from a four-year deployment of an AI-powered formative feedback tool in a technical college English course. Two sequential studies were conducted: Study 1 synthesized data from seven semesters (Spring 2022-Spring 2024) to examine the longitudinal impact of AI feedback on learners’ concept learning and subsequent task performance. Study 2 used a quasi-experimental design (Fall 2024-Spring 2025) to compare learners with and without AI support, analyzing demographic differences in outcomes. Results showed that iterative AI feedback enhanced conceptual representation and improved later performance. Between-group comparisons favored AI-supported learners for concept learning, with no demographic disparities detected. Overall, AI-powered formative assessment produced learning gains approximating one sigma while maintaining equitable outcomes across learners. |
| Description: | SHORT |
| URI: | https://doi.org/10.22318/icls2026.454960 https://repository.isls.org/handle/1/12776 |
| ISBN: | 979-8-9906980-7-9 |
| ISSN: | 1819-0138 |
| Appears in Collections: | ISLS Annual Meeting 2026 |
Files in This Item:
| File | Size | Format | |
|---|---|---|---|
| ICLS2026_1383-1387.pdf | 287.55 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.