Please use this identifier to cite or link to this item:
https://repository.isls.org/handle/1/12769| Title: | AI agents as a refinement tool for operationalizing coding process in the context of textbook analysis |
| Other Titles: | AI agents as a Refinement Tool for Operationalizing Coding Process in the Context of Textbook Analysis |
| Authors: | Lee, Boram Azimi, Seyedehkhadijeh |
| Keywords: | ICLS |
| Issue Date: | 2026 |
| metadata.dc.format.pagerange: | 1348-1352 |
| Publisher: | International Society of the Learning Sciences |
| Citation: | Lee, B. & Azimi, S. (2026). AI agents as a refinement tool for operationalizing coding process in the context of textbook analysis. In Litts, B. K., DeLiema, D., Lee, C., Krist, S. Mawasi, A., Martin, L., & Kumpulainen, K. (Eds.), Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 (pp. 1348-1352). International Society of the Learning Sciences. |
| Series/Report no.: | Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 |
| Abstract: | Qualitative research often employs coding to analyze complex data, yet even with codebooks, the operational criteria guiding coders’ decisions frequently remain implicit. This gap limits transparency and comparability across studies. We explore how an AI agent (ChatGPT-5) can function as a refinement tool to surface and formalize tacit reasoning in coding. Using textbook analysis as a case, we applied the Cognitive Demand Level (CDL) framework to 47 fraction-related problems from Grade 3 mathematics textbooks in Iran and Korea. Through iterative engagement, ChatGPT-5’s discrepant coding prompted us to articulate, refine, and document operational criteria, evolving from an intuitive flowchart to a detailed criteria table. This process transformed implicit reasoning into explicit decision rules that can be scrutinized and tested by others. We highlight AI’s affordance as a collaborative refinement tool: not replacing human coders, but scaffolding transparency, comparability, and methodological rigor in qualitative research. |
| Description: | SHORT |
| URI: | https://doi.org/10.22318/icls2026.577052 https://repository.isls.org/handle/1/12769 |
| ISBN: | 979-8-9906980-7-9 |
| ISSN: | 1819-0138 |
| Appears in Collections: | ISLS Annual Meeting 2026 |
Files in This Item:
| File | Size | Format | |
|---|---|---|---|
| ICLS2026_1348-1352.pdf | 367.33 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.