Please use this identifier to cite or link to this item: https://repository.isls.org/handle/1/12769
Title: AI agents as a refinement tool for operationalizing coding process in the context of textbook analysis
Other Titles: AI agents as a Refinement Tool for Operationalizing Coding Process in the Context of Textbook Analysis
Authors: Lee, Boram
Azimi, Seyedehkhadijeh
Keywords: ICLS
Issue Date: 2026
metadata.dc.format.pagerange: 1348-1352
Publisher: International Society of the Learning Sciences
Citation: Lee, B. & Azimi, S. (2026). AI agents as a refinement tool for operationalizing coding process in the context of textbook analysis. In Litts, B. K., DeLiema, D., Lee, C., Krist, S. Mawasi, A., Martin, L., & Kumpulainen, K. (Eds.), Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 (pp. 1348-1352). International Society of the Learning Sciences.
Series/Report no.: Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026
Abstract: Qualitative research often employs coding to analyze complex data, yet even with codebooks, the operational criteria guiding coders’ decisions frequently remain implicit. This gap limits transparency and comparability across studies. We explore how an AI agent (ChatGPT-5) can function as a refinement tool to surface and formalize tacit reasoning in coding. Using textbook analysis as a case, we applied the Cognitive Demand Level (CDL) framework to 47 fraction-related problems from Grade 3 mathematics textbooks in Iran and Korea. Through iterative engagement, ChatGPT-5’s discrepant coding prompted us to articulate, refine, and document operational criteria, evolving from an intuitive flowchart to a detailed criteria table. This process transformed implicit reasoning into explicit decision rules that can be scrutinized and tested by others. We highlight AI’s affordance as a collaborative refinement tool: not replacing human coders, but scaffolding transparency, comparability, and methodological rigor in qualitative research.
Description: SHORT
URI: https://doi.org/10.22318/icls2026.577052
https://repository.isls.org/handle/1/12769
ISBN: 979-8-9906980-7-9
ISSN: 1819-0138
Appears in Collections:ISLS Annual Meeting 2026

Files in This Item:
File SizeFormat 
ICLS2026_1348-1352.pdf367.33 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.