Please use this identifier to cite or link to this item: https://repository.isls.org/handle/1/13163
Title: Measuring cognitive presence in online discussions: Interpretable AI and instructional insights from a MOOC context
Other Titles: Measuring Cognitive Presence in Online Discussions: Interpretable AI and Instructional Insights from a MOOC Context
Authors: Tu, Fengjiao
Yu, Ji Hyun
Chen, Haihua
Ding, Junhua
Dong, Liu
Hsieh, Chi-Jia
Kim, Hannah
Watson, Sunnie Lee
Keywords: ICLS
Issue Date: 2026
metadata.dc.format.pagerange: 3109-3111
Publisher: International Society of the Learning Sciences
Citation: Tu, F., Yu, J. H., Chen, H., Ding, J., Dong, L., Hsieh, C., Kim, H., & Watson, S. L. (2026). Measuring cognitive presence in online discussions: Interpretable AI and instructional insights from a MOOC context. In Litts, B. K., DeLiema, D., Lee, C., Krist, S. Mawasi, A., Martin, L., & Kumpulainen, K. (Eds.), Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 (pp. 3109-3111). International Society of the Learning Sciences.
Series/Report no.: Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026
Abstract: This study develops and validates an interpretable transformer model for detecting cognitive presence in MOOC discussions and examines its relation to learner outcomes. A RoBERTa model fine-tuned with theory-derived structural cues from the Community of Inquiry framework classified sentences into Triggering Event, Exploration, Integration, and Resolution. Using data from six Social Work MOOCs (4,260 learners and 227,863 sentences), a human–AI annotated corpus (N = 17,627) trained the model. The cue-augmented RoBERTa achieved strong accuracy (macro F1 = 0.70, κ = 0.65), outperforming baselines. Learner-level regressions linked integration to quiz success and motivation, while resolution predicted satisfaction and knowledge transfer. Overall, findings highlight both the potential and limitations of AI-supported cognitive presence detection for understanding and enhancing online collaborative learning. However, resolution was difficult to recall, suggesting that advanced inquiry depends heavily on context.
Description: POSTER
URI: https://doi.org/10.22318/icls2026.790236
https://repository.isls.org/handle/1/13163
ISBN: 979-8-9906980-7-9
ISSN: 1819-0138
Appears in Collections:ISLS Annual Meeting 2026

Files in This Item:
File SizeFormat 
ICLS2026_3109-3111.pdf271.58 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.