Please use this identifier to cite or link to this item:
https://repository.isls.org/handle/1/13163| Title: | Measuring cognitive presence in online discussions: Interpretable AI and instructional insights from a MOOC context |
| Other Titles: | Measuring Cognitive Presence in Online Discussions: Interpretable AI and Instructional Insights from a MOOC Context |
| Authors: | Tu, Fengjiao Yu, Ji Hyun Chen, Haihua Ding, Junhua Dong, Liu Hsieh, Chi-Jia Kim, Hannah Watson, Sunnie Lee |
| Keywords: | ICLS |
| Issue Date: | 2026 |
| metadata.dc.format.pagerange: | 3109-3111 |
| Publisher: | International Society of the Learning Sciences |
| Citation: | Tu, F., Yu, J. H., Chen, H., Ding, J., Dong, L., Hsieh, C., Kim, H., & Watson, S. L. (2026). Measuring cognitive presence in online discussions: Interpretable AI and instructional insights from a MOOC context. In Litts, B. K., DeLiema, D., Lee, C., Krist, S. Mawasi, A., Martin, L., & Kumpulainen, K. (Eds.), Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 (pp. 3109-3111). International Society of the Learning Sciences. |
| Series/Report no.: | Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 |
| Abstract: | This study develops and validates an interpretable transformer model for detecting cognitive presence in MOOC discussions and examines its relation to learner outcomes. A RoBERTa model fine-tuned with theory-derived structural cues from the Community of Inquiry framework classified sentences into Triggering Event, Exploration, Integration, and Resolution. Using data from six Social Work MOOCs (4,260 learners and 227,863 sentences), a human–AI annotated corpus (N = 17,627) trained the model. The cue-augmented RoBERTa achieved strong accuracy (macro F1 = 0.70, κ = 0.65), outperforming baselines. Learner-level regressions linked integration to quiz success and motivation, while resolution predicted satisfaction and knowledge transfer. Overall, findings highlight both the potential and limitations of AI-supported cognitive presence detection for understanding and enhancing online collaborative learning. However, resolution was difficult to recall, suggesting that advanced inquiry depends heavily on context. |
| Description: | POSTER |
| URI: | https://doi.org/10.22318/icls2026.790236 https://repository.isls.org/handle/1/13163 |
| ISBN: | 979-8-9906980-7-9 |
| ISSN: | 1819-0138 |
| Appears in Collections: | ISLS Annual Meeting 2026 |
Files in This Item:
| File | Size | Format | |
|---|---|---|---|
| ICLS2026_3109-3111.pdf | 271.58 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.