Please use this identifier to cite or link to this item: https://repository.isls.org/handle/1/12764
Title: Reexamining the measurement of metacognitive regulation in online STEM learning: Validity and fairness evidence
Other Titles: Reexamining the Measurement of Metacognitive Regulation in Online STEM Learning: Validity and Fairness Evidence
Authors: Rachmatullah, Arif
Thomas, Krystal
Mislevy, Jessica
Keywords: ICLS
Issue Date: 2026
metadata.dc.format.pagerange: 1323-1327
Publisher: International Society of the Learning Sciences
Citation: Rachmatullah, A., Thomas, K., & Mislevy, J. (2026). Reexamining the measurement of metacognitive regulation in online STEM learning: Validity and fairness evidence. In Litts, B. K., DeLiema, D., Lee, C., Krist, S. Mawasi, A., Martin, L., & Kumpulainen, K. (Eds.), Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026 (pp. 1323-1327). International Society of the Learning Sciences.
Series/Report no.: Proceedings of the 20th International Conference of the Learning Sciences - ICLS 2026
Abstract: This study reexamines the measurement of metacognitive regulation in online STEM learning in the context of broad access institutions serving more diverse student populations than the selective contexts where these measures were originally developed. Using data from 1,517 undergraduates enrolled in gateway STEM courses, we analyzed three regulation-of-cognition subscales from the Metacognitive Awareness Inventory: Comprehension Monitoring, Debugging, and Evaluation. We used exploratory factor analysis, item response theory, and differential item functioning (DIF) to evaluate dimensionality, reliability, and measurement invariance. Results supported a three-factor theoretical model, though a one-dimensional model provided better parsimony and fit. Items showed moderate discrimination and difficulty, with debugging items being harder to endorse. Measurement invariance was maintained across time, gender, and first-generation status, with minor DIF across students from different racial and ethnic backgrounds.
Description: SHORT
URI: https://doi.org/10.22318/icls2026.806499
https://repository.isls.org/handle/1/12764
ISBN: 979-8-9906980-7-9
ISSN: 1819-0138
Appears in Collections:ISLS Annual Meeting 2026

Files in This Item:
File SizeFormat 
ICLS2026_1323-1327.pdf269.54 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.