Please use this identifier to cite or link to this item: https://repository.isls.org/handle/1/8527
Title: Comparing Subjective and Objective Estimates of Effort and Performance on Adaptive v. Non-Adaptive Computerized Tests of Statistics Knowledge
Authors: Ober, Teresa
Denner, Madelynn
Liu, Cheng
Cheng, Ying
Keywords: Learning Sciences
Issue Date: 2022
Publisher: International Society of the Learning Sciences
Citation: Ober, T., Denner, M., Liu, C., & Cheng, Y. (2022). Comparing subjective and objective estimates of effort and performance on adaptive v. non-adaptive computerized tests of statistics knowledge. In Chinn, C., Tan, E., Chan, C., & Kali, Y. (Eds.), Proceedings of the 16th International Conference of the Learning Sciences - ICLS 2022 (pp. 1513-1516). International Society of the Learning Sciences.
Abstract: We examine associations between subjective (self-reported) and objective (derived from behaviors or performance) indicators of effort and ability and whether the format of a computerized assessment (adaptive v. non-adaptive) moderates these associations. Participants (N=219; Mage=19.83) were randomly assigned to one of two conditions in which they completed either an adaptive or a non-adaptive version of a 20-item computerized assessment. They then self-reported their effort and the number of items they believe they answered correctly on the assessment. Self-reported effort was not significantly correlated with the behavioral indicator. However, self-reported ability was positively correlated with participants’ test score, even after controlling for test condition. Test condition appeared to moderate the association between subjective and objective estimates of ability with participants with higher ability in the nonadaptive condition estimating a greater number of items answered correctly. Further work should examine whether effects of test condition differ for certain student subgroups. computerized assessment, adaptive test, test mode, self-evaluation, effort, subjective v. objective estimates
Description: Short Paper
URI: https://dx.doi.org/10.22318/icls2022.1513
https://repository.isls.org//handle/1/8527
Appears in Collections:ISLS Annual Meeting 2022

Files in This Item:
File SizeFormat 
ICLS2022_1513-1516.pdf317 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.