Please use this identifier to cite or link to this item:
https://repository.isls.org/handle/1/8527| Title: | Comparing Subjective and Objective Estimates of Effort and Performance on Adaptive v. Non-Adaptive Computerized Tests of Statistics Knowledge |
| Authors: | Ober, Teresa Denner, Madelynn Liu, Cheng Cheng, Ying |
| Keywords: | Learning Sciences |
| Issue Date: | 2022 |
| Publisher: | International Society of the Learning Sciences |
| Citation: | Ober, T., Denner, M., Liu, C., & Cheng, Y. (2022). Comparing subjective and objective estimates of effort and performance on adaptive v. non-adaptive computerized tests of statistics knowledge. In Chinn, C., Tan, E., Chan, C., & Kali, Y. (Eds.), Proceedings of the 16th International Conference of the Learning Sciences - ICLS 2022 (pp. 1513-1516). International Society of the Learning Sciences. |
| Abstract: | We examine associations between subjective (self-reported) and objective (derived from behaviors or performance) indicators of effort and ability and whether the format of a computerized assessment (adaptive v. non-adaptive) moderates these associations. Participants (N=219; Mage=19.83) were randomly assigned to one of two conditions in which they completed either an adaptive or a non-adaptive version of a 20-item computerized assessment. They then self-reported their effort and the number of items they believe they answered correctly on the assessment. Self-reported effort was not significantly correlated with the behavioral indicator. However, self-reported ability was positively correlated with participants’ test score, even after controlling for test condition. Test condition appeared to moderate the association between subjective and objective estimates of ability with participants with higher ability in the nonadaptive condition estimating a greater number of items answered correctly. Further work should examine whether effects of test condition differ for certain student subgroups. computerized assessment, adaptive test, test mode, self-evaluation, effort, subjective v. objective estimates |
| Description: | Short Paper |
| URI: | https://dx.doi.org/10.22318/icls2022.1513 https://repository.isls.org//handle/1/8527 |
| Appears in Collections: | ISLS Annual Meeting 2022 |
Files in This Item:
| File | Size | Format | |
|---|---|---|---|
| ICLS2022_1513-1516.pdf | 317 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.