Please use this identifier to cite or link to this item: https://repository.isls.org/handle/1/8309
Title: Comparing Collaborative Problem Solving Profiles Derived From Human and Semi-Automated Annotation
Authors: Andrews-Todd, Jessica
Steinberg, Jonathan
Pugh, Samuel L.
D’Mello, Sidney K.
Keywords: CSCL
Issue Date: 2022
Publisher: International Society of the Learning Sciences
Citation: Andrews-Todd, J., Steinberg, J., Pugh, S. L., & D’Mello, S. K. (2022). Comparing collaborative problem solving profiles derived from human and semi-automated annotation. In Weinberger, A. Chen, W., Hernández-Leo, D., & Chen, B. (Eds.), Proceedings of the 15th International Conference on Computer-Supported Collaborative Learning - CSCL 2022 (pp. 363-366). International Society of the Learning Sciences.
Abstract: New challenges in today’s world have contributed to increased attention toward evaluating individuals’ collaborative problem solving (CPS) skills. One difficulty with this work is identifying evidence of individuals’ CPS capabilities, particularly when interacting in digital spaces. Often human-driven approaches are used but are limited in scale. Machine-driven approaches can save time and money, but their reliability relative to human approaches can be a challenge. In the current study, we compare CPS skill profiles derived from human and semi- automated annotation methods across two tasks. Results showed that the same clusters emerged for both tasks and annotation methods, with the annotation methods showing agreement on labeling most students according to the same profile membership. Additionally, validation of cluster results using external survey measures yielded similar results across annotation methods.
Description: Short Paper
URI: https://doi.dx.org/10.22318/cscl2022.363
https://repository.isls.org//handle/1/8309
Appears in Collections:ISLS Annual Meeting 2022

Files in This Item:
File SizeFormat 
CSCL2022_363-366.pdf378 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.