Please use this identifier to cite or link to this item:
https://repository.isls.org/handle/1/8309| Title: | Comparing Collaborative Problem Solving Profiles Derived From Human and Semi-Automated Annotation |
| Authors: | Andrews-Todd, Jessica Steinberg, Jonathan Pugh, Samuel L. D’Mello, Sidney K. |
| Keywords: | CSCL |
| Issue Date: | 2022 |
| Publisher: | International Society of the Learning Sciences |
| Citation: | Andrews-Todd, J., Steinberg, J., Pugh, S. L., & D’Mello, S. K. (2022). Comparing collaborative problem solving profiles derived from human and semi-automated annotation. In Weinberger, A. Chen, W., Hernández-Leo, D., & Chen, B. (Eds.), Proceedings of the 15th International Conference on Computer-Supported Collaborative Learning - CSCL 2022 (pp. 363-366). International Society of the Learning Sciences. |
| Abstract: | New challenges in today’s world have contributed to increased attention toward evaluating individuals’ collaborative problem solving (CPS) skills. One difficulty with this work is identifying evidence of individuals’ CPS capabilities, particularly when interacting in digital spaces. Often human-driven approaches are used but are limited in scale. Machine-driven approaches can save time and money, but their reliability relative to human approaches can be a challenge. In the current study, we compare CPS skill profiles derived from human and semi- automated annotation methods across two tasks. Results showed that the same clusters emerged for both tasks and annotation methods, with the annotation methods showing agreement on labeling most students according to the same profile membership. Additionally, validation of cluster results using external survey measures yielded similar results across annotation methods. |
| Description: | Short Paper |
| URI: | https://doi.dx.org/10.22318/cscl2022.363 https://repository.isls.org//handle/1/8309 |
| Appears in Collections: | ISLS Annual Meeting 2022 |
Files in This Item:
| File | Size | Format | |
|---|---|---|---|
| CSCL2022_363-366.pdf | 378 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.