Crowdsourcing Explanations for Improving Assessment Content and Identifying Knowledge Components

Abstract

Refining assessment items to improve their clarity and identifying the intended knowledge components required to solve them is a time-consuming task. In this study, we present the results of crowdsourcing insights into the underlying concepts of problems in mathematics and English writing, as a step towards leveraging the crowd to expedite the task. This work demonstrates a method to use the crowd’s knowledge that can lead to knowledge component identification and improved assessments.