Please use this identifier to cite or link to this item: https://repository.isls.org/handle/1/8746
Title: Empirically-Driven Multiple Choice Response Options
Authors: Condor, Aubrey
Keywords: Learning Sciences
Issue Date: 2022
Publisher: International Society of the Learning Sciences
Citation: Condor, A. (2022). Empirically-driven multiple choice response options. In Chinn, C., Tan, E., Chan, C., & Kali, Y. (Eds.), Proceedings of the 16th International Conference of the Learning Sciences - ICLS 2022 (pp. 2122-2123). International Society of the Learning Sciences.
Abstract: We introduce an empirical method for generating multiple choice (MC) response options for educational assessment. Developing quality response options for MC questions is labor intensive, especially when parallel items are necessary for repeated assessments or multiple test forms. We propose a data-driven, iterative approach for creating an item bank of MC questions by first collecting a sample of open-ended student responses that are subsequently rated by subject-matter experts. Contextual sentence embeddings of the observed student responses as well as the expert ratings are used in conjunction with hierarchical clustering to create MC options that span the desired ground truth rating levels specified by the item creator. We evaluate the quality of the automatically generated response options qualitatively, based on existing research relating to best practices for item writing.
Description: Poster
URI: https://dx.doi.org/10.22318/icls2022.2122
https://repository.isls.org//handle/1/8746
Appears in Collections:ISLS Annual Meeting 2022

Files in This Item:
File SizeFormat 
ICLS2022_2122-2123.pdf498.42 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.