Please use this identifier to cite or link to this item: https://repository.isls.org/handle/1/8557
Title: Decomposing Practice: Developing Reliable Analyses of Complex Classroom Discussion
Authors: Sushil, S
Dennis, Katherine
Clarke, Sherice N
Gates, Zaynab
Tripathi, Tarang
Gomoll, Andrea
Leung, Vivian
Lee, Ung-Sang
Lee, Barbara
Keywords: Learning Sciences
Issue Date: 2022
Publisher: International Society of the Learning Sciences
Citation: Sushil, S., Dennis, K., Clarke, S. N., Gates, Z., Tripathi, T., Gomoll, A., Leung, V., Lee, U., & Lee, B. (2022). Decomposing practice: Developing reliable analyses of complex classroom discussion. In Chinn, C., Tan, E., Chan, C., & Kali, Y. (Eds.), Proceedings of the 16th International Conference of the Learning Sciences - ICLS 2022 (pp. 1629-1632). International Society of the Learning Sciences.
Abstract: There is relatively scant conversation about the details of processes through which research teams arrive at desirable thresholds of statistical measures for inter-rater reliability (IRR) in qualitative research. This paper used autoethnography to describe how a team of five researchers achieved a Cohen’s Kappa of .7 between each pair of researchers over a period of two years while iteratively developing a codebook to be applied to science classroom discussion transcripts. Detailed meeting notes kept by the researchers were used as data. The findings describe factors that contributed to the complexity of the transcripts, strategies that worked for the team, and the role of the purpose of the analysis in shaping the process of the analysis. Some implications for the field of teacher learning are discussed based on these findings.
Description: Short Paper
URI: https://dx.doi.org/10.22318/icls2022.1629
https://repository.isls.org//handle/1/8557
Appears in Collections:ISLS Annual Meeting 2022

Files in This Item:
File SizeFormat 
ICLS2022_1629-1632.pdf251.91 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.