Using a Reflection Tool to Increase Reliability of Peer Assessments in a CSCL Environment

Abstract

To examine the reliability of students' peer assessments, two contiguous study groups used a peer assessment tool (Radar) with or without reflection tool (Reflector) in a computer-supported collaborative learning environment. Radar allows group members to assess themselves and their fellow group members on six traits related to social and cognitive behavior. Reflector stimulates group members to reflect individually and collaboratively on their past, present, and future functioning. The underlying assumption was that Radar in combination with Reflector would lead to (1) more reliable peer assessment scores, and (2) more valid perceptions of the social performance of the group. Participants were 191 second year academic students working in groups of three, four or five, on a collaborative writing task. As expected, results showed that the use of a reflection tool in a CSCL environment leads to more reliable peer assessment scores and more valid perceptions of the groups' social performance.