Please use this identifier to cite or link to this item: https://repository.isls.org/handle/1/11184
Title: “We were learning from each other:” Nuancing Learner-AI Relationships in Assessing Rhetorical Features of Disinformation
Authors: Russo, Renato
Schechter, Brett
Blikstein, Paulo
Keywords: Learning Sciences
Issue Date: 2024
Publisher: International Society of the Learning Sciences
Citation: Russo, R., Schechter, B., & Blikstein, P. (2024). “We were learning from each other:” Nuancing Learner-AI Relationships in Assessing Rhetorical Features of Disinformation. In Lindgren, R., Asino, T. I., Kyza, E. A., Looi, C. K., Keifert, D. T., & Suárez, E. (Eds.), Proceedings of the 18th International Conference of the Learning Sciences - ICLS 2024 (pp. 889-896). International Society of the Learning Sciences.
Abstract: Assessing the reliability of information is one among several potential uses of Large Language Models (LLM). However, little research documents its application for educational purposes. We developed an educational conversational agent (Aide) that aims to help learners identify rhetorical aspects of textual disinformation. In this paper, we document different traits that users attribute to Aide through verbs that they use to describe its actions (such as analyze, teach, and explain). We also describe what attributes users in our sample identify as markers of reliability in Aide’s analysis of text (such as reference to data and technical vocabulary). Finally, we present a concise case study to highlight discrepancies between users’ perception of learning outcomes derived from using Aide (perceived as effective) vis-à-vis their approach to evaluate news stories pre- and post-interaction with Aide (unaltered) We conclude with a reflection on implications for the design of technologies that employ conversational agents for instruction aimed at enhancing learners' ability to assess information.
Description: Long Paper
URI: https://doi.org/10.22318/icls2024.760623
https://repository.isls.org//handle/1/11184
Appears in Collections:ISLS Annual Meeting 2024

Files in This Item:
File SizeFormat 
ICLS2024_889-896.pdf551.57 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.