Please use this identifier to cite or link to this item:
https://repository.isls.org/handle/1/11184| Title: | “We were learning from each other:” Nuancing Learner-AI Relationships in Assessing Rhetorical Features of Disinformation |
| Authors: | Russo, Renato Schechter, Brett Blikstein, Paulo |
| Keywords: | Learning Sciences |
| Issue Date: | 2024 |
| Publisher: | International Society of the Learning Sciences |
| Citation: | Russo, R., Schechter, B., & Blikstein, P. (2024). “We were learning from each other:” Nuancing Learner-AI Relationships in Assessing Rhetorical Features of Disinformation. In Lindgren, R., Asino, T. I., Kyza, E. A., Looi, C. K., Keifert, D. T., & Suárez, E. (Eds.), Proceedings of the 18th International Conference of the Learning Sciences - ICLS 2024 (pp. 889-896). International Society of the Learning Sciences. |
| Abstract: | Assessing the reliability of information is one among several potential uses of Large Language Models (LLM). However, little research documents its application for educational purposes. We developed an educational conversational agent (Aide) that aims to help learners identify rhetorical aspects of textual disinformation. In this paper, we document different traits that users attribute to Aide through verbs that they use to describe its actions (such as analyze, teach, and explain). We also describe what attributes users in our sample identify as markers of reliability in Aide’s analysis of text (such as reference to data and technical vocabulary). Finally, we present a concise case study to highlight discrepancies between users’ perception of learning outcomes derived from using Aide (perceived as effective) vis-à-vis their approach to evaluate news stories pre- and post-interaction with Aide (unaltered) We conclude with a reflection on implications for the design of technologies that employ conversational agents for instruction aimed at enhancing learners' ability to assess information. |
| Description: | Long Paper |
| URI: | https://doi.org/10.22318/icls2024.760623 https://repository.isls.org//handle/1/11184 |
| Appears in Collections: | ISLS Annual Meeting 2024 |
Files in This Item:
| File | Size | Format | |
|---|---|---|---|
| ICLS2024_889-896.pdf | 551.57 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.