The automated model of comprehension version 4.0 – Validation studies and integration of ChatGPT

Dragos Georgian Corlatescu, Micah Watanabe, Stefan Ruseti, Mihai Dascalu, Danielle S. McNamara

Research output: Contribution to journalArticlepeer-review

Abstract

Modeling reading comprehension processes is a critical task for Learning Analytics, as accurate models of the reading process can be used to match students to texts, identify appropriate interventions, and predict learning outcomes. This paper introduces an improved version of the Automated Model of Comprehension, namely version 4.0. AMoC has its roots in two theoretical models of the comprehension process (i.e., the Construction-Integration model and the Landscape model), and the new version leverages state-of-the-art Large Language models, more specifically ChatGPT, to have a better contextualization of the text and a simplified construction of the underlying graph model. Besides showcasing the usage of the model, the study introduces three in-depth psychological validations that argue for the model's adequacy in modeling reading comprehension. In these studies, we demonstrated that AMoC is in line with the theoretical background proposed by the Construction-Integration and Landscape models, and it is better at replicating results from previous human psychological experiments than its predecessor. Thus, AMoC v4.0 can be further used as an educational tool to, for example, help teachers design better learning materials personalized for student profiles. Additionally, we release the code from AMoC v4.0 as open source in a Google Collab Notebook and a GitHub repository.

Original languageEnglish (US)
Article number108154
JournalComputers in Human Behavior
Volume154
DOIs
StatePublished - May 2024

Keywords

  • Automated model of comprehension
  • ChatGPT
  • Large language models
  • Natural language processing
  • Reading comprehension

ASJC Scopus subject areas

  • Arts and Humanities (miscellaneous)
  • Human-Computer Interaction
  • General Psychology

Fingerprint

Dive into the research topics of 'The automated model of comprehension version 4.0 – Validation studies and integration of ChatGPT'. Together they form a unique fingerprint.

Cite this