Poster
in
Workshop: Generative AI for Education (GAIED): Advances, Opportunities, and Challenges
Paper 12: The Power of Personalization and Contextualization: Early Student Performance Forecasting with Language Models
Ahatsham Hayat · Mohammad Hasan
Keywords: [ large language model ] [ student performance ] [ Time Series Forecasting ] [ contextualization ] [ early forecasting ] [ Personalization ] [ STEM ]
Early forecasting of student performance in a course is a critical component of building effective intervention systems. However, when the available student data is limited, accurate early forecasting is challenging. We present a language generation transfer learning approach that leverages the general knowledge of pre-trained language models to address this challenge. We hypothesize that early forecasting can be significantly improved by fine-tuning language models (LMs) via personalization and contextualization using data on students' distal factors (academic and socioeconomic) and proximal non-cognitive factors (e.g., motivation and engagement), respectively. Results obtained from extensive experimentation validate this hypothesis and thereby demonstrate the prowess of personalization and contextualization for tapping into the general knowledge of pre-trained LMs for solving the downstream task of early forecasting.