User-centric Evaluation of GenAI Alignment and Recommendations based on Predictive Learning Analytics

Basit Öğe Kaydı
dc.contributor.authorAhmed, Hesham
dc.contributor.authorKayaduman, Halil
dc.contributor.authorLópez-Pernas, Sonsoles
dc.contributor.authorTukiainen, Markku
dc.contributor.authorSaqr, Mohammed
dc.date.accessioned2026-04-04T13:19:14Z
dc.date.available2026-04-04T13:19:14Z
dc.date.issued2025
dc.departmentİnönü Üniversitesi
dc.description2nd International Workshop on Generative AI for Learning Analytics, GenAI-LA 2025 -- 3 March 2025 -- Dublin -- 210284
dc.description.abstractPredictive models are one of the hallmarks of learning analytics research, relying on learner data to predict academic achievement and dropouts, enabling targeted interventions. Using a user-centric evaluation framework, we assessed the recommendations generated by ChatGPT based on the results of 136 studies that used student data for predictive modeling. The evaluation considered general attributes (accuracy, coherence, justification) as well as education-specific criteria (alignment with learning theories, ethics, learner-centeredness). The results indicate that, while LLM-generated recommendations are generally accurate, coherent and useful, they often lack alignment with diverse learning theories and fail to address inclusivity and higher-order cognitive skills effectively. Therefore, to operationalize LLMs to provide automated feedback to students, these aspects should be explicitly considered in the prompt design. © 2025 Copyright for this paper by its authors.
dc.description.sponsorshipResearch Council of Finland, AKA, (350560); Research Council of Finland, AKA
dc.identifier.endpage10
dc.identifier.issn1613-0073
dc.identifier.scopus2-s2.0-105011258037
dc.identifier.scopusqualityQ4
dc.identifier.startpage1
dc.identifier.urihttps://hdl.handle.net/11616/108265
dc.identifier.volume3994
dc.indekslendigikaynakScopus
dc.language.isoen
dc.publisherCEUR-WS
dc.relation.ispartofCEUR Workshop Proceedings
dc.relation.publicationcategoryKonferans Öğesi - Uluslararası - Kurum Öğretim Elemanı
dc.rightsinfo:eu-repo/semantics/closedAccess
dc.snmzKA_Scopus_20250329
dc.subjectGenerative AI
dc.subjectLarge Language Models
dc.subjectPredictive Learning Analytics
dc.subjectUser-centric Evaluation
dc.titleUser-centric Evaluation of GenAI Alignment and Recommendations based on Predictive Learning Analytics
dc.typeConference Object

Dosyalar

Koleksiyon

Scopus İndeksli Yayınlar Koleksiyonu