WHAT KIND OF EDUCATIONAL RELATIONSHIP DOES A LARGE LANGUAGE MODEL CONSTRUCT? A QUALITATIVE ANALYSIS OF HUMAN ANNOTATIONS IN UNIVERSITY GUIDANCE DIALOGUES
DOI:
https://doi.org/10.32043/gsd.v10i4.1939Keywords:
University guidance, LLMs, Educational relationshipAbstract
The adoption of Large Language Models (LLMs) in university guidance is reshaping how students explore academic pathways, raising a key pedagogical question: what kind of educational relationship does conversational AI construct during guidance dialogues? Developed within the ELOQUENCE project (HORIZON-CL4-2023-HUMAN-01-CNECT), this study extends the framework of synthetic personas (Casoria et al., 2025) and synthetic dialogues for bias elicitation (Augello et al., 2025), shifting the focus from algorithmic fairness to educational relationship quality. Through a thematic analysis of human annotations on university guidance dialogues, six pedagogical dimensions emerged: pedagogical listening, recognition of student uniqueness, continuity, agency, reflective scaffolding, and educational reciprocity. Findings show that, although LLMs produce coherent interactions, they remain limited in supporting authentic listening, personalization, and students' autonomous decision-making, providing a pedagogical framework for evaluating AI-supported guidance systems.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Luna Lembo, Giuseppe Caggianese, Stefania Morsanuto, Agnese Augello, Davide Perrotta, Pietro Neroni, Luca Sabatucci, Francesco Peluso Cassese

This work is licensed under a Creative Commons Attribution 4.0 International License.
The licence that applies to this article is the one shown above and on its first page. Since Volume 7 (2023) the journal publishes under the Creative Commons Attribution 4.0 International License (CC BY 4.0); articles in Volumes 1–6 (2017–2022) were published under the Creative Commons Attribution–NonCommercial–NoDerivatives 3.0 Italy License (CC BY-NC-ND 3.0 IT) and keep that licence. Authors retain copyright of their work and grant the journal the right of first publication.