From black box to pedagogical partner: Students’ sense-making of LLM-based automated assessment

Basit Öğe Kaydı
dc.contributor.authorKara, Abdulkadir
dc.contributor.authorYıldırım, Serkan
dc.date.accessioned2026-09-01T15:47:37Z
dc.date.available2026-09-01T15:47:37Z
dc.date.issued2026
dc.departmentBayburt Üniversitesi
dc.description.abstractWhile current educational research on automated assessment heavily emphasizes technical validity, a significant gap remains in understanding students’ sustained, real-world experiences with these systems in authentic learning environments. This study examines students’ experiences with a large language model-based automated assessment system embedded in the regular flow of a university course. The study employed a mixed-methods design with 47 university students over a seven-week period. Quantitative data were obtained from system interaction logs and student feedback ratings, while qualitative data were collected from focus group interviews with 24 students and 175 written feedback responses. The results reveal that students perceive the LLM-based assessment system as a learning assistant, an impartial evaluator, and a self-assessment tool. The transparency of explanations was identified as a decisive factor in building trust in the algorithmic system by helping students understand the rationale behind scores and feedback. Sustained interaction with the system triggered a shift from high-frequency trial and error to more efficient and strategic participation, indicating that the assessment criteria were gradually internalized. The system appeared to create an environment free from perceived social judgment, providing favorable conditions for productive failure, repeated attempts, and self-directed revision. Overall, the study demonstrates that artificial intelligence can be positioned as a tool that scales pedagogical intent without replacing the teacher and can be effectively integrated within the framework of human–AI complementarity in higher education. © 2026, Ozgen Korkmaz. All rights reserved.
dc.description.sponsorshipAtatürk Üniversitesi
dc.identifier.doi10.17275/per.26.58.13.4
dc.identifier.endpage270
dc.identifier.issn2148-6123
dc.identifier.issue4
dc.identifier.scopus2-s2.0-105044332163
dc.identifier.scopusqualityQ2
dc.identifier.startpage251
dc.identifier.urihttps://doi.org/10.17275/per.26.58.13.4
dc.identifier.urihttps://hdl.handle.net/20.500.12403/8355
dc.identifier.volume13
dc.indekslendigikaynakScopus
dc.language.isoen
dc.publisherOzgen Korkmaz
dc.relation.ispartofParticipatory Educational Research
dc.relation.publicationcategoryMakale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı
dc.rightsinfo:eu-repo/semantics/openAccess
dc.snmzKA_Scopus_20260820
dc.subjectAi-Generated Feedback
dc.subjectAutomated Assessment
dc.subjectExplainable Ai
dc.subjectLarge Language Models
dc.subjectStudent Experience
dc.titleFrom black box to pedagogical partner: Students’ sense-making of LLM-based automated assessment
dc.typeArticle

Dosyalar

Koleksiyon

Scopus İndeksli Yayınlar Koleksiyonu