ERIC Number: EJ1483482
Record Type: Journal
Publication Date: 2025-Sep
Pages: 16
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0007-0998
EISSN: EISSN-2044-8279
Available Date: 2025-06-10
Revealing Teaching Quality through Lesson Semantics: A GPT-Assisted Analysis of Transcripts
Richard Göllner1; Rebecca Lazarides1,2; Philipp Stark3
British Journal of Educational Psychology, v95 spec iss 1 p300-315 2025
Background: Existing conceptions of teaching quality assume that classroom interactions serve as the foundation for effective teaching. The resulting data necessitates analytical approaches capable of extracting the semantics of these interactions. Aim: This study investigates whether and to what extent lesson semantics provide insights into teaching quality (i.e., cognitive engagement, encouragement and warmth, multiple approaches, and the nature of discourse). To achieve this, GPT-4 was applied as a tool for analysing lesson transcripts. Sample: The study is based on data from the TALIS Video study, which included N = 50 teachers delivering two consecutive mathematics lessons in 9th grade. Teaching quality was annotated by trained observers across multiple dimensions. Method: The analysis involved embedding segmented lesson transcripts to examine their semantic characteristics and associations with human annotations of teaching quality. Additionally, we applied content-informed prompting to evaluate the interpretability of semantic characteristics for the considered dimensions. Results: GPT-4 identified five distinct semantic representations of transcripts, varying at both the teacher and lesson levels. These representations were related to teaching quality, accounting for up to 20% of variance in teaching quality annotations. Content-informed prompting aligned lesson segments more closely with semantic representations, supporting their interpretability. Conclusion: The findings suggest that lesson semantics serve as indicators of teaching quality, offering a promising approach to understanding effective classroom learning.
Descriptors: Teacher Effectiveness, Educational Quality, Semantics, Artificial Intelligence, Technology Uses in Education, Transcripts (Written Records), Lesson Plans, Educational Indicators
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www-wiley-com.bibliotheek.ehb.be/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1Department of Education, University of Potsdam, Potsdam, Germany; 2Cluster of Excellence Science of Intelligence, Technical University Berlin, Berlin, Germany; 3Hector Research Institute of Education Sciences and Psychology, University of Tübingen, Tübingen, Germany

Peer reviewed
Direct link
