NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1483579
Record Type: Journal
Publication Date: 2025-Sep
Pages: 25
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0007-0998
EISSN: EISSN-2044-8279
Available Date: 2025-04-28
A Process-Oriented Perspective on Pre-Service Teachers' Self-Efficacy and Their Motivational Messages: Using Large Language Models to Classify Teachers' Speech
British Journal of Educational Psychology, v95 spec iss 1 p73-97 2025
Background: Recent studies have examined the relation between teacher motivation, motivational messages and student learning but are limited to an achievement-related context, primarily using survey data. Moreover, our understanding of the relation between various teacher characteristics, such as teacher self-efficacy (TSE), and their motivational message use remains limited. Aims: Our study tested whether teacher speech can be classified into self-determination (SDT)-based motivational messages and reliably assessed with a large language model (LLM). Additionally, we analysed the relation between pre-service TSE and their motivational message use. Sample: For our first aim, we used human-rater annotations from 119 pre-service teachers' classroom recordings. For our second aim, we used data from 103 pre-service teachers (52.69% female; M[subscript age] = 22.98, SD[subscript age] = 3.26, Min[subscript age] = 19, Max[subscript age] = 34) who participated in a survey and were video-recorded while teaching. Methods: First, we manually classified pre-service teachers' motivational messages based on transcripts and used human-rater annotations to fine-tune an LLM. Second, we analysed the relation between pre-service TSE and motivational message use. Results and Conclusions: The fine-tuned LLM demonstrated promising performance in assessing SDT-based motivational messages but needs further refining to assess thwarting messages. The analysis with human annotation showed that pre-service TSE for classroom management positively affected the frequency of relatedness-supportive messages. Pre-service TSE for student engagement increased the likelihood of never using a competence- or relatedness-thwarting message. Pre-service TSE for instructional strategies reduced the frequency of autonomy-supportive messages. LLM-based analyses showed slightly different results but did not contradict human annotation-based analyses.
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www-wiley-com.bibliotheek.ehb.be/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1Department of Educational Sciences, University of Potsdam, Potsdam, Germany; 2Chair of Artificial Intelligence and Intelligent Systems, Hasso-Plattner-Institute/University of Potsdam, Potsdam, Germany; 3Department of General, Intercultural and International Comparative Education as well as Educational Psychology (EW1), University of Hamburg, Hamburg, Germany; 4Institute for Psychology in Education, University of Münster, Münster, Germany; 5Department of Research on Teaching and Teacher Education, Kiel University, Kiel, Germany; 6Institute for Psychology of Learning and Instruction (IPL), Kiel University, Kiel, Germany; 7Science of Intelligence, Research Cluster of Excellence, Berlin, Germany