NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: ED671282
Record Type: Non-Journal
Publication Date: 2020-Jun
Pages: 57
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: 0000-00-00
Measuring Teaching Practices at Scale: A Novel Application of Text-as-Data Methods. EdWorkingPaper No. 20-239
Jing Liu; Julie Cohen
Annenberg Institute for School Reform at Brown University
Valid and reliable measurements of teaching quality facilitate school-level decision-making and policies pertaining to teachers, but conventional classroom observations are costly, prone to rater bias, and hard to implement at scale. Using nearly 1,000 word-to-word transcriptions of 4th- and 5th-grade English language arts classes, we apply novel text-as-data methods to develop automated, objective measures of teaching to complement classroom observations. This approach is free of rater bias and enables the detection of three instructional factors that are well aligned with commonly used observation protocols: classroom management, interactive instruction, and teacher-centered instruction. The teacher-centered instruction factor is a consistent negative predictor of value-added scores, even after controlling for teachers' average classroom observation scores. The interactive instruction factor predicts positive value-added scores. [This study was funded by the Shultz Graduate Student Fellowship in Economic Policy from the Stanford Institute for Economic Policy Research, the Stanford Graduate School of Education Doctoral Student Award from the Technology for Equity in Learning Opportunities initiative, and a dissertation grant from the Stanford Freeman Spogli Institute.]
Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/
Related Records: EJ1317414
Publication Type: Reports - Research
Education Level: Elementary Education; Grade 4; Intermediate Grades; Grade 5; Middle Schools
Audience: N/A
Language: English
Authoring Institution: Annenberg Institute for School Reform at Brown University
Grant or Contract Numbers: N/A
Author Affiliations: N/A