ERIC Number: EJ988504
Record Type: Journal
Publication Date: 2012-Nov
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0007-1013
EISSN: N/A
Available Date: N/A
Estimation of Teacher Practices Based on Text Transcripts of Teacher Speech Using a Support Vector Machine Algorithm
Araya, Roberto; Plana, Francisco; Dartnell, Pablo; Soto-Andrade, Jorge; Luci, Gina; Salinas, Elena; Araya, Marylen
British Journal of Educational Technology, v43 n6 p837-846 Nov 2012
Teacher practice is normally assessed by observers who watch classes or videos of classes. Here, we analyse an alternative strategy that uses text transcripts and a support vector machine classifier. For each one of the 710 videos of mathematics classes from the 2005 Chilean National Teacher Assessment Programme, a single 4-minute slice was selected randomly and manually transcribed. The texts were then rated by two mathematicians and two teachers on the basis of the presence/absence of eight categories of contents and 12 categories of teacher practices. Then for each rater and category a classifier was built using a support vector machine algorithm trained with his/her ratings on a subset of texts. The agreements between the classifiers and the corresponding raters computed for texts belonging to an independent subset were better than the agreements between the raters. Next, we trained classifiers by using ratings created by raters who watched the videos rather than analysing the transcripts. Again, the agreements between classifiers and the raters were satisfactory. Given that class assessment can be an extremely slow, error prone and tedious process, the proposed automatic classifier scheme could be a promising alternative for monitoring classes and building online performance support system of teacher practices. (Contains 2 figures and 5 tables.)
Descriptors: Transcripts (Written Records), Teaching Methods, Teacher Evaluation, Elementary School Teachers, Middle School Teachers, Mathematics Instruction, Video Technology, Automation, Classification, Interrater Reliability, Foreign Countries
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com.bibliotheek.ehb.be/WileyCDA/
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education; Junior High Schools; Middle Schools
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Chile
Grant or Contract Numbers: N/A
Author Affiliations: N/A