ERIC Number: ED596578
Record Type: Non-Journal
Publication Date: 2017-Jun
Pages: 6
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Assessing the Dialogic Properties of Classroom Discourse: Proportion Models for Imbalanced Classes
Olney, Andrew M.; Donnelly, Patrick J.; Samei, Borhan; D'Mello, Sidney K.
International Educational Data Mining Society, Paper presented at the International Conference on Educational Data Mining (EDM) (10th, Wuhan, China, Jun 25-28, 2017)
Automatic assessment of dialogic properties of classroom discourse would benefit several widespread classroom observation protocols. However, in classrooms with low incidences of dialogic discourse, assessment can be highly biased against detecting dialogic properties. In this paper, we present an approach to addressing this imbalanced class problem. Rather than perform classifications at the utterance level, we aggregate feature vectors to classify proportions of dialogic properties at the class-session level and achieve a moderate correlation with actual proportions, r(130) = 0.50, p < 0.001, CI[subscript 95][0.36, 0.61]. We show that this approach outperforms aggregating utterance level classifications, r(130) = 0.27, p = 0.001, CI[subscript 95][0.11, 0.43], is stable for both low and high dialogic classrooms, and is stable across both automatic speech recognition and human transcripts. [For the full proceedings, see ED596512.]
Descriptors: Models, Classroom Communication, Audio Equipment, Discourse Analysis, Classification, Correlation, Speech Communication, Classroom Observation Techniques, Teaching Methods, Instructional Effectiveness, Educational Quality, Teacher Effectiveness, Classroom Environment, Validity, Computer Software, Data Analysis
International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: http://www.educationaldatamining.org
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305A130030
Author Affiliations: N/A