ERIC Number: ED675677
Record Type: Non-Journal
Publication Date: 2024
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: 0000-00-00
Says Who? How Different Ground Truth Measures of Emotion Impact Student Affective Modeling
Andres Felipe Zambrano; Nidhi Nasiar; Jaclyn Ocumpaugh; Alex Goslen; Jiayi Zhang; Jonathan Rowe; Jordan Esiason; Jessica Vandenberg; Stephen Hutt
International Educational Data Mining Society, Paper presented at the International Conference on Educational Data Mining (EDM) (17th, Atlanta, GA, Jul 14-17, 2024)
Research into student affect detection has historically relied on ground truth measures of emotion that utilize one of three sources of data: (1) self-report data, (2) classroom observations, or (3) sensor data that is retrospectively labeled. Although a few studies have compared sensor- and observation-based approaches to student affective modeling, less work has explored the relationship between self-report and classroom observations. In this study, we use both recurring self-reports (SR) and classroom observation (BROMP) to measure student emotion during a study involving middle school students interacting with a game-based learning environment for microbiology education. We use supervised machine learning to develop two sets of affect detectors corresponding to SR and BROMP-based measures of student emotion, respectively. We compare the two sets of detectors in terms of their most relevant features, as well as correlations of their output with measures of student learning and interest. Results show that highly predictive features in the SR detectors are different from those selected for BROMP-based detectors. The associations with interest and motivation measures show that while SR detectors captured underlying motivations, the BROMP detectors seemed to capture more in-the-moment information about the student's experience. Evidence suggests that there is benefit of using both sources of data to model different components of student affect. [For the complete proceedings, see ED675485.]
Descriptors: Psychological Patterns, Measurement Techniques, Observation, Middle School Students, Game Based Learning, Artificial Intelligence, Identification
International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: Junior High Schools; Middle Schools; Secondary Education
Audience: N/A
Language: English
Authoring Institution: N/A
Grant or Contract Numbers: 2016943; 2016993
Author Affiliations: N/A

Peer reviewed
