ERIC Number: ED617867
Record Type: Non-Journal
Publication Date: 2016
Pages: 4
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-
EISSN: N/A
Available Date: N/A
Making AutoTutor Agents Smarter: AutoTutor Answer Clustering and Iterative Script Authoring
Cai, Zhiqiang; Gong, Yan; Qiu, Qizhi; Hu, Xiangen; Graesser, Art
Grantee Submission, Paper presented at the International Conference on Intelligent Virtual Agents (IVA) (2016)
AutoTutor uses conversational intelligent agents in learning environments. One of the major challenges in developing AutoTutor applications is to assess students' natural language answers to AutoTutor questions. We investigated an AutoTutor dataset with 3358 student answers to 49 AutoTutor questions. In comparisons with human ratings, we found that semantic matching works well for some questions but poor for others. This variation can be predicted by a measure called "question uncertainty", an entropy value on semantic cluster probabilities. Based on these findings, we propose an iterative AutoTutor script authoring process that can make AutoTutor agents smarter and improve assessment models by iteratively adding and modifying both questions and ideal answers. [This paper was published in: "Intelligent Virtual Agents (IVA 2016), Lecture Notes in Computer Science (LNAI, Vol. 10011)," edited by D. Traum et al., Springer, Cham, 2016, pp. 438-441.]
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF); Institute of Education Sciences (ED); US Army Research Laboratory (ARL); Office of Naval Research (ONR) (DOD)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: SBR9720314; REC0106965; REC0126265; ITR0325428; REESE0633918; ALT0834847; DRK120918409; 1108845; R305H050169; R305B070349; R305A080589; R305A080594; R305G020018; R305C120001; W911INF1220030; N000140010600; N0001412C0643; N00001416C3027
Author Affiliations: N/A