ERIC Number: ED539099
Record Type: Non-Journal
Publication Date: 2009-Jul
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Dimensions of Difficulty in Translating Natural Language into First Order Logic
Barker-Plummer, Dave; Cox, Richard; Dale, Robert
International Working Group on Educational Data Mining, Paper presented at the International Conference on Educational Data Mining (EDM) (2nd, Cordoba, Spain, Jul 1-3, 2009)
In this paper, we present a study of a large corpus of student logic exercises in which we explore the relationship between two distinct measures of difficulty: the proportion of students whose initial attempt at a given natural language to first-order logic translation is incorrect, and the average number of attempts that are required in order to resolve the error once it has been made. We demonstrate that these measures are broadly correlated, but that certain circumstances can make a hard problem easy to fix, or an easy problem hard to fix. The analysis also reveals some unexpected results in terms of what students find difficult. This has consequences for the delivery of feedback in the Grade Grinder, our automated logic assessment tool; in particular, it suggests we should provide different kinds of assistance depending upon the specific "difficulty profile" of the exercise. (Contains 4 figures and 3 footnotes.) [For the complete proceedings, "Proceedings of the International Conference on Educational Data Mining (EDM) (2nd, Cordoba, Spain, July 1-3, 2009)," see ED539041.]
Descriptors: Data Analysis, Logical Thinking, Difficulty Level, Assignments, Sentences, Translation, Error Patterns, Multivariate Analysis, Matrices
International Working Group on Educational Data Mining. Available from: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: http://www.educationaldatamining.org
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: International Working Group on Educational Data Mining
Grant or Contract Numbers: N/A
Author Affiliations: N/A