ERIC Number: ED615492
Record Type: Non-Journal
Publication Date: 2021
Pages: 9
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Automated Claim Identification Using NLP Features in Student Argumentative Essays
Wan, Qian; Crossley, Scott; Banawan, Michelle; Balyan, Renu; Tian, Yu; McNamara, Danielle; Allen, Laura
International Educational Data Mining Society, Paper presented at the International Conference on Educational Data Mining (EDM) (14th, Online, Jun 29-Jul 2, 2021)
The current study explores the ability to predict argumentative claims in structurally-annotated student essays to gain insights into the role of argumentation structure in the quality of persuasive writing. Our annotation scheme specified six types of argumentative components based on the well-established Toulmin's model of argumentation. We developed feature sets consisting of word count, frequency data of key n-grams, positionality data, and other lexical, syntactic, semantic features based on both sentential and suprasentential levels. The suprasentential Random Forest model based on frequency and positionality features yielded the best results, reporting an accuracy of 0.87 and kappa of 0.73. This model will be included in an online writing assessment tool to generate feedback for student writers. [For the full proceedings, see ED615472.]
Descriptors: Essays, Persuasive Discourse, Automation, Identification, Natural Language Processing, Documentation, Accuracy, Undergraduate Students, Computer Uses in Education
International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); Office of Naval Research (ONR) (DOD)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305A180261; R305A180144; N000142012623; N000141912424
Author Affiliations: N/A