ERIC Number: EJ1309187
Record Type: Journal
Publication Date: 2021
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1049-4820
EISSN: N/A
Available Date: N/A
Evaluation of Auto-Generated Distractors in Multiple Choice Questions from a Semantic Network
Zhang, Lishan; VanLehn, Kurt
Interactive Learning Environments, v29 n6 p1019-1036 2021
Despite their drawback, multiple-choice questions are an enduring feature in instruction because they can be answered more rapidly than open response questions and they are easily scored. However, it can be difficult to generate good incorrect choices (called "distractors"). We designed an algorithm to generate distractors from a semantic network for four types of multiple choice questions in biology. By recruiting 200 participants from Amazon Mechanical Turk, the machine-generated distractors were compared to human-generated distractors in terms of question difficulty, question discrimination and distractor usefulness. The machine-generated and human-generated distractors performed very closely on all the three measures, suggesting that generating distractors from a semantic network for simple multiple choice questions is a viable method.
Descriptors: Semantics, Networks, Multiple Choice Tests, Teaching Methods, Item Analysis, Difficulty Level, Biology, Science Tests, Comparative Analysis, Test Items, Computer Software, Test Construction, Questioning Techniques, Computer Assisted Testing
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
Grant or Contract Numbers: DRL0910221; IIS1123823
Author Affiliations: N/A