ERIC Number: EJ1311004
Record Type: Journal
Publication Date: 2020-Oct
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-1531-7714
EISSN: N/A
Available Date: N/A
A Practical Comparison of Selected Methods of Evaluating Multiple-Choice Options through Classical Item Analysis
Malec, Wojciech; Krzeminska-Adamek, Malgorzata
Practical Assessment, Research & Evaluation, v25 Article 7 Oct 2020
The main objective of the article is to compare several methods of evaluating multiple-choice options through classical item analysis. The methods subjected to examination include the tabulation of choice distribution, the interpretation of trace lines, the point-biserial correlation, the categorical analysis of trace lines, and the investigation of choice means. The comparison was performed on the basis of a data set created at the pre-operational stage of developing a test of English as a foreign language for teenage learners. The main analysis of a pool of 910 multiple-choice pilot items was carried out in Excel, which was found to be a versatile tool allowing for the application of user-defined formulas and convenient manipulation of the data. It was found that the methods differed in terms of their stringency in rejecting malfunctioning items, with the chi-square test operating in the most rigorous manner. The study also revealed that some of the evaluation methods had a similar effect on item selection, which suggests that it may not be necessary to apply all of them to multiple-choice item analysis.
Descriptors: Comparative Analysis, Evaluation Methods, Multiple Choice Tests, Item Analysis, Test Items, Correlation, Classification, Language Tests, English (Second Language), Second Language Learning, Spreadsheets, Guidelines, Evaluation Criteria, Item Response Theory, Adolescents
Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail: pare@umass.edu; Tel: 413-577-2180; Web site: https://scholarworks.umass.edu/pare
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A