NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: ED492925
Record Type: Non-Journal
Publication Date: 2004-Jul
Pages: 69
Abstractor: Author
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Exploring Item Characteristics That Are Related to the Difficulty of TOEFL Dialogue Items. Research Reports. RR-79. RR-04-11
Kostin, Irene
Educational Testing Service
The purpose of this study is to explore the relationship between a set of item characteristics and the difficulty of TOEFL[R] dialogue items. Identifying characteristics that are related to item difficulty has the potential to improve the efficiency of the item-writing process The study employed 365 TOEFL dialogue items, which were coded on 49 variables, including 5 significant variables reported in Nissan, DeVincenzi, and Tang (1996). Of the 5 significant variables in Nissan et al., 3 correlated significantly with item difficulty in this study. Another 11 met a critical probability criterion. These 11 included representatives from three broad categories of variables: 2 in the category of word-level factors, 1 in the category of discourse-level factors, and 8 in the category of task-processing factors. Multiple regression analyses indicate that the variables in this study account for about 40% of the variance in item difficulty. The following are appended: (1) Coding Instructions; and (2) Instructions for Coding Lexical Overlap. (Contains 3 tables.)
Educational Testing Service. Rosedale Road Mailstop 19R, Princeton, NJ 08541-0001. Tel: 609-921-9000; Fax: 609-734-5410; Web site: http://www.ets.org.
Publication Type: Information Analyses; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.
Identifiers - Assessments and Surveys: Test of English as a Foreign Language
Grant or Contract Numbers: N/A
Author Affiliations: N/A