We study the automatic identification of educational items worthy of content authors' attention. Based on the results of such analysis, content authors can revise and improve the content of learning environments. We provide an overview of item properties relevant to this task, including difficulty and complexity measures, item discrimination, and…

This study aimed to compare selection patterns of distractors (incorrect options) according to test taker proficiency regarding Japanese students' summarization skills of an English paragraph. Participants included 414 undergraduate students, and the test comprised three summarization process types--deletion, generalization, and integration.…

We investigated whether consensus-based test translation review procedures can be used effectively in cultural contexts with high social stratification. We staged two test translation review panels in China -- where social stratification may potentially inhibit individuals' ability to express opinion and disagreement. We adapted a consensus-based…

This study presents empirical evidence for the hypothesis that reading purpose may impact upon the cognitive processes that L2 readers use in comprehending a text. 25 advanced learners of English were put into two purpose groups--testing condition (TC) and learning condition (LC). The participants in the TC read two expository passages and…

This study investigates the psychological effect of a wrong question with wrong items on answering to the next question in a test of structure. Forty students selected through stratified random sampling are given 15 questions of a standardized test namely a TOEFL structure test in which questions number 7 and number 11 are wrong and their answers…

English-as-a-foreign-language (EFL) textbooks and internet resources exhibit various formats and implementations of exercises on phrasal verbs. The experimental study reported here examines whether some of these might be more effective than others. EFL learners at a university in Japan were randomly assigned to 4 treatment groups. Two groups were…

This study investigated Korean college students' performance as measured by two different vocabulary assessment tools (the Productive Vocabulary Levels Test (PVLT) and the Productive Vocabulary Use Task (PVUT)) and the relationship these assessments have with students' writing proficiency. A total of 72 students participated in the study. The…

This study is aimed at examining how students of selected Teacher Training Colleges handle one important aspect of sentence structure, i.e. "subordination". Data were collected from written scripts, and tests responded to by 150 participants from three selected colleges. These were analyzed by identifying both correct and incorrect uses…

Uses item analysis techniques to compare two multiple-choice test formats for assessing second language students' competence in English structure in terms of mean scores, item difficulty, and item discrimination. Findings reveal that difficulty and discrimination aspects are item-specific rather than format-dependent and items with moderate…