This study investigates the psychological effect of a wrong question with wrong items on answering to the next question in a test of structure. Forty students selected through stratified random sampling are given 15 questions of a standardized test namely a TOEFL structure test in which questions number 7 and number 11 are wrong and their answers…

This study investigates test-takers' processing while completing banked gap-fill tasks, designed to test reading proficiency, in order to test theoretically based expectations about the variation in cognitive processes of test-takers across levels of performance. Twenty-eight test-takers' eye traces on 24 banked gap-fill items (on six tasks) were…

The research reported in this article investigates differential item functioning (DIF) in a listening comprehension test. The study explores the relationship between test-taker age and the items' language domains across multiple test forms. The data comprise test-taker responses (N = 2,861) to a total of 133 unique items, 46 items of which were…

The present study focused on the analysis of listening sections of two international English proficiency tests, i.e. IELTS and TOEFL tests, and one local English proficiency test, i.e. TOLIMO from pragmatic perspective. An attempt was made to explore the areas of pragmatic knowledge presented, and to assess test takers' pragmatic knowledge. For…

Cloze tests have been the subject of numerous studies regarding their function and use in both first language and second language contexts (e.g., Jonz & Oller, 1994; Watanabe & Koyama, 2008). From a validity standpoint, one area of investigation has been the extent to which cloze tests measure reading ability beyond the sentence level.…

Multiple-choice formats remain a popular design for assessing listening comprehension, yet no consensus has been reached on how multiple-choice formats should be employed. Some researchers argue that test takers must be provided with a preview of the items prior to the input (Buck, 1995; Sherman, 1997); others argue that a preview may decrease the…

Self-assessment has been used to assess second language proficiency; however, as sources of measurement errors vary, they may threaten the validity and reliability of the tools. The present paper investigated the role of experiences in using Japanese as a second language in the naturalistic acquisition context on the accuracy of the…

Our study aimed at finding out the effectiveness of corpus-based vocabulary teaching activities as well as students' attitudes towards concordance-based materials when corpus-based tasks in English vocabulary learning are used. The study was conducted in a preparatory school in a private university. The participants were 28 intermediate level…

We translated and report on the psychometric properties of English and French versions of two reading difficulties screening tools for junior/community college students. We administered the Adult Reading History Questionnaire-Revised (ARHQ-R) (Parrila, Georgiou, & Corkett, 2007) to 1889 students enrolled in compulsory language courses in…

There has been a growing interest in the use of integrated tasks in the field of second language testing to enhance the authenticity of language tests. However, the role of text integration in test takers' performance has not been widely investigated. The purpose of the current study is to examine the effects of text-based relational (i.e.,…

This article describes two research studies conducted on the linguistic modification of test items from K-12 content assessments. In the first study, 120 linguistically modified test items in mathematics and science taken by fourth and sixth graders were found to have a wide range of outcomes for English language learners (ELLs) and non-ELLs, with…

Japan's government has mandated a shift from traditional to communicative methodologies in secondary English classrooms (Tanabe, 2004), but it is unclear whether this has affected student beliefs about language learning. This study investigates the beliefs of 315 incoming university students at a large private university in Japan from 2006 through…

This study employed Bachman and Palmer's (2010) Assessment Use Argument framework to investigate to what extent the use of a second language oral test as an exit test in a Hong Kong university can be justified. It also aimed to help test developers of this oral test identify the most critical areas in the current test design that might need…

This paper concerns the divisibility of comprehension subskills measured in L2 listening and reading tests. Motivated by the administration of the new Web-based English as a Second Language Placement Exam (WB-ESLPE) at UCLA, this study addresses the following research questions: first, to what extent do the WB-ESLPE listening and reading items…

A study investigated the use of multidimensional scaling (MDS), a statistical technique, to examine the underlying structure of an ability test at the item level. Subjects were over 8,500 Egyptian students in the Department of Public Service at the American University in Cairo. The testing instrument used was a 36-item English language test based…