Reports on a study that uses a range of analysis techniques to present validity evidence and to explore the equivalence of two revised and expanded versions of the Vocabulary Levels Test. (Author/VWL)

The Common European Framework of Reference (CEFR) posits six levels of proficiency and defines these largely in relation to empirically derived difficulty estimates based on stakeholder perceptions of what language functions expressed by 'Can-do' statements can be successfully performed at each level. Though also containing much valuable…

This article reports on a large-scale study that aims to validate the theory of strategic competence proposed by Bachman and Palmer (1996) through the use of structural equation modeling (SEM). The present study examines the relationship of test-takers' long-term strategic knowledge (i.e., trait strategies) and actual strategy use (i.e., state…

Presents a framework that takes as its starting point an analysis of test purpose, and then shows how purpose can be systematically related to test design. Argues that the way forward for vocabulary assessment is to take account of test purposes in the design and validation of tests, as well as considering an interactionalist approach to construct…

This simulation study considered the effects on statistical measures of test dimensionality that result from systematic sampling variation in both a single- and a double-trait assessment model. Results suggest that there are distinct psychological and psychometric states of test dimensionality, and that psychometric unidimensionality may be…

Examination boards are often criticized for their failure to provide evidence of comparability across forms, and few such studies are publicly available. This study aims to investigate the extent to which three forms of the General English Proficiency Test Intermediate Speaking Test (GEPTS-I) are parallel in terms of two types of validity…

Despite increasing interest in interlanguage pragmatics research, research on assessment of this crucial area of second language competence still lags behind assessment of other aspects of learners' developing second language (L2) competence. This study describes the development and validation of a 36-item web-based test of ESL pragmalinguistics,…

An extensive adaptation exercise was undertaken by the Australian Council for Educational Research (ACER) when it was decided to modify the 1998 version of the American "SIGI Plus" (System for Interactive Guidance, plus more) for Australian conditions. Although the same language was involved, there are substantial differences in…

Discusses the elusiveness of precision in language testing in relation to three major issues of linguistic analysis: 1) universality; 2) combining power; and 3) incorporation of extra language data. The results of a recent English Language Testing Service (ELTS) Test support this relationship. Language testing should accept the centrality of…

This article reports the results of an investigation, based on a 170,000-word corpus of test performance, of the validity of College English Test-Spoken English Test (CET-SET) group discussion by examining the degree of interaction among candidates in the group discussion task with respect to a set of interactional language functions (ILFs) to be…

Analysis of the English language aptitude test scores of 824 full-time Jewish students studying at a major Israeli university evidenced both slope and intercept bias by ethnicity (Western or Oriental), and by gender, tending significantly to overpredict or underpredict students' first-year cumulative grade point averages. (31 references)…

Speech act theory-based, second language pragmatics testing (SLPT) poses problems for validation due to a lack of correspondence with empirical conversational data. Since conversation analysis (CA) provides a richer and more accurate account of language behavior, it may be preferred as a basis for SLPT development. However, applying CA methodology…

Looks at recent approaches to communicative language testing and to the testing of English for specific purposes (ESP). Contrasts two approaches to language testing research and discusses Oller's unitary competence hypothesis. Examines problems deriving from scoring procedures associated with ESP tests. (SED)

Discusses steps taken to attain cultural relevance and appropriateness in the reading literacy construct, and in the stimulus materials and items that operationalize it. Explains the influence of multilingual considerations on the development of the reading literacy assessment instrument and notes psychometric procedures used to maximize the…

Investigated the reliability, validity, and practicality of a controlled production measure of vocabulary, consisting of items from five frequency levels and using a completion-item format. Two equivalent test forms were compared. The test was found to be useful in distinguishing between different proficiency groups. (Author/MSE)