Focusing on the reflective exchanges of four test writers at an intensive language school within a public university, this study explored the effectiveness of a "lesson study" model on their professional development as test writers. Lesson study is a powerful tool for teachers' professional development and a modified version of it--a…

New Meridian Corporation has developed the "Quality Testing Standards and Criteria for Comparability Claims" (QTS) to provide guidance to states that are interested in including New Meridian content and would like to either keep reporting scores on the New Meridian Scale or use the New Meridian performance levels; that is, the state…

Test-takers' voices in relation to high-stakes language tests have received growing attention in recent years. While the perspectives of this stakeholder group can be utilised to improve test quality, test-taking experience, and test impact, we argue that this goal needs to be achieved by considering a fundamental shift in our conceptualisation of…

Test-takers' interpretations of validity as related to test constructs and test use have been widely debated in large-scale language assessment. This study contributes further evidence to this debate by examining 59 test-takers' perspectives in writing large-scale English language tests. Participants wrote about their test-taking experiences in…

Although the United States has had a language requirement for citizenship (through the naturalization process) since the first decade of the 20th century, very little research and discussion has taken place in academic circles about this requirement, which has been enforced for the past two decades through a test and testing practice to which…

This article describes and analyses the development of a new test of aviation English by the Finnish Civil Aviation Authority (FCAA), as well as the overall situation in Finland as regards the testing of aviation English. The article describes the FCAA development project and evaluates the strengths and weaknesses of the new test and the whole…

This article reviews research on differential item functioning (DIF) in language testing conducted primarily between 1990 and 2005 with an eye toward providing methodological guidelines for developing, conducting, and disseminating research in this area. The article contains a synthesis of 27 studies with respect to five essential sets of…

A study investigated whether examinees taking the Test of English as a Foreign Language (TOEFL) attended to the text passages in the "minitalks" when answering the multiple-choice items (n=337) testing listening comprehension. Results support the construct validity of the minitalks, and also allow comparison between reading and listening…

Discusses research into the effect of background knowledge on English for Academic Purposes (EAP) tests and discusses EAP tests in which the content of at least some of the test components is related to students' fields of academic study. Suggests that for international EAP tests, English for specific academic purposes testing be abandoned.…

It is argued that tests of English as a Second Language based on specific instructional materials, reflecting both real-world and classroom language activities, can satisfy measurement needs and provide interesting psycholinguistic insights. It is also proposed that the potential for mismatch between test and materials can be overcome by several…

A discussion of second language program evaluation focuses on the interpretability of test scores as a criterion in program evaluation. It looks at both test design and research design issues. First, eight method-comparison, program evaluation studies that compare acquisition-based and analysis/practice based methods are described. Acquisition…