In recent years, continuing advances in technology have increased the capacity to automate the extraction of a range of linguistic features of texts and thus have provided the impetus for the substantial growth of corpus linguistics. While corpus linguistic tools and methods have been used extensively in second language learning research, they…

This commentary argues that the OET research raises inescapable contradictions in trying to separate "language" from "communication" within a weak performance test and advocates for reconceptualizing the legitimate domain of "language" more widely, reclaiming the full potential of the communicative competence…

In this article, the author begins by discussing four challenges on the concept of validity. These challenges are: (1) the appeal to logic and syllogistic reasoning; (2) the claim of reliability; (3) the local and the universal; and (4) the unitary and the divisible. In language testing validity cannot be achieved directly but only through a…

This paper presents the author's critique on Xiaoming Xi's article, "How do we go about investigating test fairness?," which lays out a broad framework for studying fairness as comparable validity across groups within the population of interest. Xi proposes to develop a fairness argument that would identify and evaluate potential fairness-based…

This paper presents the author's response to Xiaoming Xi's article titled "How do we go about investigating test fairness?" In this response, the author focuses on test fairness and Toulmin's model of argument structure, Xi's proposal, and the challenges the proposal brings. Xi proposes an approach to investigating test fairness to guide…

Just like buildings, tests are designed and built for specific purposes, people, and uses. However, both buildings and tests grow and change over time as the needs of their users change. Sometimes, they are also both used for purposes other than those intended in the original designs. This paper explores architecture as a metaphor for language…

In this speech, the author covers a lot of ground. In the first half of his speech, the author gives a brief summary of the last 40 years of the history of language testing, from his perspective. The author reviews these years more or less by decade. Additionally, he discusses the evolution of the profession of language testing during this period,…

Considers how far a code of ethics makes language testing an open profession and notes the dangers of face validity and of hypocrisy. Discusses the need for a code of practice to provide detailed guidance to language testers with regard to their professional responsibilities. (Author/VWL)

Looks at recent approaches to communicative language testing and to the testing of English for specific purposes (ESP). Contrasts two approaches to language testing research and discusses Oller's unitary competence hypothesis. Examines problems deriving from scoring procedures associated with ESP tests. (SED)

Discusses problems in task-based language assessment, including the definition and sampling of tasks, generalizations across tasks, interpretations about broad ability and language use domains, and the notion of task difficulty. (Author/VWL)

Discusses the purpose of a French-as-a-Second-Language (FSL) placement test designed for students enrolling in FSL at the postsecondary level. The test measures proficiency level in French and consists of three parts: comprehension of a short paragraph, selection of the appropriate statement in a situation, and a fill-in-the-gap part. (JL)

Questions the English for specific purposes enterprise on both practical and theoretical grounds. Rejects the idea of considering specific purposes (SPs) as registers alone, agreeing with suggestions that SPs are characterized by their communicative natures. Questions the influence SP factors have in test-taker performances relative to other…

Presents simplified methods for deriving estimates of the consistency of criterion-referenced, English-as-a-Second-Language tests, including (1) the threshold loss agreement approach using agreement or kappa coefficients, (2) the squared-error loss agreement approach using the phi(lambda) dependability approach, and (3) the domain score…

Explores the effect on pair-task performance of test-takers' familiarity with their partner. Japanese learners performed a series of tasks, once with a friend and again with a person who was not familiar to them. Results support findings in the literature that suggest learners vary their language when interacting with familiar or unfamiliar…

Discusses authenticity in language testing in relation to the language proficiency movement. Looks at both sociolinguistic and psychometric principles as they are concerned with authenticity and validity as well as the inferential distance that separates face validity from techical validities. Criticizes the belief that some test type possess…