The high-stakes College English Test (CET), developed, administered, and reformed over the last 20 years, has received great attention in the aspect of washback on teaching and learning from previous research. Very few studies explored its consequences in the workplace domain--being used as a screening lever. This research aimed to 1) compare…

One consequence of test use in the English-language teaching community is the negative washback of tests on teaching and learning. Test preparation courses are often seen as part of the more general issue of washback. IELTS and TOEFL iBT tests, focusing on communicative competence, are anticipated to have positive washback effect on how English is…

Paul Newton (2010), with his characteristic concern about theory, has set out two different ways of thinking about the basis upon which equivalences of one sort or another are established between test score scales. His reason for doing this is a desire to establish "the defensibility of linkages lower on the continuum than concordance."…

This article presents the author's rejoinder to thinking about linking from issue 8(1). Particularly within the more embracing linking frameworks, e.g., Holland & Dorans (2006) and Holland (2007), there appears to be a major disjunction between (1) classification discourse: the supposed basis for classification, that is, the underlying theory…

"Linking" is a term given to a general class of procedures by which one represents scores X on one test or measure in terms of scores Y on another test or measure. A recent taxonomy by Holland and Dorans (2006; Holland, 2007) organizes the various types of links into three broad categories: prediction, scale aligning, and equating. In…

Newton's article (2010) makes three main contributions to the literature. First, it is transatlantic, bringing together literatures that have been dealing with similar problems, using sometimes different methods and certainly with distinctive educational, cultural perspectives. He points out that neither of these literatures has all of the…

The article "Thinking About Linking" by Newton (2010) presents a novel philosophical perspective on the way that educational assessments should be linked. Newton starts by describing the linking framework as it was characterized in various publications and identifies a cross-cultural dimension in the definitions and uses of test…

Problems with performance assessment (PA) and multiple-choice tests (MCTs) are outlined, with reference to the literature on accountability. PA for individual teachers who should integrate their assessments with their instruction; PA as a supplement to more traditional examinations for licensure decisions; and some limited, experimental tryouts of…

Discusses three common misconceptions about achievement testing: (1) the idea that men generally outscore women; (2) the notion that the primary role of norms is to compare one student to another; and (3) the misconception that it is not possible to measure the achievement of kindergarten and primary grade students with group tests. (SLD)

Research on true-false (TF), multiple-choice, and alternate-choice (AC) tests is reviewed, discussing strengths, weaknesses, and the usefulness in classroom and large-scale testing of each. Recommendations are made for improving use of AC items to overcome some of the problems associated with TF items. (SLD)

Volume 1 of this sourcebook is a compendium of information about tests used to assess critical thinking, problem solving, and writing. It serves as a tool for people who want comparative data about the policy relevance of specific student outcomes measured in these areas. An interactive version of Volume 1 allows users to specify their areas of…

Several methods of assessing test item bias are described, and the concept of fair use of tests is examined. A test item is biased if individuals of equal ability have different probabilities of attaining the item correct. The following seven general procedures used to examine test items for bias are summarized and discussed: (1) analysis of…

Authentic measurement has become an important topic recently in educational testing. Advocates of authentic measurement feel that objective tests, multiple-choice tests in particular, cannot meet the demands required of today's tests and should be replaced by tests that can be closely matched to instruction and can assess higher-order cognitive…

Focuses on Subject-Pair Analysis, a technique for comparing examinations in different subjects, to demonstrate that reliance on statistical comparisons of standards between subjects is misplaced. Explicates the fundamental assumptions underlying the Subject-Pair Analysis. Argues that this and related analyses are inappropriate for dealing with the…

Discusses the tension between testing and literacy education, the deleterious influences of testing on the curriculum, and the lack of a firm relationship between improved test scores and improved educational experiences for students. Presents two alternative systems for evaluation of writing skills at the local and state level. Demonstrates the…