Establishing a cut score is a crucial aspect of the test development process since the selected cut score has the potential to impact students' performance outcomes and shape instructional strategies within the classroom. Therefore, it is vital for those involved in test development to set a cut score that is both fair and justifiable. This cut…

There has been a steady increase in the use of mixed-format tests, that is, tests consisting of both multiple-choice items and constructed-response items in both classroom and large-scale assessments. This calls for appropriate equating methods for such tests. As Item Response Theory (IRT) has rapidly become mainstream as the theoretical basis for…

This simulation study compared the performance of two multilevel measurement testlet (MMMT) models: Beretvas and Walker's (2008) two-level MMMT model and Jiao, Wang, and Kamata's (2005) three-level model. Several conditions were manipulated (including testlet length, sample size, and the pattern of the testlet effects) to assess the impact on the…

"Linking" is a term given to a general class of procedures by which one represents scores X on one test or measure in terms of scores Y on another test or measure. A recent taxonomy by Holland and Dorans (2006; Holland, 2007) organizes the various types of links into three broad categories: prediction, scale aligning, and equating. In…

The article "Thinking About Linking" by Newton (2010) presents a novel philosophical perspective on the way that educational assessments should be linked. Newton starts by describing the linking framework as it was characterized in various publications and identifies a cross-cultural dimension in the definitions and uses of test…

This article is a description of the process of constructing an assessment of written and oral language for pre-service teachers. This assessment was used prior to their formal admission into the teacher education programme. The rationale for this evaluation is presented along with the actual processes involved. Finally, comparisons are made…

The proposition, "That measurement issues in competency-based educational programs (CBE) are not different from those in other kinds of testing (NCBE)" must be declared false. (1) Measurement in CBE focuses on the present while NCBE measurement focuses on information needed for future planning. (2) CBE measurement starts with definitive statements…

Reviews research literature on comparability issues in computerized adaptive testing (CAT) and synthesizes issues specific to comparability and test security. Develops a framework for evaluating comparability that contains three categories of criteria: (1) validity; (2) psychometric property/reliability; and (3) statistical assumption/test…

The author defines criterion-referenced (CRT) and norm-referenced (NRT) tests, considers current objections to each, and distinguishes their appropriate uses: CRTs for pupil diagnosis and instruction and NRTs for surveying achievement in a long-term evaluation context. Part of a theme issue on student assessment. (SJL)

Problems in constructing criterion referenced tests related to inadequate technical criteria, and guidelines for their solution are discussed. The need to select a well-defined domain of behaviors is emphasized as the key to test construction and to understanding students' test performance. Considerations must also be given to the most effective…

The original data strategy on which PISA was based suggested that, after the completion of the first three assessments in 2000, 2003 and 2006, the cycle would repeat itself with three-yearly assessments in the areas of reading, mathematics and science. However, in light of newly emerging policy priorities and the experience gained with PISA so…

The testing practices and tests described in the preceding articles are reviewed and compared. This cross-cultural examination identifies some issues that are common to the United States and Europe: (1) the emphasis on performance tasks, (2) the accommodation of language minorities, and (3) concerns about gender differences. (SLD)

Computer-based testing (CBT) is typically implemented using one of three general test delivery models: (1) multiple fixed testing (MFT); (2) computer-adaptive testing (CAT); or (3) multistage testing (MSTs). This article reviews some of the real cost drivers associated with CBT implementation--focusing on item production costs, the costs…

In fall 1986, a study was conducted at Florence-Darlington Technical College (South Carolina) to measure the reliability and validity of the TEC-MAT, a newly developed entrance test. The TEC-MAT instrument, a criterion-referenced test consisting of 100 items assessing numerical skills, was field tested among a group of entry-level freshmen already…

The Pre-Postsecondary Program (PPSP) was conducted during the 1974-75 school year at four Ohio secondary schools in order to offer a career exploration program for students in grades 11 and 12 that would be related to the high school content and provide a foundation for careers in the students' areas of interest. The report presents the evaluation…