Unsupervised summative assessment has become a feature of the educational landscape in various educational jurisdictions around the world, including the state of Queensland in Australia. However, I suggest it is an invalid and unnecessary practice that can impact negatively on the affect of students, call for a reconsideration of its use, and…

This article presents the author's comments on ""Lake Woebegone," Twenty Years Later" by J. J. Cannell, MD. J. J. Cannell's article on the so-called "Lake Woebegone" effect for K-12 educational testing systems is mostly an historical account of technical issues and policy considerations that led in part to development…

This report offers advice on the issues to be considered and the steps to be taken when implementing a high school graduation test. The research was conducted, specifically, to address problems with Mississippi's high school exit test. An external panel, developed by Southeastern Regional Vision for Education (SERVE), reviewed data obtained…

As adaptive testing moves toward operational implementation in large scale testing programs, where it is important that adaptive tests be as parallel as possible to existing linear tests, a number of practical issues arise. This paper concerns three such issues. First, optimum item pool size is difficult to determine in advance of pool…

As developer and custodian of the General Aptitude Test Battery (GATB), the U.S. Department of Labor (USDOL) is responsible for ensuring that its use meets established professional standards. Considering the logistical problems of overseeing the use of the GATB at more than 2,000 separate sites, the USDOL has confronted a monumental task in the…

This paper is based on guidelines developed in 1989 for training workshops for state and local educators to demonstrate the processes by which performance assessments could be created, validated, and used in statewide assessment programs. These guidelines are based on work with the National Assessment of Educational Progress and several statewide…

The purpose of this study was to investigate the relationship between the scores students earned on multiple choice tests and the number of minutes students required to complete the tests. The 5 tests were made up of 20 randomly drawn questions from a large pool of questions about research methods. Students were allowed an unlimited amount of time…

This paper describes the development and outcomes of New York State's "Invitation to Invention," the Regents Exam Options Project. Initiated as a temporary strategy to encourage and support local changes in teaching and assessment toward the learner-centered reforms taking place in the state, the project provided high school teachers and…

Applications of item response theory to practical testing problems including equating, differential item functioning, and computerized adaptive testing, require that item parameter estimates be placed onto a common metric. In this study, two methods for developing a common metric for the graded response model under item response theory were…

Students at grades four and five were administered a writing assessment that was developed to correspond to the California Learning Assessment System (CLAS) writing tasks at grade four. Teachers were trained to score the CLAS-like tasks according to the rubric developed by the State for CLAS. In addition, 164 students at three schools in the…

An item-selection algorithm to neutralize the differential effects of time limits on scores on computerized adaptive tests is proposed. The method is based on a statistical model for the response-time distributions of the examinees on items in the pool that is updated each time a new item has been administered. Predictions from the model are used…

This study examined the development of cognitive perspective taking skills and the lack of consistency across perspective taking measures in earlier studies. Four perspective taking measures were administered to 56 children between 4 and 10 years of age under two testing conditions. The high structure condition included multiple presentation of…

Equating studies using item response theory (IRT) are reviewed. The most well-known papers, as well as a sampling of lesser-known studies, are included. Accompanying tables list the papers and classify them according to the test used, models used, test length and type, sample size and type, method of assessment, equating design, and kinds of…

Discussed are nine questions regarding standard setting issues in educational testing: (1) Should normative or content-referenced standards be used? (2) Different standard setting methods yield different results. Does this finding present a problem? (3) Assess the adequacy of the grounding of various methods of standard setting in psychological…

Discussions of "test curriculum overlap" that focus on the term "mismatch" tend to be based on several untenable premises. This paper addresses the issue of the degree to which standardized tests should reflect the specific content of a given school curriculum with regard to three points: (1) The idea of matching the content of…