This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

Sampling errors limit the accuracy with which forms can be linked. Limitations on accuracy are especially important in testing programs in which a very large number of forms are employed. Standard inequalities in mathematical statistics may be used to establish lower bounds on the achievable inking accuracy. To illustrate results, a variety of…

Items on test score scales located at and below the Proficient cut score define the content area knowledge and skills required to achieve proficiency. Alternately, examinees who perform at the Proficient level on a test can be expected to be able to demonstrate that they have mastered most of the knowledge and skills represented by the items at…

In large-scale assessments, such as state-wide testing programs, national sample-based assessments, and international comparative studies, there are many steps involved in the measurement and reporting of student achievement. There are always sources of inaccuracies in each of the steps. It is of interest to identify the source and magnitude of…

Many students who are deaf or hard-of-hearing are eligible for a signing accommodation for state and other standardized tests. The signing accommodation, however, presents several challenges for testing programs that attempt to administer tests under standardized conditions. One potential solution for many of these challenges is the use of…

Two focus groups of test and measurement experts were held to explore the use of out-of-level testing for students with disabilities. The participants (n=17) included state and federal level assessment personnel, test company employees, and university professors. A content analysis of the narrative results indicated that there was no clear…

In this study, special education teachers identified students with learning disabilities who were working on math skills usually taught two grades below the grade in which the student was enrolled. Each student (n=33) took two levels of the MAT/7 math computation test, an on-grade test, and an out-of-level test intended for students two grades…

The Council of Chief State School Officers has raised some issues pertinent to the implementation of a national project to collect statistical indicators of academic achievement and to compare them across states. The United States Department of Education shares this concern, with an emphasis on sampling schools for a school level analysis which…

Issues related to the establishment of formal standards for student achievement on large-scale assessments are discussed, and two approaches to standard setting that have been used in Saskatchewan (Canada) are described. In spite of the general success of these programs, numerous issues to consider in future evaluations are raised. (SLD)

Accrediting associations assess colleges in order to find out what has been accomplished, and to find out how it might be better accomplished. Assessment of educational outcomes can be a useful way to demonstrate the success of alternative means. However, accrediting agencies do not rely exclusively on outcome measures, since they only assess what…

The value-added approach to the assessment of student outcomes examines actual or inferred changes in students' performance over time. It also attempts to separate the net effects of instruction from previous ability or simple maturation. Others may have different definitions of this concept, and this vagueness causes problems. Suggested ways to…

This article supports Edward Haertel's views on inappropriate use of student test scores in evaluating teachers. Tests scores may identify a few incompetent teachers, but may bring new ailments to schools. The article argues that even the system proposed by Haertal may become subject to abuse by mechanistic or autocratic administrative practices.…

The measurement dilemmas involved in assessing the national educational goals established by the President and governors at the 1989 education summit are discussed. The first and most important choice is what to assess and whether to align assessment to the vision of curriculum reform or to the curriculum that students are actually experiencing.…

Argues against large-scale, federally funded, census approaches to measuring higher education outcomes, outlining specific problems. Discusses the effects of tests as instruments of educational reform, the cross-discipline transfer of higher-order skills, and the technology of setting performance standards. Places measurement within the broader…

Two perspectives on assessment for teacher certification are described: the competency orientation, and the professional orientation. These perspectives are used to discuss current problems, basically validity issues, in teacher assessment: (1) a professional orientation toward assessment; (2) criterion-referenced assessments; and (3) the unit of…