The administrative and political ramifications of a form of multiple matrix sampling where all students in the population are tested on a subtest is discussed in the context of a statewide testing program. The conclusion is drawn that large-scale testing programs will have to adopt a testing framework which samples items from the total item domain…

In 1979-80, the Arkansas minimum competency tests were administered to a sample of 5,000 students in grades 3, 6, and 8. To determine how well test objectives matched the curriculum, their teachers estimated how many of the four items per objective a randomly selected student would answer correctly. Because chi square test comparisons of teacher…

Political and legislative pressures have posed a number of measurement issues and challenges to the development of sound, valid voluntary national tests (VNTs). This paper focuses on what appear to be the most difficult technical issues related to the VNT proposed by President Clinton in 1997. Technical issues refer to psychometric issues, as…

The National Assessment of Educational Progress (NAEP) measures the educational achievement of nationally representative samples of students in grades 4, 8, and 12. Local educational agencies tend to view the NAEP as a benchmark to which the educational achievement of their students can be compared. In particular, state departments of education…

Some of the reasons efforts are being made to reform education are discussed, and how these reforms are likely to affect U.S. schools is explored. Data collected annually by the Council of Chief State School Officers (CCSSO) indicate that almost all states have some form of assessment that is administered to all students at one or more grade…

The merits and hazards of minimum competency testing for the individual student or for student groups are discussed. Types of groups which lend themselves to group application and some important factors in determining the parameters of a group are discussed. Ten critical issues related to minimum competency testing are identified: (1) scope of…

This paper examines how various equating methods are affected by: (1) sampling error; (2) sample characteristics; and (3) characteristics of anchor test items. It reviews empirical studies that investigated the invariance of equating transformations, and it discusses empirical and simulation studies that focus on how the properties of anchor tests…

This paper contains a comparison of descriptive information based on analyses of pilot and live administrations of the Alabama High School Graduation Examination (AHSGE). The test is composed of three subject tests: Reading, Mathematics, and Language. The study was intended to validate the test development procedure by comparing difficulty levels…

The operational preparations for the Dutch national assessment program in education started in 1986. The program's aim is to periodically describe the contents of the curriculum in use and the attainment of 8-year-old and 11-year-old students on a national basis by means of surveys. In this paper some of the guiding principles in instrument…

The introduction of the trial state assessment program into the design of the 1990 National Assessment of Educational Progress (NAEP) raises questions about differences across states in sampling and administration practices. In addition, questions about the general approach to comparing state data to national data need discussion. Subject areas…

Recent investigations of the extent to which students with disabilities are allowed to participate in major national data collections used in measurement-driven education reform suggest that 40 to 50 percent of students with disabilities are typically excluded from major assessments, although they are included to a greater degree in assessments…

An achievement testing framework is being developed by the Los Angeles Unified School District to assess the educational progress of 14,000 secondary level compensatory education students with something other than standardized tests. The technique of multiple matrix sampling was applied to the use of large item domains in the subject area of…