A recent Common Sense Institute report addresses two important policy questions about Arizona's ESA program. First, how much will the ESA program cost in the upcoming year? Second, what are the characteristics of ESA users by household income and race/ethnicity? The report concludes that the ESA program is "essentially fully subscribed,"…

In state assessment programs in which performance has no real immediate consequence for the individual examinee, the issue of examinee motivation arises. Some examinees may respond to questions in ways that do not reflect their real knowledge of the test domain. In this study, a new approach was developed to identify students who have responded to…

This paper discusses the use of two theories of item analysis and test construction, their strengths and weaknesses, and applications to the design of the Hawaii State Test of Essential Competencies (HSTEC). Traditional analyses of the data collected from the HSTEC field test were viewed from the perspectives of item difficulty levels and item…

Large gains in scores have been observed over the first years of the Kentucky Instructional Results Information System (KIRIS) program. The extent to which these gains in scores indicate that student learning improved was evaluated. Previous studies have suggested that KIRIS score gains might be appreciably inflated, something that might result…

The U.S. Department of Education has not yet published an official guidance document for using NAEP achievement level scores to confirm state testing results. A review of the literature, however, identified four principles that inform the valid use of NAEP scores in a confirming analysis. The principles address the appropriate NAEP statistics to…

A student-centered evaluation of the California Drug, Alcohol, and Tobacco Education (DATE) program shows how a state policy directed toward students at risk influences program directions and affects at-risk and thriving students. Reasons to question the validity of the risk factor model as a prevention tool are discussed. (SLD)

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…

In 1994 the National Education Statistics Agenda Committee (NESAC) of the National Forum on Education Statistics, National Center for Education Statistics (NCES), established the Core Data Task Force to identify and define a set of "core elements" for the collection and reporting of data about enduring and emerging issues at local,…

Because districts in Nebraska are not measured on common instruments, comparisons are difficult. This study examined a district evaluation strategy that classifies districts into school performance ratings (SPR) based on a combination of three factors. Student performance and non-cognitive indicator data for three grade levels and two content…

In 1988, whether the National Assessment of Educational Progress (NAEP)--the "Nation's Report Card"--could become a report card for the states was studied. A trial assessment program was authorized to determine whether state assessments following the NAEP format could produce reliable and useful estimates of educational progress. This…

Two perspectives on assessment for teacher certification are described: the competency orientation, and the professional orientation. These perspectives are used to discuss current problems, basically validity issues, in teacher assessment: (1) a professional orientation toward assessment; (2) criterion-referenced assessments; and (3) the unit of…

To fulfill a mandate of the Tennessee State Legislature, the extent to which the Tennessee Career Ladder System (CLS) is valid for making inferences about the professional competence of teachers was investigated. Evidence of the extent to which the content of the evaluation procedures reflects sound theory, empirical findings, and best practices,…

This article examines one of the challenges to the integration of classroom and large-scale portfolio assessment, a challenge posed by the use of a student's classroom portfolio for large-scale assessment of his or her individual competencies. When work is composed with the support of peers, teachers, and parents, whose work is being judged? The…

The validity of various procedures for rank ordering school districts throughout a state on the basis of statewide test results was studied. Data were drawn from the 1987 administration of the Kentucky Essential Skills Test (KEST), which is given each spring to all children enrolled in public school grades kindergarten through 12 in 178 school…

A large urban northwest school district is engaged in the construction of a central accountability policy that depends on school-based implementation. As part of this effort, the district has implemented a standards-based exit policy. Each school has identified students as either meeting grade-level standards or not meeting these standards. This…