"Through-year assessments" are assessments that are administered in multiple parts and at different times over the course of a school year that also produce summative scores that can be used with state accountability systems (Lorié et al., 2021; Dadey & Gong, 2023). These assessments are alternatively known as instructionally…

A particular trait of the educational system under socialist reign was accountability at the input side--appropriate facilities, centrally decided curriculum, approved text-books, and uniformly trained teachers--but no control on the output. It was simply assumed that it met the agreed standards, which was, in turn, proven by the statistics…

Standards-based reform, as codified by the No Child Left Behind Act, relies on the ability of assessments to accurately reflect the learning that takes place in U.S. classrooms. However, this property of assessments--their instructional sensitivity--is rarely, if ever, investigated by test developers, states, or researchers. In this paper, the…

Standards-based education has now reached a stage where it is possible to evaluate its overall effectiveness. Several earlier papers in the special issue of "Educational Measurement: Issues and Practice" on "Test Scores and State Accountability" (Volume 24, Number 4) examined specific state policies and their effects on schools…

The "Standards for Educational and Psychological Testing" have evolved in the breadth and depth of coverage of issues in educational testing and measurement since their first publication in 1954. There were a number of substantive changes in the 1999 revision that addressed validity, fairness, accommodations, and compliance with the…

Current nationwide efforts to improve education call for new information for policymakers in testing and evaluation. Recent state and national evaluation activities, including the Department of Education's project to establish statistical indicators for education, are discussed. Guidelines are given for developing reasonable and appropriate…

Provides a general framework for examining the consequences of assessment programs, especially statewide programs that intend to improve student learning by holding schools accountable. The framework is intended for use with programs using performance-based tasks but can be used with programs using traditional item formats as well. (SLD)

This study explores the use of multiple measures to enhance the validity and reliability of inferences about school and district effectiveness. Using data from the state of Ohio, a framework for combining measures is applied to examine the individual and collective impact of multiple measures on both the federal AYP designations and state ratings.…

Addresses issues in evaluating the consequences of assessment programs that are developed to hold schools accountable to state standards. Proposes a validation study to obtain consequential evidence for state assessment and accountability programs that includes a validity argument, propositions that follow from the validity argument, a definition…

Proposed an accountably model that addresses the challenges of allowing school districts to choose the specific strategies they use to measure student performance and evaluated this model using data from multiple sources for all school districts in Florida. Findings identify three strategies that would be useful for this type of accountability…

The use of performance assessments in accountability programs is discussed. Performance assessments have the potential to measure important objectives not easily measured by multiple-choice tests. Nevertheless, they are not suitable for every purpose, and their use should not be oversold. Many psychometric issues remain to be resolved. (SLD)

Test specifications need to take a middle road so that they are not so general that instructional targeting is impossible and not so specific that only unitary assessment targets are fostered. Using illustrative sample items provides a good means of communicating the items eligible to be tested. (SLD)

Implications of using alternative assessments for accountability in a high-stakes testing environment (using tests to make impact decisions for students, schools, or teachers) are examined. The psychometric properties of standardized alternative assessments are discussed, and the consequences of their use are considered. (SLD)

How portfolio-based conclusions about student learning might be used to communicate with audiences outside the classroom is explored. Procedures and criteria for investigating validity in portfolio use are discussed. Ten portfolios from an eighth grade language arts class are used as an example. (SLD)

Precedents from litigation on state graduation assessments provide insight into the potential legal arguments challengers may raise with regard to mandated content and performance standards for all students. Clearly documented, fairly administered procedures that adhere to professional recommendations will be the hallmark of defensible standards.…