An effect size of about 0.70 (or 0.40-0.70) is often claimed for the efficacy of formative assessment, but is not supported by the existing research base. More than 300 studies that appeared to address the efficacy of formative assessment in grades K-12 were reviewed. Many of the studies had severely flawed research designs yielding…

Local assessment systems are being marketed as formative, benchmark, predictive, and a host of other terms. Many so-called formative assessments are not at all similar to the types of assessments and strategies studied by Black and Wiliam (1998) but instead are interim assessments. In this article, we clarify the definition and uses of interim…

Based on the results of a generalizability study of measures of teacher knowledge for teaching mathematics developed at the National Center for Research on Evaluation, Standards, and Student Testing at the University of California, Los Angeles, this article provides evidence that teachers are better at drawing reasonable inferences about student…

In most large-scale assessments of student achievement, several broad content domains are tested. Because more items are needed to cover the content domains than can be presented in the limited testing time to each individual student, multiple test forms or booklets are utilized to distribute the items to the students. The construction of an…

In many school districts, the pressure to raise test scores has created overnight celebrity status for formative assessment. Its powers to raise student achievement have been touted, however, without attending to the research on which these claims were based. Sociocultural learning theory provides theoretical grounding for understanding how…

There is no agreement at present about the importance or meaning of the term "consequential validity." It is important that the authors of revisions to the "Standards for Educational and Psychological Testing" recognize the debate and relegate discussion of consequences to a context separate from the discussion of validity.…

The utility of the federally funded National Assessment of Educational Progress (NAEP) is often unclear, and critics have claimed that NAEP is not used. This paper summarizes an exploratory study of evidence against these claims, including that data are most useful to audiences with a national perspective. (Author/CM)

Proposes a process approach to validity that addresses assessment validation in the context of high-stakes assessment. This approach includes a test evaluator or validator who considers the perspectives of five stakeholder groups at four different stages of assessment maturity in relation to six aspects of construct validity. Illustrates each…

The concept of consequential validity wrongly links the idea of the consequences of test use with the idea of validity, widely held to be rooted in the accuracy of inferences drawn from examinees' test performances. The reification of consequential validity can distract from a needed clarity about test use consequences. (SLD)

The National Assessment of Educational Progress incorporates key elements of a responsible standard-setting process: (1) choice of educational objective; (2) description of current group performance ranges and trends; and (3) the identification of educational contexts differentially related to performance. NAEP results can direct public values…

Recommendations from the Wirtz/Lapointe report, "Measuring The Quality of Education" (ED 213 769), which evaluates National Assessment of Educational Progress (NAEP), are presented. Six educators respond to the concern that NAEP's reports and material are not widely known or as useful to educators as they should be. (CM)

Discusses current high-stakes standardized testing policy in response to G. Cizek through analogy with the policies of Chairman Mao in China and the decision to build the Maginot Line in France after World War I. Lessons from these events show that high-stakes policies skew outcomes and present high risk. (SLD)

Although G. Cizek's article balances positive consequences for high-stakes testing against anti-testing criticisms, there is no evidence that high-stakes testing per se has substantial positive consequences. There is, however, optimism that aligned educational systems with testing as a component may lead to higher levels of student achievement.…

Responds to critiques of an earlier article on the unintended consequences of high-stakes testing. Reiterates the need to look for positive as well as negative consequences of high stakes testing and calls for balance between the role of large-scale assessment in identifying achievement deficits and the responsibility educational systems have to…

Discusses appropriate ways to prepare students for performance assessments and proposes a list of six guidelines for teaching to performance assessments. The focus is on elementary and secondary education. It is believed that these guidelines will help balance the domain and sample problem. (SLD)