Background/Context: Education policy over the past 40 years has focused on the importance of accountability in school improvement. Although much of the scholarly discourse around testing and assessment is technical and statistical, understanding of validity by a non-specialist audience is essential as long as test results drive our educational…

This chapter addresses assessment (testing) with an emphasis on the 100-year period since the American Education Research Association was formed. The authors start with definitions and explanations of contemporary tests. They then look backward into the 19th century to significant work by Horace Mann and Herbert Spencer, who engendered two…

This report analyzes the validity issues that arise in the context of educational accountability systems. The report addresses validity from three interlocking perspectives. The first explores the theory of action underlying accountability provisions. It considers problems emerging from the distance between aspirations for accountability in…

Attempts to understand educational quality have created an ever-increasing set of measures and approaches. Issues regarding assessment of student learning, teacher effectiveness, and school effectiveness are discussed. (MT)

Guidelines for evaluating responses to requests for proposals (RFPs) for state-level educational assessment programs are presented. The guidelines articulate key choice points, options, and considerations by state (and district) testing directors as they solicit services for large-scale assessment from commercial testing companies. Focus is on…

Paper introduces a collection of papers on educational assessment, noting controversies surrounding both old and new assessment methods, discussing the persistent set of technical issues that must be addressed by the research community in measurement, and examining work by the National Center for Research on Evaluation, Standards, and Student…

A series of studies by the Technical Review Panel (TRP) of the National Assessment of Educational Progress (NAEP) to improve the quality and utility of the NAEP is introduced, with a description of the NAEP, the creation of the TRP, the education policy issues that influenced the selection of research topics, and the relationship among the…

The goal of technology assessment is to provide a larger view of the utility and potential impact of a class of technology for a set of potential uses. In this paper, the concentration is on technology for training. Some examples are given of technology assessments conducted on behalf of the public by national agencies. This view of technology…

In the early 1970s educational evaluation's fusion of respect for rationality, power to implement rational procedure, and an altruistic objective (improved instruction) appealed to educational researchers. Dealing essentially with closed systems, it measured program success by student performance on measurement instruments. Critics exclaimed that…

The renewed attention to assessments that attempt to capture complex aspects of educational attainments of students is explored. The definition and impetus for attention of the measurement community to higher order thinking skills are examined. Through a detailed description, a model assessment development process is presented. The process relies…

Ways to improve the validity of assessment of college students are discussed. Validity problems often have occurred because the purpose of assessment was not clear. Traditionally, college students have been tested for admission and placement. However, the results of these tests have been used for other purposes, such as comparing institutions.…

This document summarizes the activities conducted under the National Institute of Education (NIE) planning grant for the new Center on Student Testing, Evaluation, and Standards and the conceptualizations that emerged from these activities. Chapter 1 presents a summary of the planning activities actually conducted under the award, including…

The implications of international assessments in setting world-class performance standards are explored. Possible uses of recent international assessments as benchmarks against which to compare the achievement of U.S. students are illustrated. Characteristics of international assessments that affect their usefulness as benchmarks are discussed.…

Over the last 20 years, writing about technology (and more recently about its use in assessment systems) has been a joyful experience, in part because the author was usually right about how fast and how unexpected technology progress would be made. In this article, the author suggests to rethink assessment systems from design perspectives and the…

The development of a new national policy on achievement testing and how researchers sought to influence its development are chronicled. This development has been marked by the emergence of assessment advocates and educational researchers as two classes of assessment experts. Their differential effects on educational reform are explored. (SLD)