This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

This paper is based on guidelines developed in 1989 for training workshops for state and local educators to demonstrate the processes by which performance assessments could be created, validated, and used in statewide assessment programs. These guidelines are based on work with the National Assessment of Educational Progress and several statewide…

This paper discusses students with disabilities who do not fit into large-scale traditional assessment systems, seeks to clarify what is meant by "gray areas of assessment," delineates the primary issues that surround and contribute to gray areas, and provides suggestions for developing fully inclusive systems. It provides brief case studies of…

Central New York's 1968 migrant summer school programs were sampled and evaluated on the basis of meeting Crewson's objectives as stated in 1967: (1) improvement of self-concept; (2) development of language ability and vocabulary; (3) development of social and academic skills; (4) expansion of cultural experiences; and (5) establishment of sound…

This paper examines the content of The California Critical Thinking Skills Test (1990). This report is not a statistical review. Instead it brings under scrutiny the content of the exam. This content will be of interest to the general reader, because the issues range from logic to ethics to pedagogy, and to questions of evidential and…

At the request of the Oklahoma Department of Education, the Technical Assistance Center 3 West conducted a statewide review of local Chapter 1 evaluation data to provide possible explanations for the unusual standardized test score gains or losses reported by a number of local school districts. During the two months of quality control visits, 35…

The speeches presented at the second national conference on testing deal with models for program evaluation, reporting of test results, minimum competency programs, and the role of state and federal government in educational testing. Various approaches to program evaluation, and its relationship to testing are described by Michael Scriven, Lee J.…

The National Education Association's Task Force on Testing has stated its opinion that standardized tests are overused. The task force suggests that the application of sampling techniques and a variety of alternatives to current testing practices would accomplish the same purposes. Representatives of the testing industry have indicated that the…

Results of a 1987 report indicating that elementary students of all states were above the national average are assessed. Issues addressed include teaching for standardized tests, the effect of teaching on national norms, and alternatives available to protect the integrity of instruction and the validity of normed test scores. (TJH)

In 1987, a survey report by J. Cannell was published criticizing state reports based on national standardized testing of elementary school students that indicated that all 50 states were above the national average. This phenomenon--known as the "Lake Wobegon Effect"--is analyzed. Technical problems with the study are considered. (TJH)

The University of California's (Los Angeles) Center for Research on Evaluation, Standards, and Student Testing survey of state assessment directors reveals that about 25 states currently study or develop performance assessments. Obstacles to statewide use of performance assessments were expressed. The new Student Assessment Exchange should…

New York State United Teachers (NYSUT) established a Task Force on Student Assessment in the spring of 1990, which was designed to: review available information on testing principles and practices; make recommendations for reform of testing; and communicate its findings to NYSUT members. Ten recommendations were made, centering on the necessity…

This report summarizes the present and past status of students with disabilities in educational assessment and accountability systems, and highlights the critical emerging issues to be addressed. Issues include participation in accountability systems, graduation requirements, data management, accommodations, alternate assessments, reporting, and…

This manual provides information concerning the appropriate use of alternative testing techniques when pupils with handicapping conditions participate in statewide testing programs. It is written for parents and professionals involved in the education of pupils with handicapping conditions, and is to be used as a resource by members of Committees…

Oregon has recognized the problems involved in the evaluation of Elementary Secondary Education Act Title I programs, and has worked toward solutions, while recognizing the differing needs of local, state, and federal departments of education. In order to provide help to the local school districts with respect to evaluation, a statewide committee…