This article summarizes the research base on teacher effectiveness in physical education from a historical perspective and explores the implications of the recent emphasis on student performance and teacher observation systems to evaluate teachers for physical education. The problems and the potential positive effects of using student performance…

This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

Items on test score scales located at and below the Proficient cut score define the content area knowledge and skills required to achieve proficiency. Alternately, examinees who perform at the Proficient level on a test can be expected to be able to demonstrate that they have mastered most of the knowledge and skills represented by the items at…

Student success is at the heart of both institutional effectiveness and the community college mission, yet measuring such success at community colleges is problematic. This article highlights three efforts to grapple with this problem--a multistate work group of system- and state-level policymakers to create an improved set of student success…

Findings from an outcome evaluation of the California AIDS Education and Prevention Program, the largest of its kind in the country, are presented. Specific programs suffered from design defects that made it impossible to accurately determine their effectiveness. Attitude and behavior change was not properly addressed by the programs. (TJH)

Discusses evaluation issues that developed during implementation of the nation's first statewide career ladder program in Tennessee. After three years of development major issues have centered around communication, confidentiality, paperwork, career development, multidata source systems, and the evaluation cycle. (CJH)

Kentucky's systemic reform initiative has been heralded as one of the more comprehensive and well-sustained reforms in recent history. To evaluate the course of this reform, the challenges associated with researching and evaluating a statewide systemic reform effort are detailed here. By using a description of the politics of evaluating systemic…

This research investigated the effects of two contrasting pre-k curricula, relative to practice as usual, on subsequent academic achievement. One curriculum had a strong literacy focus, the other was a less didactic "developmentally appropriate" curriculum that allowed children to have more influence on classroom activities. The purpose…

In this article, the author takes a critical look at current assessment practices in social studies education, especially those at the state level. He defines some key assessment terms, then considers the major issues of statewide assessment, focusing on the reliability and validity of the means by which government agencies across the United…

A study compared the effects of different methods of analyzing trends to illustrate how failure to account for change in classification will lead to misinterpretation of data on the performance of students with disabilities. Data from five years of assessment in Texas is used to illustrate effects of classification changes. (Contains references.)…

This report reviews work by the Department of Health and Human Services Office of Inspector General (OIG), which evaluated the State Children's Health Insurance Program (SCHIP), including whether children are being enrolled inappropriately in SCHIP rather than in Medicaid, and states' progress in reducing the number of uninsured children. This…

This publication provides a framework that is designed for use by state agencies as a guide for planning and conducting evaluation of different aspects of the State Adult Education Program. The evaluation framework is presented using a set of design tables that offer different approaches states can use to address the Adult Education Act's…

On the surface, it appears that it should be quite simple to identify the characteristics of a child who is ready for school and then to assess whether or not any given child has these characteristics. But readiness is a difficult construct and one that has been the topic of great debate. Assessment of readiness is even more challenging. Policies…

The Annual Performance Report submitted by each state to the Office of Vocational and Adult Education was used to monitor what states have developed and how and to what extent states have implemented their accountability system. The following findings of this analysis are synthesized in this report: (1) 32 states require evaluation of all programs…

Two perspectives on assessment for teacher certification are described: the competency orientation, and the professional orientation. These perspectives are used to discuss current problems, basically validity issues, in teacher assessment: (1) a professional orientation toward assessment; (2) criterion-referenced assessments; and (3) the unit of…