This article describes an ongoing survey that illustrates how evaluators, working with program managers, have effectively used client-based data to monitor performance in the Social Security Administration. The value of client-based data outweighs the limitations and problems collecting it. Customer perceptions are a critical barometer of quality.…

Contains a summary of the measurement strategies developed and used by the Technical Analysis Group on behalf of the National Board for Professional Teaching Standards. Also describes some remaining measurement dilemmas in the context of the National Board's assessments and suggests some areas for further research. (SLD)

In the evaluation scenario presented, that of a mentoring program matching high school juniors and seventh graders, the external evaluator is asked for impact information before enough time has elapsed to provide really meaningful data. The commentators, T. A. Schwandt and D. G. Bonnet, take different approaches to what the evaluator should do.…

Discusses three ways for teachers to affect standardized measures of student achievement: teach only students demographically predisposed to higher scores; cheat; or establish a challenging, integrative, and exploratory curriculum. (JPB)

Evaluation findings of the National Institute on Alcohol Abuse and Alcoholism (NIAAA) Community Demonstration Program show few clear indications of the effectiveness of case management approaches. This article identifies phenomena that explain the lack of positive effects and suggests that evaluation problems may explain apparent negative…

Statistical identification of employees with unusual sick leave patterns can result in false-positive identifications. A computer simulation model was used to evaluate alternate methods of unusual sick leave detection for the New York State Department of Health. Results were used to refine identification parameters and modify supervisory…

The Behavior Assessment System for Children (BASC), which was designed to assess both children's and adolescents' emotional disorders, personality constructs, and behavior problems, is discussed. Discusses the BASC technical manual, and psychometric properties such as norms, reliability, and validity. Offers favorable commentary for the BASC. (KW)

A study compared the effects of different methods of analyzing trends to illustrate how failure to account for change in classification will lead to misinterpretation of data on the performance of students with disabilities. Data from five years of assessment in Texas is used to illustrate effects of classification changes. (Contains references.)…

Course evaluations are used by many institutions in promotion, tenure, and merit decisions. This article discusses the influences on those evaluations and how faculty can combat those biases to ensure accurate portrayal of their teaching effectiveness. Alternative evaluation methods are reviewed, including portfolios, peer feedback sessions, and…

A school, like a nation, is a complex system existing in discursive rather than physical geographical space (other than as a set of buildings). The meaning of "school" is therefore dependent on actors' perceptions, and these are dependent on factors apparently beyond the school. Research evidence relating to such perceptions comes not as data or…

There are pressures for researchers to demonstrate impact and relevance. This paper recounts the case of translating research into training on coaching for mass consumption in secondary schools in England as part of a Government strategy. The account describes how the materials were developed for the particular format and how they were fine tuned…

A Friedman Foundation report attempts to find empirical support for the contention that competition from private schools, through voucher programs, improves the effectiveness of public schools. In the first year of Ohio's new EdChoice voucher program, the report claims to have found substantial academic gains at public schools exposed to the…

Evaluation is important to public education and training programs if the United States is to be competitive in a global economy. Six major factors have had an impact on evaluation efforts: decreased financial resources, increased public dissatisfaction, changed management approaches, enhanced evaluation methods and procedures, redesigned…

Findings of a study that determined the ways in which practicing administrative course developers utilize instructional design activities in their design projects are presented in this paper. A survey was administered to 30 participants in a training and development group within a large organization and mailed to 43 other practicing instructional…

This digest recommends assessing all of a person's abilities, not just some. It also discusses self-report in the context of ability assessment. Current use of self assessment methodology taps more ability areas than existing ability or aptitude tests cover. Alternative testing approaches have been called for which enhance self-discovery and…