Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

Student success is at the heart of both institutional effectiveness and the community college mission, yet measuring such success at community colleges is problematic. This article highlights three efforts to grapple with this problem--a multistate work group of system- and state-level policymakers to create an improved set of student success…

This study examines two community college instructional support programs to explore the effectiveness of an evaluation model--responsive evaluation theory--that may ease the tensions between a concern over programs' processes and reporting requirements for program outcomes. The study uses a comparative qualitative case study design and applies…

New testing theories, concepts, and psychometric methods (e.g., item response theory, test equating, and item bank) developed during the past several decades have many advantages over previous theories and methods. In spite of their introduction to the field, they have not been fully accepted by physical educators. Further, the manner in which…

This article chronicles the evolution of a large research extensive institution's General Education writing assessment efforts from an initial summative focus to a formative, improvement focus. The methods of assessment, which changed as the assessment purpose evolved, are described. As more data were collected, the measurement tool was…

A central commitment for professional development schools (PDSs) is to link preservice teacher preparation and in-service teacher professional development with improved learning outcomes for pupils. PDSs are expected to improve student achievement in two primary ways: (1) by enriching and intensifying the learning environment through professional…

The use of rigorous assessment in an Information Literacy program can be used to persuade reluctant faculty and administrators to buy into a program. A "culture of assessment" also assures quality control for internal and external audiences. Information Literacy at Wartburg College is unique in that it is a required component of five…

The experience of the research and evaluation department in the Dallas (Texas) Independent School District in pioneering the use of a policy-oriented report to communicate evaluation findings is described. The report--the chart essay--replaced a methods-oriented report. In restructuring the methods-oriented report into a policy-oriented report,…

Describes as example a parents' center in London to examine impact of evaluation exercises on people and services being evaluated. Questions whether evaluators are measuring the right things, whether evidence is valid, and what effects an evaluation may have on services. Identifies features of research and evaluation that are most likely to…

Working out assessment philosophy and practices takes time, as the team members working on the "Competent Children" research project in New Zealand have found out during the first 18 months of the project. It is imperative that those with expertise in early childhood care and education insist on developmentally appropriate assessment…

This document is comprised of the single 2000 issue of a newsletter of the Harvard Family Research Project, designed to share new ideas and experiences in evaluating systems reform and comprehensive child and family services. The issue focuses on after-school programs and includes the following articles: (1) "Building the After School…

Noting the paucity of information on the effectiveness of the growing numbers of programs promoting responsible fatherhood, this report examines the evaluability of responsible fatherhood programs. The report provides policymakers with an evaluation design for use with a variety of responsible fatherhood programs, and gives direction to…

This article describes the use of a schematic model for developing and distributing online surveys. Two empirical studies that developed and implemented online surveys to collect data to measure satisfaction in various aspects of human resource development and adult education exemplify the use of the model to conduct online survey research. The…