Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

After months of waiting, the grant reviews came back: "excellent," "excellent," and "fair." What?! How can this be? Why is the third review so out of line with the first two? On more than one occasion a principal investigator (PI) has been frustrated not only by a negative funding decision but more so by the accompanying reviewer evaluation forms…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

For better or for worse, the assessment of research quality is one of the primary drivers of the behaviour of the academic community with all sorts of potential for distorting that behaviour. So, if you are going to assess research quality, how do you do it? This article explores some of the problems and possibilities, with particular reference to…

Like Dorothy in the Wizard of Oz, faculty members and student affairs educators often believe that the answers they seek about assessment are secrets kept by an all-knowing, powerful person. If they can just find the Wizard of Assessment and be granted the secret assessment formula, all will be well. The student affairs educators at California…

This document is comprised of the single 2000 issue of a newsletter of the Harvard Family Research Project, designed to share new ideas and experiences in evaluating systems reform and comprehensive child and family services. The issue focuses on after-school programs and includes the following articles: (1) "Building the After School…

This article describes the use of a schematic model for developing and distributing online surveys. Two empirical studies that developed and implemented online surveys to collect data to measure satisfaction in various aspects of human resource development and adult education exemplify the use of the model to conduct online survey research. The…