Considers the competing demands placed on evaluators in relation to the service (characteristics of the intervention), the sample (people participating), and methodology or research design. Explores compromises that may be required between scientific ideals and real-world limitations, and assesses implications for obtaining meaningful results in…

American philanthropy, by local and national foundations, corporations, and wealthy individuals, has played many important roles in K-12 education: creating new schools, underwriting research, funding scholarships, testing hypotheses, generating new curricula, invoking ideals, setting agendas, bolstering training, and building a case for policy…

This handbook is designed to help educators understand program evaluation processes so that they will be able to carry out evaluation tasks and talk knowledgeably to evaluators about what they want to find out from a program evaluation. The book reviews the purposes and uses of evaluation to help the reader identify the scope and direction of the…

Quality has become a priority issue for all concerned with early childhood care and education services. Starting from the premise that quality is a relative and dynamic concept based on values and beliefs, this collection advocates that the process of establishing definitions of quality should involve a range of stakeholder groups. The chapters…

For the past 20 years, the University of Hawaii Community Colleges have had a formal process for the review of educational programs, requiring that each program undergo a systematic review at least once every 5 years. The result tended to be a lengthy document that chronicled the history of the previous 5 years and was far more descriptive than…

Evaluators usually assume that the data they receive are valid, or at least, that the data reflect that which is being evaluated. In a recent evaluation in a large southern school district, evaluators compared their raw interview notes with interview notes edited by the teachers interviewed or project staff. The program evaluated was Project SEED,…

Evaluation of adult literacy programs requires different criteria from those used to judge regular schooling. Indicators for evaluating adult voluntary programs with individualized curricula are recruitment; retention, including absenteeism; one-on-one tutoring with volunteers; training in a context; support services; the "quick-fix" syndrome;…

The evaluation team of the Lincoln Public Schools (Nebraska) used the multi-attribution utility technology (MAUT) approach to prioritize potential evaluation projects. The priorities were used to allocate resources to the district's most important projects, and to eliminate or scale down less important projects. The problem was caused initially…

The author responds to Pinnell et al's (1996) call for caution in using cost-benefit analysis in measuring educational reform success. It is argued that reform already is being sold to state legislators and educators in cost-benefit terms and that research has been inappropriately used in the selling process. (GR)

Described is the Graded Assessment in Science Project (GASP). Students' attitudes toward this program were assessed using essays, questionnaires, and interviews. The results, conclusions, and cautions about this program are included. (KR)

Difficulties faced in evaluations that include data in a language not native to the evaluators or that lie outside the evaluators' cultural experience are discussed. Improvements to credibility and fairness from using a cross-cultural, bilingual evaluation are described and illustrated through evaluation of a language immersion program in Hawaii.…

Suggestions, based on the experience of researchers at Oak Ridge (Tennessee) Associated Universities (ORAU), are offered on how evaluations in which true experimental designs are not possible can be designed for meaningful comparison. The ORAU conducts evaluation and assessment studies of educational programs intended to explore some aspect of the…

Elaborates on the article "Synthesis of Research on the Effectiveness of Intellectual Skills Programs: Snake-Oil Remedies or Miracle Cures?" by Sternberg and Bhana. Encourages the development of a theory that could provide a guide to the infusion of thinking instruction into any area of inquiry. (IW)

A beverage-server intervention project at two West Coast Navy bases that attempted to reduce levels of alcoholic intoxication via policy changes and server training is described. Data obtained via interviews and structured observations of 1,511 club customers indicate methodological bias and self-selection effects. Bias adjustments were performed…

Questions assumptions implicit in the fifth objective of National Education Goal 5, calling for critical thinking, communication and problem-solving abilities. Outlines strategies for a national assessment/improvement program, including setting goals, preparing faculty to foster student learning, gathering evidence on outcomes, and using…