Examines principles to consider when evaluating the impact of outdoor-based experiences, including developing a rationale for the evaluation, determining the emphasis of the evaluation, and applying appropriate criteria to the evaluation process. Discusses difficulties associated with control groups, sampling bias, time period of evaluation, and…

The thesis of this paper is that, in evaluating most innovative educational projects that are conducted in schools, tenets of formal experimental design and associated inferential data analysis methods should be given limited emphasis. The basis of this thesis lies in the problems and difficulties that undermine the design and implementation of…

Discusses the importance of fairness in evaluation studies of second-language programs and the potential for misinterpretation of studies which are not program-fair. Strategies designed to overcome this problem from the perspective of standardized tests include: specific tests for each program, program-specific plus program-neutral measures,…

Summarizes literature on early childhood (EC) program evaluation, presents an overview of the national standards addressing quality in EC programs, and presents the results of a survey of the evaluation practices of 18 model EC programs. Found that the programs' evaluation procedures were varied, well-developed, open-ended, and process-orientated.…

Discusses the history of evaluation research, focusing on current emphasis on "evidence-based policy." Highlights five issues emerging as relevant: evaluation can be done in many ways, serious doubts exist about the usefulness of the term "evaluation," evaluation is held back by paradigm wars, views of evaluation are…

A multistakeholder evaluation procedure is presented to address the many challenges in evaluating the performance of condominial sewer projects in Brazil. Condominial sewerage is a promising appropriate technology that is coproduced by users and public agencies, but little is known about project performance. This article shows that…

In "Holding Accountability to Account: How Scholarship and Experience in Other Fields Inform Exploration of Performance Incentives in Education"--a paper presented at the National Center on Performance Incentives research to policy conference in February--Richard Rothstein, a research associate at the Economic Policy Institute, argues educational…

The use of rigorous assessment in an Information Literacy program can be used to persuade reluctant faculty and administrators to buy into a program. A "culture of assessment" also assures quality control for internal and external audiences. Information Literacy at Wartburg College is unique in that it is a required component of five…

Challenges faced in the evaluation of programs for the disabled are discussed, focusing on values orientation, key stakeholders, program structure, and measurement issues. Workers in the field are presently witnessing a fundamental change in the philosophy that underlies programs for persons with disabilities. Evaluators must be sensitive to the…

Program impact methodology--usually referred to as evaluation research--is described as it is developing in the United States. Several problems face the field of evaluation research. First, those issues grouped as "meta-scientific" include: (1) the distinction between qualitative and quantitative studies; (2) the separation of implementation and…

Changing ideas about the role of early education increasingly point toward universal preschool education for all children. Examines issues concerning the long-term effects of preschool experiences and suggests that the value of early education will vary as a function of a matrix of factors including program quality, the vulnerability of individual…

Assessment of welfare gains from a targeted social program can be seriously biased unless the endogeneity of program participation is addressed. Bias comes from two sources of placement endogeneity: the purposive targeting of geographic areas, and the targeting of individual recipients within selected areas. Partial decentralization of program…

This document is comprised of the 1997 issues of a quarterly newsletter of the Harvard Family Research Project, designed to share new ideas and experiences in evaluating systems reform and comprehensive child and family services. The first issue focuses on evaluation methodology and includes articles on the following topics: (1) mixing evaluation…

To explore the treatment fidelity of employee safety-belt programs, 614 organizations were divided into 2 groups: those that had (n=183), and those that had not (n=431) conducted an evaluation. Multiple regression analysis of associated data indicated that evaluation-active organizations were generally more active in other program areas. (TJH)

Four studies found serious problems with components of the federal Medicaid program's survey process for evaluating intermediate care facilities for the mentally retarded--surveys did not discriminate between certified and noncertified units, direct-care staff behavior was very reactive to the survey's presence, and service providers had divergent…