In a secondary analysis of the Abrams and Siegel evaluation of the Transcendental Meditation program at Folsom prison, experimental groups fared better than control groups, although the treatment explains only a small proportion of the variance. (Author)

It is argued that reports of evaluation activities often leave much to be desired because they fail to portray the real trial-and-error processes of the research study and do not report on the logic in use at the time of the inquiry. (SLD)

Presents an overview of the concepts and methods employed by outcome researchers evaluating intervention effectiveness in child welfare, and the problems associated with these methods that make their use by agencies impractical. Discusses concepts of statistical significance, effect size, and the meaningfulness of effects. Emphasizes the need for…

This article discusses the difficulties in conducting intervention research or evaluating intervention programs in a school setting. In particular, the problems associated with randomization and obtaining control groups are examined. The use of quasi-experimental designs, specifically a paired comparison design using the individual as his or her…

Evaluating school-based mental health services for children and youth with emotional disturbance (ED) has been a challenge for researchers. One particular challenge is the study design of using the student as the statistical unit of analysis, which in certain cases may lead to a violation of the "independence of error" assumption.…

Purpose: The use of e-learning is largely predicated upon the assumption that it can facilitate improvements in student learning and therefore can be more effective than conventional techniques. This assumption has been supported by some in the literature but has been questioned by a continuing body of contrary or indifferent evidence. The purpose…

Principles of program evaluation research are outlined so that bilingual education program coordinators can conduct methodologically acceptable program evaluations. The three basic principles of evaluation research are: identification of the program participants, definition of the program intervention, and assessment of program effectiveness.…

National Institute of Education (NIE) research priorities indicate the use of panel measures only during the time children are in Follow Through programs and further seem to indicate that only implementation variables should be measured. This paper raises questions about the desirability of the narrow focus implied by the NIE priorities, the…

Given the current, apparently favorable, climate for introducing and implementing program evaluation schema, the author questions factors mitigating against success, and variables relevant to program evaluation. He cites two types of problems: technological or instrumental problems of methodology and measurement, and evaluation process into…

The review of current evaluation practice indicates a failure to provide information relevant to policy makers and service consumers due to investigation of restricted range of outcomes, inattention to ecological context of behavior, and methodological weaknesses. Promising directions in measuring quality of life and pertinent environmental…

Reports aspects of a case study of educational politics relating to early childhood education in California. Confirms the complex and political nature of evaluation and lists evaluation dilemmas played out in the policy arena. (RH)

The review examines evaluations of the efficacy of special education programs for mildly disabled children. The author suggests that serious methodological flaws make our present knowledge in this area very weak and proposes a methodology to address and overcome many of the limitations of previous research. (Author)

In the form of a play, a brief discussion is presented of program evaluation problems at the elementary/secondary education level. (PN)

Professional evaluators are often called upon to analyze data produced by a catastrophically inadequate evaluation design. A remedial strategy involving diagnosis of error, application of a corrective procedure and sensitization of program personnel of the need for a more sophisticated stance, is proposed and illustrated with a case study.…

The choice between experimental research or process-oriented oriented research as the only valid paradigm of evaluation research is rejected. It is argued that there is a middle ground. Suggestions are made for mixing the two approaches to suit particular research settings. (Author/GK)