In social policy evaluations, the multiple testing problem occurs due to the many hypothesis tests that are typically conducted across multiple outcomes and subgroups, which can lead to spurious impact findings. This article discusses a framework for addressing this problem that balances Types I and II errors. The framework involves specifying…

A broad set of ethical principles is examined to determine their relevance for evaluation. The five principles of K. S. Kitchener (autonomy, nonmaleficience, beneficence, justice, and fidelity) are relevant to evaluation and are fully represented in the evaluation standards of the Joint Committee on Standards for Educational Evaluation. (SLD)

This study reports results from an evaluation of the experimental Rio Hondo driving under the influence (DUI) court of Los Angeles County, California. Interviews and official record checks with 284 research participants who were randomly assigned to a DUI court or a traditional criminal court were assessed at baseline and at 24-month follow-up.…

When compared with regular schools in the same district, fundamental school students performed as well as or better than regular school students; fundamental schools rated better on learning climate, discipline, and suspensions; and there were no differences in student self-concept. (Author/BW)

Criteria for suitable research designs for use with large databases are suggested and analyzed. The advantages and disadvantages of several types of quasi-experimental designs are compared. Examples are taken from the authors' research with data from the Manitoba Health Services Commission. (Author/AL)

To explore the treatment fidelity of employee safety-belt programs, 614 organizations were divided into 2 groups: those that had (n=183), and those that had not (n=431) conducted an evaluation. Multiple regression analysis of associated data indicated that evaluation-active organizations were generally more active in other program areas. (TJH)

The relationships among grade, substance assessed, and type of measurement and statistical analysis used in the detection of external validity threats resulting from subject attrition in a modal follow-up study were examined in 6 successive 2-year panels of adolescents, including 4,819 overall stayers and 1,897 dropouts. (SLD)

Survey items representing 30 standards of the Joint Committee on Standards for Educational Evaluation were used to examine violations in program evaluations. Twenty-nine novice graduate students, 57 graduate students with moderate knowledge about evaluation, and 61 expert evaluators viewed propriety and accuracy standards as suffering the most…

The problem of the appropriate comparison group for bereavement studies is discussed. The use of the retrospective pretest design is illustrated through a longitudinal study of bereavement outcome following pregnancy loss, involving 138 bereaved women and a comparison group of 215 currently pregnant women. (SLD)

Recommendations for feasible and rigorous evaluation design formulated by a 1991 conference on the evaluation of comprehensive community interventions are summarized and illustrated through the example of a program for drug risk reduction. Implications of a multisite design with matched pairs randomized into intervention and comparison conditions…

Evidence is presented that strengthens the argument against comparison group research strategies. Results from a study of youth attitudes related to the California Conservation Corps involving 528 participants and 668 comparisons indicate that the comparison group may not adequately represent the nontreatment state. (SLD)