The authors examined whether paper-and-pencil and Web surveys administered in the school setting yield equivalent risk behavior prevalence estimates. Data were from a methods study conducted by the Centers for Disease Control and Prevention (CDC) in spring 2008. Intact classes of 9th- or 10th-grade students were assigned randomly to complete a…

Many Medicaid programs have either fully or partially carved out mental health services. The evaluation of carve-out plans requires a case-mix model that accounts for differing health status across Medicaid managed care plans. This article develops a diagnosis-based case-mix adjustment system specific to Medicaid behavioral health care. Several…

Two competing approaches to policy analysis are distinguished: a credibility approach, and a truth approach. According to the credibility approach, the policy analyst's role is to search for plausible argument rather than truth. Each approach has pragmatic tradeoffs in fulfilling the goal of providing usable knowledge to decision makers. (TJH)

Advantages of using logistic and hazards regression techniques in assessing the overall impact of a treatment program and the differential impact on client subgroups are examined and compared using data from a juvenile court program for status offenders. Implications are drawn for management and effectiveness of intensive supervision programs.…

A broad set of ethical principles is examined to determine their relevance for evaluation. The five principles of K. S. Kitchener (autonomy, nonmaleficience, beneficence, justice, and fidelity) are relevant to evaluation and are fully represented in the evaluation standards of the Joint Committee on Standards for Educational Evaluation. (SLD)

In this article, the authors discuss program evaluation of intervention studies when the outcome of interest is collected routinely at equally spaced intervals of time. They illustrate concepts using data from the American Stop Smoking Intervention Study, where the outcome is state per capita tobacco consumption. States differ widely in mean…

An experiment with 766 homeowners compared 3 strategies for delivering radon test results to homeowners. Small improvements in consumer satisfaction were found for personalized messages (a telephone call or personal letter) over a form letter. No detectable improvement was found in recall of advice or compliance for any strategy. (SLD)

The problem of the appropriate comparison group for bereavement studies is discussed. The use of the retrospective pretest design is illustrated through a longitudinal study of bereavement outcome following pregnancy loss, involving 138 bereaved women and a comparison group of 215 currently pregnant women. (SLD)

Recommendations for feasible and rigorous evaluation design formulated by a 1991 conference on the evaluation of comprehensive community interventions are summarized and illustrated through the example of a program for drug risk reduction. Implications of a multisite design with matched pairs randomized into intervention and comparison conditions…

Three methods of estimating tobacco products experimentation were examined in 13 junior high and 6 high schools. The methods were aggregated students' self-reports of tobacco experimentation, school personnel prevalence estimates of student tobacco experimentation, and school outdoor refuse evidence. The school personnel method proved the most…

Focus group findings were compared with survey findings for three studies in which both methods were used. Studies conducted on voluntary sterilization in Guatemala, Honduras, and Zaire with over 2,000 subjects confirm that focus groups yield information similar to that obtained from surveys and are useful in program planning. (SLD)

Use of performance gaps analysis in program evaluation is examined by analyzing and critiquing the gap reduction design as an experimental design and an analytic tool in program outcome evaluation. The example of the Bilingual Education Evaluation System illustrates the contention that disadvantages of the method outweigh its contributions. (SLD)