This paper introduces an empirical strategy to estimate dynamic treatment effects in randomized trials that provide treatment in multiple stages and in which various noncompliance problems arise such as attrition and selective transitions between treatment and control groups. Our approach is applied to the highly influential four year randomized…

Rapidly declining response rates and the associated threat of nonresponse bias call into question the validity of data obtained through telephone surveys, a tool often used in evaluation. This article explores changes in nonresponse bias over time by examining three data points (1991, 1996, and 2002) from an annual household telephone survey…

The What Works Clearinghouse (WWC) provides online reports to the public about the scientific evidence for educational interventions. The quality of these reports is important because they effectively tell the non-scientific community which programmes do and do not work. The aim of this brief review is to assess WWC's report on a clinically…

Considers the use of instrumental variables to estimate effects of treatments on treated and randomly selected groups. Concludes that instrumental variable methods are extremely sensitive to assumptions about how people process information. (SK)

The present review examines research on the effects of technology use on reading achievement in K-12 classrooms. Unlike previous reviews, this review applies consistent inclusion standards to focus on studies that met high methodological standards. In addition, methodological and substantive features of the studies are investigated to examine the…

A rationale is presented for the systematic evaluation of gifted/talented education programs, citing the consequences of failure to carry out such evaluation. Historically, evaluation of gifted programs was not emphasized, as the evaluation process involved experimental designs, control groups, and parametric statistics which could only be…

Replies to comments by David Rush concerning the effectiveness of a WIC program in improving pregnancy outcomes among Massachusetts women. (GC)

Describes problems in implementing placebo controls in psychotherapy including the difficulty of ensuring that therapists and their patients will view both the experimental and placebo treatments as comparably credible. Considers six research issues stemming from the definitional requirement that the placebo control for the critical and specific…

The third-year evaluation of the federally funded Washington, D.C. voucher program shows that low-income students offered vouchers in the first two years of the program had modestly higher reading scores after three years but showed no significant difference in mathematics. Students were randomly assigned to treatment and control groups, and the…

A report from the School Choice Demonstration Project examines issues concerning the funding formula used for the Milwaukee Parental Choice Program (MPCP). It finds that the program generates a net saving to taxpayers in Wisconsin but imposes a significant fiscal burden on taxpayers in Milwaukee. However, these findings depend significantly on how…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

SOME SUGGESTIONS FOR THE REVIEW AND EVALUATION OF GUIDANCE PROGRAMS UNDER TITLE V-A OF THE NATIONAL DEFENSE EDUCATION ACT ARE PRESENTED. ALTHOUGH GENERAL GOALS ARE AGREED ON, THERE ARE VARIATIONS IN SPECIFIC PROCEDURES, TECHNIQUES, AND PROFESSIONAL STANDARDS. THEIR VALUE IS AT PRESENT HYPOTHETICAL. DEMANDED IS A CRITICAL EXAMINATION OF THE…

The study of the Functional Literacy Program in India encountered problems of opposition to evaluation, inappropriate respondents, and difficulties in contacting participants, which point to changes that should be made in the evaluation methods. (SK)