This article reviews issues involved with using norm-referenced measures within an intervention validity model. Methodological examination of intervention validity has become more important as intervention methodologies have become part of federal legislation. However, current practice and federal guidelines often implicitly portray a dichotomy…

This article explores the statistical methodologies used in demonstration and effectiveness studies when the treatments are applied across multiple settings. The importance of evaluating and how to evaluate these types of studies are discussed. As an alternative to standard methodology, the authors of this article offer an empirical binomial…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

Presents conclusions drawn from symposium studies on current and future direction in family caregiving research. Suggests improving measurement of treatment effects in group intervention for family caregiver studies by: (1) better specification of goals and outcomes; (2) development of measures with less floor and ceiling effects; and (3)…

Analysis of covariance (ANCOVA) has been recommended as one vehicle with which to evaluate special education and other intervention impacts (M. J. Taylor and M. S. Innocenti, 1993). Common misinterpretations of this methodology for these purposes are explained. These misapplications of ANCOVA include: (1) ignoring the assumption of homogeneity of…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

In October 2002, the Institute of Education Sciences (IES) contracted with Mathematica Policy Research, Inc. (MRP) to help identify issues pertinent to the evaluation of Title I and to propose feasible evaluation design strategies. This design effort took its lead from two sources: (1) the Title I Independent Review Panel (IRP); and (2) a more…