Experimental evaluations that involve the educational system usually involve a hierarchical structure (students are nested within classrooms that are nested within schools, etc.). Concerns about contamination, where research subjects receive certain features of an intervention intended for subjects in a different experimental group, have often led…

Due to the clustered nature of field data, multi-level modeling has become commonly used to analyze data arising from educational field experiments. While recent methodological literature has focused on multi-level mediation analysis, relatively little attention has been devoted to mediation analysis when three levels (e.g., student, class,…

A number of potential threats to internal validity in true experiments are discussed. Programmatic research efforts proceeding from established correlational findings to experiments employing random assignment are described and used as referents in discussions of validity considerations. The collection of observational data is recommended for use…

A rationale is presented for the "control items" technique, the technique of using control (nonexperimental) test items to provide a baseline for estimating the effects indicated by scores on the experimental test items. For evaluating the effects of a curriculum, a test can be made of two types of items--ones that test explicit program objectives…

Problems with conducting randomized field experiments in education are explored. Focus is on problems encountered while evaluating a group of dropout prevention projects. Project planners were asked to manipulate the subject eligibility criteria until they identified as eligible three to four times as many students as they could serve. They were…