Multisite field experiments using the (generalized) randomized block design that assign treatments to individuals within sites are common in education and the social sciences. Under this design, there are two possible estimands of interest and they differ based on whether sites or blocks have fixed or random effects. When the average treatment…

Education experiments frequently assign students to treatment or control conditions within schools. Longitudinal components added in these studies (e.g., students followed over time) allow researchers to assess treatment effects in average rates of change (e.g., linear or quadratic). We provide methods for a priori power analysis in three-level…

Experimental evaluations that involve the educational system usually involve a hierarchical structure (students are nested within classrooms that are nested within schools, etc.). Concerns about contamination, where research subjects receive certain features of an intervention intended for subjects in a different experimental group, have often led…

As evidence-based reform becomes increasingly important in educational policy, it is becoming essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. The purpose of this study was to examine how methodological features such as types of publication, sample sizes, and…

While split-plot designs have received considerable attention in the literature over the past decade, there seems to be a general lack of intuitive understanding of the error structure of these designs and the resulting statistical analysis. Typically, students learn the proper error terms for testing factors of a split-plot design via "expected…

The need for analysis of covariance is discussed in the context of present day education. . .new approaches to instruction including new methods, curricula, devices and patterns of classroom organization. A problem is then used as an example of a typical experiment and the reader is led step by step through the application, analysis and…

This research investigates stochastic approximation procedures of the Robbins-Monro type. Following a brief introduction to sequential experimentation, attention is focused on formal methods for selecting successive values of a single independent variable. Empirical results obtained through computer simulation are used to compare several formal…

Exploratory research with large numbers of variables and even larger numbers of relationships is likely to result in frequent Type II errors; that is falsely accepting an incorrect null hypotheses. There are three ways of reducing Type II errors: (1) choosing a lower significance level, which then increases the probability of Type I error; (2)…

With an emphasis on the problems of control of extraneous variables and threats to internal and external validity, the arrangement or design of experiments is discussed. The purpose of experimentation in an educational institution, and the principles governing true experimentation (randomization, replication, and control) are presented, as are…

Different effects of instructional strategies on recall and comprehension of terms frequently used in formal analysis of art were examined. The study looked at a synthesis of three theoretical positions: dual-coding theory, schema theory, and elaboration theory. Two-hundred and fifty sixth-grade students were randomly assigned to three groups:…

The technique originating from the study of ecological systems for the examination of dynamic educational systems over time is utilized. The technique is based on the theory of energy exchanges in interactions between variables. Using this technique, interactions among variables can be specified and simulated over time using an analog computer.…

The conference, dedicated to E.F. Lindquist, focused on three areas in which E.F. Lindquist pioneered: the development of tests of educational achievement, design and analysis techniques in educational research, and an application of electronic data processing to educational problems. Two of the papers are about the contributions to measurement…