Different random or purposive allocations of items to parcels within a single sample are thought not to alter structural parameter estimates as long as items are unidimensional and congeneric. If, additionally, numbers of items per parcel and parcels per factor are held fixed across allocations, different allocations of items to parcels within a…

This paper provides a guide to calculating statistical power for the complex multilevel designs that are used in most field studies in education research. For multilevel evaluation studies in the field of education, it is important to account for the impact of clustering on the standard errors of estimates of treatment effects. Using ideas from…

This article discusses replication sampling variance estimation techniques that are often applied in analyses using data from complex sampling designs: jackknife repeated replication, balanced repeated replication, and bootstrapping. These techniques are used with traditional analyses such as regression, but are currently not used with structural…

To support and promote secondary analyses, the International Association for the Evaluation of Educational Achievement (IEA) is making the SITES 2006 international database and accompanying User Guide available to researchers, analysts, and public users. The database comprises national contexts and school- and teacher-level data from 23 education…

A large sample technique attributed to L. Marascuilo, based on the multiple comparison technique of H. Scheffe, was programmed with the Statistical Analysis System (SAS), focusing on comparisons among independent binomial samples. Use of the SAS program is discussed. (SLD)

Reporting methods used in large-scale assessments such as the National Assessment of Educational Progress (NAEP) rely on latent regression models. To fit the latent regression model using the maximum likelihood estimation technique, multivariate integrals must be evaluated. In the computer program MGROUP used by the Educational Testing Service for…

Describes MINSIZE, an MS-DOS computer program that permits the user to determine the minimum sample size needed for the results of a given analysis to be statistically significant. Program applications for statistical significance tests are presented and illustrated. (SLD)

Central limit theorem (CLT) is considered an important topic in statistics, because it serves as the basis for subsequent learning in other crucial concepts such as hypothesis testing and power analysis. There is an increasing popularity in using dynamic computer software for illustrating CLT. Graphical displays do not necessarily clear up…

Two computer-intensive procedures are presented for dealing with non-random selection in the development of samples for experimental, quasi-experimental, and survey designs associated with educational research. The procedures are randomization tests to clarify treatment effects and bootstrap techniques to estimate the uncertainty of…

A brief, practical overview of "design effects" (DEFFs) is presented for users of the results of sample surveys. The overview is intended to help such users to determine how and when to use DEFFs and to compute them correctly. DEFFs are needed only for inferential statistics, not for descriptive statistics. When the selections for…

Although videotape is the preferred method for recording behavior, there are many natural settings in which it is impractical or too intrusive. The ability to collect data in such settings and in real time has been enhanced by the advent of light, powerful laptop computers. This poster (with paper) describes a set of eight programs (developed in…

The serious problems associated with the use of stepwise methods are well documented. Various authors have leveled scathing criticisms against the use of stepwise techniques, yet it is not uncommon to find these methods continually employed in educational and psychological research. The three main problems with stepwise techniques are: (1)…

Though common structural equation modeling (SEM) methods are predicated upon the assumption of multivariate normality, applied researchers often find themselves with data clearly violating this assumption and without sufficient sample size to use distribution-free estimation methods. Fortunately, promising alternatives are being integrated into…

An important topic presented in introductory statistics courses is the estimation of population parameters using samples. Students learn that when estimating population variances using sample data, we always get an underestimate of the population variance if we divide by n rather than n-1. One implication of this correction is that the degree of…

This paper summarizes and highlights some of the critical developments, issues, and trends which impact the work of survey research. The issue of preventing or minimizing nonresponse bias by successfully obtaining cooperation from people being surveyed continues to be of concern to survey research professionals. The most effective response rate…