The sampling distribution is a common source of misuse and misunderstanding in the study of statistics. The sampling distribution, underlying distribution, and the Central Limit Theorem are all interconnected in defining and explaining the proper use of the sampling distribution of various statistics. The sampling distribution of a statistic is…

Contingency tables, and their associated statistical tests, are frequently used in educational and social research. Popular statistical tests used in contingency table analyses include the Pearson chi-square test and the likelihood ratio chi-square test. These two tests are chi-square distributed under large sample conditions. However, when a…

In a complex sampling scheme it is desirable to select the primary sampling units (PSUs) without replacement to prevent duplications in the sample. Since the estimation of the sampling variances is more complicated when the PSUs are selected without replacement, L. Kish (1965) recommends that the variance be calculated using the formulas…

Replication is important to viable scientific inquiry; results that will not replicate or generalize are of very limited value. Statistical significance enables the researcher to reject or not reject the null hypothesis according to the sample results obtained, but statistical significance does not indicate the probability that results will be…

This Monte Carlo study examines whether, given various numbers of variables, treatments, and sample sizes, in a one-way multivariate analysis of variance, Type I error rates of the test approximations provided by the BMDP program, the Statistical Analysis System (SAS), and the Statistical Package for the Social Sciences (SPSS) for Roy's largest…

The observed probability "p" is the social scientist's primary tool for evaluating the outcome of statistical hypothesis tests. The small-sample accuracy of nonnull asymptotic distributions of several functions of "p" was studied. Implications for use of the approximations are discussed. (SLD)

Modifications are proposed to the recently developed method of comparing one-step M-estimators of location corresponding to two independent groups that provides good control over the probability of Type I error even for unequal sample size, unequal variances, and different shaped distributions. Simulation results reveal cautions required. (SLD)

This paper describes a study, now in progress, of new methods for representing the sampling variability of Mantel-Haenszel differential item functioning (DIF) results, based on the system for categorizing the severity of DIF that is now in place at the Educational Testing Service. The methods, which involve a Bayesian elaboration of procedures…

Previous work on the effects of dimensionality on parameter estimation was extended from dichotomous models to the polytomous graded response (GR) model. A multidimensional GR model was developed to generate data in one-, two-, and three-dimensions, with two- and three-dimensional conditions varying in their interdimensional associations. Test…

Hierarchical Bayes procedures were compared for estimating item and ability parameters in item response theory. Simulated data sets from the two-parameter logistic model were analyzed using three different hierarchical Bayes procedures: (1) the joint Bayesian with known hyperparameters (JB1); (2) the joint Bayesian with information hyperpriors…