Conventional wisdom suggests the omnibus F-test needs to be significant before conducting post-hoc pairwise multiple comparisons. However, there is little empirical evidence supporting this practice. Protected tests are conducted only after a significant omnibus F-test while unprotected tests are conducted without regard to the significance of the…

A special case of the homogeneity of effect size test, as applied to pairwise comparisons of standardized mean differences, was evaluated. Procedures for comparing pairs of pretest to posttest effect sizes, as well as pairs of treatment versus control group effect sizes, were examined. Monte Carlo simulation was used to generate Type I error rates…

Research was conducted to provide educational researchers with a choice of pairwise multiple comparison procedures (P-MCPs) to use with single group repeated measures designs. The following were studied through two Monte Carlo (MC) simulations: (1) The T procedure of J. W. Tukey (1953); (2) a modification of Tukey's T (G. Keppel, 1973); (3) the…

The level of standardized effect sizes obtained by chance and the use of significance tests to guard against spuriously high standardized effect sizes were studied. The concept of the "protected effect size" is also introduced. Monte Carlo methods were used to generate data for the study using random normal deviates as the basis for sample means…

One set of approaches to the problem of clustering with dichotomous data in cluster analysis (CA) was studied. The techniques developed for clustering with binary data involve calculating distances between observations based on the variables and then applying one of the standard CA algorithms to these distances. One of the groups of distances that…

Describes Monte Carlo simulation studies and their application in vocational education research. Explains study design and analysis as well as use and evaluation of results. (SK)

Investigates the commonly suggested rounding rule for addition and subtraction including its derivation from a basic assumption. Uses Monte-Carlo simulations to show that this rule predicts the minimum number of significant digits needed to preserve precision 100% of the time. (Author/KHR)

Two forms, pure-rank and mixed-rank, of a nonparametric, general, linear model-based statistic that can be used to test several hypotheses are presented. A Monte Carlo study was used to investigate the distributional properties of these forms, and their use is discussed. (SLD)

Presents an approach to multidimensional unfolding that reduces the occurrence of degenerate solutions and conducts a Monte Carlo study to demonstrate the superiority of the new method to the ALSCAL and KYST nonmetric procedures for student preference data. (SLD)

Clarifies several issues regarding the effects of autocorrelated errors on Type I error in ordinary least-squares models. Demonstrates through Monte Carlo simulation the conditions under which distortion in Type I error is less than predicted by asymptotic theory. Suggests a recently developed small-sample method for time-series analyses. (SLD)

Used Monte Carlo methods to compare several measures of item-parameter drift, manipulating numbers of examinees and items and numbers of drift items. Overall, Lord's chi square (F. Lord, 1968) measure was the most effective in identifying items that exhibited drift. Discusses the usefulness of other methods. (SLD)

Presents a hierarchical Bayes approach to modeling parameter heterogeneity in generalized linear models. The approach combines the flexibility of semiparametric latent class models that assume common parameters for each subpopulation and the parsimony of random effects models that assume normal distributions for the regression parameters.…

Assessed the relative merits of the Student "t" test and the Wilcoxon rank sum test under four population distributions and six sample-size pairings through Monte Carlo methods. The Wilcoxon rank sum test demonstrated an advantage in statistical power for nonnormal distributions (but not normal distributions), with fewer Type III errors…

Studied the effect of including nonindependent correlations in the meta-analysis method of J. Hunter and F. Schmidt on the estimated population standard deviation. Evaluation indicates that the Hunter and Schmidt method will underestimate the true population standard deviation. Developed new methods to correct for this and illustrated the methods…

Studied the use of the person response function (PRF) for identifying nonfitting item score patterns. Proposed a person-fit method reformulated in a nonparametric item response theory (IRT) context. Conducted a simulation study to compare the use of the PRF with a person-fit statistic, resulting in the conclusion that the PRF can be used as a…